Automate

What is Data Automation?

The Datawave Platform automates code generation by employing a Pattern Based approach. This Pattern driven development allows the bulk generation of very large high quality code sets in a fraction of the time with fewer resources.

Automation transforms development time-scales. Repetitive, low-complexity mappings can be generated tens or hundreds at a time freeing up internal resource to focus on more complex development challenges. It allows faster access to a wider set of data sources by replacing the development effort needed from source system owners to build data extracts with automated extraction – all that is needed is access details and permissions.

The Platform can perform single pass, automation-driven, comprehensive data analysis on secure, full-size copies of production source systems and record it in a standardised data analysis format. Test cycles are minimised by automated testing, and automated regression testing is used throughout the delivery to improve the accuracy of the delivered application and to reduce test effort by up to 25%.

Simplified framework to enable Automation

The Datawave Platform employs a standardised, modular, automated and repeatable framework that enables a truly agile approach through our best in class Control Framework.

When coupled with the Code generation this acts as the mechanism for moving the data through the process. It separates the source code logic from the target code logic, meaning that you can start iterating quickly.

Typically changes made later on (e.g. DevOps) can be very expensive to change. This approach massively reduces the cost and speed of maintaining data, enabling agile and continuous integration.

Focused engagement to help customer understand their data landscape and begin Datawave encapsulation.

Loads into standard staging area. Continues lineage and provides a single launch point for source data consumption.

Source systems are simplified into pseudo logical structures by altering grain of data. No transformation
of attributes.

Leveraging HCL’s heritage and skills in Platform work, we deploy the Datawave cloud and begin the movement offsite.

Transformed data is sent to target system as per requirement. Final lineage applied to ensure full lineage captured.

Automation out of the box

Currently the Datawave Platform can automate the following items, but more are being added all the time. These patterns are optimised for Informatica, Teradata, Hadoop and IBM Datastage.

  • Staging Load From Files
  • Job Control Mechanism
  • Hadoop Ingress
  • On-Host Data Migration
  • Standardisation and Transformation
  • Test Script Creation
  • Mainframe Unloads
  • Teradata Warehouse Load
  • Development and Test Deployments

Orchestrate. Automate. Transform.

 

Reception

Focused engagement to help customer understand their data landscape and begin Datawave encapsulation.

Ingress

Loads into standard staging area. Continues lineage and provides a single launch point for source data consumption.

Consolodate

Source systems are simplified into pseudo logical structures by altering grain of data. No transformation of attributes.

Transform

Leveraging HCL’s heritage and skills in Platform work, we deploy the Datawave cloud and begin the movement offsite.

Publish

Transformed data is sent to target system as per requirement. Final lineage applied to ensure full lineage captured.

What is Data Automation?

The Datawave Platform automates code generation by employing a Pattern Based approach. This Pattern driven development allows the bulk generation of very large high quality code sets in a fraction of the time with fewer resources.

Automation transforms development time-scales. Repetitive, low-complexity mappings can be generated tens or hundreds at a time freeing up internal resource to focus on more complex development challenges. It allows faster access to a wider set of data sources by replacing the development effort needed from source system owners to build data extracts with automated extraction – all that is needed is access details and permissions.

The Platform can perform single pass, automation-driven, comprehensive data analysis on secure, full-size copies of production source systems and record it in a standardised data analysis format. Test cycles are minimised by automated testing, and automated regression testing is used throughout the delivery to improve the accuracy of the delivered application and to reduce test effort by up to 25%.

Simplified framework to enable Automation

The Datawave Platform employs a standardised, modular, automated and repeatable framework that enables a truly agile approach through our best in class Control Framework.

When coupled with the Code generation this acts as the mechanism for moving the data through the process. It separates the source code logic from the target code logic, meaning that you can start iterating quickly.

Typically changes made later on (e.g. DevOps) can be very expensive to change. This approach massively reduces the cost and speed of maintaining data, enabling agile and continuous integration.

Control Framework

Reception

Focused engagement to help customer understand their data landscape and begin Datawave encapsulation.

Ingress

Loads into standard staging area. Continues lineage and provides a single launch point for source data consumption.

Consolodate

Source systems are simplified into pseudo logical structures by altering grain of data. No transformation of attributes.

Transform

Leveraging HCL’s heritage and skills in Platform work, we deploy the Datawave cloud and begin the movement offsite.

Publish

Transformed data is sent to target system as per requirement. Final lineage applied to ensure full lineage captured.

Automation out of the box

Currently the Datawave Platform can automate the following items, but more are being added all the time. These patterns are optimised for Informatica, Teradata, Hadoop and IBM Datastage.

  • Staging Load From Files
  • Job Control Mechanism
  • Hadoop Ingress
  • On-Host Data Migration
  • Standardisation and Transformation
  • Test Script Creation
  • Mainframe Unloads
  • Teradata Warehouse Load
  • Development and Test Deployments