Transformation

Data Provisioning Commoditisation

Simpler and wider transformation and data transfer asks are becoming the norm within many enterprises, meaning more demand on Technical teams. The Datawave Platform allows enterprises to transform their data rapidly by re-factoring and deploying it in an agile manner, freeing up internal resource to focus on more complex development challenges.

The Datawave Platform defines a data integration requirement as a pattern. The platform then provides an engine that applies this pattern to any source structural metadata to build mappings, sessions and workflows. This allows business users to agree on standardised terms and change them as required without impacting the code.

Data that cannot be standardised, i.e. exceptions are captured into the framework. All this is done concurrently with automated Unit testing.

The Platform currently supports a number of Out of the Box patterns already including Data Lakes, Warehousing, Transformation, Informatica, Teradata and Hadoop.

Automation Features

Source to Target Mappings

Replaces traditional spreadsheet based approach to source to target mapping definitions for transformation rules. By leveraging the Accelerated Data Architecture and Data Standardisation components analysts or developers can capture transformation logic via a web based interface which generates complex transformation code.

Ability to build new patterns using the SDK

New patterns can be built and consumed via the standard UI by partners and customers who are faced with specific requirements not met by the out of the box patterns.

Web based UI for generating code

Fully hosted solution or on-site. Provides partners with the ability to enable their developers with bulk code generation capability easily and without client installations.

Code refactoring

Re-factoring of the code base when data structures change in source systems is automated removing a major maintenance headache from the process.

Metalake

Captures all source and target structural metadata which can be leveraged with any of the code generation patterns. In addition, analysis and data dictionary notes can be captured and leveraged by the wider team.

Analytics

The Datawave Platform makes it very simple to deliver Big Data for Advanced Analytics.

Versioning

Full version control of logic within the software allows users to easily track changes.

Regulatory reporting

FATCA, EDGS, OTP, CCR

Supported Technologies

The Datawave Platform works with the leading ETL and Big Data vendors to give you all the benefits regardless of your choice. Using Datawave means you can move away from custom platform builds, removing the massive lock in risk.

Sources

  • Any Source Type
  • Any Target Type Staging
  • Big Data Analytics
  • Big Data Streaming
  • Business Intelligence
  • Data Consolidation
  • Data Transformation
  • Data Standardisation
  • Data Sub-setting
  • Data Obfuscation
  • Data Wrangling
  • DB2 Unload / JCL
  • ETL Platforms
  • Hand Coding
  • Mainframe
  • Near Real Time
  • Real Time
  • RDBMS
  • SCD Loading
  • Teradata Specific
  • Warehouse Loads

Outputs

  • Automated Batch Testing
  • Automated Build
  • Automated Regressing Testing
  • Automated Testing
  • Code
  • Component Recipes
  • Datatorrent
  • Deployment Package
  • Delivery Report
  • Existing Applications
  • Functional Specification
  • Generic Java
  • Informatica Workflows
  • IBM Datastage Jobs
  • Java Packages
  • Kafka Streams
  • SAP DS
  • Spark
  • Talend
  • Test Plans
  • Kafka Streams

Applications

• Analytics

• AI/ML

• BI Platforms

• CRM’s

• Data Hub

• Data Warehouses

• Data Lakes

• Data Transformation

• Hadoop

• Informatica

• IBM Datastage

• Machine Learning

• Self-service

• Teradata

Delivery

  • AWS
  • Google Cloud Platform
  • Microsoft Azure
  • On-premise

Orchestrate. Automate. Transform.

 

Data Provisioning Commoditisation

Simpler and wider transformation and data transfer asks are becoming the norm within many enterprises, meaning more demand on Technical teams. The Datawave Platform allows enterprises to transform their data rapidly by re-factoring and deploying it in an agile manner, freeing up internal resource to focus on more complex development challenges.

The Datawave Platform defines a data integration requirement as a pattern. The platform then provides an engine that applies this pattern to any source structural metadata to build mappings, sessions and workflows. This allows business users to agree on standardised terms and change them as required without impacting the code.

Data that cannot be standardised, i.e. exceptions are captured into the framework. All this is done concurrently with automated Unit testing.

The Platform currently supports a number of Out of the Box patterns already including Data Lakes, Warehousing, Transformation, Informatica, Teradata and Hadoop.

Automation Features

Source to Target Mappings

Replaces traditional spreadsheet based approach to source to target mapping definitions for transformation rules. By leveraging the Accelerated Data Architecture and Data Standardisation components analysts or developers can capture transformation logic via a web based interface which generates complex transformation code.

Ability to build new patterns using the SDK

New patterns can be built and consumed via the standard UI by partners and customers who are faced with specific requirements not met by the out of the box patterns.

Web based UI for generating code

Fully hosted solution or on-site. Provides partners with the ability to enable their developers with bulk code generation capability easily and without client installations.

Code refactoring

Re-factoring of the code base when data structures change in source systems is automated removing a major maintenance headache from the process.

Metalake

Captures all source and target structural metadata which can be leveraged with any of the code generation patterns. In addition, analysis and data dictionary notes can be captured and leveraged by the wider team.

Analytics

The Datawave Platform makes it very simple to deliver Big Data for Advanced Analytics.

Versioning

Full version control of logic within the software allows users to easily track changes.

Regulatory reporting

FATCA, EDGS, OTP, CCR

Supported Technologies

The Datawave Platform works with the leading ETL and Big Data vendors to give you all the benefits regardless of your choice. Using Datawave means you can move away from custom platform builds, removing the massive lock in risk.

Sources

  • Any Source Type
  • Any Target Type Staging
  • Big Data Analytics
  • Big Data Streaming
  • Business Intelligence
  • Data Consolidation
  • Data Transformation
  • Data Standardisation
  • Data Sub-setting
  • Data Obfuscation
  • Data Wrangling
  • DB2 Unload / JCL
  • ETL Platforms
  • Hand Coding
  • Mainframe
  • Near Real Time
  • Real Time
  • RDBMS
  • SCD Loading
  • Teradata Specific
  • Warehouse Loads

Outputs

  • Automated Batch Testing
  • Automated Build
  • Automated Regressing Testing
  • Automated Testing
  • Code
  • Component Recipes
  • Datatorrent
  • Deployment Package
  • Delivery Report
  • Existing Applications
  • Functional Specification
  • Generic Java
  • Informatica Workflows
  • IBM Datastage Jobs
  • Java Packages
  • Kafka Streams
  • SAP DS
  • Spark
  • Talend
  • Test Plans
  • Kafka Streams

Applications

• Analytics

• AI/ML

• BI Platforms

• CRM’s

• Data Hub

• Data Warehouses

• Data Lakes

• Data Transformation

• Hadoop

• Informatica

• IBM Datastage

• Machine Learning

• Self-service

• Teradata

Delivery

  • AWS
  • Google Cloud Platform
  • Microsoft Azure
  • On-premise

Transformation