Overview Overview EVL Anonymization EVL Anonymization EVL Validation EVL Validation EVL Data Generation EVL Data Generation QVD Utils QVD Utils EVL Manager
Omlouváme se, tato stránka ještě není dostupná v českém jazyce.

A Modular Approach to Data Workflows

EVL Microservices are a family of modular components designed to create flexible data workflows. Build cost-effective solutions that are fast, automated, and metadata driven.

Use Standalone or Integrate with Existing Solutions

Each EVL Microservice is designed to solve a particular data integration problem. Use them individually to augment existing workflows or together to build complete standalone solutions. Built with interoperability in mind, EVL Microservices work with any system or scheduler that can execute a shell command.

High Performance

Written in C++ from the ground up for blazing fast performance. Process jobs in parallel or serial. Move processing from expensive systems like Qlik or database servers to commodity Linux hardware

Flexible and Agile

Get the best of both worlds: use code for things like dynamic job generation, and solving problems that require unusual or complex logic. Use our GUI tool to manage operations, troubleshoot, inspect data flows, and develop with ease.

Use Cases

Test Data

From the same configuration file generate dummy data, or anonymize production data– for example: GDPR compliance, or business data protection– before providing it to dev teams and contractors.

QVD to Hadoop Workflows

High performance conversion of Qlik QVD files to Avro, then provide data to Hadoop Impala or Hive tables.

Extract Load Transform (ELT) Workflows

Get data from various sources–like Oracle, Teradata, Kafka or CSV files–and provide a historized base stage in Parquet files for further processing by Spark, Impala or Hive. All metadata driven, based on configuration files; orchestrated and managed with a GUI interface.

Cleanse Roaming TAP files

High performance decoding and cleansing of ASN.1 coded files; separate invalid records/files and provide JSON output for subsequent processing.

"With EVL Tool we finished our data migration project ahead of schedule, with savings in both our project and operational budgets."
Eva Mikulecka
OSS/BSS Integration Services Project Manager

EVL - A Fully Featured ETL Tool

Microservices are built on top of the core EVL software, and retain it's robustness, productivity, and ability to read and write a wide variety of file formats and databases. EVL is designed with the Unix philosophies of interoperability and "do one thing, and do it well" in mind. Templates, a high level of abstraction, and the ability to dynamically create jobs, make for a powerful ETL tool.


Natively read/write:
  • File formats: CSV, JSON, XML, XLS, XLSX, Parquet,
    Avro, QVD/QVX, ASN.1
  • >DBMS: Teradata, Oracle, PostgreSQL, SQLite, ODBC, (near future: Maria/MySQL, Snowflake, Redshift)
  • read/write HDFS and S3; resolve, build and run Spark jobs; and query Impala/Hive

EVL Manager

Manage and run EVL microservices, jobs, and workflows. Graph data workflows with EVL Manager's visual inspection tools. Monitor operations and resource consumption. Available for Windows, Mac, and Linux.

More Info →

EVL Anonymization

Intuitive, business-oriented data anonymization. Designed for the protection of commercially sensitive data, and the anonymization of personally identifiable information for legal compliance. High performance, and easy to implement.

More Info →

EVL Validation

Useful in situations where complex automated testing tools may be too heavy and expensive. Good candidates for the validation tool are ETL or migration projects or quick quality checks of production data.

More Info →

EVL Data Generation

Having a proper test environment is a must in many areas like application development, implementing ETL processes, and stress testing where existing production data can’t be used. The syntheitc data complies with real-life data patterns, and data volumes should be close to the expected peaks.

More Info →

EVL QVD Utils

Enables reading/writing QVD files without using Qlik Sense or QlikView. Also provides metadata from QVD/QVX header. Useful when you need to convert various sources immediately to/from a QVD file and you don’t want to overload your Qlik server by processing many, or large, QVD files.

More Info →

EVL Staging

Get data from various sources, like Oracle, Teradata, Kafka, CSV or JSON files, and create a historized base stage.

  • SCD2 historization
  • Full, delta or incremental loads
  • Store lineage information
  • Statistical checks

EVL Hadoop Utils

Read/write Parquet and Avro file formats, query Impala, Hive, etc. Especially useful together with other EVL Microservice(s), when you need to cooperate with Hadoop.

  • Read/write Parquet files (with EVL Staging, partitioning is available)
  • Read/write Avro files
  • Load, unload Impala tables
  • Load, unload Hive tables
  • Our tip: Manage regular delivery with EVL Orchestration

EVL ASN.1 Decoder

To decode files from ASN.1 format into JSON with the highest performance.

  • Decode roaming TAP/RAP files (descriptions of 3.x versions predefined)
  • Decode any ASN.1 coded files into JSON
  • Our tip: Output into Avro files using EVL Hadoop Utils

EVL Orchestration

Schedule and monitor sequences of jobs and workflows, await file delivery, and provide information about processing via e-mail or SNMP traps. Operations can view the data flow of jobs as well as workflow states and its steps as a diagram in a graphical user interface. They can also start, restart, cancel jobs and workflows and check their statistics and logs.

  • GUI for Operations
  • Workflows can be generated
Questions? Contact Us

Contact Us

Email
Message