Skip to main content
Version: 2.8

2 Release Notes​

Versions numbering: EVL Data Generation x.y.z

x – major release, i.e. big changes must happen to advance this number

y – minor releases, i.e. introduce new features

z – bugfixes

Overview​

Version 0.1 (2019/03)
Initial version of Anonymization Microservice.
EVL version needed: 2.0
New features: Anonymization, Unique Anonymization, Checksum, Salted checksum, Tokenization.

Version 0.2 (2019/07)
Randomization added, dates and timestamps handling improved.
EVL version needed: 2.1
Changes: Function names refined, dates/timestamps ‘9999-12-31’ and ‘4712-12-31’ are not anonymized by default.
New features: Masking, Randomization, Min and max can be specified also for dates and timestamps.

Version 1.0 (2020/01)
Excel sheet can be used as config, workflow generator introduced.
EVL version needed: 2.2
Changes: project folder structure reorganized, Anon type names get shorter.
New features: EVL workflow generator, project generator.

Version 1.1 (2020/05)
EVL version needed: 2.3
New features: predefined business anonymization types, config file checker

Version 2.4 (2020/10)
Version numbers synchronized with EVL, EVL Manager added – a graphical interface, IBAN anonymization, anonymization by lookup.
New features: business anon type ‘ANON_IBAN’, anon function ‘ANON_LOOKUP’.

Version 0.1​

Released
2019/03

EVL Version needed
2.0

Description
Initial version

New features

  • anonymization,
  • unique anonymization,
  • checksums,
  • salt,
  • tokenization

Version 0.2​

Released
2019/07

EVL Version needed
2.1

Changes

  • Function ‘TOKENIZE’ renamed to ‘ANONYMIZE_UNIQ’ as it better describes what it does. To migrate, it is enough to replace all in anon-config file(s) and regenerate jobs.

  • Function ‘TOKENIZE_LKP’ renamed to ‘TOKENIZE’. To migrate, it is enough to replace all in anon-config file(s) and regenerate jobs.

  • Default Anonymization options can be added into project.sh:

    export EVL_ANON_DEFAULT_MIN_STRING_LENGTH=0
    export EVL_ANON_DEFAULT_MAX_STRING_LENGTH=10

    Then for string fields these values are used when ‘min_length’ and/or ‘max_length’ are empty in anon-config file.

  • When running generated anonymization jobs, data are appended to the target file/table, not overwritten.

  • Dates/timestamps 9999-12-31 and 4712-12-31 are not anonymized by default.

New features

  • randomization,
  • Min and Max can be specified also for dates and timestamps,
  • masking.

Migration script
To migrate your config CSV file from version 0.1, just run:

# cd to your project directory
for i in anon-config.*.csv
do
  mv $i $i.bckp
  sed 's/TOKENIZE\([^_]\)/ANONYMIZE_UNIQ\1/;
       s/TOKENIZE_LKP/TOKENIZE/' $i.bckp >$i
done

Version 1.0​

Released
2020/01

EVL Version needed
2.2

Description
Folder structure reorganized. Next to CSV, also an intelligent Excel config file can be used (list values, syntax checking). Job generators enhanced and generation of EVL workflows added.

Changes

  • project folder structure reorganized,
  • Anon type names get shorter: ‘ANONYMIZE’ changed to ‘ANON’.

New features

  • an intelligent Excel config file can be used (list values, syntax checking),
  • project generator,
  • EVL Workflow generator,

Migration script
Create new project in current directory:

evl anon new project your_project_name

Then modify your configs in old project:

# cd to your project directory
for i in anon-config.*.csv
do
  mv $i $i.bckp
  sed 's/;ANONYMIZE/;ANON/' $i.bckp >$i
done

and copy them into your new project directory:

cp anon.*.csv your_project_name/

And copy all your custom settings from ‘project.sh’ and ‘run/generate_jobs.*.evl’ files.

Version 1.1​

Released
2020/05

EVL Version needed
2.3

Description
Basic syntax validation of config file. Configurable anonymization types with the set of predefined ones.

New features

  • check config file syntax,
  • predefined business anonymization types:
    ‘ANON_AMOUNT’, ‘ANON_EMAIL’ and ‘ANON_NAME’.

Version 2.4​

Released
2020/10

Description
Version numbers synchronized with EVL. EVL Manager added – a graphical interface. Anonymize by lookup.

New features

  • predefined anonymization functions for using lookups: ‘ANON_LOOKUP’,
  • IBAN anonymization predefined types:
    ‘ANON_IBAN’, ‘ANON_IBAN_KEEP_COUNTRY’, ‘ANON_IBAN_KEEP_BANK’,
  • GUI: integration with EVL Manager,
  • Next to Oracle, PostgreSQL, Teradata, also MySQL/MariaDB can be connected.

Version 2.5​

Plan to release
2021/04

New features

  • Files can be read/written from/to Samba, HDFS, SFTP, AWS S3 and Google Storage.
  • Config file generator also for JSON files and for Oracle and PostgerSQL tables.