Transformers

Transformers take a DataFrame as an input, transform it accordingly and return a DataFrame.

Each Transformer class has to have a transform method which takes no arguments and returns a DataFrame.

Possible transformation methods can be Selecting the most up-to-date record by id, Exploding an array, Filter (on an exploded array), Apply basic threshold cleansing or Map the incoming DataFrame to at provided structure.

Create your own Transformer

Please see the Create your own Transformer for further details.