Skip to content

The DataProcessor crashes when assigning transformers with Metadata V2 #2993

Description

@R-Palazzo

Environment Details

  • SDV version: sdv_2.0 feature branch

Problem Description

Transformer assignment can fail with Metadata V2 because the new metadata keys are not always handled correctly when assigning transformers in the DataProcessor.

This can result in errors such as:

InvalidMetadataError: Invalid values '(range_is_nullable)' for email column 'pii_col'.

or:

TypeError: UniformEncoder.__init__() got an unexpected keyword argument 'range_values'

Expected behavior

Update the DataProcessor transformer assignment so that only the appropriate metadata parameters are passed to each transformer.

Additional context

This was found while working on targeted sampling and fixed in #2973 https://github.com/datacebo/SDV-Enterprise/pull/2202

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions