Custom Data
To evaluate synthetic data generated by external tools, use the custom_data
method.
The custom_data
method enables Evaluator to correctly recognize and evaluate external files as synthetic results.
Usage Examples
Click the below button to run this example in Colab:
Synthesizer:
external_data:
method: custom_data
filepath: benchmark://adult-income_syn
schema: benchmark://adult-income_schema
This example demonstrates custom_data
usage with other modules:
- Synthesizer: Uses
custom_data
to import external synthetic data - Other modules: Loader, Splitter, and Evaluator are used together for complete evaluation workflow
ℹ️
When using
custom_data
, the filepath
parameter supports all Loader formats, including benchmark://
protocol and regular file paths.