VerificationArguments

class VerificationArguments

Container for verification arguments.

Attributes

catalog_total_rows	Constructed - not a user argument.
check_metadata	Whether to check the metadata as well as the schema.
input_collection_path	Constructed - not a user argument.
input_dataset_path	Path to the directory under input_catalog_path that contains the parquet dataset.
output_file_path	Path to the output file (output_path / output_filename).
output_filename	Filename for the verification report.
truth_schema	Path to a parquet file or dataset containing the expected schema.
truth_total_rows	Total number of rows expected in this catalog.
verbose	Should we output progress and results to standard out?
write_mode	Mode to be used when writing the output file.
input_catalog_path	Path to an existing catalog that will be inspected.
output_path	Directory where the verification report should be written.

Methods

__init__(*, input_catalog_path, output_path)

__init__(*, input_catalog_path: UPath, output_path: UPath, output_filename: str = 'verifier_results.csv', truth_total_rows: int | None = None, truth_schema: UPath | None = None, verbose: bool = True, write_mode: Literal['a', 'w', 'x'] = 'a', check_metadata: bool = False, input_collection_path: UPath = None, catalog_total_rows: int = 0) → None

classmethod __new__(*args, **kwargs)