hipscat_import.soap
#
Source-Object Association Pipeline - special case of the the association pipeline
Submodules#
Package Contents#
Classes#
Data class for holding source-object association arguments |
- class SoapArguments[source]#
Bases:
hipscat_import.runtime_arguments.RuntimeArguments
Data class for holding source-object association arguments
- object_catalog_dir: str = ''#
- object_id_column: str = ''#
- object_storage_options: Dict[Any, Any] | None#
optional dictionary of abstract filesystem credentials for the OBJECT catalog.
- source_catalog_dir: str = ''#
- source_object_id_column: str = ''#
- source_id_column: str = ''#
- source_storage_options: Dict[Any, Any] | None#
optional dictionary of abstract filesystem credentials for the SOURCE catalog.
- resume: bool = True#
if there are existing intermediate resume files, should we read those and continue to run the pipeline where we left off
- write_leaf_files: bool = False#
Should we also write out leaf parquet files (e.g. Norder/Dir/Npix.parquet) that represent the full association table
- compute_partition_size: int = 1000000000#