hipscat_import.pipeline

Flow control and pipeline entry points.

Module Contents

Functions

pipeline(args)	Pipeline that creates its own client from the provided runtime arguments
pipeline_with_client(args, client)	Pipeline that is run using an existing client.
_send_failure_email(args, exception)
_send_success_email(args)
_send_email(message)

pipeline(args: hipscat_import.runtime_arguments.RuntimeArguments)

Pipeline that creates its own client from the provided runtime arguments

pipeline_with_client(args: hipscat_import.runtime_arguments.RuntimeArguments, client: dask.distributed.Client)

Pipeline that is run using an existing client.

This can be useful in tests, or when a dask client requires some more complex configuraion.

_send_failure_email(args: hipscat_import.runtime_arguments.RuntimeArguments, exception: Exception)

_send_success_email(args)

_send_email(message: email.message.EmailMessage)