`prefect_aws.glue_job`

Integrations with the AWS Glue Job.

Classes

Execute a Glue Job Methods:

fetch_result(self) -> str

fetch glue job state

wait_for_completion(self) -> None

Wait for the job run to complete and get exit code

Execute a job to the AWS Glue Job service. Attributes:

job_name: The name of the job definition to use.
arguments: The job arguments associated with this run. For this job run, they replace the default arguments set in the job definition itself. You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes. Job arguments may be logged. Do not pass plaintext secrets as arguments. Retrieve secrets from a Glue Connection, Secrets Manager or other secret management mechanism if you intend to keep them within the Job. doc
job_watch_poll_interval: The amount of time to wait between AWS API calls while monitoring the state of a Glue Job. default is 60s because of jobs that use AWS Glue versions 2.0 and later have a 1-minute minimum. AWS Glue Pricing

Methods:

trigger(self) -> GlueJobRun

trigger for GlueJobRun