All integrationsCloud Computing

Apache Airflow

Run your Airflow pipelines: trigger DAG runs with a conf, follow and wait for them, re-run failed tasks, pause DAGs, read task logs, set Variables, and start a workflow when a DAG run fails or succeeds or a DAG file stops loading.

actions
15
triggers
3

Triggers

Start a workflow when something happens in Apache Airflow.

  • DAG run failedRuns when a run of a DAG fails, of every DAG or the one you choose, with the tasks that failed. A run cleared and failing again starts it again. Runs that failed before the workflow was turned on don't.
  • DAG run succeededRuns when a run of a DAG succeeds, of every DAG or the one you choose. Runs that succeeded before the workflow was turned on don't start it.
  • New import errorRuns when a DAG file stops loading in Airflow, with the error, so its DAG doesn't silently stop running. A file that loads again and breaks again starts it again.

Actions

Steps a workflow can run in Apache Airflow.

  • Trigger DAG runStart a run of a DAG now, with a conf for it to read, as Airflow's Trigger button does. It doesn't wait for the run: follow it with Wait for DAG run or Get DAG run.
  • Get DAG runGet a DAG run's state, conf and times, with each of its tasks' state and which failed.
  • Wait for DAG runWait until a DAG run succeeds or fails, up to 15 minutes, then get it with each task's state. A run still going when the wait is up carries on in Airflow.
  • List DAG runsList the runs of one DAG, or of every DAG, newest first, by state and since when.
  • Clear DAG runRun a DAG run's failed tasks again (or every task, or the ones you name), as clearing them in Airflow does. The run goes back to queued.
  • Mark DAG runMark a DAG run as succeeded or failed, with a note saying why, as Airflow's Mark run as button does. Tasks still going are stopped.
  • Get task logGet the log of a task in a DAG run, of its latest try or the one you choose, with the error it ended on.
  • List DAGsList DAGs by ID, with whether each is paused, its schedule and its tags.
  • Get DAGGet a DAG: whether it's paused, its schedule and next run, its params (what its conf takes) and its newest run.
  • Pause DAGPause a DAG, so no new runs start, by its schedule or by a trigger, until it's unpaused. Runs going now carry on.
  • Unpause DAGUnpause a DAG, so its schedule runs it again and runs waiting in the queue start.
  • Get VariableGet an Airflow Variable's value, as text.
  • Set VariableSet an Airflow Variable that DAGs read, such as a date to load from or a list of recipients, making it if there's none.
  • Delete VariableDelete an Airflow Variable. One that isn't there is left as it is.
  • List import errorsList the DAG files Airflow can't load, newest first, with the error each fails on. A DAG whose file fails doesn't run.

Automate Apache Airflow with Lodol.

Connect Apache Airflow, then hand Lodol the job in Slack, Claude or ChatGPT.

Free plan, no credit card