Airflow kubernetesPorOperator example fails to run - airflow-scheduler

Question

Trying to run sample kubernetesPodOperator retrieves:
[2020-05-25 20:00:40,475] {{init.py:51}} INFO - Using executor
LocalExecutor
[2020-05-25 20:00:40,475] {{dagbag.py:396}} INFO - Filling up the
DagBag from /usr/local/airflow/dags/kubernetes_example.py
│ │ Traceback (most recent call last):
│ │ File "/usr/local/bin/airflow", line 37, in
│ │ args.func(args)
│ │ File
"/usr/local/lib/python3.7/site-packages/airflow/utils/cli.py", line
75, in wrapper
│ │ return f(*args, **kwargs)
│ │ File
"/usr/local/lib/python3.7/site-packages/airflow/bin/cli.py", line 523,
in run
│ │ dag = get_dag(args)
│ │ File
"/usr/local/lib/python3.7/site-packages/airflow/bin/cli.py", line 149,
in get_dag
│ │ 'parse.'.format(args.dag_id))
│ │ airflow.exceptions.AirflowException: dag_id could not be found:
kubernetes_example. Either the dag did not exist or it failed to
parse.
This is the code I am using:
from airflow import DAG
from datetime import datetime, timedelta
from airflow.contrib.operators.kubernetes_pod_operator import KubernetesPodOperator
from airflow.operators.dummy_operator import DummyOperator
from airflow.utils.dates import days_ago
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'start_date': days_ago(1),
'email': ['airflow#example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=60)
}
dag = DAG(
'kubernetes_example', default_args=default_args, schedule_interval=timedelta(minutes=60))
start = DummyOperator(task_id='run_this_first', dag=dag)
passing = KubernetesPodOperator(namespace='airflow',
image="python:3.6.10",
cmds=["Python","-c"],
arguments=["print('hello world')"],
labels={"foo": "bar"},
name="passing-test",
task_id="passing-task",
env_vars={'EXAMPLE_VAR': '/example/value'},
in_cluster=True,
get_logs=True,
dag=dag
)
failing = KubernetesPodOperator(namespace='airflow',
image="ubuntu:18.04",
cmds=["Python","-c"],
arguments=["print('hello world')"],
labels={"foo": "bar"},
name="fail",
task_id="failing-task",
get_logs=True,
dag=dag
)
passing.set_upstream(start)
failing.set_upstream(start)
I just took it from sample executor.
Did someone stumble upon this issue?
Thanks!

Answer 1

You need to have a name (the dag_id for your dag).
dag = DAG(
dag_id='kubernetes_example',
default_args=default_args,
schedule_interval=timedelta(minutes=60)
)
Also your task_id should have _ not - and be: task_id="failing_task"