Description
As described in https://cwiki.apache.org/confluence/display/AIRFLOW/Examples+Refurbish
After #52469 is implemented and the "hacky" integration of example dags from standard provider are cleaned... a generic enhanced loading mechanism is needed to source example dags from all providers which are (1) installed and (2) which have an example dags folder.
Proposal could be to dynamically create a list ad a set of dag bundles.
Use case/motivation
Airflow Examples have been grown in number and focus over the past years. They purpose multiple things:
Serve as tutorials to learn Airflow DAG implementation
Serve with code snippets for documentation
Serve for testing the setup
(some) service for CI integration testing
Some example DAGs are in a good quality, some are not following best practices. Current examples do not follow a structure.
There are example DAGs contained in the Airflow core (currently pushed to standard provider/example_dags) as well as there are more examples in other providers. But examples from other providers are lot loaded automatically.
So in the Airflow 3 Dev Calls there was a demand named to clean-up and optimize example DAGs.
Related issues
Probably #52469 as pre-requisite if not implemented together.
Are you willing to submit a PR?
Code of Conduct
Description
As described in https://cwiki.apache.org/confluence/display/AIRFLOW/Examples+Refurbish
After #52469 is implemented and the "hacky" integration of example dags from standard provider are cleaned... a generic enhanced loading mechanism is needed to source example dags from all providers which are (1) installed and (2) which have an example dags folder.
Proposal could be to dynamically create a list ad a set of dag bundles.
Use case/motivation
Airflow Examples have been grown in number and focus over the past years. They purpose multiple things:
Some example DAGs are in a good quality, some are not following best practices. Current examples do not follow a structure.
There are example DAGs contained in the Airflow core (currently pushed to standard provider/example_dags) as well as there are more examples in other providers. But examples from other providers are lot loaded automatically.
So in the Airflow 3 Dev Calls there was a demand named to clean-up and optimize example DAGs.
Related issues
Probably #52469 as pre-requisite if not implemented together.
Are you willing to submit a PR?
Code of Conduct