Skip to content

Commit

Permalink
Default to standalone DAG processor in breeze (apache#45723)
Browse files Browse the repository at this point in the history
We are moving to only support a standalone DAG processor in Airflow 3,
so let's switch breeze to default to a standalone DAG processor, while
still allowing it to be explicitly disabled for Airflow 2.
  • Loading branch information
jedcunningham authored Jan 16, 2025
1 parent 17385a2 commit 4bc37af
Show file tree
Hide file tree
Showing 8 changed files with 428 additions and 342 deletions.
2 changes: 1 addition & 1 deletion Dockerfile.ci
Original file line number Diff line number Diff line change
Expand Up @@ -1053,7 +1053,7 @@ function start_webserver_with_examples(){
echo
echo "${COLOR_BLUE}Parsing example dags${COLOR_RESET}"
echo
airflow scheduler --num-runs 100
airflow dags reserialize
echo "Example dags parsing finished"
echo "Create admin user"
airflow users create -u admin -p admin -f Thor -l Administrator -r Admin -e [email protected]
Expand Down
180 changes: 102 additions & 78 deletions dev/breeze/doc/images/output-commands.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
330 changes: 179 additions & 151 deletions dev/breeze/doc/images/output_shell.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_shell.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
1f9defd0443e2de2496b75a00c5af2cb
d9370f833ddcc89db417a69b3de40a4b
246 changes: 139 additions & 107 deletions dev/breeze/doc/images/output_start-airflow.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_start-airflow.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
e0c5377c9e26b5c5fa79b61ace516ea7
a788bf6d34c4341a30287b60d134e43d
6 changes: 4 additions & 2 deletions dev/breeze/src/airflow_breeze/commands/common_options.py
Original file line number Diff line number Diff line change
Expand Up @@ -363,9 +363,11 @@ def _set_default_from_parent(ctx: click.core.Context, option: click.core.Option,
envvar="SKIP_DB_TESTS",
)
option_standalone_dag_processor = click.option(
"--standalone-dag-processor",
help="Run standalone dag processor for start-airflow.",
"--standalone-dag-processor/--no-standalone-dag-processor",
is_flag=True,
default=True,
show_default=True,
help="Run standalone dag processor for start-airflow (required for Airflow 3).",
envvar="STANDALONE_DAG_PROCESSOR",
)
option_upgrade_boto = click.option(
Expand Down
2 changes: 1 addition & 1 deletion scripts/docker/entrypoint_ci.sh
Original file line number Diff line number Diff line change
Expand Up @@ -376,7 +376,7 @@ function start_webserver_with_examples(){
echo
echo "${COLOR_BLUE}Parsing example dags${COLOR_RESET}"
echo
airflow scheduler --num-runs 100
airflow dags reserialize
echo "Example dags parsing finished"
echo "Create admin user"
airflow users create -u admin -p admin -f Thor -l Administrator -r Admin -e [email protected]
Expand Down

0 comments on commit 4bc37af

Please sign in to comment.