You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've been running some Airflow Docker solution and has been always working well, until now when I tried to upgrade to 2.10.0 (this bug is introduce in 2.10.0, but I was trying to migrate from 2.9.3 to latest Airflow version).
I built some Airflow containerization solution and it worked well, with no problem until Airflow version 2.9.3 (This issue was introduced in Airflow version 2.10.0).
Correct behaviour (before 2.10.0)
Functionally the problem is in the startup.sh I am listing the DAGS and I am unpausing some of them. But from 2.10.0 when I am running "airflow dags unpause myDagName" I am getting the following error: No paused DAGS were found.
I realized the cause of the issue thanks to the "airflow dags list" that I run before: all the DAGS are in is_paused=None (before 2.10.0 always the outcome was is_paused=True)
As the is_pause of the DAGS are not True or False but None, it is understadable that "airflow dags unpause" does not work properly.
I've also check for differences in airflow.cfg but my Airflow version 2.9.3 and 2.10.0 are exactly the same file.
This issue only happens the first time you start the container. So after killing the container (and scheduler already run) this is fixed at second run.
Here you have my startup.sh that tries to unpause the DAGS (for reference):
#!/bin/bash
# Check if the file exists and set a variable accordingly
FILE_EXISTS=$( [ -e "$AIRFLOW_HOME/airflow-webserver.pid" ] && echo "true" || echo "false" )
if [ "$FILE_EXISTS" = "true" ]; then
# Perform action if the file exists
echo "Removing files pid..."
rm "$AIRFLOW_HOME/airflow-webserver.pid"
rm "$AIRFLOW_HOME/airflow-webserver-monitor.pid"
else
# Perform alternative action if the file does not exist
echo "File does not exist, performing alternative action..."
# Airflow db initialise
airflow db init
flask fab create-admin --username "admin" --firstname "admin" --lastname "admin" --email "$FLASK_EMAIL" --password "$FLASK_PASS"
fi
# Set Variables
airflow variables set github_token $GITHUB_TOKEN
airflow variables set environment $ENVIRONMENT
airflow variables set python_shared_libraries $PYTHON_SHARED_LIBRARIES
airflow variables set python_cache_data '/usr/local/miniconda3/envs/cache_data/bin/python'
if [ "$GITHUB_ACTIONS" = "true" ]; then
airflow variables set is_CI true
else
airflow variables set is_CI false
fi
# Migrate db
airflow db migrate
#Dag actions
echo "Listing Dags and unpausing them..."
airflow dags list
airflow dags unpause git_management
airflow dags unpause data_transfer_orchestration
airflow dags unpause mdp_processing_orchestration
airflow dags unpause sync_snow_duckdb
airflow dags unpause hubspot_cell_get_orchestration
airflow dags unpause hubspot_cell_import_orchestration
airflow dags unpause hubspot_lancet_get_orchestration
airflow dags unpause hubspot_lancet_import_orchestration
airflow dags unpause audit_log_reset_failed_glue
airflow dags unpause scopus_file_transfer_gdl_orchestration
git config --global --add safe.directory /home/airflow_user/airflow/cep-analytics-platform-airflow-orchestration
airflow webserver -D &
exec airflow scheduler
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I've been running some Airflow Docker solution and has been always working well, until now when I tried to upgrade to 2.10.0 (this bug is introduce in 2.10.0, but I was trying to migrate from 2.9.3 to latest Airflow version).
I built some Airflow containerization solution and it worked well, with no problem until Airflow version 2.9.3 (This issue was introduced in Airflow version 2.10.0).
Correct behaviour (before 2.10.0)

Functionally the problem is in the startup.sh I am listing the DAGS and I am unpausing some of them. But from 2.10.0 when I am running "airflow dags unpause myDagName" I am getting the following error:
No paused DAGS were found.
I realized the cause of the issue thanks to the "airflow dags list" that I run before: all the DAGS are in is_paused=None (before 2.10.0 always the outcome was is_paused=True)

As the is_pause of the DAGS are not True or False but None, it is understadable that "airflow dags unpause" does not work properly.
I've also check for differences in airflow.cfg but my Airflow version 2.9.3 and 2.10.0 are exactly the same file.
This issue only happens the first time you start the container. So after killing the container (and scheduler already run) this is fixed at second run.
Here you have my startup.sh that tries to unpause the DAGS (for reference):
Really appreciated any help.
Beta Was this translation helpful? Give feedback.
All reactions