From the course: Apache Airflow Essential Training

Unlock this course with a free trial

Join today to access over 24,900 courses taught by industry experts.

Configuring PostgreSQL as a metadata database and using the LocalExecutor

Configuring PostgreSQL as a metadata database and using the LocalExecutor - Apache Airflow Tutorial

From the course: Apache Airflow Essential Training

Start my 1-month free trial Buy for my team

Configuring PostgreSQL as a metadata database and using the LocalExecutor

“

- [Instructor] Now each time we worked with the Airflow UI, you've seen this message on top. Do not use SQLite as a metadata DB in production. It should only be used for dev/testing. Also, do not use the SequentialExecutor in production. Click here for more information. Well, we'll fix these warnings, now. I'm going to set up Airflow in a more production environment. We'll use PostgreSQL as the metadata database and we'll use the local executor. The metadata database is what Airflow uses for orchestrating and managing data pipelines. It's a central repository that stores and manages information about workflows, tasks, and the execution history of your Airflow environment. I'll now switch over to a terminal window and run psql. Now, within our PostgreSQL database installation, I'm going to create a new database that Airflow can use for its metadata. Create database. I've called it "Airflow underscore db". Once this…

Contents