From the course: Apache Airflow Essential Training
Unlock this course with a free trial
Join today to access over 24,900 courses taught by industry experts.
Quick Airflow setup overview - Apache Airflow Tutorial
From the course: Apache Airflow Essential Training
Quick Airflow setup overview
- [Instructor] Before we get into the first of our demos on the TaskFlow API, let's do a quick overview of our Airflow installation. Now, on my local machine, the Python version that I'm running is Python 3.9.13. Now, I'm going to be running Airflow on a slightly older version of Python, but you should know that Airflow has been tested with Python 3.7, 3.8, 3.9, and 3.10. I'm going to be using Python 3.7 within a virtual environment. I'll run conda env list, and you can see that I have a 3.7 virtual environment available here, which is what I'm going to be using. I'm going to go ahead and activate this virtual environment, and from here on in, any Airflow commands I'll be running within this virtual env. Just something to keep in mind. The exact version of Python that I'm using to run Airflow is 3.7.16. Of course, you may have a different 3.7 version. Shouldn't really matter much. Now, I already have Airflow…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
Prerequisites39s
-
(Locked)
Quick Airflow setup overview3m 27s
-
(Locked)
DAG using PythonOperators3m 33s
-
(Locked)
DAG using TaskFlow3m 55s
-
(Locked)
Passing data using XCom with operators5m 37s
-
(Locked)
Passing data using the TaskFlow API4m 41s
-
(Locked)
Tasks with multiple outputs5m 40s
-
(Locked)
Passing multiple outputs in TaskFlow1m 47s
-
-
-
-
-
-