Getting Started with Airflow for Beginners

Getting Started with Airflow for Beginners

Data with Marc

8 месяцев назад

12,206 Просмотров

Ссылки и html тэги не поддерживаются


Комментарии:

@sophialawal7306
@sophialawal7306 - 01.11.2023 18:16

Thank you the video is really help full

Ответить
@Incomingsign
@Incomingsign - 14.10.2023 17:46

i have setup airflow with docker using astro cli. how to make code suggestion work in vscode?

Ответить
@kirillfedorov7595
@kirillfedorov7595 - 09.10.2023 20:10

Today I watched the entire playlist without a break, you have a talent for explaining! Thank you. Also, perhaps the last two videos would be better placed at the beginning of the playlist.

Ответить
@2998sebastian
@2998sebastian - 03.10.2023 03:20

Great video Marc! But why doesn't Visual Studio Code recognize the Airflow library even though I'm running my containers correctly? I've noticed that you're experiencing the same issue because the 'airflow.decorators' library is underlined in yellow. Is there a way to fix this?

Ответить
@buddhabob359
@buddhabob359 - 02.10.2023 18:51

Many thanks for the video ; great tutorial !

I have a question regarding Airflow though ; I keep seeing DAG file where task functions are defined directly into the DAG file.
What if I want to import functions from python scripts from other Repositories ? How can I call them in my DAG file ?

I plan to use Airflow to run many scripts I have deployed on various Git repositories.
I don't want to recreate those already existing functions into my DAG file but just call those scripts with their functions in my Airflow repository.
Any idea how can I achieve that ?

Many thanks and keep up making great videos ! ;)

Ответить
@0kazaki
@0kazaki - 02.10.2023 16:19

Using tempfile module from python, can I create a temporay directory associated with a DAG RUN that will be automatically deleted at the end of a DAG RUN regardless if the DAG RUN was successful or failure or otherwise?

Ответить