If you are working with data pipelines, you definitely need to give Apache Airflow a look. This pure-Python workflow framework is one of the most popular and capable out there. You create your workflows by writing Python code using clever language operators and then you can monitor them and even debug them visually once they get started. <br/> <br/> Stop writing manual code or cron-job based code to create data pipelines check out Airflow. We're joined by three excellent guests from the Airflow community: Jarek Potiuk, Kaxil Naik, and Leah Cole.<br/> <br/> <strong>Links from the show</strong><br/> <br/> <div><b>Jarek Potiuk</b>: <a href="https://ift.tt/3B0SRoW" target="_blank" rel="noopener">linkedin.com</a><br/> <b>Kaxil Naik</b>: <a href="https://twitter.com/kaxil" target="_blank" rel="noopener">@kaxil</a><br/> <b>Leah Cole</b>: <a href="https://twitter.com/leahecole" target="_blank" rel="noopener">@leahecole</a><br/> <br/> <b>Airflow site</b>: <a href="https://ift.tt/2rhBfSj" target="_blank" rel="noopener">airflow.apache.org</a><br/> <b>Airflow on GitHub</b>: <a href="https://ift.tt/2V4ubay" target="_blank" rel="noopener">github.com</a><br/> <b>Airflow community</b>: <a href="https://ift.tt/2SJ1mCq" target="_blank" rel="noopener">airflow.apache.org</a><br/> <b>UI</b>: <a href="https://ift.tt/2XO4CB7" target="_blank" rel="noopener">github.com</a><br/> <b>Helm Chart for Apache Airflow</b>: <a href="https://ift.tt/3sBAOmr" target="_blank" rel="noopener">airflow.apache.org</a><br/> <b>Airflow Summit</b>: <a href="https://ift.tt/3aigWKT" target="_blank" rel="noopener">airflowsummit.org</a><br/> <b>Astronomer</b>: <a href="https://ift.tt/2u7iAuq" target="_blank" rel="noopener">astronomer.io</a><br/> <b>Astronomer Registry (Easy to search for official and community Providers)</b>: <a href="https://ift.tt/2UB8dBb" target="_blank" rel="noopener">registry.astronomer.io</a><br/> <b>REST API</b>: <a href="https://ift.tt/3ggBuZq" target="_blank" rel="noopener">airflow.apache.org</a><br/> <b>Contributing</b>: <a href="https://ift.tt/3D7Fi95" target="_blank" rel="noopener">github.com</a><br/> <b>Airflow Loves Kubernetes talk</b>: <a href="https://ift.tt/3y6VzHA" target="_blank" rel="noopener">airflowsummit.org</a><br/> <b>Episode transcripts</b>: <a href="/episodes/transcript/330/apache-airflow-open-source-workflow-with-python" target="_blank" rel="noopener">talkpython.fm</a><br/></div><br/> <strong>Sponsors</strong><br/> <br/> <a href='https://ift.tt/2PVc9qH Python Training</a><br> <a href='https://ift.tt/3x0z72P>
from Planet Python
via read more
Subscribe to:
Post Comments (Atom)
TestDriven.io: Working with Static and Media Files in Django
This article looks at how to work with static and media files in a Django project, locally and in production. from Planet Python via read...
-
Podcasts are a great way to immerse yourself in an industry, especially when it comes to data science. The field moves extremely quickly, an...
-
Graph traversal algorithms are used to perform various operations on a graph data structure. In this article, we will use the breadth-first ...
-
In an earlier tutorial we've already covered how to open dialog windows. These are special windows which (by default) grab the focus o...
No comments:
Post a Comment