Talk Python to Me: #302 The Data Engineering Landscape in 2021

I'm sure you're familiar with data science. But what about data engineering? Are these the same or how are they related? <br/> <br/> Data engineering is dedicated to overcoming data-processing bottlenecks, data cleanup, data flow and data-handling problems for applications that utilize lots of data. <br/> <br/> On this episode, we welcome back Tobias Macey to give us the 30,000 ft view of the data engineering landscape in 2021.<br/> <br/> <strong>Links from the show</strong><br/> <br/> <div><b>Live Stream Recordings:</b><br/> <b>YouTube</b>: <a href="https://www.youtube.com/watch?v=D0Z6ZsNNeJs" target="_blank" rel="noopener">youtube.com</a><br/> <br/> <b>Tobias Macey</b>: <a href="https://ift.tt/2YJXtPr" target="_blank" rel="noopener">boundlessnotions.com</a><br/> <br/> <b>Podcast.__init__</b>: <a href="https://ift.tt/2IAX78B" target="_blank" rel="noopener">pythonpodcast.com</a><br/> <b>Data Engineering podcast</b>: <a href="https://ift.tt/2iV0TIg" target="_blank" rel="noopener">dataengineeringpodcast.com</a><br/> <br/> <b>Designing Data-Intensive Applications Book</b>: <a href="https://amzn.to/36rsLyC" target="_blank" rel="noopener">amazon.com</a><br/> <b>wally</b>: <a href="https://ift.tt/2O0jhnA" target="_blank" rel="noopener">github.com</a><br/> <b>lakeFS</b>: <a href="https://lakefs.io/" target="_blank" rel="noopener">lakefs.io</a><br/> <b>A Beginner’s Guide to Data Engineering</b>: <a href="https://ift.tt/2CQLshQ" target="_blank" rel="noopener">medium.com</a><br/> <b>Apache Airflow</b>: <a href="https://ift.tt/2rhBfSj" target="_blank" rel="noopener">airflow.apache.org</a><br/> <b>Dagster</b>: <a href="https://dagster.io/" target="_blank" rel="noopener">dagster.io</a><br/> <b>Prefect</b>: <a href="https://www.prefect.io/" target="_blank" rel="noopener">prefect.io</a><br/> <b>#68 Crossing the streams with Podcast.__init__</b>: <a href="https://ift.tt/2anqkTk" target="_blank" rel="noopener">talkpython.fm/68</a><br/> <b>dbt</b>: <a href="https://www.getdbt.com/" target="_blank" rel="noopener">getdbt.com</a><br/> <b>Great Expectations</b>: <a href="https://ift.tt/2Ge2Bzv" target="_blank" rel="noopener">github.com</a><br/> <b>Dask</b>: <a href="https://dask.org/" target="_blank" rel="noopener">dask.org</a><br/> <b>Meltano</b>: <a href="https://meltano.com/" target="_blank" rel="noopener">meltano.com</a><br/> <b>Languages trends on StackOverflow</b>: <a href="https://ift.tt/3jmrqOX" target="_blank" rel="noopener">insights.stackoverflow.com</a><br/> <b>DVC</b>: <a href="https://dvc.org/" target="_blank" rel="noopener">dvc.org</a><br/> <b>Pandas</b>: <a href="https://ift.tt/2tJGfU3" target="_blank" rel="noopener">pandas.pydata.org</a><br/></div><br/> <strong>Sponsors</strong><br/> <br/> <a href='https://ift.tt/33twppf> <a href='https://ift.tt/3rljQa7> <a href='https://ift.tt/2PVc9qH Python Training</a>

from Planet Python
via read more