Talk Python to Me: #306 Scaling Python and Jupyter with ZeroMQ

When we talk about scaling software threading and async get all the buzz. And while they are powerful, using asynchronous queues can often be much more effective. You might think this means creating a Celery server, maybe running RabbitMQ or Redis as well. <br/> <br/> What if you wanted this async ability and many more message exchange patterns like pub/sub. But you wanted to do zero of that server work? Then you should check out ZeroMQ. <br/> <br/> ZeroMQ is to queuing what Flask is to web apps. A powerful and simple framework for you to build just what you need. You're almost certain to learn some new networking patterns and capabilities in this episode with our guest Min Ragan-Kelley to discuss using ZeroMQ from Python as well as how ZeroMQ is central to the internals of Jupyter Notebooks.<br/> <br/> <strong>Links from the show</strong><br/> <br/> <div><b>Min on Twitter</b>: <a href="https://twitter.com/minrk" target="_blank" rel="noopener">@minrk</a><br/> <b>Simula Lab</b>: <a href="https://ift.tt/30noqcd" target="_blank" rel="noopener">simula.no</a><br/> <b>Talk Python Binder episode</b>: <a href="https://ift.tt/3ef3yw6" target="_blank" rel="noopener">talkpython.fm/256</a><br/> <b>The ZeroMQ Guide</b>: <a href="https://ift.tt/30SdSCI" target="_blank" rel="noopener">zguide.zeromq.org</a><br/> <b>Binder</b>: <a href="https://mybinder.org" target="_blank" rel="noopener">mybinder.org</a><br/> <b>IPython for parallel computing</b>: <a href="https://ift.tt/2lzwErK" target="_blank" rel="noopener">ipyparallel.readthedocs.io</a><br/> <b>Messaging in Jupyter</b>: <a href="https://ift.tt/3rpUetc" target="_blank" rel="noopener">jupyter-client.readthedocs.io</a><br/> <b>DevWheel Package</b>: <a href="https://ift.tt/2O7iW2P" target="_blank" rel="noopener">pypi.org</a><br/> <b>cibuildwheel</b>: <a href="https://ift.tt/3bjaHcQ" target="_blank" rel="noopener">pypi.org</a><br/> <br/> <b>YouTube Live Stream</b>: <a href="https://www.youtube.com/watch?v=AIq4fO5t_ks" target="_blank" rel="noopener">youtube.com</a><br/> <b>PyCon Ticket Contest</b>: <a href="https://ift.tt/3qkZKf6" target="_blank" rel="noopener">talkpython.fm/pycon2021</a><br/></div><br/> <strong>Sponsors</strong><br/> <br/> <a href='https://ift.tt/3aBjB2k> <a href='https://ift.tt/3c4UgQv> <a href='https://ift.tt/2PVc9qH Python Training</a>

from Planet Python
via read more