Talk Python To Me - Python Conversations For Passionate Developers

In recent years, there has been a lot of experimenting how we work with dependencies and external libraries for our Python code. There is pip, pip-tools, Poetry, pdm, pyenv, pipenv, Hatch and others workflows. We dove into this deeply back on episode 406: Reimagining Python's Packaging Workflows. We're back with Ofek Lev to take a deeper look at Hatch. Links from the show Hatch: hatch.pypa.io Ofek on Twitter: @Ofekmeister Mamba: github.com Hatch env management: hatch.pypa.io Packaging a Python project tutorial: packaging.python.org Customize project generation: hatch.pypa.io Textual: textualize.io Ruff on Talk Python: talkpython.fm RustUp: rustup.rs Conda: docs.conda.io import antigravity: xkcd.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy Sponsors Microsoft Founders Hub 2023 Sentry Error Monitoring, Code TALKPYTHON Talk P

If you're like most people, the simplicity and easy of getting started is a big part of pytest's appeal. But beneath that simplicity, there is a lot of power and depth. We have Brian Okken on this episode to dive into his latest pytest tips and tricks for beginners and power users. Links from the show pytest tips and tricks article: pythontest.com Getting started with pytest Course: training.talkpython.fm pytest book: pythontest.com Python Bytes podcast: pythonbytes.fm Brian on Mastodon: @brianokken@fosstodon.org Hypothesis: readthedocs.io Hypothesis: Reproducability: readthedocs.io Get More Done with the DRY Principle: zapier.com "The Key" Keyboard: stackoverflow.blog pytest plugins: docs.pytest.org Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy Sponsors Microsoft Founders Hub 2023 Brilliant 2023 Talk Python Training

The great power of Python is its over 400,000 packages on PyPI to serve as building blocks for your app. How do you get those needed packages on to your dev machine and managed within your project? What about production and QA servers? I don't even know where to start if you're shipping built software to non-dev end users. There are many variations on how this works today. And where we should go from here has become a hot topic of discussion. So today, that's the topic for Talk Python. I have a great panel of guests: Steve Dower, Pradyun Gedam, Ofek Lev, and Paul Moore. Links from the show Python Packaging Strategy Discussion - Part 1: discuss.python.org Thoughts on the Python packaging ecosystem: pradyunsg.me Python Packaging Authority: pypa.io Hatch: hatch.pypa.io Pyscript: pyscript.net Dark Matter Developers: The Unseen 99%: hanselman.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python

So you know about dependencies and testing, right? If you're talking to a DB in your app, you have to decide how to approach that with your tests. There are lots of solid options you might pick and they vary by goals. Do you mock out the DB layer for isolation or do you use a test DB to make it as real as possible? Do you just punt and use the real DB for expediency? What if your dependency was a huge array of radio telescopes and a rack of hundreds of bespoke servers? That's the challenge on deck today were we discuss testing radio astronomy with pytest with our guest James Smith. He's a Digital Signal Processing engineer at the South African Radio Astronomy Observatory and has some great stories and tips to share. Links from the show GPU-based correlator for MeerKAT: github.com Meerkat: sarao.ac.za SARAO: sarao.ac.za Skarab server: peralex.com pycuda: documen.tician.de Commercial Telescopes: telescope.com PyLaTeX: github.com Linearity Test Code: talkpython.fm Correlator Context: talkpython.fm Watch this

Clean code is one of those aspects of your programming career that's easy to put on the back burner (sometimes by management more than yourself). But it's important in the short term for writing more debuggable and readable code. And important in the long run for avoiding having your program take on the dreaded "legacy code" moniker. We're fortunate to have Bob Belderbos back on the show. He's been thinking and writing about clean code and Python a lot lately and we'll dive into a bunch of tips you can use right away to make your code cleaner. Links from the show Bob on Mastodon: @bbelderbos@fosstodon.org PyBites: pybit.es Tips for clean code in Python article: pybit.es Refactoring book: pybitesbooks.com Final type: docs.python.org Sentinels pattern: python-patterns.guide Black formater: pypi.org Guarding clauses: medium.com ChatGPT: chat.openai.com Git Precommit: pre-commit.com #100DaysOfCode in Python course: training.talkpython.fm #100DaysOfWeb in Python course: training.talkpython.fm Watch this episode

Imagine a world with free and unlimited clean energy. That's the musings of a great science fiction story. But nuclear fusion (the kind that powers the sun) has always been close at hand, we see the sun every day, and yet impossibly far away as a technology. We took a major step towards this becoming a reality with the folks at the Lawrence Livermore National Labratory in the US achieved "ignition" where they got significantly more energy out than they put in. And Python played a major role in this research and experiment. We have Jay Salmonson here to give us a look at the science and the Python code of this discovery. Links from the show Jay on Mastodon: hachyderm.io/@jdsalmonson Jay on Twitter: @JaySalmonson Official Announcement: lasers.llnl.gov QnD Package: github.com PlasmaPy: plasmapy.org ML in Fusion: llnl.gov National Ignition Facility Achieves Ignition in Historic Nuclear Fusion Experiment: newenergytimes.net Video demonstrating the fusion lab: youtube.com Watch this episode on YouTube: youtube

When you think about processing tabular data in Python, what library comes to mind? Pandas, I'd guess. But there are other libraries out there and Polars is one of the more exciting new ones. It's built in Rust, embraces parallelism, and can be 10-20x faster than Pandas out of the box. We have Polars' creator, Ritchie Vink here to give us a look at this exciting new data frame library. Links from the show Ritchie on Mastodon: @ritchie46@fosstodon.org Ritchie on Twitter: @RitchieVink Ritchie's website: ritchievink.com Polars: pola.rs Apache Arrow: arrow.apache.org Polars Benchmarks: pola.rs Coming from Pandas Guide: github.io Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy Sponsors Taipy User Interviews Talk Python Training

At some point, you've probably migrated an app from one framework or major runtime version to another. For example, Django to Flask, Python 2 to Python 3, or even Angular to Vue.js. This can be a big challenge. If you had 100s of active devs and millions of lines of code, it's a huge challenge. We have Ben Bariteau from Yelp here to recount their story moving 3.8M lines of code from Python 2 to Python 3. But this is not just a 2-to-3 story. It has many lessons on how to migrate code in many situations. There are plenty of gems to take from his experience. Links from the show Ben on Twitter: @benbariteau Ben's Talk at PyCon 2022: youtube.com python-modernize: github.com python-future: github.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy Sponsors Cox Automotive User Interviews Talk Python Training

Our code quality tools (linters, test frameworks, and others) play an important role in keeping our code error free and conforming to the rules our teams have chosen. But when these tools become sluggish and slow down development, we often avoid running them or even turn them off. On this episode, we have Charlie Marsh here to introduce Ruff, a fast Python linter, written in Rust. To give you a sense of what he means with fast, common Python linters can take 30-60 seconds to lint the CPython codebase. Ruff takes 300 milliseconds. I ran it on the 20,000 lines of Python code for our courses web app at Talk Python Training, and it was instantaneous. It's the kind of tool that can change how you work. I hope you're excited to learn more about it. Links from the show Charlie on Twitter: @charliermarsh Charlie on Mastodon: @charliermarsh@hachyderm Ruff: github.com PyCharm Developer Advocate Job: jetbrains.com/careers Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch

Monorepos are contrary to how many of us have been taught to use source control. To start a project or app, the first thing we do is create a git repo for it. This leads to many focused and small repositories. A quick check of my GitHub account shows there are 179 non-fork repositories. That's a lot but I think many of us work that way. But it's not like this with monorepos. There you create one (or a couple) repositories for your entire company. This might have 100s or 1,000s of employees working on multiple projects within the single repo. Famously, Google, Meta, Microsoft, and Airbnb all employ very large monorepos with varying strategies of coordination. On this episode, we have David Vujic here to give us his perspective on monorepos as well as highlight an architectural pattern and set of tools for accomplishing this in Python. Links from the show David on Twitter: @davidvujic David on Mastodon: @davidvujic@mastodon.nu Monorepo definition: wikipedia.org git-sizer tool for large repos: github.

The iconic and first ever image of a black hole was recently released. It took over a decade of work and is a major achievement for astronomy and broadens our understanding of the universe for all of us. Would it surprise you to know that Python played a major part in this discovery? Of course it did, and Dr. Sara Issaoun is here to give us the full story. Links from the show Sara's PyCon keynote: youtube.com Sara on Twitter: @saraissaoun Event Horizon Telescope: eventhorizontelescope.org Black Hole Image Makes History; NASA Telescopes Coordinated Observations: nasa.gov Event Horizon Data: eventhorizontelescope.org Imaging, analysis, and simulation software for radio interferometry Package: github.com Initial data showing ring (matplotlib) (video at time): youtube.com Mars 2020 Helicopter GitHub Badge: github.blog Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Foll

The beauty of open source software and libraries is that you're not stuck with a single option some vendor is offering. This is especially true when that support is poor and antiquated. Almost any capability you think of has multiple options even for a single language such as Python. Just think about how many web frameworks you can pick today. Links from the show Guests Emily Morehouse-Valcarcel: @emilyemorehouse Cecil Phillip: @cecilphillip@hachyderm.io Kim van Wyk: @kimvanwyk@fosstodon.org Łukasz Langa: @ambv@mastodon.social Gareth Thomas: @thestub@pythonist.as Dan Gerlanc: @dgerlanc@fosstodon.org Does the GitHub page need to be pretty?: github.com/tiangolo/fastapi Do fancy "marketing pages" matter? Poetry: python-poetry.org Tailwind: tailwindcss.com VueJS: vuejs.org Aesara: github.com/aesara-devs/ Story of creating Michael's Site: mkennedy.codes Went to the community: fosstodon.org Hugo Site Generator: gohugo.io Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay i

For links and very detailed show notes, please view the original episode page over on Python Bytes. Thanks for listening! Sponsors Sentry Error Monitoring, Code TALKPYTHON AWS Insiders AssemblyAI Talk Python Training

If you maintain projects on places like GitHub, you know that having a classy readme is important and that maintaining a change log can be helpful for you and consumers of the project. It can also be a pain. That's why I'm excited to welcome back Ned Batchelder to the show. He has a lot of tools to help here as well as some opinions we're looking forward to hearing. We cover his tools and a bunch of others he and I found along the way. Links from the show Ned on Mastodon: @nedbat@hachyderm.io Ned's website: nedbatchelder.com Readme as a Service: readme.so hatch-fancy-pypi-readme: github.com Shields.io badges: shields.io All Contributors: allcontributors.org Keep a changelog: keepachangelog.com Scriv: Changelog management tool: github.com changelog_manager: github.com executablebooks' github activity: github.com dinghy: A GitHub activity digest tool: github.com cpython's blurb: github.com release drafter: github.com Towncrier: github.com mktestdocs testing code samples in readmes: github.com shed: github.co

Jupyter is an amazing environment for exploring data and generating executable reports with Python. But there are many external tools, extensions, and libraries to make it so much better and make you more productive. On this episode, we are going to cover a ton of them. We have Markus Schanta, the maintainer of the awesome-jupyter list on the show and we'll highlight a bunch of Jupyter gems. Links from the show Markus Shanta: markus.schanta.at Markus on Twitter: @markusschanta awesome-jupyter list: github.com Jupyter book: jupyterbook.org Jupyter Desktop App: jupyter.org Talk Python Episode on 60 Notebook Envs: talkpython.fm nbdev: github.com Python Tutor: pythontutor.com Cell Magics: ipython.readthedocs.io Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy Sponsors AWS Insiders Sentry Error Monitoring, Code TALKPYTHON AssemblyAI Ta

Space science is one of the few sciences that can spark wonder and imagining in almost anyone. It also happens to be the domain of Python with many missions, telescopes, and analysis happening with Python playing a major role. On this episode we have Thomas Albin who has worked on several recent space missions. He has created a delightful YouTube channel called Space Science with Python. It's approachable and yet concrete and realistic. We are going to dive into some of his videos and see how Python can model things like astroid fly-bys and render comets in 3D. Links from the show Thomas Albin: astrodon.social/@ThomasAlbin Thomas on Twitter: @MrAstroThomas YouTube Channels Thomas' Space Science Channel: youtube.com Dr Becky's Channel: youtube.com Astrum Channel: youtube.com/@astrumspace Talk Python's Channel: youtube.comyoutube.com/@talkpython Michael's Channel: youtube.com/@mikeckennedy Cassini Mission: nasa.gov Comet: 67P/Churyumov–Gerasimenko: wikipedia.org Code from the series: github.com Space Scien

When you think data science, Jupyter notebooks and associated tools probably come to mind. But I want to broaden your toolset a bit and encourage you to look around at other tools that are literally at your fingertips. The terminal and shell command line tools. On this episode, you'll meed Jeroen Janssens. He wrote the book Data Science on The Command Line Book and there are a bunch of fun and useful small utilities that will make your life simpler that you can run immediately in the terminal. For example, you can query a CSV file with SQL right from the command line. Links from the show Jeroen's Website: jeroenjanssens.com Jeroen on LinkedIn: linkedin.com Jeroen cohort-based course, Embrace the Command Line. Listeners can use coupon code TALKPYTHON20 for a 20% discount: maven.com Data Science on The Command Line Book: datascienceatthecommandline.com McFly Shell History Tool: github.com Explain Shell: explainshell.com CSVKit: csvkit.readthedocs.io sql2csv: csvkit.readthedocs.io pipx: github.com PyProjec

No Python announcement of 2022 was met with more fanfare than pyscript. This project, announced at PyCon 2022, allows you to write Python files and run them in your browser in place of JavaScript or even with interactions between Python and JavaScript. There was just one catch: The runtime download was a 9MB WebAssembly file. That made its uses quite limited. On this episode, we dive into some news that might change that calculus. The MicroPython and PyScript folks have been teaming up to get PyScript running in the browser on MicroPython. Yes, that's the embedded chip Python. Here's the good news: MicroPython's WebAssembly is just 300k to download and loads in under 100ms. Now that could unlock some possibilities. We have Brett Cannon, Nicholas Tollervey, and Fabio Pliger on the show to discuss. YOUTUBE: id=ABVn6uMG1OI Links from the show Guests and Host Links Brett Cannon: @brettcannon@fosstodon.org Nicholas Tollervey: @ntoll@mastodon.social Fabio Pliger: @b_smoke Michael Kennedy: @mkennedy@f

Wondering what Mastodon is all about? More importantly, what does it offer Python developers and other open source folks compared to Twitter? There is a huge amount of interest in the tech community about what's happening at Twitter and whether they should expand to or even move to a new location. So I decided to put together a set of experienced Python developers who have been Mastodon inhabitants for a long time to discuss what this unexpected shift means for one of our important online watering holes. On this episode you'll meet Gina Häußge, Simon Willison, and Juan Luis Cano Rodríguez. We're going to have a great time talking about the technology and the culture of Mastodon from this Python perspective. Links from the show Gina on Mastodon: chaos.social/@foosel Juan on Mastodon: social.juanlu.space/@astrojuanlu Simon on Mastodon: simonwillison.net/@simon Carol on Mastodon: @willingc@hachyderm.io Michael on Mastodon: fosstodon.org/@mkennedy Talk Python on Mastodon: fosstodon.org/@talkpython Mastodon

If you're a fan of Python's async and await keywords and the powers they unlock, then this episode is for you. We have Timo Furrer here to share a whole bunch of asyncio related Python packages. Timo runs the awesome-asyncio list and he and I picked out some of our favorites to share with you. Links from the show Timo on Twitter: @tuxtimo awesome-asyncio list: github.com Some of the highlighted packages FastAPI: github.com starlette: github.com sanic: github.com uvicorn - The lightning-fast ASGI server: github.com Tech Empower Python Framework benchmarks: techempower.com aioamqp - AMQP implementation using asyncio: github.com pyzmq - Python bindings for ZeroMQ: github.com Scaling Python and Jupyter with ZeroMQ Talk Python episode: talkpython.fm/306 asyncpg - Fast PostgreSQL Database Client: github.com Piccolo - An ORM / query builder: github.com aiosqlite: github.com motor - The async Python driver for MongoDB: github.com AsyncSSH: github.com HTTPX: github.com pytest-asyncio - Pytest support for asyncio: g