DEV

40 Episodes
Subscribe

By: Eric Lamanna

Software and AI development podcast. We cover all things software development, including today's advanced AI development tricks and techniques.

โœ‚๏ธ Clip this podcast
Document Automation Software: 20 Platforms That Could Win Back Your Time
Today at 12:10 AM

Document creation is one of the most persistent, invisible productivity drains in business โ€” proposals, contracts, invoices, and reports rebuilt from scratch day after day. This episode of Development uses the 20 best document automation platforms as a jumping-off point to explore what these tools really do, what separates the standout platforms from the mediocre ones, and how to build a practical framework for choosing the right fit.

The episode covers a wide range of platforms and use cases, including:

What document automation software actually does โ€” from AI-driven drafting and templating to e-signatures, compliance features, and async collaboration tool...


85 Million IPs and Counting: The Case for Rotating Residential Proxies
Yesterday at 10:45 PM

Getting blocked mid-scrape is one of the most common โ€” and most avoidable โ€” failures in data engineering. This episode of Development takes a clear-eyed look at why IP visibility is the root cause of most pipeline failures at scale, and how rotating residential proxies address that problem in a way that static pools and datacenter IPs simply can't. The full argument is laid out in the rotating residential proxies deep-dive article that forms the basis for this discussion.

The episode covers a lot of ground, from fundamentals to real-world infrastructure considerations:

Why single or small-pool IPs fail at s...


The Context Problem: Why Your AI Agent Keeps Getting It Wrong
Last Tuesday at 12:08 AM

Demos lie. An AI agent can look flawless in testing and then consistently produce confident, plausible, wrong answers the moment it touches real work. This episode of Development digs into the single most common โ€” and most expensive โ€” failure mode teams encounter when deploying AI agents inside their businesses: the context problem. It's not about the model. It's about what the agent actually knows when it has to make a decision.

The episode covers what context really means for an AI agent in production, why the gap between what you assume the agent knows and what it actually has...


The 30-Day Response, Budgeted Backwards
Last Monday at 1:29 AM

Most proposal teams treat the federal government's 30-day minimum response window as a schedule โ€” spending time from the front until it runs out. This episode of Development examines what changes when you reverse that logic entirely, drawing on this worked example of budgeting a 30-day RFP response backwards. The math is simple; the implications for how teams allocate drafting, review, and decision time are anything but.

The episode walks through two versions of the same 30-day window โ€” one that drifts, one that's deliberately shaped โ€” and traces what a shift of just four days between phases actually produces at sub...


The Complete List of Programming Languages 2025: What You Need to Know
Last Sunday at 2:20 AM

Not all programming languages are created equal โ€” and in 2025, the gap between choosing the right one and the wrong one can mean the difference between a system that scales and one that fails. This episode of Development cuts through the noise to examine the languages actually shaping modern software, drawing on the complete 2025 programming language guide to deliver a clear-eyed look at where each language fits, what it costs, and what it's worth.

Here's what the episode covers:

C and C++ โ€” why two languages from the 1970s and 80s still underpin embedded systems, high-frequency trading, and AAA...


The SaaS Audit: How to Find the Tools Worth Replacing First
Last Saturday at 2:29 AM

Most small and mid-sized businesses carry a SaaS stack that feels both essential and absurd at the same time. Some of those subscriptions are load-bearing walls; others are doing something a weekend script could handle. The hard part isn't knowing that the bloat exists โ€” it's knowing where to cut first, and in what order, without breaking anything that actually matters. This episode of Development walks through a structured audit methodology designed for operators who want answers, not abstractions.

The episode covers a repeatable framework for evaluating every tool in your stack and sequencing replacements intelligently:

Why co...


Bid/No-Bid Is Arithmetic Before It Is Judgment
Last Friday at 1:07 PM

Most bid/no-bid conversations jump straight to judgment โ€” incumbency risk, relationships, competitive fit โ€” without ever running the numbers that should come first. This episode of Development makes a case that's simple but easy to overlook: arithmetic is the gate, and judgment is only useful once a pursuit clears it. The discussion is grounded in the bid/no-bid arithmetic article from RFP.co, which lays out the underlying model in full.

Here's what the episode covers:

The expected-value formula. A bid's worth equals the probability of winning multiplied by the contract's margin contribution, minus the fully loaded cost...


Why AI Won't Replace Manual QA Anytime Soon
Last Friday at 3:32 AM

As AI tools take on more of the software development lifecycle, it's tempting to assume quality assurance is next on the automation chopping block. But a closer look at what QA actually demands โ€” curiosity, empathy, judgment, and collaboration โ€” reveals a much more complicated picture. This episode of Development digs into the case for why manual QA remains essential, even as AI-powered testing tools grow more capable by the month.

The episode walks through four core reasons why human testers can't simply be swapped out for automated systems, covering everything from the limits of trained models to the irre...


Web Development Trends Shaping 2026 and Beyond
08/06/2026

The gap between websites that feel polished and purposeful and those that feel dated is growing fast โ€” and the difference often comes down to a handful of deliberate choices. This episode of Development works through the top 20 web development trends for 2026 and beyond, separating the durable shifts from the passing fads and offering a grounded look at what's actually defining the modern web.

Here's what the episode covers:

High-contrast design: Why today's dark-mode aesthetic is more sophisticated โ€” and more accessible โ€” than its early-2000s predecessor, and how off-black, off-white, and intentional accent colors are driving it.Single...


Python in 2025: Why the World's Favorite Language Keeps Getting Better
08/05/2026

Python has quietly become the connective tissue of modern software. It powers platforms used by hundreds of millions of people, sits at the heart of the AI revolution, and remains the go-to language for data scientists and financial analysts worldwide. This episode of Development digs into the key Python development trends shaping 2026ย โ€” examining not just how popular the language is, but why that popularity keeps compounding.

Here's what the episode covers:

Python's real-world footprint: From Instagram and Spotify to Dropbox and Uber, the episode maps out just how much of the software world already runs on Pyt...


Why Your AI Is Slower Than a 1998 Modem โ€” And How to Fix It
08/04/2026

A model that aces every benchmark but makes users wait five seconds for a response isn't ready for production โ€” it's a liability. This episode of Development tackles one of the most common and costly gaps in modern AI deployment: the difference between a transformer model that works and one that works fast enough. Drawing from this in-depth guide on optimizing transformer models for low-latency inference, the episode walks through why inference is so expensive by design, and what engineering teams can realistically do about it.

Here's what the episode covers:

Why transformers are inherently compute-hungry โ€” every toke...


Fine-Tuning LLaMA 3 With LoRA: Making AI Work for Your World
08/03/2026

General-purpose language models are impressive until you need them to be specific. This episode of Development examines how teams can close the gap between what LLaMA 3 knows broadly and what a real-world application demands, using a technique that has quietly made fine-tuning accessible to organizations well outside Big Tech. The discussion is grounded in this practical guide to fine-tuning LLaMA 3 on a custom dataset with LoRA โ€” a step-by-step resource for developers ready to move from experimentation to execution.

The episode walks through the full arc of a fine-tuning project, from understanding why specialization matters to the realities of...


FAISS and HNSW: The Duo Making Vector Search Actually Scalable
08/02/2026

Vector search sits at the heart of modern AI applications, but the gap between a working prototype and a production-ready system can be enormous. This episode of Development digs into the engineering reality of similarity search at scale, drawing on this deep-dive on implementing HNSW with FAISS for scalable AI to explain why the tools most teams start with eventually betray them โ€” and what to use instead.

The episode traces the full arc of the vector search problem: from naive approaches that collapse under real-world data volumes, through the seductive-but-limited world of tree-based indexes, and finally into th...


When One AI Agent Just Isn't Enough: Multi-Agent Collaboration With AutoGPT
08/01/2026

Scaling an AI workflow beyond a single agent sounds like a natural next step โ€” until you're wrangling shared memory pools, circular communication loops, and agents that flatly disagree with each other. This episode of Development digs into the real engineering work behind multi-agent collaboration, drawing on this in-depth guide to implementing multi-agent systems with AutoGPT to unpack what it actually takes to make autonomous agents cooperate at scale.

AutoGPT is more than a GPT wrapper โ€” it's a modular framework with persistent memory, recursive task planning, and full agent lifecycle management. But out of the box, it doesn't hand...


Building an AI Code Refactoring Tool With GPT 5.6 Sol
07/31/2026

Legacy codebases don't clean themselves โ€” but what if an AI could do the heavy lifting? This episode of Development digs into the architecture, tradeoffs, and hard-won lessons behind building a custom AI-powered code refactoring tool using GPT 5.6 Sol. Drawing from this in-depth guide to building an AI code refactoring tool, the episode goes well beyond the hype to examine what a real, production-minded implementation actually requires.

The conversation covers the full lifecycle of designing a controlled, auditable refactoring pipeline โ€” from defining goals precisely enough for a language model to act on them, to keeping GPT from wandering into...


Stop Whack-a-Mole: Using Reinforcement Learning to Scale Microservices
07/30/2026

Kubernetes autoscaling works โ€” until it doesn't. For teams managing microservices under unpredictable, spiky traffic, the gap between a metric crossing a threshold and new pods actually serving users is exactly where incidents are born. This episode of Development examines whether reinforcement learning can close that gap for good, drawing on this deep-dive article on optimizing microservices scaling with RL as its foundation.

The conversation covers both the promise and the genuine difficulty of applying RL to infrastructure, walking through everything from the conceptual model to real-world implementation concerns. Here's what's unpacked:

Why rule-based autoscaling structurally lags be...


Building a Custom AI Code Refactoring Tool With GPT-4-Turbo
07/29/2026

Technical debt doesn't clean itself โ€” but what if a well-engineered AI tool could do most of the heavy lifting? This episode of Development examines the practical architecture behind a custom GPT-4-Turbo refactoring tool, drawing on this deep-dive article on building a custom AI code refactoring tool. It's a candid look at what it genuinely takes to turn a powerful language model into something trustworthy enough to run against a real codebase.

The episode walks through four interconnected layers of the problem โ€” goal definition, prompt engineering, pipeline architecture, and output validation โ€” covering:

Defining the scope precisely: "Make t...


When Your AI Forgets the World Changed: Data Drift Detection Explained
07/28/2026

A machine learning model can be technically flawless the day it ships and still become a liability six months later โ€” not because anyone broke it, but because the world it was trained on no longer exists. This episode of Development tackles one of the most underappreciated threats to production AI systems: data drift. Drawing on this in-depth guide to implementing online monitoring pipelines for AI systems, the episode walks through why drift happens, how to recognize its different forms, and what a practical, engineering-first response actually looks like.

Here's what the episode covers:

What data drift re...


Real-Time ML Inference: Wrangling Kafka and TensorFlow Serving
07/28/2026

Real-time machine learning inference has moved from a competitive advantage to a baseline expectation. This episode of Development tackles the architectural and operational realities of building a streaming inference pipeline โ€” one that can ingest live events, score them against an ML model, and return predictions in milliseconds. The discussion is grounded in the deep-dive on streaming ML inference with Kafka and TensorFlow Serving and covers everything from initial design decisions to the production pain points that only reveal themselves under real traffic.

Here's what this episode walks through:

Why real-time inference matters: Use cases like fraud de...


Why Deploying LLMs on Serverless Is a Beautiful Disaster
07/26/2026

Serverless computing promises infinite scale, zero infrastructure management, and pay-per-use economics โ€” so the idea of running a large language model on top of it is understandably tempting. But the gap between that pitch and production reality turns out to be enormous. This episode of Development unpacks the very real architectural friction explored in this deep-dive on deploying large language models in serverless environments, walking through the core challenges and the hybrid strategies that actually hold up at scale.

The conversation covers a lot of ground for engineers weighing up this architectural choice:

Cold starts as a de...


The Future of Coding Is No Coding at All โ€” And Why Developers Need to Adapt Now
07/26/2026

The rise of no-code and low-code platforms isn't a passing trend โ€” it's a structural change in how software gets built. This episode of Development draws on the article exploring why coders need to adapt to a no-code world to examine what this shift actually means for working developers: not the end of the profession, but a fundamental redefinition of where developer value lives.

Hosts walk through the economic logic behind the no-code movement, the tools reshaping production workflows, and the specific skills that will separate indispensable developers from those who get left behind. Key topics include:

Wh...


Custom Tokenization Pipelines: The NLP Skill You Can't Afford to Skip
07/24/2026

Tokenization is the step most NLP developers treat as an afterthought โ€” until their model starts mangling stock tickers, shredding hashtags, and treating multi-word entities like random word salad. This episode of Development makes the case that tokenization is a foundational design decision, not a checkbox, drawing on this in-depth guide to building custom tokenization pipelines for NLP models. If your model's behavior has ever felt inexplicably broken despite clean-looking data, the tokenizer is almost certainly where the story starts.

The episode walks through the full landscape of tokenization approaches and explains why knowing the trade-offs โ€” not just the...


Stop Writing API Docs by Hand โ€” Let AI Do the First Draft
07/23/2026

Every developer knows the feeling: the code ships clean, the tests pass, and then the documentation tab sits open, untouched, for days. API docs have a way of drifting out of sync with the codebase almost immediately after they're written โ€” and the real cost isn't inconvenience, it's the compounding miscommunication that erodes team trust over time. This episode of Development explores how large language models are changing that dynamic by handling the grunt work of the first draft, drawing on this in-depth look at automating API documentation with AI.

Here's what the episode covers:

Why manual do...


Training a Diffusion Model from Scratch: A Developer's Real Guide
07/22/2026

Most developers who work with generative AI stop at the API layer โ€” and that's fine, until curiosity kicks in. This episode of Development pulls back the curtain on what it genuinely takes to train a diffusion model from the ground up, drawing on the step-by-step guide to training a diffusion model for custom image generation published at DEV. Whether the goal is a specialized creative tool, a proprietary image pipeline, or simply a deeper understanding of how these systems work, this episode treats the topic with the seriousness it deserves โ€” no hand-waving, no skipped steps.

Here's what the...


Neural Network Quantization: Shrinking Models Without Losing Accuracy
07/21/2026

Deploying a well-trained machine learning model to a resource-constrained environment โ€” a smartphone, an IoT sensor, or a cost-sensitive cloud setup โ€” often reveals a painful gap between a model's theoretical requirements and what real hardware can deliver. This episode of Development tackles that gap head-on, exploring how neural network quantization makes production AI more practical across the board. The discussion is drawn from this in-depth article on reducing model size without losing accuracy, and goes further by walking through the tradeoffs developers actually face in the field.

Here's what the episode covers:

What quantization actually does: How conv...


AI-Powered Linting: Smarter Static Code Analysis With Machine Learning
07/20/2026

Traditional linters are reliable workhorses, but they can only flag what someone thought to write a rule for. This episode of Development explores what happens when you pair static code analysis with machine learning โ€” moving beyond deterministic rule enforcement toward a tool that can recognize subtle, historically problematic patterns the way a seasoned developer does. The discussion is grounded in this deep-dive on building an AI-powered linter with ML models, and goes further into the practical decisions teams face when taking this approach seriously.

Here's what the episode covers:

Why traditional linters hit a ceiling: Rule-based an...


Edge AI Explained: Running Smarter Models on Tiny Devices
07/19/2026

Running intelligence directly on constrained hardware โ€” smartwatches, industrial sensors, smart cameras โ€” is no longer a niche research problem. It's a core skill for modern developers. This episode of Development digs into the practical side of edge AI, drawing on the in-depth guide to integrating AI in edge computing and IoT to explain what it actually takes to deploy capable models on devices with severe memory, power, and connectivity limits.

Here's what the episode covers:

Why edge AI matters now: The core case for moving inference closer to where data is generated โ€” cutting latency, protecting user privacy, and re...


Best Web Development Stacks to Use in 2026
07/18/2026

Stack decisions are among the most consequential choices a developer or technical founder makes โ€” and they're often made too quickly, too early, or for the wrong reasons. This episode of Development uses the best web development stacks guide for 2026 as its foundation, offering a structured tour of today's most relevant technologies and a practical framework for choosing between them before a single line of code is written.

The episode moves through the three layers of the modern web stack โ€” front end, back end, and full stack โ€” comparing the leading options at each level, then closes with four decisi...


Why Your GPU Is Loafing: Optimizing Deep Learning Training at Scale
07/17/2026

Provisioning a powerful GPU only to watch utilization flatline is one of the most common โ€” and costly โ€” frustrations in deep learning. This episode of Development digs into the systemic reasons why large-scale training runs underperform, drawing on this in-depth guide to optimizing GPU utilization for large-scale deep learning models. Rather than hunting for a single silver-bullet fix, the episode frames GPU performance as an interconnected system where small inefficiencies compound โ€” and where targeted, methodical changes add up fast.

Here's what the episode covers:

Data pipeline bottlenecks: Why a slow or single-threaded data loader is often the first...


Zero-Copy Data Pipelines: What Apache Arrow Actually Does for ML
07/16/2026

Data wrangling is the silent tax on every machine learning project โ€” endless format conversions, redundant buffer copies, and library-to-library shuffling that eats hours without producing a single model improvement. This episode of Development takes a practical look at Apache Arrow and the zero-copy pipeline architecture it enables, drawing on this deep-dive article on zero-copy data pipelines for ML workloads to separate genuine capability from inflated hype.

The episode walks through how Arrow works, why its columnar memory layout is a natural fit for ML workloads, and โ€” most valuably โ€” systematically dismantles five misconceptions that are keeping developers from adopti...


Why Custom CUDA Kernels Could Be Your Deep Learning Secret Weapon
07/15/2026

GPU hardware is only as useful as the code running on it. For deep learning teams chasing faster training loops and tighter inference times, the bottleneck isn't always the model or the data pipeline โ€” sometimes it's the abstraction layer between your workload and the silicon. This episode of Development explores building custom CUDA kernels for deep learning performance, making the case that going low-level isn't just for systems programmers โ€” it's a practical tool for anyone serious about squeezing the most out of their GPU.

The episode walks through the full arc of writing, integrating, and optimizing a cust...


What Your Food Truck Website Is Missing โ€” And Why It Matters
07/14/2026

Great food alone doesn't keep customers coming back โ€” they have to be able to find you first, and then stay connected between visits. This episode of Development explores how food truck owners can transform a bare-bones website into a 24/7 business-building tool, drawing on 11 essential elements for a food truck website to help operators close the gap between good food and loyal regulars.

The conversation covers a wide range of practical, actionable improvements โ€” from the basics that most food truck sites get wrong to the softer touches that quietly build community. Here's what's discussed:

Real-time location and sche...


Writing Efficient Memory Allocators for PyTorch Extensions
07/13/2026

Building a custom PyTorch extension is hard enough โ€” but for engineers targeting specialized hardware or unconventional data pipelines, the default memory management layer can quietly become the biggest performance bottleneck of all. This episode of Development draws on this in-depth guide to writing efficient memory allocators for PyTorch extensions to walk through everything from the fundamentals of PyTorch's memory model to practical pooling strategies, debugging techniques, and the discipline of knowing when not to over-engineer.

Here's what the episode covers:

When custom allocators are actually necessary โ€” the specific scenarios (hardware alignment requirements, repetitive tensor shapes, unusual data...


AI-Assisted Data Labeling: How Active Learning Loops Change the Game
07/12/2026

For most machine learning teams, the real bottleneck isn't compute power or model architecture โ€” it's labeled data quality. This episode of Development digs into how active learning loops are reshaping the data annotation process, drawing on this in-depth article on AI-assisted data labeling to make the technique feel practical and immediately applicable, not just academically interesting.

Rather than front-loading an entire labeling budget on a massive, undifferentiated dataset, active learning lets the model itself surface the examples it's most uncertain about โ€” sending only those to human annotators, retraining, and repeating. The episode walks through the anatomy of that...


Checkpoint Versioning for Continual Learning Pipelines
07/11/2026

Managing checkpoints in a continual learning pipeline is one of those engineering problems that feels like housekeeping โ€” until it isn't. When a production model misbehaves at 2 a.m. and your checkpoint directory is a graveyard of files named "final_really_this_time.pt," the cost of poor versioning becomes very real, very fast. This episode walks through the key ideas from this deep-dive on managing checkpoint versioning for continual learning pipelines, translating seven concrete practices into a framework any ML team can adopt incrementally.

Unlike models that train once and ship once, continual learning systems produce fresh ch...


ONNX + TensorRT: The Smart Path to Faster AI Inference
07/10/2026

Getting a deep learning model to perform well in training is one challenge โ€” getting it to run efficiently in production is a different beast entirely. This episode of Development tackles that gap head-on, exploring the powerful combination of ONNX and TensorRT as a practical path to faster, leaner inference. The discussion is grounded in this in-depth guide to runtime optimization of ONNX models with TensorRT, and covers everything from the fundamentals to the real-world trade-offs engineers face on the way to production.

Here's what the episode covers:

What ONNX actually solves โ€” how this open, framework-agnostic format brid...


Multi-GPU Training With Model Parallelism in DeepSpeed
07/09/2026

Modern AI models have grown far beyond what a single GPU can hold in memory โ€” and that's not a problem you can optimize your way out of on one device. This episode of Development tackles the architecture, tooling, and practical considerations behind multi-GPU training, using Microsoft's DeepSpeed framework as the focal point. It's grounded in this in-depth guide to multi-GPU training with model parallelism, which is worth having open alongside your own training setup.

The episode walks through the full picture โ€” from why model scale has made distributed training a necessity, to the key parallelism strategies, to what...


Why Your LLM Service Needs an Async Prompt Queue
07/08/2026

Shipping an LLM-powered product is one thing โ€” keeping it responsive when traffic spikes is another challenge entirely. This episode of Development digs into a foundational infrastructure decision that separates hobby demos from production-grade AI services, drawing on this practical deep dive into async LLM serving architecture published on DEV. If your service handles user-submitted prompts synchronously today, this episode explains exactly why that will eventually break and what to build instead.

Here's what the episode covers:

Why synchronous serving fails at scale โ€” LLM inference can take seconds or minutes per request; a synchronous thread-per-request model hits a ha...


Compressing Transformer Models With Weight Clustering
07/07/2026

Large Transformer models like BERT and GPT have redefined what's possible in natural language processing โ€” but their enormous parameter counts create serious deployment headaches. Memory constraints, sluggish inference, and ballooning cloud costs can make shipping a production-ready model feel like an engineering wall. This episode of Development digs into weight clustering, a compression technique that doesn't always get the attention it deserves but can meaningfully reduce model size while preserving the accuracy that makes these models worth using. The discussion draws on this in-depth look at compressing Transformer models with weight clustering from DEV.

Here's what the ep...


Building a Static AI Code Assistant with Tree-Sitter and ASTs
07/06/2026

Inheriting a messy, multi-language codebase is one of those challenges that used to mean hours of manual archaeology. This episode of Development explores a more intelligent approach: a static AI code assistant powered by abstract syntax trees (ASTs) and Tree-sitter. The discussion is grounded in this practical deep-dive on building a static AI code assistant, and it covers everything from the foundational concepts to real-world deployment in a CI/CD pipeline.

Here's what the episode walks through:

Why text-based search falls short: Regex and keyword searches can't distinguish a "return" statement from the word "return" in...