Beyond The Pilot: Enterprise AI in Action

37 Episodes
Subscribe

By: VentureBeat

AI gets real here. On “Beyond the Pilot,” top business execs share what actually happens after the AI proof of concept — from infrastructure and org design to wins, failures, and ROI. Not theory, but deep dives into how they scaled AI that works.

✂️ Clip this podcast
How Clementine is growing Instacart’s baskets with Instacart CTO Anirban Kundu
How Clementine is growing Instacart’s baskets with Instacart CTO Anirban Kundu episode artwork
Today at 11:28 AM

Instacart's CTO stopped his engineers from reading code. 97% of their codebase is now AI-generated — and they've cut the cost of serving Clementine, their AI shopping agent, to one-eighth of what it was eight months ago.

Anirban Kundu (AK), CTO of Instacart, breaks down the internal architecture behind that number. The core insight: the harness matters more than the model. Instacart built a proprietary system called Maverick that routes planning tasks to frontier models and code generation to faster, cheaper open-source models like Luna and DeepSeek — cutting development AI costs by 75% while hitting their highest-ever weekly code merge coun...


How SaaS Wins in World of Agents with BOX CTO Ben Kus
How SaaS Wins in World of Agents with BOX CTO Ben Kus episode artwork
11/05/2026

AI agents can now be weaponized to run elite-level cyberattacks at scale — and your perimeter won't stop them. Box CTO Ben Kus lays out exactly how enterprises defend against agentic threats without locking down the tools their teams actually need.


Ben Kus spent years at IBM's BigFix patching vulnerabilities at enterprise scale. Now at Box — where 95% of the codebase is permissions, security, and compliance — he's dealing with a new threat model: cheap, scalable AI agents that give any attacker access to elite hacking capabilities previously limited to nation-state actors. Only 14% of companies in VentureBeat's Septem...


Why Home Depot Refuses to Build One Big AI Agent
Why Home Depot Refuses to Build One Big AI Agent episode artwork
#19
10/21/2026

Home Depot cut delivery failure rates from 5.3% to 2.8% in Chicago using a purpose-built agentic system — and it's protecting 1.5 million at-risk deliveries a year across weather, geospatial, and customer preference signals.


Home Depot CIO Angie Brown breaks down exactly how the sixth-largest U.S. e-commerce operation ($25B+ in online sales, 2,300+ stores) built its production AI stack from the ground up. The architecture is a layered agent hierarchy: a thin client planner routes to domain agents (selling, post-purchase, delivery), which hand off to fine-grained sub-agents by category — paint, power tools, configurables. Underneath sits a knowledge foundation buil...


AI Engineering: Measure the PRs not the Code
AI Engineering: Measure the PRs not the Code episode artwork
#18
10/14/2026

A $600 day of AI coding spend sounds alarming — until you divide it by the PRs shipped. At ~$30/PR, it reframes the entire ROI conversation: the spend isn't the problem, spend with no return is.

This episode comes from a live panel Sam moderated at VentureBeat Transform, featuring Emilie Schario (Kilo Code, acquired by Anaconda the morning of the panel), Amol Jain (Replit), and Jared Go (Symbiotic). The conversation cuts straight to what agentic coding actually looks like in production — not in demos.

On architecture: Kilo routes across 500+ models and processes 10 trillion tokens/month, using expensive fron...


Routing Wars: Which Model Gets the Workload?
Routing Wars: Which Model Gets the Workload? episode artwork
#17
07/08/2026

66% of enterprise AI teams are actively engineering toward zero human oversight — but only 4.5% fully trust their automated evals. Half have already shipped an agent that passed evals and still failed a real customer.

VentureBeat's latest research exposes a dangerous gap between deployment ambition and evaluation maturity. The most-used eval platform is OpenAI's native tooling. The second most common answer: no dedicated eval platform at all. Meanwhile, 51% of enterprises are relying on a hyperscaler's built-in guardrails as their primary AI security layer — not a deliberate security architecture.

Fable's 19-day market absence changed the conversation. Enterprises that had...


Small Models, Massive Wins: The New Shopify AI Formula
Small Models, Massive Wins: The New Shopify AI Formula episode artwork
#16
06/24/2026

Shopify's distillation pipeline cuts production AI costs by up to 30x — and in some cases, the smaller model outperforms the frontier model on the narrow task. That's not a trade-off. That's a win on accuracy, latency, and cost simultaneously.

Farhan Thawar, VP & Head of Engineering at Shopify, runs AI across one of the largest commerce platforms on earth. In this episode, he breaks down the exact infrastructure decisions Shopify made to avoid being locked into any single model provider — and why 29% of enterprise AI projects die from token costs, not model failure.

Shopify built an inte...


Weaponize Tokenmaxing: MassMutual’s ROI Engine
Weaponize Tokenmaxing: MassMutual’s ROI Engine episode artwork
#15
06/10/2026

If you enjoy these conversations, you need to be in Menlo Park this July.


VB Transform 2026 is VentureBeat's flagship enterprise AI event, built entirely around one question: How do you orchestrate AI autonomy at scale? July 14–15, Hotel Nia. Real projects, proprietary research, no fluff.


50% off for listeners with code BEYONDTHEPILOT: https://bit.ly/4fK4F6z


_

He negotiated seat-based (unlimited) licenses before token costs exploded — and projects only a 20–30% spend increase when that changes. MassMutual's CIO rebuilt a COBOL mainframe app into a work...


Building a 30% Better AI: The Taste Graph Moat
Building a 30% Better AI: The Taste Graph Moat episode artwork
#14
05/27/2026

Pinterest's open-source AI stack costs 90% less than frontier models — and their custom-trained recommender outperforms off-the-shelf alternatives by 30% in accuracy. Pinterest CTO Matt Madrigal breaks down exactly how they did it, and what enterprise AI teams can actually replicate.

Madrigal walks through the full architecture behind Navigator 1, Pinterest's conversational shopping assistant built on Qwen 3 VL — and the specific decision to rip out its native vision encoder and replace it with PinCLIP, Pinterest's proprietary multimodal embedding layer. That swap alone closes a 20x inference latency gap and makes the economics work at 620 million monthly active users. This is the clea...


GPU Hoarding is Over. The $401B Reality Check
GPU Hoarding is Over. The $401B Reality Check episode artwork
#13
05/13/2026

Enterprise GPU hoarding is over. LinkedIn CTO Erran Berger and VentureBeat analyst Rob Strechay break down what comes next — and the infrastructure math most enterprises are only now being forced to confront.

VentureBeat's Q1 research shows GPU availability anxiety dropped from 20.8% to 15.4% among enterprise teams, while cost-per-inference and TCO concerns jumped from 34% to 41% — a number that's still climbing. The hoarding phase is giving way to an audit phase, and the companies that didn't build the instrumentation to understand their workloads are now paying for it.

Erran Berger explains how LinkedIn runs one of the few rema...


Agents Ate the UI: Data is Your Only Moat with LlamaIndex
Agents Ate the UI: Data is Your Only Moat with LlamaIndex episode artwork
04/29/2026

The CEO who built one of the most-starred RAG frameworks on GitHub (47,000 stars) just publicly declared that frameworks like his are becoming obsolete — and then pivoted his entire company around that conclusion.

Jerry Liu, CEO and co-founder of LlamaIndex, joins Matt Marshall and Sam Witteveen to explain exactly what broke in the AI stack, why 95% of his team's code is now AI-generated, and where the real defensibility in enterprise AI infrastructure actually lives in 2026.

The conversation covers the specific architectural shift that made RAG orchestration frameworks less central: agent reasoning has improved to the point wh...


The Protocol Stack AI Is Missing
The Protocol Stack AI Is Missing episode artwork
#11
04/15/2026

Cisco's OutShift deployed a multi-agent network configuration system that raised error detection from 10–15% to 100% and cut full change validation from 2–3 weeks to 6–7 minutes. The reason it worked — and why most enterprise multi-agent deployments still fail — comes down to a single gap nobody is talking about: agents can connect, but they cannot think together.

Vijoy Pandey, SVP and General Manager of OutShift by Cisco, joins Matt and Sam to explain why A2A, MCP, and existing agent protocols solve connectivity but leave out an entire layer: shared cognition. OutShift's research identifies this as a missing "Layer 9" — a semantic and cognitiv...


100M Agents: Scaling the New Execution stack with Intuit
100M Agents: Scaling the New Execution stack with Intuit episode artwork
#10
04/01/2026

A QuickBooks customer discovered significant fraud by asking their AI assistant follow-up questions about transaction amounts that didn't add up. This isn't a demo — it's one of 3 million customers now using Intuit's AI agents in production, with 80.5% returning to use them again.

Marianna Tessel, EVP and GM of QuickBooks (formerly CTO of Intuit), walks through the architecture decisions behind one of the first enterprise AI deployments at true scale. Intuit's "done-for-you" agents now automate book closing, reconciliation, transaction categorization, and payroll — but the breakthrough came when they realized chatbots alone weren't enough. Businesses wanted human experts integrated dire...


The AI War For Your Personal Context
The AI War For Your Personal Context episode artwork
#9
03/18/2026

Major SaaS companies including Salesforce, Intuit, and ServiceNow saw stock drops of 45-50% as enterprises shift from bloated software suites to personalized AI agents that users can control directly. Microsoft just capitulated this week, opening Copilot to allow Claude Cowork-style functionality — a clear signal that the "build vs. buy" calculus for enterprise software has fundamentally changed.

Matt Marshall and Sam Witteveen break down why personalization is no longer optional for enterprise products. Companies like Zoom now offer personalized workflows that access your conversation history and profile context. Infrastructure decisions are moving fast: token budgets must account for pe...


LangChain: What OpenClaw Got Right (And Why Enterprises Can't Have It)
LangChain: What OpenClaw Got Right (And Why Enterprises Can't Have It) episode artwork
#8
03/04/2026

LangChain told employees they cannot install OpenClaw on company laptops due to "massive security risk" — yet this unhinged approach is exactly what makes it work. Harrison Chase unpacks why OpenClaw succeeds where AutoGPT failed, and why context engineering, not just smarter models, separates demo agents from production-ready systems.

The shift is architectural: Modern agent harnesses like Claude Code now dump 40,000-token API responses to file systems instead of cramming them into message history. LangChain's Deep Agents framework emerged from reverse-engineering Claude Code, Codex, and Deep Research — discovering they all use planning via to-do lists, subagents for focused work...


LexisNexis on Why Standard RAG Fails in Law
LexisNexis on Why Standard RAG Fails in Law episode artwork
#7
02/18/2026

On February 2nd, a single plugin wiped nearly $800 billion off the enterprise software market. Wall Street is terrified that AI agents are about to eat the legal industry's lunch. But LexisNexis isn't scared—they're building the moat.


In this episode of Beyond the Pilot, Min Chen (Chief AI Officer, LexisNexis) reveals the sophisticated architecture they built to counter the "LLM wrapper" revolution. Moving beyond standard RAG, Min breaks down their move to "GraphRAG", their deployment of Agentic workflows (using Planner and Reflection agents), and why they created a proprietary "Usefulness Score" because standard accuracy me...


Mastercard's 160 Billion Transactions: AI's Biggest Test
Mastercard's 160 Billion Transactions: AI's Biggest Test episode artwork
#6
02/04/2026

While most of the world is still running GenAI pilots, Mastercard is running AI inference on 160 billion transactions a year—with a hard latency limit of 50 milliseconds per score.

In this episode of Beyond the Pilot, Johan Gerber (EVP of Security Solutions) and Chris Merz (SVP of Data Science) open the hood on one of the world's largest production AI systems: Decision Intelligence Pro. They reveal how they moved beyond legacy rules engines to build Recurrent Neural Networks (RNNs) that act as "inverse recommenders"—predicting legitimate behavior faster than the blink of an eye.

AI Gets...


Inside LinkedIn’s AI Engineering Playbook
Inside LinkedIn’s AI Engineering Playbook episode artwork
#5
01/21/2026

While the rest of the industry chases massive models, LinkedIn quietly achieved a major engineering breakthrough by going small.

In this episode of Beyond the Pilot, Erran Berger (VP of Product Engineering, LinkedIn) opens the "cookbook" on how they distilled massive 7B parameter models down to ultra-efficient 600M parameter "student" models—scaling AI to 1.2 billion users without breaking the bank.

AI Gets Real Here. This isn't theory. Erran details the exact architecture, the "Multi-Teacher" distillation process, and the organizational shift that forced Product Managers to write evals instead of specs.

In this episode, we...


Most enterprise AI agents are Slop - here’s why they fail
Most enterprise AI agents are Slop - here’s why they fail episode artwork
#4
01/07/2026

The "TAM" for AI Agents isn't software. And there is a $10 Trillion opportunity.

In this episode, Replit CEO Amjad Masad reveals why 99% of today's enterprise AI agents are just "Slop"—unreliable, generic toys that fail in production. We dive deep into the engineering reality of building autonomous agents that actually work, moving beyond simple chatbots to systems that can navigate the messy reality of enterprise infrastructure.

Amjad breaks down Replit’s "Computer Use" hack that makes agents 10x cheaper than generic models, explains why "Vibe Coding" is the future of the C-Suite, and issues a warn...


How JPMorgan Engineered a 30K AI Agent Economy
How JPMorgan Engineered a 30K AI Agent Economy episode artwork
#3
12/17/2025

Inside the 'Agent Economy': How 30,000 AI Assistants Took Over JPMorgan

While most enterprises were scrambling after ChatGPT launched, JPMorgan Chase was already two years ahead. 🚀

In this episode of Beyond the Pilot, we sit down with Derek Waldron, Chief Analytics Officer at JPMorgan Chase, to reveal how the world’s largest bank built an internal AI platform that is now used by 1 in 2 employees daily.

Derek shares the contrarian insight that drove their strategy: AI models are commodities; the real moat is connectivity.

Learn how they scaled from zero to 250,000+ users, why t...


How Booking.com Boosted Agent Accuracy 2x with Mini LLMs with Pranav Pathak
How Booking.com Boosted Agent Accuracy 2x with Mini LLMs with Pranav Pathak episode artwork
#2
12/03/2025

We built AI agents by accident... and it worked. 🤯

In this episode of VentureBeat’s Beyond the Pilot, we go inside the engineering brain of Booking.com with Pranav Pathak (Director of Product Machine Learning). Pranav reveals how they "stumbled" into agentic architectures before the term even existed, how a simple text box revealed a massive missed revenue opportunity (the "Hot Tub" story), and exactly how they stack LLMs, RAG, and Orchestrators to handle millions of travelers without breaking the bank.

If you are building Enterprise AI, this is the blueprint for moving from "cool demo"...


NOTION - Unpacking Ryan Nystrom's AI Journey: From Challenges to Custom Agents
NOTION - Unpacking Ryan Nystrom's AI Journey: From Challenges to Custom Agents episode artwork
#1
11/19/2025

In our inaugural episode, we sit down with Ryan Nystrom, leader of the AI team at Notion, to pull back the curtain on Notion 3.0. Ryan reveals the journey of integrating powerful AI agents into the productivity platform and draws fascinating parallels between the current AI era and the mobile revolution he witnessed at Instagram. He shares exclusive insights into the development challenges, the critical role of tools, context, and curation, and how custom agents are poised to reshape work. Plus, Ryan offers essential advice for any company diving into the AI space.

Learn more about...


Venture Beat in Conversation: MongoDB - From Lift-and-Shift to AI-Ready Data
10/20/2025

Lift-and-shift isn’t enough. MongoDB’s Vinod Bagal breaks down how to modernize your data for AI — and why waiting could cost you your competitive edge.


Host: Sean Michael Kerner

Guest: Vinod Bagal


For more stories visit venturebeat.com

Learn more about your ad choices. Visit megaphone.fm/adchoices


FBI Veterans on AI Cyber Threats & Future Defenders
10/13/2025

AI is accelerating the cyber arms race — and former FBI agents Paul Bingham and Mike Morris say most enterprises aren’t ready. In this VB in Conversation, they break down the real-world threats targeting critical infrastructure, how AI is changing the attack surface, and why smart, layered defense starts with training the next-gen cyber workforce.

Learn more about your ad choices. Visit megaphone.fm/adchoices


AI CHAT: 70% of Enterprises Adopt AI Agents: The Real-World Impact
10/08/2025

Key Insights and Takeaways from VentureBeat Transform Event: AI and Enterprise Innovation In this episode, Matt and Sam recount their experiences and insights from the recent VentureBeat Transform event, an annual gathering focused on enterprise AI. They discuss the significant takeaways, including the increasing adoption of AI agents in production, the lack of dominance by any single hyperscaler in the AI model space, the focus on practical AI solutions over super-intelligence hype, and the evolving structure of teams in the AI-driven workplace. Highlights include insights from speakers at major companies like American Express, Google, IBM, and Zoom, as well...


Visa’s $3.5B Bet on AI
10/06/2025

Visa’s SVP of Data & AI, Sam Hamilton, joins VentureBeat to break down the hidden costs, trade-offs, and infrastructure realities behind running over 400 AI solutions incorporating 300 AI models at global scale.

Learn more about your ad choices. Visit megaphone.fm/adchoices


AI CHAT: Interview with Richard Seroter: Unveiling Google Cloud's AI Strategy
10/01/2025

Google Cloud Next: In-Depth Discussion with Chief Evangelist Richard Seroter Join us for an exclusive interview with Richard Seroter, Chief Evangelist of Google Cloud, as he discusses the latest developments and insights from Google Cloud Next. Dive into conversations about AI advancements, the new agent development kit, and the multi-agent protocol, and how they are reshaping the future of cloud services and enterprise solutions. Learn about the balance between pre-built and custom agents, and Google's commitment to open-source and multi-cloud flexibility. Don't miss out on this insider look at the cutting edge of AI and cloud technology. 00:00 Introduction and...


The AI Surge Is Coming — Is Your Network Ready?
09/29/2025

Cisco’s Anurag Dhingra joins VentureBeat’s Matt Marshall to unpack what it means to build a truly AI-ready network. From smart switching to agentic operations, Dhingra explains how enterprises must stay ahead of surging network demands — and why network intelligence is now foundational to scaling AI.

Learn more about your ad choices. Visit megaphone.fm/adchoices


AI CHAT: The Future of AI Agents: How Napkin AI Is Redefining Design
09/24/2025

Exploring Napkin.ai: Revolutionizing Graphic Design with AI Agents Join Matt Marshall, founder and CEO of VentureBeat, and Sam Witteveen as they interview Pramod Sharma, CEO of Napkin.ai, and co-founder Jerome Scholler, about their innovative AI-powered graphic design tool. Discover how Napkin.ai has rapidly grown to 2 million beta users with its unique ability to transform text into compelling graphics effortlessly. Learn about the sophisticated backend structure involving multiple specialized AI agents and the recently introduced custom styles feature that allows users and companies to define and perfect their graphic outputs. Perfect for anyone interested in the future...


From RSAC 2025 - Inside the Cybersecurity-First AI Model & Built in, Always on
From RSAC 2025 - Inside the Cybersecurity-First AI Model & Built in, Always on episode artwork
09/22/2025

Part 1: Inside the Cybersecurity-First AI Model

LLMs are inherently non-deterministic — but more data isn’t always better. As Cisco’s Jeetu Patel explains, Cisco Foundation AI distilled 900 billion tokens down to the most relevant 5 billion to create the industry’s first AI model purpose-built for security.


Part 2: AI Security: Built-in, Always-On

Cisco’s Tom Gillis and Splunk’s Mike Horn reveal how distributed enforcement, self-upgrading firewalls, and AI-powered infrastructure are redefining security architecture and transforming what a SOC can do in the AI era.

Learn more about your a...


Credit Karma’s path to scalable AI
Credit Karma’s path to scalable AI episode artwork
09/17/2025

Originally published in September 2024 As orgs race to progress from proof-of concept to full, scalable production in AI, there are many lessons and resets. Key to these are choices made around infrastructure. Intuit’s Credit Karma, with over 100 million users, has been one of AI’s success stories. Vishnu Ram, Credit Karma’s VP of Engineering, spoke with VB about those lessons – and how the learning will continue.

Learn more about your ad choices. Visit megaphone.fm/adchoices


Inside the Super Bowl’s cyber war: NFL CISO on AI threats, deepfakes and defending the big game
Inside the Super Bowl’s cyber war: NFL CISO on AI threats, deepfakes and defending the big game episode artwork
09/15/2025

NFL CISO Tomás Maldonado speaks with VentureBeat about defending Super Bowl LIX from adversarial attacks that potentially include weaponized AI, endpoint attacks, deepfakes, and finely tuned social engineering – and require collaboration with the FBI and Secret Service.

Learn more about your ad choices. Visit megaphone.fm/adchoices


Handling Greater Demands in the Data Center with Ken Spangler, FedEx
Handling Greater Demands in the Data Center with Ken Spangler, FedEx episode artwork
09/13/2025

Originally Published in July 2023 FedEx handles 100 billion daily transactions, from tracking packages to routing flights. To keep up with this massive data demand, the company has invested in data center performance, especially in high-performance computing. Ken Spangler, EVP of IT and CIO of Global Operations Technology, FedEx, talks with VB Editor-in-Chief Matt Marshall about how the company has adopted the co-location model for the data center, which allows it to leverage the benefits of cloud computing while maintaining control of the technology stack. He also reveals how FedEx is partnering with edge computing providers to deploy “mini data centers” that...


Payment giant Paypal tackles the data sustainability challenge
Payment giant Paypal tackles the data sustainability challenge episode artwork
09/13/2025

Originally published in October 2023 VentureBeat Editor-in-Chief Matt Marshall talks with Archana Deskus, EVP & CIO of Paypal, on how the payment giant, with more than 400 million users, is meeting the need for more computation, more power and more storage, particularly during peak periods — all while committing to sustainability and greater efficiency. Deskus dives into bursting capacity, data center consolidation, asset utilization, efficient code and more.

Learn more about your ad choices. Visit megaphone.fm/adchoices


Gen AI: What the enterprise is getting right, and wrong
Gen AI: What the enterprise is getting right, and wrong episode artwork
09/13/2025

Originally Released in February 2024 In his role as Global Leader for Tech and Digital Advantage at the Boston Consulting Group, Vlad Lukic has overseen hundreds of AI deployments. Now working with scores of enterprise companies racing to embrace gen AI, he finds that critical considerations are often overlooked, such as readiness of data and pivotal financial factors. Missteps such as deploying AI where it’s not really needed and neglecting the essential task of managing organizational change for seamless AI adoption can also tank the best intentions to capitalize on gen AI. He also has lots of advice on ho...


eBay doubles down on data efficiency
eBay doubles down on data efficiency episode artwork
09/13/2025

Originally published in October 2023 VentureBeat Editor-in-Chief Matt Marshall talks with Mazen Rawashdeh, SVP & CTO of eBay, about how one of the world’s largest online marketplaces is using innovative technologies to power its data centers and reduce its environmental impact while meeting the growing demand for data processing in the age of generative AI. Rawashdeh explores the importance of fungibility between CPUs and GPUs, hybrid cloud, open source, running their data centers on 85% utilization and more.

Learn more about your ad choices. Visit megaphone.fm/adchoices


Handling Greater Demands in the Data Center with Kamran Ziaee, Verizon
Handling Greater Demands in the Data Center with Kamran Ziaee, Verizon episode artwork
09/13/2025

Originally published in July 2023 Kamran Ziaee, SVP, Technology Strategy & Global Infrastructure at Verizon sits down with VB Editor-in-Chief Matt Marshall to discuss how data centers now must handle greater and greater demands. While high-performance computing used to be reserved for exceptionally data-intensive applications, like gene sequencing or self-driving cars, every industry is seeing real use cases for adopting HPC. Verizon is an example of a company that says HPC is now table stakes for many applications it runs in its data centers. While Verizon has consolidated down to three data centers from nine, it has also invested in multi-access...


Scaling Up with Databricks: Achieving the potential of generative AI
Scaling Up with Databricks: Achieving the potential of generative AI episode artwork
09/10/2025

Originally Released in October 2023

How do companies identify the best uses cases for gen AI — and then navigate the complexity of AI-first products and tools to drive that innovation at scale? VB’s editorial director, Michael Nuñez, speaks with Databricks co-founder Reynold Xin and Vijoy Pandey, SVP at Outshift by Cisco, about the many factors that will determine how organizations succeed, or don’t, during a time of, as Xin says, bottom-up innovation.

Learn more about your ad choices. Visit megaphone.fm/adchoices