In this episode, we chat with Roy Ben-Alta, co-founder of Oakminer AI and former director at Meta AI Research, about his fascinating journey through the evolution of data infrastructure and AI. We explore his early days at AWS when cloud adoption was still controversial, his experience building large language models at Meta, and the challenges of training and deploying AI systems at scale. Roy shares valuable insights about the future of data warehouses, the emergence of knowledge-centric systems, and the critical role of data engineering in AI. We'll also hear his practical advice on building AI companies today, including thoughts on model evaluation frameworks, vendor lock-in, and the eternal "build vs. buy" decision. Drawing from his extensive experience across Amazon, Meta, and now as a founder, Roy offers a unique perspective on how AI is transforming traditional data infrastructure and what it means for the future of enterprise software.

Chapters

00:00 Introduction to Roy Benalta and AI Background
04:07 Warren Buffett Experience and MBA Insights
06:45 Lessons from Amazon and Meta Leadership
09:15 Early Days of AWS and Cloud Adoption
12:12 Redshift vs. Snowflake: A Data Warehouse Perspective
14:49 Navigating Complex Data Systems in Organizations
31:21 The Future of Personalized Software Solutions
32:19 Building Large Language Models at Meta
39:27 Evolution of Data Platforms and Infrastructure
50:50 Engineering Knowledge and LLMs
58:27 Build vs. Buy: Strategic Decisions for Startups

In this episode, we chat with Nitzan Shapira, co-founder and former CEO of Epsagon, which was acquired by Cisco in 2021. We explore Nitzan's journey from working in cybersecurity to building an observability platform for cloud applications, particularly focused on serverless architectures. We learn about the early days of serverless adoption, the challenges in making observability tools developer-friendly, and why distributed tracing was a key differentiator for Epsagon. We discuss the evolution of observability tools, the future impact of AI on both observability and software development, and the changing landscape of serverless computing. Finally, we hear Nitzan's current perspective on enterprise AI adoption from his role at Cisco, where he helps evaluate and build new AI-focused business lines.

03:17 Transition from Security to Observability
09:52 Exploring Ideas and Choosing Serverless
16:43 Adoption of Distributed Tracing
20:54 The Future of Observability
25:26 Building a Product that Developers Love
31:03 Challenges in Observability and Data Costs
32:47 The Excitement and Evolution of Serverless
35:44 Serverless as a Horizontal Platform
37:15 The Future of Serverless and No-Code/Low-Code Tools
38:15 Technical Limits and the Future of Serverless
40:38 Navigating Near-Death Moments and Go-to-Market Challenges
48:36 Cisco's Gen .AI Ecosystem and New Business Lines
50:25 The State of the AI Ecosystem and Enterprise Adoption
53:54 Using AI to Enhance Engineering and Product Development
55:02 Using AI in Go-to-Market Strategies

From GPU computing pioneer to Kubernetes architect, Brian Grant takes us on a fascinating journey through his career at the forefront of systems engineering. In this episode, we explore his early work on GPU compilers in the pre-CUDA era, where he tackled unique challenges in high-performance computing when graphics cards weren't yet designed for general computation. Brian then shares insights from his time at Google, where he helped develop Borg and later became the original lead architect of Kubernetes. He explains key architectural decisions that shaped Kubernetes, from its extensible resource model to its approach to service discovery, and why they chose to create a rich set of abstractions rather than a minimal interface. The conversation concludes with Brian's thoughts on standardization challenges in cloud infrastructure and his vision for moving beyond infrastructure as code, offering valuable perspective on both the history and future of distributed systems.

Links:
Brian Grant LI

Chapters

00:00 Introduction and Background
03:11 Early Work in High-Performance Computing
06:21 Challenges of Building Compilers for GPUs
13:14 Influential Innovations in Compilers
31:46 The Future of Compilers
33:11 The Rise of Niche Programming Languages
34:01 The Evolution of Google's Borg and Kubernetes
39:06 Challenges of Managing Applications in a Dynamically Scheduled Environment
48:12 The Need for Standardization in Application Interfaces and Management Systems
01:00:55 Driving Network Effects and Creating Cohesive Ecosystems

Click here to view the episode transcript.