Scaling RL Rollouts: Agent-Native Infrastructure with Daytona
Ivan Burazin, Daytona
Abstract:
In this talk, we’ll outline why a new class of agent-native infrastructure is emerging, what problems it is designed to solve, and the core use cases driving it, from autonomous coding agents to large-scale evaluation and training workloads. Daytona is an agent-native control plane designed to orchestrate isolated, stateful sandbox environments at scale. We’ll break down the infrastructure challenges behind isolation, state management, and massive parallelism, and why traditional VM and container stacks fall short. As a concrete example, we’ll walk through scaling RL rollouts, showing how tens of thousands of environments can be provisioned and orchestrated in minutes as part of a high-throughput RL pipeline.
Bio:
Ivan Burazin is the co-founder and CEO of Daytona, one of the fastest-growing infrastructure companies of its generation. Daytona is building agent-native cloud infrastructure that enables AI agents to securely run, fork, and manage stateful runtime environments at scale. Backed by $31M, including a $24M Series A led by FirstMark Capital, Daytona powers millions of sandboxes per day for startups and Fortune 500 companies building autonomous AI systems. Previously, Ivan co-founded Codeanywhere, one of the first cloud IDEs (2009), and created Shift, Europe’s leading developer conference, acquired by Infobip in 2021. He later joined Infobip’s executive board as Chief Developer Experience Officer.
This event is organized by Columbia's Data, Agents, and Processes Lab (DAPLab). For more information about the series, see https://daplab.cs.columbia.edu/entrepreneurship.
The Columbia Engineering AI Entrepreneurship Series is a bi-weekly speaker series that brings students and faculty at Columbia together with founders, VCs, technologists, and business leaders to learn about the process of transitioning lessons from research and the classroom into products and value.