Professor research guide

Sergey Levine

Associate Professor · Electrical Engineering and Computer Sciences

Sergey Levine studies learning methods for autonomous agents at UC Berkeley and is a co-founder of Physical Intelligence, a separate company. This independent guide distinguishes academic RAIL results from Physical Intelligence research.

Official profile ↗

Independent educational guide. Not affiliated with or endorsed by the universities, professors or laboratories described here. This collection reflects the material currently mapped on Socratic Learn.

Associated labs and groups

Your recommended path

Learn this research

Research primer

How Robots Learn

7 lessons · ~37 minutes

A video-first introduction to robot policies, imitation and reinforcement learning, offline learning, goal-conditioned behavior, generative control, and robot foundation models. Academic RAIL research and Physical Intelligence company research are identified separately.

Watch videos
  1. 01From programming robots to teaching robots
  2. 02Imitation learning versus reinforcement learning
  3. 03How can robots learn without millions of dangerous mistakes?
  4. 04How does a robot learn many goals instead of one task?
  5. 05Generative models for robot control
  6. 06Physical Intelligence: building a foundation model for robots
  7. 07Can robots learn from their own experience?

Key concepts

Behavioral cloning and imitation learning

Explain behavioral cloning and compounding error under distribution shift.

Conservative learning and offline-to-online improvement

Explain conservative value estimates and cautious offline-to-online improvement.

Cross-embodiment training and hierarchical control

Explain cross-embodiment data and the subtask-action-observation hierarchy.

Demonstrations, reward feedback, interventions, and continual improvement

Describe the distinct contributions of demonstrations, interventions, and human reward labels.

Diffusion, flow matching, and continuous robot control

Distinguish diffusion and continuous flow matching from language token prediction.

Generative policies and multimodal actions

Explain why averaging distinct valid actions can be unsafe.

Goal-conditioned policies and representations

Explain how a goal changes the action chosen by one policy.

Learning from autonomous robot experience

Explain how autonomous attempts expose policy-specific failures.

Learning-based control versus hand-engineered robotics

Compare learned visuomotor control with an engineered pipeline.

Offline reinforcement learning and distribution shift

Explain why fixed-data learning cannot test an unfamiliar action.

Planning, subgoals, and action chunking

Explain the roles of subgoals and temporally coherent action chunks.

Reinforcement learning, reward, return, and Q-values

Distinguish a demonstration from reward and explain expected return and Q-values.

Robot policies and end-to-end visuomotor learning

Explain a policy and the closed perception-action loop.

Vision-language-action models and robot foundation models

Distinguish a VLM from a VLA and a company goal from demonstrated capability.

Important papers

2023

ViNT: A Foundation Model for Visual Navigation

Shah D, Sridhar A, Dashora N, Stachowicz K, Black K, Hirose N, Levine S

Why this matters: Berkeley / RAIL research. A visual-navigation foundation model evaluated across robot platforms.

2025

Flow Q-Learning

Park S, Li Q, Levine S

Why this matters: Berkeley / RAIL research. Combines a generative policy with value-guided learning.

2025

π*0.6: a VLA That Learns From Experience

Physical Intelligence, Amin A, Aniceto R, Balakrishna A, Black K, et al

Why this matters: Physical Intelligence research: RECAP combines demonstrations, autonomous attempts, interventions, and human outcome labels; not fully autonomous.