Skip to content

Build your first AI agent robot

An agent is an LLM that can act — it reads sensors and moves the robot through tool calls. The PhysiCar panel's Agent tab is a working agent; in this course you turn it into yours.

Chat: watch an agent think

  1. Panel → Agent › Chat. Ask: "Look around and tell me what you see."
  2. The agent calls tools (camera, drive) — each call and result shows inline — then answers. That loop (think → call tool → observe → repeat) is the whole idea of agents.

Realtime: talk to it

  1. Switch to Agent › Realtime and press Start.
  2. Speak: "Drive forward. Stop. What's in front of you?" — the robot acts and answers out loud. Completed voice turns land in the chat thread; both modes share one conversation and the same instructions and tools.

Make it yours

The two levers you own:

  • Instructions — who your agent is and how it behaves.
  • Tools — what it can do; you'll add your own.

Then put both to work: build an agent app by vibe coding.

The theory behind this → Learn: LLM & agents

AI