LIVE AT APP.VOXEL51.COM
10 MINUTES · ZERO CODE

10 Prompts, Zero Code

A fast tour of the FiftyOne Agent, live, in the real app, on real datasets.

Adonai Vera
ML Engineer & DevRel, Voxel51
# no setup, just ask
"Summarize the robot tasks
in this dataset."
THE DATA BEHIND IT

100% of teams report underperforming models

The causes are almost always data problems, not model problems.

39%
of ML teams' time spent wrangling data
97%
of teams struggle to iterate on datasets
100%
of teams report underperforming models

Top causes of underperforming models

Insufficient training data for specific scenarios
57%
Data quality issues (occlusions, lighting, artifacts)
48%
Domain shift between training and real-world data
43%
Annotation errors or inconsistencies
32%
Class imbalance in training data
31%
10 PROMPTS, ZERO CODE
WHY THIS MATTERS

One request should replace three scripts

Fragmented tools, manual processes, brittle integrations, that's how most vision pipelines still run. Watch the left column become the right one, same tools, wired into one agent.

Before · 5 scripts, 5 terminals, 0 memory between them

filter_low_conf.py
--dataset bdd100k --thresh 0.4
compute_embeddings.py
--model clip-vit-base32
run_eval.py
--pred yolo --gt truth, paste into Slack
dedupe_check.py
--method embeddings --thresh 0.92
export_coco.py
--split val, hand off to annotation team

After · 1 request, full context, same underlying tools

Agent, live

"Filter low-confidence detections, cluster them by embedding, and tell me which classes need more data."

That's the whole pitch: turn your left column into your right column.
10 PROMPTS, ZERO CODE
WHO'S TALKING

Building the FiftyOne Agent, in the open

Everything today, the tools, the skills, the MCP wiring, comes from building this for real, mistakes included.

Adonai Vera

AdonAI Vera

ML Engineer & DevRel, Voxel51

Creator of Voxel51 Agent
Google Developer Expert, AI/ML
QR code to Adonai's LinkedIn
Follow me on LinkedIn
10 PROMPTS, ZERO CODE

FiftyOne as the Harness

One surface for data, models, and the agent that works them, side by side.

THE COMPUTER VISION DATA OS

FiftyOne is the harness where you and your agent work the data

Curation, annotation, data generation, evaluation, and multimodal: five real product surfaces, each usable by a person, a script, or the same agent.

FiftyOne App with the Voxel Agent chat panel open
Embeddings scatter plot colored by class label in the FiftyOne App

Curation

Distribution, diversity, dedup, and label-quality checks across images, video, 3D, and audio.

X-ray with agent-generated fracture detection boxes and confidence score

Annotation

Agentic auto-labeling and intelligent QA that catches annotation errors at scale.

Satellite imagery dataset with a geo map panel in the FiftyOne App

Data Generation

Audits and enriches sensor data into simulation-ready 3D reconstructions.

FiftyOne Model Evaluation panel with precision, recall, and support metrics

Evaluation

Aggregate metrics down to sample-level diagnostics, model versus ground truth, side by side.

LiDAR point cloud with 3D cuboid detections alongside camera view in the FiftyOne App

Multimodal

Camera, LiDAR, and sensor streams synchronized on one timeline, searchable by embedding.

The same five surfaces, worked by a person, a script, or an agent, with the same data underneath.
10 PROMPTS, ZERO CODE

The Anatomy of an Agent

What's actually running when you hit enter.

AGENT = LLM + TOOLS + SKILLS + MCP

Your agent is only as good as the tools you give it

Intelligence plans and decides. Execution is where it touches your data, and where tools, skills, and MCP all live.

Skillsplaybooks
Memoryorg/user/dataset
Visual Inputvision context
Multi-Providerany LLM
Docs SearchKapa Agent, live docs
AGENT

the loop that ties it together

MCP80+ operators
Guardrailsallow/confirm/block
Code Executionescape hatch
Plugin GenerationPython + hybrid JS
10 PROMPTS, ZERO CODE
YOUR TURN

You can try this right now

Try the Agent on our platform. Open it on your phone, save the URL, and start typing while I keep going.

QR code to link.voxel51.com/ado link.voxel51.com/ado →
10 PROMPTS, ZERO CODE

Now, Live

Six real datasets, six real prompts, app.voxel51.com the whole way.

LIVE · THE SIMPLE ONE

Ask it to summarize, and mean it

Robotics Droid · multimodal robot-demo data, no schema to learn.

# the prompt, typed live
Summarize the robot tasks in this dataset.

Open live at

app.voxel51.com/datasets/robotics-droid/samples?prompt=Summarize+the+robot+tasks+in+this+dataset
10 PROMPTS, ZERO CODE
LIVE · COUNT AND CLASSIFY

Count the aircraft, then tell me which ones matter

RarePlanes · satellite imagery, military identification in one ask.

# the prompt, typed live
Find the image with the most aircraft and tell me if any of them are military.

Open live at

app.voxel51.com/datasets/rareplanes-5k/samples?prompt=Find+the+image+with+the+most+aircraft...
10 PROMPTS, ZERO CODE
LIVE · ROOT CAUSE

Find the outlier, then explain it

Robotics Droid · peak joint torque, cross-referenced with task and outcome.

# the prompt, typed live
Find the episode with the highest peak joint torque and tell me what task it was performing and whether it succeeded.

Open live at

app.voxel51.com/datasets/robotics-droid/samples?prompt=Find+the+episode+with+the+highest...
10 PROMPTS, ZERO CODE
LIVE · RANK AND TAG

Find the violations, rank them, tag them

Learning to Drive · actual speed against the posted limit, across every episode.

# the prompt, typed live
Find episodes where the vehicle's actual speed exceeded the road's posted speed limit, rank them by how much over, and tag the worst ones for review.

Open live at

app.voxel51.com/datasets/l2d-750/samples?prompt=Find+episodes+where+the+vehicle...
10 PROMPTS, ZERO CODE
LIVE · COMPOSITE SCORING

Combine three risk signals into one judgment call

Learning to Drive · speed, lighting, and surface condition, scored together.

# the prompt, typed live
Find the 5 most hazardous-looking episodes, combine high speed, poor lighting, and bad surface conditions, and open them so I can see them.

Open live at

app.voxel51.com/datasets/l2d-750/samples?prompt=Find+the+5+most+hazardous...
10 PROMPTS, ZERO CODE
LIVE · DIVERSITY AT A GLANCE

One sample per condition, laid out for you

PandaSet · a representative episode for every weather condition, side by side.

# the prompt, typed live
Pick one representative episode for each weather condition and lay them out so I can see our weather diversity at a glance.

Open live at

app.voxel51.com/datasets/pandaset-detection/samples?prompt=Pick+one+representative+episode...
10 PROMPTS, ZERO CODE
LIVE · IS THIS TRAIN-READY?

Would capping your biggest class even help?

Any dataset you open · a real training-readiness question, answered on the spot.

# the prompt, typed live
Is our category split balanced enough to train on, or is one category going to dominate, and if I capped the biggest category to match the smallest, how many images would I lose?

Open live at

app.voxel51.com/datasets/pandaset-detection/samples?prompt=Is+our+category+split+balanced...
10 PROMPTS, ZERO CODE
MORE TO TRY

If there's time, ask one of these

Same agent, same app, different datasets.

"Show me samples where the animals are running" · Animal Pose Benchmark

"Show me episodes with repeated grasps" · Robotics Droid

"Show me samples where predictions differ from ground truth" · PhenoBench

"Find duplicate images in this dataset" · works on any dataset you open

10 PROMPTS, ZERO CODE

This is how physical AI gets built

Real robots, real vehicles, real sensors, all live on production app.voxel51.com. Every link on this screen works. Use it on your next call.

QR code to book a demo
Book a demo