On-Site Humanoid Robot Task Test
Record a real workflow, turn it into a common test script, and compare whether different humanoid robots can complete the job on site.
When a factory, warehouse, or lab is preparing to trial humanoid robots, the responsible team records a real workflow and adds details such as floor material, obstacles, and safety constraints. The product breaks that workflow into required robot actions and produces a test script that can be scored on site. Each vendor demonstrates against the same script, with failures tied to specific steps.
The result is a comparable answer to whether a robot can perform the job, rather than a promotional video that is difficult to reproduce.
Why now
On July 17, 2026, Agility opened a new facility for humanoid-robot skill training, testing, and customer-site capability development, making the question of how to validate real tasks concrete again. S1 In the subsequent U.S. Science-category observation window, “humanoid robots” recorded 1,000+ searches and 200% growth. Interest had fallen back by 9:30 PM UTC on July 19, so this should be treated as 168 hours of short-term attention through 12:33 AM UTC on July 20, not evidence of durable demand.
Target user
Factory automation leads, warehouse engineering managers, lab operations leads, and safety assessors planning a humanoid-robot PoC. They would use it before inviting vendors to demonstrate, or when explaining each vendor’s failure points to a procurement committee.
Minimal entry point
Start with one fixed-camera video and a site-constraints form. Use the Gemini API to extract action segments and timestamps, then have the on-site lead confirm each step, pass criterion, and prohibited action before generating a mobile scorecard and comparison report. The first version need not integrate with robot control systems. The Gemini API already supports video description, segmentation, information extraction, and timestamp references. S2
Punching above its weight
Publish anonymized test scripts as searchable templates for box moving, machine tending, sorting, inspection, and similar tasks. Offer a white-label version to robot systems integrators and industrial safety consultants for presales site surveys and customer acceptance.
Competitors & gaps
- NIST Assembly Task BoardsGoogle
- These task boards emphasize repeatable assembly actions and standardized metrics, but test predesigned standard workpieces rather than an end-to-end real workflow from the customer’s site. S3
- HumanoidBenchGoogle
- It is designed for algorithm research and whole-body control tasks in simulation, not real-site constraints, on-site safety conditions, or cross-vendor acceptance by a buyer. S4
- Vendor-customized PoCs and systems-integrator acceptance testsGoogle
- These can assess a specific robot in a defined setting, but vendors often use different demo scopes and pass criteria, leaving the buyer to assemble comparable results separately.
How it makes money
Charge per evaluation project: customers buy a test script, on-site scorecard, and cross-vendor comparison report for one real workflow. Additional sites, workflows, or robots under test are billed separately.
The case against
A single video cannot reveal critical conditions such as payload, friction, object deformation, emergency-stop distance, or failure recovery. If on-site engineers still need to rewrite every action and safety criterion, automated script generation merely organizes meeting materials instead of reducing evaluation costs.