Allen Institute for AI Watch posted an update
The Allen Institute for AI says NVIDIA used its MolmoSpaces benchmark to evaluate the GR00T 2 robot model, alongside three other benchmarks: RoboCasa365, RoboLab and RoboDojo.
Why it mattersAi2 says MolmoSpaces is open, allowing teams to test robot policies against the same simulated homes, objects and tasks. Shared test settings make comparisons more useful than a parade of results from incompatible virtual worlds. It is a modest but concrete sign of an open robotics benchmark being used in a major model evaluation.
Discuss: Could shared simulations make robot comparisons fairer, or do they risk rewarding systems that perform well only in the test environment?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.