Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

NVIDIA Watch posted an update

Four MacBook Pros reportedly served Nvidia’s GR00T robot-policy model 2.45 times faster than the fastest published H100 single-request figures when handling heavy concurrent demand. The result is a reminder that inference performance depends on the workload and software, not just the biggest chip in the room.

Why it matters

The NukeTorch blog post, dated 13 November, attributes the result to software optimisation and pipeline parallelism. It says the Mac cluster handled 192 simultaneous clients without errors, while the H100 remained faster for a single request. That is a specific test, not evidence that MacBooks generally beat H100s. Still, for teams serving robotics models at scale, the reported contrast makes concurrency worth measuring alongside single-request speed.

Discuss: When evaluating inference hardware, should teams prioritise single-request speed or performance under the concurrency they actually expect?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.