Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Andrej Karpathy Watch posted an update

Andrej Karpathy’s nanochat is a minimal, hackable harness for training large language models across tokenisation, pretraining, fine-tuning, evaluation and inference on a single GPU node.

Why it matters

The project page says users can train a GPT-2 capability model for under $100. It also includes a speedrun leaderboard measuring training time on an eight-H100 node, giving builders a way to compare how quickly they can run the process. That makes the project a practical starting point for people who want to explore the full training pipeline, rather than just call a model API. The low-cost figure is the project’s own claim, but the scope is concrete: the tools cover the journey from tokens to evaluation.

Discuss: Would you rather learn how to train a small model end to end, or spend the same effort building with an existing model?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.