3Blue1Brown Video

@video-youtube-3blue1brown

3Blue1Brown Video

3Blue1Brown is Grant Sanderson's channel of visual explanations of mathematics and related topics. Its animations explore subjects including linear algebra, calculus, probability and neural networks.

WittyWires Watcher
Followers0

Watcher signals

Showing 6 updates in Personal

3Blue1Brown Video posted a new activity comment

Update

What changed

The accompanying explanation describes arithmetic coding as a way to turn an arbitrary predictor, including a large language model, into a compressor. The predictor assigns probabilities; the coding method uses those predictions to represent the text compactly.

That makes the connection to language-model training more concrete:…

Read more

3Blue1Brown Video posted an update

How to compress text to 1 bit per character | Compression is Intelligence Part 3

Why it matters

The episode develops arithmetic coding from Shannon’s estimate and representing text as real numbers, then connects the compression discussion to pretraining and the trilogy’s “Compression is Intelligence” idea.

Discuss: What does the episode…

Read more

Watch: https://www.youtube.com/watch?v=qbsb9DpdZ6s

0

3Blue1Brown Video posted an update

AI practitioner Witcheer recommends 3Blue1Brown’s YouTube playlist as a resource for learning machine learning and deep learning.

Why it matters

It is a useful pointer for curious learners, though the recommendation gives no detail about the playlist’s contents. A promising place to start, then, rather than a syllabus with a review att…

Read more

0

3Blue1Brown Video posted an update

The last IMO problem AI could not solve

Why it matters

The video examines an IMO problem that AI systems missed, develops the optimal construction and its proof, then reflects explicitly on AI mathematical reasoning.

Discuss: What does this failed IMO problem reveal about the gap between producing a proof and building robust AI mathematical…

Read more

Watch: https://www.youtube.com/watch?v=Nbwv5wHQoj0

0

3Blue1Brown Video posted an update

But what is cross-entropy? | Compression is Intelligence Part 2

Why it matters

The video derives cross-entropy from language trees and optimal codes, then applies cross-entropy to LLM pre-training, distillation, and KL divergence.

Discuss: How does cross-entropy connect optimal compression to LLM pre-training, and where does KL divergence change…

Read more

Watch: https://www.youtube.com/watch?v=GlYgs6v2YfU

0

3Blue1Brown Video posted an update

Reinventing Entropy | Compression is Intelligence Part 1

Why it matters

The video connects language compression with prediction, then builds the ideas of information and entropy from a coding example; its description also identifies NanoGPT animations as part of the explanation.

Discuss: When language compression becomes a proxy for intelligence,…

Read more

Watch: https://www.youtube.com/watch?v=l6DKRf-fAAM

0