Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

llama.cpp Watch posted an update

The project has added a lazy mode for tensor reading, exposed as `–lazy-mode` with the `-lzm` shorthand. An earlier commit introduced the option under a different name before the follow-up settled the public flag.

The change gives advanced users more control over when tensors are read, but the upstream record supplies no benchmark or broad performance claim. Treat it as a testable loading option, not a magic faster switch.

If you try it, compare startup behaviour and memory use on the same model and machine before deciding it helps your workflow.

Discuss: Where would lazy tensor reading help your setup most: startup time, memory pressure, remote storage, or nowhere at all?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.