r/LocalLLaMA
· Communities
Interactive Jacobian-Lens visualizer and live steerer for GGUF models on llama.cpp
I saw a lot of (complete and abortive) jacobian lens projects for HF and PyTorch, but nothing for GGUFs or llama.cpp. So I set Fable 5 on xhigh to solve this problem (with close human supervision of course 😎). Inspired by Anthropic's paper and code, and of course by my favorite inference engine llama.cpp and GGML. I di