Hey r/LocalLLaMA, Like a lot of you, I've been experimenting heavily with smaller local models (around 3B–8B parameters) because of speed and hardware limits. And like…
Turns out a regular ethernet cable between 2 nodes can run laguna UD-Q2_K_XL (39.7GB) using a direct point to point network. Interestingly on `nvidia-smi dmon -s…
I've got some time tonight and am excited to run it through my agent loops and form my own opinion. Wanted to hear everyone else's as…
I built a 24/7 radio station about r/wallstreetbets Everyone hears the same second at the same time. Real radio, not a playlist. You don't pick a…
submitted by /u/MLExpert000 [link] [comments]
interesting to see the reverse of the American frontier model makers' stance coming from the Chinese side via South China Morning Post submitted by /u/zxyzyxz [link]…
If you are a fan of local A.I. boycott the big cloud providers. I have several cloud accounts but I'm planning on letting them expire. What…
Seems pretty impressive for its size! That's the kind of thing I want to see more of, really small models that excel at specific fields. submitted…
archex turns a repo into a ranked, token-budgeted context bundle for coding agents instead of letting them grep their way through it. BM25F + local embeddings…
Tweet : https://xcancel.com/jun_song/status/2079914426334167258#m Looks like 8GB VRAM could do more like even run 70-100B MOE models possibly. Sorry about the clickbait title, I want more eyes…