r/LocalLLaMA
· Communities
macbook unified memory + big LLM’s + heat
Hi Folks, I see a lot of folks talking about how they are able to load massive llm models coz they have unified memories. projects like ds4 etc claim to be running super massive llm's. however per my experiment loading rear full ram models means high heat and macbook pro's reach 100 degrees C easily while doing such co