Skip to content
r/LocalLLaMA · Communities

What "task oriented" models are folks running on N100 MiniPCs with 16GB of RAM and no GPU?

By "task oriented", I dont really mean agentic, I mean no deep coding ability, no need for conversation. More things like classification, identification, simple interaction with web apps and APIs, etc... I run YOLO8 locally for image classification, but now I am starting do other things in my homelab that need some ver