minus-squarewraekscadu@vargar.orgtoLinux@lemmy.ml•Which specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?linkfedilinkarrow-up2arrow-down1·5 days agoDepends on how big your local LLM model is. You can easily run 2-3B param models on a potato. BUT, the model is shit. linkfedilink
minus-squarewraekscadu@vargar.orgtolinuxmemes@lemmy.world•Gimme! Gimme! Gimme!linkfedilinkarrow-up27·1 month agoPeak linkfedilink
Depends on how big your local LLM model is. You can easily run 2-3B param models on a potato. BUT, the model is shit.