Track_Shovel to Lemmy Shitpost@lemmy.worldEnglish • 4 months agoHexadecimalslrpnk.netimagemessage-square129arrow-up1834
arrow-up1834imageHexadecimalslrpnk.netTrack_Shovel to Lemmy Shitpost@lemmy.worldEnglish • 4 months agomessage-square129
minus-square@MasterNerd@lemm.eelinkfedilink3•4 months agoDepends on how many parameters you want to use. I can run it with 8billion on my laptop.
Don’t you need a beefy GPU to run local LLMs?
Depends on how many parameters you want to use. I can run it with 8billion on my laptop.