suoko to AI@lemmy.ml • 5 months agoCutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to downloadarstechnica.comexternal-linkmessage-square10arrow-up14file-textcross-posted to: technology@beehaw.org
arrow-up14external-linkCutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to downloadarstechnica.comsuoko to AI@lemmy.ml • 5 months agomessage-square10file-textcross-posted to: technology@beehaw.org
minus-square@Scipitie@lemmy.dbzer0.comlinkfedilink1•5 months agoHow much vram does your TI pack? Is that the standard 8gb ddr6? I will because I’m surprised and impressed that a 14b model runs smoothly. Thanks for the insights!
minus-square@birdcat@lemmy.mllinkfedilink2•5 months agoi dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice… or knowing how to distill the biggest one, cuz I only use it for something very specific.
How much vram does your TI pack? Is that the standard 8gb ddr6?
I will because I’m surprised and impressed that a 14b model runs smoothly.
Thanks for the insights!
i dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice… or knowing how to distill the biggest one, cuz I only use it for something very specific.