suoko to AI@lemmy.ml • 6 months agoCutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to downloadarstechnica.comexternal-linkmessage-square10arrow-up14file-textcross-posted to: technology@beehaw.org
arrow-up14external-linkCutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to downloadarstechnica.comsuoko to AI@lemmy.ml • 6 months agomessage-square10file-textcross-posted to: technology@beehaw.org
minus-squaresuokoOPlinkfedilink0•6 months agoYou still need an expensive hardware to run it. Unless myceliumwebserver project will start
minus-square@Scipitie@lemmy.dbzer0.comlinkfedilink1•6 months agoHow much vram does your TI pack? Is that the standard 8gb ddr6? I will because I’m surprised and impressed that a 14b model runs smoothly. Thanks for the insights!
minus-square@birdcat@lemmy.mllinkfedilink2•5 months agoi dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice… or knowing how to distill the biggest one, cuz I only use it for something very specific.
You still need an expensive hardware to run it. Unless myceliumwebserver project will start
Removed by mod
How much vram does your TI pack? Is that the standard 8gb ddr6?
I will because I’m surprised and impressed that a 14b model runs smoothly.
Thanks for the insights!
i dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice… or knowing how to distill the biggest one, cuz I only use it for something very specific.