Researchers found some LLMs create four times the amount of CO2 emissions than other models with comparable accuracy. Their findings allow users to make informe
You can run a model locally on your phone and it will answer most prompts without breaking a sweet, it’s actually way less energy than googling and loading the content from a website that’s hosted 24/7 just waiting for you to access the content.
You can run a model locally on your phone and it will answer most prompts without breaking a sweet, it’s actually way less energy than googling and loading the content from a website that’s hosted 24/7 just waiting for you to access the content.
Training a model is expensive, using it isn’t.
I would like to learn about this a bit more, I keep hearing it in conversations here and there. Do you have links around studies/data on this?
Can you link me to what model you are talking about? I experimented with running some models on my server, but had a rather tough time without a GPU.
Nice claim you have there. Do you have anything to back that up?
If it’s so easy, it shouldn’t be hard for you to link a model like that.