I have a memory consumption issue with Ubuntu, because I stupidly set up the system to have 0 swap. This means under high memory pressure, the entire system could suddenly crash.
To be fair, Windows isn’t a shining beacon either because whenever I attempt something very GPU intensive like running local LLMs the GPU overheats in a split second before the fans have time to spin up and the entire system shuts down.
So the system is a gaming laptop which might explain things. The CPU has liquid metal for cooling and a lower TDP so it’s fine. Whereas the GPU has a higher TGP and if ran hard draws like 120W. If the GPU fans are not already on this quickly overwhelming the GPU thermally.
Weird. If I was going to saturate my GPU, I’d pick an intensive game. Seems odd that a gaming laptop might get overwhelmed and shut off if a game is too intensive? Or is is something special about LLMs that make it the Archilles’ heel?
I’m not the type to run super intensive games, and even those games have plenty of warm up time in the form of a loading screen.
That being said, I have had instances of my entire system shutting down due to a graphically intensive game, but it’s much rarer than when running a local LLM.
I have a memory consumption issue with Ubuntu, because I stupidly set up the system to have 0 swap. This means under high memory pressure, the entire system could suddenly crash.
To be fair, Windows isn’t a shining beacon either because whenever I attempt something very GPU intensive like running local LLMs the GPU overheats in a split second before the fans have time to spin up and the entire system shuts down.
How does that happen? Shouldn’t the GPU and CPU have thermal throttling so even under intense loads it just slows down to keep temps down?
When I play games on my laptop the integrated graphics are at 100% most of the time but it doesn’t cause the system to crash.
So the system is a gaming laptop which might explain things. The CPU has liquid metal for cooling and a lower TDP so it’s fine. Whereas the GPU has a higher TGP and if ran hard draws like 120W. If the GPU fans are not already on this quickly overwhelming the GPU thermally.
Weird. If I was going to saturate my GPU, I’d pick an intensive game. Seems odd that a gaming laptop might get overwhelmed and shut off if a game is too intensive? Or is is something special about LLMs that make it the Archilles’ heel?
I’m not the type to run super intensive games, and even those games have plenty of warm up time in the form of a loading screen.
That being said, I have had instances of my entire system shutting down due to a graphically intensive game, but it’s much rarer than when running a local LLM.
Just enable zram. It’s super easy to set up too.
How do I do that?