

But if the LLM stays in the V-RAM or even just stays in normal RAM does it still benefit from zram? I thought that only helped when the ram was not enough.
So I’d say it is more likely the bore scheduler + better drivers.


But if the LLM stays in the V-RAM or even just stays in normal RAM does it still benefit from zram? I thought that only helped when the ram was not enough.
So I’d say it is more likely the bore scheduler + better drivers.


Basically it compresses your data in the RAM. Needs a little more work form the CPU but it is still faster than swap. fyi


I had zram setup on my previous OS as well and on cachy the LLM didn’t need to use it while on my old OS it did. My guess would be that the driver had a little less overhead.


I did some Benchmarks and CachyOS claims of around 15% more performance seem to be true. Unigin Heavenbenchmark , Super Tuxkart and Furmark all got improved scores compared to PopOS. Additionally Fallout 4 now runs a lot smoother which is probably due to the BORE scheduler doing something better. My local LLMs also seem to be slightly faster and for some reason now need less V-Ram.
Image working in an old building, there is no coffee machine, there is no warm water and if you want to do something new, chances of you getting in trouble because you forgot to mess with CMake or free memory, are high. But the building works since it has been tested for 30 years.
Rust is a new building that you can move over to, there is a coffee machine that is a bit complicated at first but once you understand it it is that bad, there is warm water and you don’t have to mess with CMake or allocate/free memory for everything. But the building is new, there will be issues here and there and sometimes the promised warm water wont work since someone fucked it up, but in general it is just sooooo much more comfy to work in.
Rust is not about making Programming languages fast or memory safe. If you truly want to do that, I recommend doing crack and writing in assembly. It is about making programming easier without sacrificing speed.


Social Credit --;
Yes but my previous OS had zram setup as well, unless PopOS was using a worse compression algorithm, zram was not the main player here. Also there is no such thing as zram for vram unless you are talking about hardware compression.