Stamets@lemmy.world to People Twitter@sh.itjust.works · 1 year agoThe dreamlemmy.worldimagemessage-square31fedilinkarrow-up139arrow-down12
arrow-up137arrow-down1imageThe dreamlemmy.worldStamets@lemmy.world to People Twitter@sh.itjust.works · 1 year agomessage-square31fedilink
minus-squarearthurpizza@lemmy.worldlinkfedilinkEnglisharrow-up1·1 year agoThose server farms are because the needs of corporations might just be different from the needs of regular users. I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago. It’s almost as if technology can get better and more efficient over time.
Those server farms are because the needs of corporations might just be different from the needs of regular users.
I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.
It’s almost as if technology can get better and more efficient over time.