Stamets@lemmy.world to People Twitter@sh.itjust.works · 11 months agoThe dreamlemmy.worldimagemessage-square31fedilinkarrow-up134arrow-down12
arrow-up132arrow-down1imageThe dreamlemmy.worldStamets@lemmy.world to People Twitter@sh.itjust.works · 11 months agomessage-square31fedilink
minus-squarearthurpizza@lemmy.worldlinkfedilinkEnglisharrow-up1·11 months agoThose server farms are because the needs of corporations might just be different from the needs of regular users. I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago. It’s almost as if technology can get better and more efficient over time.
Those server farms are because the needs of corporations might just be different from the needs of regular users.
I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.
It’s almost as if technology can get better and more efficient over time.