Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 9 months agoSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comexternal-linkmessage-square30fedilinkarrow-up1293arrow-down115
arrow-up1278arrow-down1external-linkSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 9 months agomessage-square30fedilink
minus-squareDarkThoughts@fedia.iolinkfedilinkarrow-up2arrow-down1·9 months agoHopefully we see more specific hardware for this. Like extension cards with pretty much just tensor cores and their own ram.
minus-squaretopinambour_rex@lemmy.worldlinkfedilinkEnglisharrow-up1·9 months agoGraphic cards without video connection exists since a while.
minus-squareDeceptichum@kbin.sociallinkfedilinkarrow-up1·9 months agoI’d love to see some consumer level AI stuff, sadly it all seems to be designed for server farms and by the time it ages out into consumer prices it’s so obsolete there’s no point in getting it.
minus-squareDarkThoughts@fedia.iolinkfedilinkarrow-up1·9 months agoIt’s not quite consumer level I’d say but Coral.ai has some small Google Edge based TPUs.
minus-squareraldone01@lemmy.worldlinkfedilinkEnglisharrow-up1·9 months agoDo they want consumer ai cards to exist though? Think about the data!
minus-squareDeceptichum@kbin.sociallinkfedilinkarrow-up1·9 months agoCard makers? They only want money, if theres enough consumer level demand they will make them.
Hopefully we see more specific hardware for this. Like extension cards with pretty much just tensor cores and their own ram.
Graphic cards without video connection exists since a while.
I’d love to see some consumer level AI stuff, sadly it all seems to be designed for server farms and by the time it ages out into consumer prices it’s so obsolete there’s no point in getting it.
It’s not quite consumer level I’d say but Coral.ai has some small Google Edge based TPUs.
Do they want consumer ai cards to exist though?
Think about the data!
Card makers? They only want money, if theres enough consumer level demand they will make them.
I guess your right.