Running AI is so expensive that Amazon will probably charge you to use Alexa in future, says outgoing exec::In an interview with Bloomberg, Dave Limp said that he “absolutely” believes that Amazon will soon start charging a subscription fee for Alexa
We need to move AI from the cloud to our own hardware running in our homes. Free, open source, privacy focused hardware. It’ll eventually be very affordable.
deleted by creator
Yes, and you can run a language model like Pygmalion Al locally on koboldcpp and have a naughty AI chat as well. Or non sexual roleplay
deleted by creator
Never underestimate human ingenuity
When they’re horny
Which models do you think beat Pygmalion for erotic roleplay? Curious for research haha
deleted by creator
Oh I see, sorry for the repeat question. Thanks!
deleted by creator
GPT4All is a neat way to run an AI chat bot on your local hardware.
deleted by creator
it does have a very funny name though
You’re probably right, but I kinda hope you’re wrong.
deleted by creator
Call it paranoia if you want. Mainly I don’t have faith in our economic system to deploy the technology in a way that doesn’t eviscerate the working class.
deleted by creator
Don’t these models require rather a lot of storage?
Storage is getting cheaper every day and the models are getting smaller with the same amount of data.
I’m just curious - do you know what kind of storage is required?
deleted by creator
Yeah that’s not a lot. I mean… the average consumer probably has 10GB free on their boot volume.
It is a lot to download. If we’re talking about ordinary consumers. Not unheard of though - some games on Steam are 50GB+
So okay, storage is not prohibitive.
God I wish, I would just love local voice control to turn my lights and such on and off… but noooooooooooo
https://www.home-assistant.io
I have home assistant, but have not heard anything good about rhasspy. Just want to control lights and be able to use it to play music and set timers. That being said I run home assistant right now and can control it with Alexa and Siri but… I would like local only
I do wonder how much of those voice assistants could run on-device. Most of what I use Bixby for (I know. I KNOW.) is setting timers. I think simple things like that can run entirely on the phone. It’s got a shocking amount of processing in it.
While you may have points against Apple and how effective Siri may be, with this latest version kind of products, even the watch has enough processing power to do voice processing on device. No ads. No cloud services
Pretty much. If you want a voice assistant right now, Siri is probably the best in terms of privacy. I bought a bunch of echos early, then they got a little shitty but I was in, and now I just want them out of my house except for one thing - music. Spotify integration makes for easy multi-room audio in a way that doesn’t really work as well on the other platform that I’ll consider (Apple/Siri) and basically adds sonos-like functionality for a tiny fraction of the price. The Siri balls and airplay are just not as good, and of course, don’t work as well with Spotify.
But alexa is so fucking annoying that at this point I mostly just carry my phone (iPhone) and talk to that even though it’s a little less convenient because I’m really goddamned tired of hearing “by the way…”
deleted by creator