Something that lets you pay but doesn’t log the inputs like a blank slate.
I don’t mind paying or maybe there’s an offline implementation (doesnt have to be cutting edge)
Just looking for text/messaging style app that implements an LLM, preferably not tuned if that limits its inferential abillity
Basically think I’m looking for a talking Wikipedia haha
You can try some offline LLMs:
- https://llm.mlc.ai/#ios (fully FOSS)
- https://apps.apple.com/us/app/private-llm-local-ai-chatbot/id6448106860 (paid and closed source)
You seem to be seeking some kind of AI proxy, I think you’re trying to anonymize your prompts. VPNs and Wikipedia are not ideal examples of this. But I will try to answer the intent of your question.
All AI as a service provider will log your queries. The only way to sort of anonymize would be to use someone else’s key/credentials. But that would just push off the logging to someone else. It’s like sharing out your Netflix password…
The only truly anonymous way is to run your own, by self hosting an open LLM, which is doable, yet much more complicated, and would not be as good as the current big company services.
It’s not that much more complicated if you use something like “GPT4All”. It even has one-click download of chat models, and local document ingestion. I know there are others, that’s just the one I’ve used.
This doesn’t appear to be anonymous, it requires you to enter an api key. The ideal method for anonymity with this would be a third party selling chat gpt API keys so chat gpt wouldn’t know who owns it and the third party seller wouldn’t know what you’re inputting. If that’s what OP is looking for anyway.
Ya exactly that works. Like, does anyone know who the “Apollo” equivalent of AI LLM apps is (using the analogy of Reddit)
Large LLM companies authenticate at their API point. It doesn’t matter if you are behind a proxy, you need an API key and that will identify you.
There really isn’t a way to do what you are asking.
