Orbit is an LLM addon/extension for Firefox that runs on the Mistral 7B model. It can summarize a given webpage, YouTube videos and so on. You can ask it questions about stuff that’s on the page. It is very privacy friendly and does not require any account to sign up.
I personally tried it, and found it to be incredibly useful! I think this is going to be one of my long term addons along with uBlock Origin, Decentraleyes and so on. I would highly recommend checking this out!
So mozilla is paying the server costs for this, what’s the business model?
AI
deleted by creator
It is very privacy friendly […]
What makes you believe that? The most information I could find about this is that it doesn’t “save your session data.” The Orbit privacy policy also seems a bit bare, and I can’t decide if that’s a good thing or not.
Either way, you’re still sending data to a third party service to process. Might be worth it for some people.
No association with any account. Therefore, no profiling.
deleted by creator
Can I just trade in that LLM for the old Firefox please?
I’m just glad it’s an add on/extension. A lot of the crap baked into browsers these days is just bloat nobody wants or uses.
Probably not for me as I’m not interested in a summarizing tool, but I’m not against AI in general.
OAN, I think over time, the community will see that AI was a bubble, but in the same way that the internet was a bubble back in the day.
OAN, I think over time, the community will see that AI was a bubble, but in the same way that the internet was a bubble back in the day.
Surprised to see this opinion on Lemmy haha. Yep, totally agree with ya here!
Everyone wants a Her style personal assistant — as in one that is personal-context aware, can simplify, and generally enrich their lives (not for emotional support) — but if most people knew how unintelligent AI is, how spectacularly it fails, and how dangerous it is to integrate it into information systems and (especially) give it any ability to act … Literally nobody would want to give it access to all their data, or use it beyond an advisory role.
Perhaps I’m a luddite - but I unequivocally do not want an assistant like that. I dislike even the basic commands of google assistant. I can do the tasks better and faster than than the assistant can.
Amen to that. I’m not a busy CEO of four companies, I don’t need or want an assistant, digital or otherwise. I want to read through articles and watch videos, I can scroll/fast-forward through myself if I feel like it. And while we’re at it, I don’t really need or want personalized anything - just give me ALL the search results and I’ll sort through them myself. Luddite? Maybe, but I literally cannot think of a case where this would be useful or helpful to me…
I can’t tell if you’re serious or trolling
In before is not just skips important details in its summarization, but also hallucinates its own interpretation of things into it.
Generally, don’t call it “AI”, don’t overhype it, don’t use it where it is bad in its function (like telling you “facts”), don’t shove it into everything. I bet 80+ percent of all “AI” energy consumption is wasted on completely useless and moronic tasks that have 0 value even on a personal level.
"The term “AI” has been in use since 1956 for a wide range of computer science techniques. LLMs most certainly qualify as AI. You may be thinking of the science-fiction kind of “artificial people” AI, which is a subset of AI called Artificial General Intelligence when researchers want to be specific about that kind.
I’m thinking of something that actually processes some form of “thought”, in the abstract sense. Even video game AI does that to an extend (granted, there’s various techniques depending on the game type), so the term here is actually somewhat appropriate. LLMs don’t do that at all though, they’re just word guessing based on the texts they were trained upon (while we stick with text gen here at least) and that just so happens to sound like somewhat coherent sentences that can fool someone into thinking that their computer actually talked to them. There never was any sort of thought behind that though. It functions closer to how your mobile keyboard predicts the next word you want to use in its suggestions at the top. It just tries to complete the text it was already presented with. A lot of the illusion here comes actually from the tools used to display this information in a chat like manner, but that’s just frontend foolery for the user.
I think it’s more that you’re overestimating video game AI, here. If your definition of “abstract thought” doesn’t include what LLMs do then it definitely shouldn’t include video game AI. It’s even more illusory.
Yeah but you think a lot of weird things, so that does not surprise me in the slightest.
I would agree with the other guy. A video game AI can be as simple as some if-then decision logic, and i would count that as “AI”. An LLM also makes “decisions” on what to do/say, just via a different mechanism (predictive modeling) . I would still bucket that as AI. It you count one you should count the other. Neither are truly “thinking” in the sense of an AGI.
I wasn’t talking about something like an AI in Pong. But if your definition of “AI” is conditionals such as if statements, then absolutely everything is an AI, which honestly just further muddles the meaning of that term.
The general tone in this thread seems so very different from when “Mozilla is working on AI” was first announced
Ooh, I just tried it out and I can tell I’m going to love it - if not this specific plugin (the UI needs some work) then this general concept of a plugin.
I just popped over to Youtube and went to a ten-minute video of something or other, clicked the “summarize transcript” button, and within a few seconds I had a paragraph-long summary of what the whole video was about. There have been sooo many Youtube videos over the years that I’ve reluctantly watched with a constant “get to the point, man!” Frustration. Now I’ll know if it’s worth it.
Do you have the SponsorBlock add-on installed? Most videos have user-submitted sections that it lets your skip. Also, a highlighted part.
Huh, I’ll have to check it out then. This will be especially useful for Louis Rossmann videos because he rambles and repeats himself a lot.
Hm…could be useful for those times you want to read a guide but can only find one in video form
Indeed. And after generating the summary, there’s a chat field below that where you can ask the AI to elaborate on particular subjects. This is really nice.
deleted by creator
RIGHT?!!! IT’S SO FKIN AMAZING
This is especially going to be useful for me as a student. It’s just feels like browser 2.0 at this point haha
If you really care for an LLM, run it locally… Not sure if this does it…
Don’t want to install and maintain 10gigs of cuda stuff on my PC. Next, my mum won’t know how to do that. Her laptop is a potato. This add-on makes all of this way easier.
You don’t need CUDA, it’s actually pretty easy. You can run the Mistral 7B model this add-on is based on using GPT4All. It doesn’t require much, if any, technical knowledge.
what’s the min-sys requirements for a good experience?
A midrange graphics card and 16 GB of RAM should suffice. Check their site for specifics.
HOLY HELL THAT’S COOL. It can do so much too!!!
I locally installed some small LLM model more than a year ago. It took up like 25 gigs or something along with all CUDA libraries n stuff. It was alright, but I figured that cloud based solutions were the best for my use case, as they were better and for free.
I had no idea that open sourced AI progressed so much in the last year. Amazing stuff!
You’re not generating models at this point. You don’t need that kind of hardware to run these.
Well that comes with shit ton of privacy risk. If y’all are comfortable, then it is your choice
Maybe they could focus on developing a web browser instead…
Considering how google is making chrome worse every day, they could do only security updates and still be the best browser.
deleted by creator
- I don’t think this is the proper channel for feedback.
- Rude
- Fuck you. This is an optional extension for those who want to try. Do you want the final version of a piece of free software? Then you can go lie in a ditch because hopefully it will continue to evolved for years. It’s astonishing the entitlement of some people.
- Good local LLM that can run on most hardware is a very interesting project. Usually you need at least a GPU to get it to run. The fact that is only summarizing might be because it this.
You’re right, it was rude. Sorry.
Gross.
