There are still major ethical issues with how they get training data, but the problem with hijacking the economy and society seems resolved. I feel like I can more easily forgive the copyright theft for someone just fucking around in their homelab, replacing Google assistant.
don’t forget that frequent LLM use erodes patience and skills. even with the training ethics and environmental ethics set aside, they make you measurably dumber.
LLM users consistently underperform at neural, linguistic, and behavioral levels
This kinda gets philosophy-of-cognative-science-ey, but it kinda smells like “measuring a fish by its tree climbing ability”. Or maybe like goodharts law.
There are many different kinds of smart, is the kind of smart they’re measuring the one that will be relevant?
Again, I don’t want to carry too much water for AI, but I also don’t want to propagate arguments that also apply to other tools I like. Consider: externalizing memory. Without the tool you used to capture that memory, you’re completely unable to function. Dependency on it reduces your ability to remember things yourself. By many measures, it makes your dumber and less productive. But I wouldn’t personally consider taking notes to be detrimental.
So I want to be very careful when we make claims that externalizing some aspect of our cognition makes us worse somehow.
What about opensource self hosted AI?
There are still major ethical issues with how they get training data, but the problem with hijacking the economy and society seems resolved. I feel like I can more easily forgive the copyright theft for someone just fucking around in their homelab, replacing Google assistant.
Maybe I’m just bean-souping.
I think it means people who use AI to talk to people.
don’t forget that frequent LLM use erodes patience and skills. even with the training ethics and environmental ethics set aside, they make you measurably dumber.
https://arxiv.org/abs/2506.08872
This kinda gets philosophy-of-cognative-science-ey, but it kinda smells like “measuring a fish by its tree climbing ability”. Or maybe like goodharts law.
There are many different kinds of smart, is the kind of smart they’re measuring the one that will be relevant?
Again, I don’t want to carry too much water for AI, but I also don’t want to propagate arguments that also apply to other tools I like. Consider: externalizing memory. Without the tool you used to capture that memory, you’re completely unable to function. Dependency on it reduces your ability to remember things yourself. By many measures, it makes your dumber and less productive. But I wouldn’t personally consider taking notes to be detrimental.
So I want to be very careful when we make claims that externalizing some aspect of our cognition makes us worse somehow.