This kinda gets philosophy-of-cognative-science-ey, but it kinda smells like “measuring a fish by its tree climbing ability”. Or maybe like goodharts law.
There are many different kinds of smart, is the kind of smart they’re measuring the one that will be relevant?
Again, I don’t want to carry too much water for AI, but I also don’t want to propagate arguments that also apply to other tools I like. Consider: externalizing memory. Without the tool you used to capture that memory, you’re completely unable to function. Dependency on it reduces your ability to remember things yourself. By many measures, it makes your dumber and less productive. But I wouldn’t personally consider taking notes to be detrimental.
So I want to be very careful when we make claims that externalizing some aspect of our cognition makes us worse somehow.
This kinda gets philosophy-of-cognative-science-ey, but it kinda smells like “measuring a fish by its tree climbing ability”. Or maybe like goodharts law.
There are many different kinds of smart, is the kind of smart they’re measuring the one that will be relevant?
Again, I don’t want to carry too much water for AI, but I also don’t want to propagate arguments that also apply to other tools I like. Consider: externalizing memory. Without the tool you used to capture that memory, you’re completely unable to function. Dependency on it reduces your ability to remember things yourself. By many measures, it makes your dumber and less productive. But I wouldn’t personally consider taking notes to be detrimental.
So I want to be very careful when we make claims that externalizing some aspect of our cognition makes us worse somehow.