Recent example: I asked AI to help me come up with a search/replace string for editing a file in vim. My prompt was something like “I am editing a text file in vim and I need to replace <description of pattern> with <description of pattern>. How can I do this with :s/ ?” And it spat out something that didn’t work. It was not valid syntax (for vim, I think it was valid standard regex, or close to it), and it didn’t quite follow the pattern I was trying to describe (although ofc that could be my fault to some extent). But it was useful in that it pointed me in the right direction to come up with a correct formula with some follow up googling and experimentation.
That has been very typical of my experiences with AI. Useful sometimes, but absolutely not “does everything to the point you don’t have to think about it” that seems to be a common opinion.
For context I’m using ~20GB local models, so not Claude, which people who pay for LLMs swear by.
Yeah its definitely useful for topics you personally don’t have much experience in. It’s much less useful when trying to use it for topics you personally are an expert in.
Yes, older models will make those mistakes. The solution is to provide appropriate agent/skill definitions so it doesn’t just spit something out, but rather comes up with the solution, then smoke tests it in a separate scratch environment.
Claude uses this approach for reinforced learning, and it works well. Takes a few more rounds to resolve, but the solution is generally flawless (for that specific purpose).
Eh idk I still have it make mistakes constantly.
Recent example: I asked AI to help me come up with a search/replace string for editing a file in vim. My prompt was something like “I am editing a text file in vim and I need to replace <description of pattern> with <description of pattern>. How can I do this with :s/ ?” And it spat out something that didn’t work. It was not valid syntax (for vim, I think it was valid standard regex, or close to it), and it didn’t quite follow the pattern I was trying to describe (although ofc that could be my fault to some extent). But it was useful in that it pointed me in the right direction to come up with a correct formula with some follow up googling and experimentation.
That has been very typical of my experiences with AI. Useful sometimes, but absolutely not “does everything to the point you don’t have to think about it” that seems to be a common opinion.
For context I’m using ~20GB local models, so not Claude, which people who pay for LLMs swear by.
I recently used it to customize a vimeopro library and I had to go through some back and forth with it but we did get there in under an hour.
I have very little coding experience, I’m a graphic designer.
I would’ve required the help of someone who’s salary would’ve been six figures to solve this problem without the Claude.
So what it’s done is make computer code much cheaper than it previously was.
Yeah its definitely useful for topics you personally don’t have much experience in. It’s much less useful when trying to use it for topics you personally are an expert in.
I use Claude + local models.
Yes, older models will make those mistakes. The solution is to provide appropriate agent/skill definitions so it doesn’t just spit something out, but rather comes up with the solution, then smoke tests it in a separate scratch environment.
Claude uses this approach for reinforced learning, and it works well. Takes a few more rounds to resolve, but the solution is generally flawless (for that specific purpose).