It’s definitely in the nature of the current-gen systems. It’s possible to imagine other ways to train chatbots that wouldn’t favor bullshitting in the same way, though. The way they currently are isn’t a way they necessarily have to be.

Anyway, it’s very clearly a case where it would have been better to cut out the middleman and just share the prompt, which was my point in sharing it.