How do you explain the positive cases in the article?
You are right that they are bad at reflecting on their own knowledge.
I do explain in the article why it's not reasonable to expect an LLM to have a strong intuition about the specifics of the boat and goat problem. The altered question is extremely obvious to us because of our intuitions about the entities in the puzzle. Intuitions an LLM doesn't possess.
You are right that they are bad at reflecting on their own knowledge.
I do explain in the article why it's not reasonable to expect an LLM to have a strong intuition about the specifics of the boat and goat problem. The altered question is extremely obvious to us because of our intuitions about the entities in the puzzle. Intuitions an LLM doesn't possess.