In this matter I disagree with Borges (What would Wittgenstein say?)

Language is part of reality. It is what we utter as we do things in the real world and it has real meaning and real uses.  Of course, language can be absurd, but for the nonce let's set those cases aside.

First case: When I ask you, "Would you like an apple?" do you picture a monkey on a stick?

Next case: Let's suppose we agree on the definition for "apple." I ask if you would like an apple but substitute a monkey on a stick.  When I ask if you are surprised that the apple I handed you turned out to be a monkey on a stick and you say, "Yes! I am surprised! I was expecting an apple!" could it be possible that by "I am surprised" I think you mean "Thank you" or "I am grateful [that you handed me a monkey on a stick]"?

Otherwise, of course Borges writes good stories.

"Apple"

"Monkey on a Stick"