How LLMs come up with their answers?

I know the basics of RNNs and LSTMs, and a very high-level understanding of LLMs, but I'm still confused at how it can answer some of the questions the way that it does.

If you look at the example I give below, it really feels like it has a deeper level semantic understanding. It gave a VERY reasonable answer to a question that, AFAICT, has never been asked before and one I don't think you'd be able to necessarily piece together just from the words in existing docs on the internet.

Any good pointers that would help me (and I'm sure others) understand this better? Most of the stuff I've seen is either too basic (some probability of the next word) or so deep into the guts that its hard to understand intuitively what's happening.

==========================================

Prompt: What if basketball required the ball to bounce at least once before rebounding. How would that impact the benefit of height in the game?

Response: If basketball required the ball to bounce at least once before rebounding, it would significantly impact the benefit of height in the game.

Traditionally, height has been a significant advantage in basketball, particularly when it comes to rebounding. Taller players have an easier time grabbing rebounds, both on the offensive and defensive end of the court, since they can reach higher and cover more ground. However, if the ball had to bounce before a rebound could be made, the benefit of height would be greatly reduced.

Requiring the ball to bounce before rebounding would increase the importance of timing and positioning over height. A player with excellent timing and positioning could still grab rebounds even if they are shorter than their opponents. In fact, a shorter player with good timing and positioning might be able to get into position to grab the rebound before taller opponents have a chance to react.

Additionally, if the ball had to bounce before a rebound could be made, it would also increase the importance of quickness and agility. Players who can move quickly and change directions easily would be better able to anticipate the ball's trajectory and position themselves for a rebound.

Overall, requiring the ball to bounce before rebounding would make basketball a more dynamic and strategic game, where height is no longer the dominant factor in rebounding. It would give shorter players a greater chance to excel and force taller players to adapt their strategies to the new rules.