A lot of this is context dependent. You can work out a lot of meaning if you assume that every topic change in a conversation came out as a direct result of what you were just talking about before he said that. So you need to be a little more aware in these kinds of situations and work out how to remember more.