Well, when some one asks "What are you thinking?", there is some kind of happy medium between a billion page answer and 140 characters including spaces.
Maybe and maybe not.
I was thinking of all the handwringing going on over whether the makers of self-driving cars could ever fully explain how one of their cars makes all it's decisions. And if they can't explain that, then how can we trust these AI systems? Yet no human driver could pass this standard either so maybe they should not be allowed to drive.
In the context of chess, a human player might be able to briefly describe some of their thinking on the top 2 or 3 movement sequences they were considering but that leaves out 99.999999% of the far more interesting thought processes by which they ruled out the other 2 or 3 billion movement sequences that were possible.