Whether you are anti-social and grumpy or just fully focused on your workout I suspect you are not interested in the LHS leaderboards or RHS nearby rider list?
On the device you appear to be using you can just swipe them away at the very start of your ride. No need to see what anyone else is doing.
Some issues with swiping away or swiping back so just read this forum post.