A post with 20 ratings and a score of 20 probably signals something different than a post with 1000 ratings and a score of 20. One signals that fewer people were interested in the comment but those people were generally supportive of it while the other signals many people were interested in the comment but they were split in their opinions of it.
It would be cool to see these numbers for comments!
I think it would be cool to see it for comments but it could be a bit too distracting as well. The idea to not be obsessed with number of upvotes. Not showing comment upvotes beyond 4 might be a good idea in that regard.