I have to say that I don't think this idea would work out well for sellers at all.

As it stands, DSRs already impact a seller's account much more than a few negs do, and can sometimes result in the 'silent negative', when a positive comment is left but the ratings are trashed. Because of that, I think I can understand, to a degree, the reasoning behind thinking the comments and related dots have become irrelevant for sellers, but they are not irrelevant to buyers, and I think they are still relevant for sellers.

Negs and neuts provide insight to a few general things for buyers - possible common problems with a specific product, for example, plus a seller's response to negs can have a significant impact on how they are viewed by potential buyers - you can't respond to DSRs and provide some insight to your customer service and so forth. Sure, you could still respond to comments, but without being able to refine them like they can now, most buyer's eyes would just glaze over trying to find relevant comments to read (if they even bothered to look anymore). 

I wonder if you think the way DSRs are rated might be affected if buyers were no longer able to leave a red dot? It would be the only way to have an impact on a seller's account, and sometimes the low ratings might be unfair just like the red dots, but of course you probably won't have any idea who left them or why.