I think we have a lot of bad answer on this site that I would downvote. Not because I disagree with them, thats no reason for me personally to downvote, but they are inherently bad. For example claiming something that is clearly wrong and not providing any reference, just I know this and everyone who says otherwise is lying. Take this answer as an example of what I am talking about.

A lot of those answers tend to be from 1 rep users that maybe never come back, a downvote does not impact them at all.

I don't want to flag those questions either, because they often at least try to answer the question. When reviewing late answers I mostly just skip these, because I really am not sure what to do here.

Does a downvote at least have a long term effect? Will it be more prone to deletion if it has more down votes?