Person B: But if lots of people like you did that in this election, the greater of two evils might win.
I thought this was the bandwagon fallacy, but yourlogicalfallacyis.com/bandwagon describes the fallacy as "appealing to popularity or the fact that many people do something as an attempted form of validation." In this case, refusing to vote for the lesser of two evils is unpopular. Other websites have similar definitions of the bandwagon fallacy.