Frankly, I'm of the opposite opinion. I'm glad he sits against lefties. Granted, I'm in an NL-only league, so what he's giving me right now is still top 3 or 4 of any catcher in the league.
But I love him for his average. I acknowledge that he's not giving me as many runs, RBIs, HRs that he could, but I don't expect that from my catcher anyway. I say let him sit and keep his average high!