If you are in a WHIP/ERA league, then I would do it. If not, then I'd still do it.
Cain is still a monster, despite giving up 6R to a stacked Colorado field @ Colorado. He also proved that despite that outing, he could benefit from SO's (6 K's).
Your bullpen is plenty strong and I will assume there are other relief guys on your w/w.