Earlier this week, the comedian, 34, made a scathing quip after it was revealed that he and three other beloved cast members would be leaving the show ahead of season 51.