Sullivan's Crossing star Scott Patterson spoke out about his departure as Harry "Sully" Sullivan after three seasons, saying ...