The Real Reasons Downton Abbey Actors Quit The Show

Audiences fell in love with "Downton Abbey's" upstairs aristocrats and their downstairs staff. Why would any actor lucky enough to be cast on such a massive hit show ever choose to leave it?