Bill Walsh is first  person I can think of that voluntarily returned to Stanford after 4 year break.

Dan Devine had some success with the Packers (made the playoffs one year at 10-4) before returning to Notre Dame.