Thanks to a helpful reader, I tracked down the
Dan Patrick podcast with the Les Miles interview. First, a clarification: Miles did not say "I was loyal to Michigan, Michigan was not loyal to me." Dan Patrick said that later.
First, the relevant section of the Miles interview: