It's clear to me why he had to carry out the special Avodah of the day described in Parashat Acharei Mot.
But why did he have to do everything else, such as the Tamid and the "ordinary" Musaf similar to that offered on other festival days?
We find that significant changes were made to the Kelim used on Yom Kippur to make things easier for the Kohen Gadol. Why not make it really easy by not requiring him to do all of the ordinary daily and festival Avodah?