The Kohen Gadol only wears white in the Kodesh Kedoshim and not gold, so as not to invoke the memory of the Chet Haegel. So why does he wear gold during the rest of the Yom Kippur service? Differences in how to speak to our fellow Jews, and how we speak about them before Hakadosh Baruch Hu. Have a good Shabbos