Capitalize when used formally: Office of the President, Office of the Provost. Preference for first reference: president’s office, provost’s office.