E. Cobham Brewer 18101897. Dictionary of Phrase and Fable. 1898.
The youngest bishop of the House of Lords, whose duty it is to read prayers; so called because he walks into the house in a dead mans shoes or boots, i.e. he was not in the house till some bishop there died, and left a vacancy.