E. Cobham Brewer 18101897. Dictionary of Phrase and Fable. 1898.
Stolen Things are Sweet.
A sop filched from the dripping-pan, fruit procured by stealth, and game illicitly taken, have the charm of dexterity to make them the more palatable. Solomon says, Stolen waters are sweet, and bread eaten in secret [i.e. by stealth] is pleasant.