Kenneth G. Wilson (1923). The Columbia Guide to Standard American English. 1993.
sake, sakes (nn.)
In idiomatic expressions similar to for heavens sake (also for heavens sake or for heavens sake) wherein the modifiergoodness, mercys, righteousness, or the likeends in one of the sounds of the letter s, use an apostrophe or not, as you wish.