If you like your dirt in scholarly form (but still an entertaining read), look into Servants: A Downstairs History of Britain from the Nineteenth Century to Modern Times.
And if you like a little Austen with your curiosity, check out Longbourn by Jo Baker. It’s Pride and Prejudice viewed from the servants’ hall, and a real eye-opener. Where gentlemen reside there are also “gentleman's gentlemen” and romance and misalliances are not limited to the posh set.
Springville Road Library