He married twice; firstly Jane, the daughter of Gilbert Vane, 2nd Baron Barnard and Mary Randyll (Mary was reputed to be a woman of "scandalous life"), and sister of Henry Vane, 1st Earl of Darlington and Anne Vane, mistress of Frederick, Prince of Wales. They had 2 sons, who both predeceased him, and 2 daughters. He married secondly Catherine, the daughter of Thomas Thurston of Holbrook Hall, Suffolk and the widow of William Peck of Little Sampford, Essex (died 1742), who had been a first cousin of Jane Staunton. After his second marriage, he lived at Holbrook Hall.[citation needed]
He was considered a fine Parliamentary orator, but after 1761 there is no record of his speaking in the House. He would clearly have welcomed a Government appointment, but never received one.[citation needed]