Born in Edinburgh, Stuart was the third and youngest son of Morton Stuart, 17th Earl of Moray, and Edith Douglas Palmer, daughter of Rear-Admiral George Palmer.
When the Conservatives returned to power under Churchill in 1951, Stuart was made Secretary of State for Scotland, with a seat in the cabinet. He continued in this post until 1957, the last two years under the premiership of Sir Anthony Eden. He was appointed a Companion of Honour in 1957. On 20 November 1959 he was elevated to the peerage as Viscount Stuart of Findhorn, of Findhorn in the County of Moray.[9]
He had earlier been noted as a suitor of Lady Elizabeth Bowes-Lyon while serving as an equerry to her eventual husband Prince Albert, Duke of York (the future King George VI).
Lord and Lady Stuart had two sons and one daughter.
David, 2nd Viscount Stuart of Findhorn (1924-1999)
John, a Royal Navy lieutenant (1925-1990)
Jean (Mrs Michael Ritchie) born 7 January 1932.
Lord Stuart died in February 1971, aged 74, and was succeeded in the viscountcy by his eldest son, David. Lady Stuart of Findhorn died in October 1977.
Arms
Coat of arms of James Stuart, 1st Viscount Stuart of Findhorn
Crest
In a nest Vert a pelican feeding her young Or about her neck a collar engrailed Gules.
Escutcheon
Quarterly 1st Or a lion rampant within a double tressure flory counterflory Gules all within a bordure compony Azure and Argent (Stuart) 2nd Or a fess chequy Azure and Argent (Stewart of Downe) 3rd Or three cushions within a double tressure flory counterflory Gules (Randolph) 4th Gules a lion rampant within a bordure engrailed Argent (Gray) all within a bordure Or for difference.