Oliver was born to Daniel and Elizabeth (Kemble) Oliver on November 24, 1800 in North Beverly, Massachusetts.[4] Originally named Thomas Henry, Oliver's name was changed, by the legislature, in 1821 to that of his mother's brother who had died in 1802.[4]
Oliver entered Phillips Academy, Andover in 1811 and Harvard College in the fall of 1814, however because Harvard was becoming overly Unitarian in its views[5] and also more expensive,[5] Oliver left Harvard after his sophomore year and transferred to Dartmouth College entering Dartmouth's Junior class in the fall of 1816.[5] Oliver graduated from Dartmouth College.[5] Oliver also received a degree Ad eundem from Harvard. At the age of 25, in 1825, Oliver joined the Unitarian church. The same year, he married Sally Cook, and they had seven children.[6]
In 1844 Oliver was appointed the Adjutant General of Massachusetts by Governor George N. Briggs.[1]
He died at his home in Salem on August 12, 1885.[6]