Born in Newfield in 1813, Caleb R. Ayer was the son of Captain James Ayer one of the most prominent citizens of that town.
Graduating from Dartmouth College in the class of 1834 he immediately pursued his legal studies in the office of his brother-in-law, Nathan Clifford, future Justice of the United States Supreme Court.
Ayer was admitted to the bar in 1838 and entered into a partnership with Clifford that lasted until 1841 when he moved to Cornish where he continued to reside until his death.
He was elected to the State Senate in 1847 and 1848, serving in the latter year as its President.
In 1856, during Governor Wells administration, he served as Secretary of State.
In 1868, 1869 and 1870, Ayer was County Attorney for York County and, until his death on October 5, 1883, he was a prominent and eloquent member of the York Bar.