The son of Charles George and Rose Ravenshaw Fountaine, Algernon Charles in 1876 succeeded his uncle, Andrew Fountaine [d.1873], in the Narford Hall estate, upon marrying his cousin, Mary, who was Andrew Fountaine's eldest daughter and heiress. They had a son (Vice-Admiral Charles Andrew Fountaine, who succeeded his father in the Narford Hall estate) and a daughter, Marion.