Frederick Drake-Brockman succeeded his two older brothers in the Beechborough estate. Their parents were James Drake-Brockman, High Sheriff of Kent, and Catherine (Tatton), daughter of The Rev. William Tatton, D.D., Rector of Rotherfield, Sussex, and Prebendary of Canterbury Cathedral.