Lechmere was the second and favorite son of Emilia Lavie Lechmere, and grandson of Germain Lavie of Putney, London. His mother appears with her six siblings in a group portrait (now in the NGA) of Lavie's children painted by Johann Zoffany. He inherited the picture, then left it to his widow, Sophie.