Charles Benjamin Perry was a prominent member of Auburn society. He was the first President of the Auburn Savings Bank, and was also a Judge. He and his wife Frances had a daughter, Frances Marvine, and a son, Miles H. Perry. Charles was also the grandfather of Fanny Seward's friends Esther and Ellen Perry.