One of the earliest Federal-style mansions on Chestnut Street in Salem was built in 1804 for two brothers, a schoolmaster and a ship-master, Amos and Solomon Towne. Notable for its fine entrance porch, the house was jointly owned until Amos sold his half in 1807. Solomon sold the house to merchant James King in 1821. While Amos still occupied the house, there was “a school for misses” held there where Sarah Gould taught “reading, English, grammar, geography, embroidery, tambouring, needlework in its various branches, drawing, painting and paper fancy work.” The house has been expanded on the sides and to the rear by later owners.