The house at 35 West Silver Street in Westfield originally stood across the street. It was built, reputedly using ballast bricks from a Dutch ship, c.1825 by Colonel Lewis Fowler on the site of his family’s earlier homestead. The Fowler House was moved to its current site in 1875 by Cutler Laflin to make way for his new mansion. As related in The Westfield Jubilee (1870):

Another prominent citizen was Col. Lewis Fowler, son of Justus Fowler, brother of Alvin Fowler. He built the red brick house on the corner of Silver and South Maple streets, on the site of the old family mansion. He was never married. He was a farmer, a man of reading and information, a useful and faithful officer of the town, a representative, and died in the year 1849 at the age of fifty-one.

Special Bonus! A differently written entry and a newer picture of the house:

Circa 1815 (really anytime during the first quarter of the nineteenth century), Col. Lewis Fowler built a brick Federal-style house on the site of his family’s old homestead at the east corner of West Silver and South Maple Streets in Westfield. The house was later purchased by Cutler Laflin, who moved it (between 1870 and 1875) to its present location across the street at 35 West Silver Street. Laflin built a new house on its original site.