Built around 1810, the home of James Cooley in Granville Center is a Federal-style home with a double leaf front door below a Palladian window. The house was later the summer home of Dr. Austin Scott, president of Rutgers University from 1891 to 1906. He died in Granville in 1922 and according to Rutgers Alumni Monthly (Vol. 2, No. 1):

Dr. Scott’s funeral service was held at Granville Center, Massachusetts. For years he had his summer home there, the home of his grandfather, with whom he spent much of his boyhood. The service was in the village Congregational Church, and the neighbors gathered to pay their tribute of great respect and friendship.