The library was an octagonal building with windows on all sides and a cupola on top. Its first collection contained 2,300 books that were cared for by Samuel Puffer, the single librarian who also cared for the building. The library was a gift to the town of Sudbury from John Goodnow, a Sudbury native, who died in 1861. Mr. Goodnow bequeathed $20,000 to the town for purchasing and keeping in order a Public Library for the benefit of the inhabitants of Sudbury. He also gave 3 acres of land, and $2,500 to erect the building. Goodnow Library soon became and remains an integral part of the community. Additions were added in 1885, 1894, 1971 and finally the largest in 1999. Throughout all of the changes, the original 19th century building remained, and has been carefully restored to resemble the 1863 structure.