Nicknamed "the Hill Church," the First Congregational Church of Woodstock dates its foundation back to 1690. The current building, which dates from 1822, was featured on a local blog in 2008. Beautiful fall scene!
The records for the church are held in several different places. Church records from 1727 to 1783 are available at the State Library Slip Index, according to an article on AmericanAncestors.org. Other records may also be at the State Library. Records from the 1740s to the 1930s can be ordered from the Family History Library website. Find A Grave offers images of many gravestones.