The Toby House was a hostelry across the railroad tracks just north of the original location of the Dutch Reformed Church.
It was the site of the New York State Convention of the Liberty League and National Reform Party on September 28, 1848, which involved (among others) abolitionists Gerrit Smith (shown above), James Caleb Jackson, and Beriah Green.
The structure was razed at an unknown date, and is now occupied by a modern one-story office building housing an insurance agency.
Thanks to Joe DiGiorgio for historical research.
September 28, 1848