By 1832 the New York & Harlem River Railroad had moved all the way up to 23rd Street and Fourth Avenue and by 1836 to this larger castle-like facility between Madison and Fourth Avenues bounded by 26th and 27th streets. By this point the NY&HRR is running steam engines, however, in 1858 a ban will be put into place as to how far south a steam engine can go. The risk of an exploding steam engine, as these things had the unfortunate propensity of every now and then doing that, was to great to bring into a populated area. The limit will be set at the once upon a time wilderness of 42nd street. This print is from the Valentine's Manual and is dated 1860. On the lower right, that is a train car being pulled by a team of 4 horses, the horses are pulling more than just this one car. The engine was removed at a facility at 42nd Street and 4th Avenue. In the center of the print, the smaller conveyance is a horse car and the building eventually became P.T. Barnum's Greco Roman Arena and then Frank Gilmore's Garden Arena. This is the great grand father of the current Madison Square Garden.
I stuck my camera into the little window under the arch in above picture. It was pitch black but this is a back of a staircase.
There is a light at the top of the stairs. This is again the eastern side and the holes on either side as well as the concrete patch work indicate that there was once something there.
This is the map from 1916. The station is there but not for very much longer. It appears that the need for these stations will not be needed. There already had been the 3rd and 2nd Avenues where in place by the early 1880's and we will have the Lexington Avenue subway running by 1918 so the East Side was well served and the New York Central did not need all of those stops, even if they would have been incredibly convenient.