Most residential chimneys nowadays are too small for people to climb into. Sweeping is done with a brush on a pole :)

Also, the glass pane would not have to be anchored deeply in the masonry, just set in slightly, enough to support its own weight. Thus any breakage would likely remove it entirely.