The key would be in balancing the strength versus the weight - too heavy and you would never be able to get it back off the bottom, which would be unfortunate for any manned explorations.

[Sorry, he's been distracted by actually considering it.]

Amaurot glass should work well enough for the windows, at least up to a certain point, judging by how the ruins of the city have fared, but the difficultly would lie in any kind of functional engine...

[He hums thoughtfully before seeming to remember his audience.]

Well, I must thank you for a puzzle to occupy my time, if nothing else. Even if it is only a hypothetical.