It wont be dimp but it could be any number of other things. Silicone seals as used in the food industry for ovens and fridges would be OK.
What I have done in the past is glue a couple of thin strips of glass down front, back and base then slide glass in between. I have one at the moment to divide a reptile cage and it can be removed if required. Use silicone to glue.