I have a set up like that and have not had a problem with fish getting skittish. It will be because it is a bare tank and they are breeding (mine was well planted). Put paper or something over the bit where they see you but be careful when you go to have a sneaky look.
They can bahave like they are on "P" when breeding sometimes.