You must specify it in the policy for many.
We thought we were covered but were only covered for the tank itself, not the damage caused when it cracked. We changed to a "Premium" policy which would cover the damage as well.
Most insurance companies only pay out on damage done by water from a "normal" water source, not an aquarium ie a burst pipe or broken tap.