i recently replanted my tank, removed a lot of plants etc... shuffled things around a fair bit. Since I didnt have potting mix at the bottom, and only had gravel i just went ahead and left the fish as is. the were all perfectly fine, and the water settled within hours.
if there is a lot of muck that gets stirred up, just do a water change - its as good a time as it gets!