Yep, goldfish produce a lot of waste and I suspect this is the cause of the pH drop.
Have all those fish been added at once to an uncycled tank? Dropping pH is going to be the least of your problems if so as I suspect you will also have high ammonia, nitrite and nitrate readings
Goldfish don't care what the pH is.