should answer all your questions
from there
Freshwater Fisheries Regulation 1984
Section 64 (a). No unauthorised catching or keeping of certain fish (amended).
No person shall, except with the prior consent in writing of the acclimatisation society for the district within which it is proposed to catch or keep the fish and except in compliance with such conditions as the society may lay down:
(a) Obtain or keep in captivity any live sports fish or any mosquito fish (Gambusia affinis) or catfish or brown bullhead (Ictalaurus nebulosus).
Conservation Act 1987
26zm. Transfer or release of aquatic life.
(1) No person shall transfer live aquatic life or release live aquatic life into any freshwater except in accordance with this section.
(2) The prior approval of the Minister of Fisheries shall be required for the following: (a) The movement of live aquatic life between sites in which it already exists. (b) The movement of live aquatic life between the islands of New Zealand.
(3) The prior approval of the Minister of Conservation is required for the following: (a) The transfer of live aquatic life to or the release of live aquatic life in a new location where the species does not already exist (including the transfer of a new species to or the release of a new species in an existing or a new fish farm). (b) The transfer of a species of live aquatic life to any land or water managed or administered under this act or any other act specified in the First Schedule of this act.