Can a UK passport holder visiting NZ holder obtain a visa to visit China whilst in NZ?

Yes, you can apply for it at the embassy or consulate in New Zealand. Apart from the regular documents you need (passport, application form, recent bare-headed photo, transportation ticket and hotel booking records, etc.), you should also submit the original and photocopy of your NZ entry permit.