Can anybody take HKIA ferry to Fuyong even if you're not a passenger?

I'm staying in HK for a few days, but I need to meet someone at Fuyong Port and he told me about the HKIA ferry, however I'm not sure if I can just go from Central HK to HKIA and buy a ferry ticket or you need to get in the transfer area somehow. Thanks so much.