Multiple entries to Hong Kong from Japan

Hi!
I am a South African and married an American. We are moving to Japan for 3 months for his work and would like to visit Hong Kong once a month to visit friends there while we're in Japan. Do I need a visa for HK for this? I have a multiple entry one for Japan.
Thank you!
Kim