Do I need to put visa for HKG?

Actually, I hold Nepalese passport but I do have the right to land in HKG (hold HKG Identity Card). I came to Brunei in March of 2010 and until now I had been to Nepal for two times. So, is it counted as two entries for visas? My husband is British Gurkha Army and his base is in Brunei (Seria) at the moment which means we will stay in Brunei until August of 2013. When I used to go HKG from Nepal, no visas were needed. What is the system from here? Please suggest.