Do i need to have a visa for a British passport currenly staying in brunei.

hello,
Iam Brikha limbu from brunei. Actually,iam a British army currently serving in Brunei.I have two kids and they both have British Passports.I would like to visit HK in this december while i am going to nepal.we will be staying in Hk for 3 days and thats it.i have heard that of course the visa is needed for Nepalese citizens but not for British passport holders.is that true?Any suggestions pls.