If you are Chinese citizen, you do not need a passport but you need to have a permit to enter HK/Macau are in local entry-exit administration office. If you have passport of other countries, you are probaly allowed to go there directly without visa or special permit.