China for four hours

Hello!

My family of four holds American passports visiting Macao. I am originally from Hong Kong and like to visit my dad’s ancestral home for a few hours and am planning to go in from Macao. We are staying in Macao then to Hong Kong. Do we need to pay for a visa to go in or does the 24 hour visa free applies?