Gwailo using home return permit

Hello all!

I would like to know if anyone else is in the same situation as me and knows the answer to my question.

I am half-Chinese (HK) and half-British. I have a HK Chinese father and a British mother and thus have both UK and HK passports. I have held my HKID and Chinese Mainland Home Return Permit (HRP) since I was very young and I have used the latter before, as a minor, when travelling with my Chinese-speaking father. I do not speak Chinese and I wondered how Chinese authorities upon entering mainland china would react upon seeing my HRP and my very white face, along with the fact I do not speak Chinese. I have already used it to visit Beijing, Zhongshan, Shenzhen, etc., but the only 'problem' I had was when crossing from HK to Shenzhen and my father was asked why I held the card because I was 'white'.

I worry that this may occur if I do visit mainland China alone, and I am unable to communicate in Mandarin ?

Thanks guys