Visa requirement for Hong Kong resident with US Passport

I am a Hong permanent resident and have an Entry permit that allows me to enter China from Hong Kong without a visa. If I fly to Shanghai direct from USA, can I use my Entry permit or I need to apply for a visa too? I am also a US citizen. Please advise.