Confused about what is needed for a 2-3 week trip to China and Hong Kong

My Husband and I will be traveling to Guangzhou on US passport and L type PRC entry permits (I believe), spend two to three days in Hong Kong, and then stay at Guangzhou again until I head back to the U.S.

I have Hong Kong permanent residence card but my husband doesn't. Would we need to apply for Hong Kong Visa/Entry Permit for our route?