My husband has an X visa. Can he now apply for a residence permit that accompany me in Z?

I am employed in China with a Z. I met my boyfriend who is a student here in China with an X. Then we went to Hong Kong and got our marriage certificate and returned back to mainland China. Can he apply now while in China for residence permit that accompany me in Z as my husband before his X expires? Thank you.