Can I apply for a family L visa without exiting PRC?

You can prepare your passport, an application form, a half-length photo against light background, a registration form of temporary residence, your wife's passport and residence permit, an invitation letter from your wife, and your marriage certificate.
Then go to the local Exit and Entry Administration to submit the application.