Applying for a visa to china for an ex-pat permanently living in Taiwan

I am afraid that you need to go back to apply for that. In the past, you might apply for it from the office of the Ministry of Foreign Affairs of PRC in HK. However, the rules have changed. According to the notice on their website, those who do not have HK resident status must apply from the Chinese embassy or consulate in their own countries.