Visa to Taiwan

No, you cannot go to Taiwan with China visa.
In your case, first, you need to check if you can travel to Taiwan without visa. If no visa is needed, it will be much great.
If you need one, you cannot get it in China mainland, for there is no office there. To deal with it, many tourists from abroad travel to Hong kong to get the Taiwan visa before going to Taiwan.