Tap Water in Taiwan: undrinkable?? how safe the restaurant food are??

Yes, the tap water is not safe enough to drink directly. But you can have it boiled and then it will be safe enough. Or there would be barreled pure water you can drink also.
The food safety is ok, don’t worry too much. If you keep healthy eating habit, it will be fine.