You may go the downtown area for a look.

What is a muslim restaurant? Are there only muslims allowed? There aren't many muslims in Taiwan, so it could happen that you'll have to eat in a normal restaurant. But if it's just about food, then you won't have much trouble, because you can find many sorts of different food there.
If it's just about religion, then I don't know what to say... Be more open to new experiences! Don't let beliefs restrict you from good things in the world.