Would it be very cold for late December in Taipei?

It won't be so cold in the late December. This area welcomes tourists all year around. The temperature may range from 60 F to 70 F during that period of time. The climate will be cool and comfortable. You don't need to bring knitted clothes. Only light jackets, thick long sleeved shirts, jeans and pants are enough.