It is difficult to estimate the weather two months later. Somtimes there was snow, but last year, the days were very nice during this period. Anyway, a long-sleeved shirt and a jacket is ok at outdoors.
In Taoyuan, you could visit the Jin-fu Temple, the Residential House of Li Tengfang, the Jhongjheng Park and Shihmen Reservoir, etc.