Taiwan Weather(https://www.travelchinaguide.com/climate/taipei.htm) is characterized by a warm winter and a mild summer. It has no severe cold in Jan. The usual temperature is about 12~19C. You can prepare for some inner shirts and light jacket for both your baby and you. You could buy baby food after arrive in Taiwan.