Traveling to Taiwan from March 26 to April 1. Is it good to fly in via Kaohsiung & exit via Taoyuan?

The goal is to catch the cherry blossoms in Alishan, Formosan aboriginal cultural village, sun moon lake, and yangminshan park. Also we would like to experience the laid back character of Kaohsiung and the bustling area of Taipei. Thank you!