Toronto-Shanghai-Taiwan-Hong Kong-Toronto

I planned my trip this way to only stay in Shanghai for 72 hours and then fly to Taiwan and Hong Kong. Does the 72 hr visa still apply to me even though my next 2 destinations could be considered Chinese (even though I've read Canadians don't need visas for Taiwan and Hong Kong)? thank you!