With an average temperature of about 2~11C in Dec in Shanghai, the Weather in Shanghai(https://www.travelchinaguide.com/climate/shanghai.htm) is cold at that time. You need to take sweater and overcoat, better with a down jacket. Prepare warmer clothes for your baby.
It is generally safe for you with your kid travelling in Shanghai, but better not go around at night.