We have been told that 3rd and 4th of September are holidays which is the celebration?

Well, Sept. 3rd is the public holiday to celebrate the victory of Anti-Japanese War. However, Chinese people are still on holiday on Sept. 4th and 5th. The fact is that they spend their weekends (Sept. 5th and 6th) in advance. And they will start to work on Sept. 6th.