Have X2 to study in China, but want to stop the class.

I'm currently living in China, I am holding an X2 visa. But I didn't have to enrol in any university. A private school wrote to me an invitation letter where it said I would be studying an amount of hours per week. I went to the embassy and they gave me the x2 right away, it looks like they are more flexible now. Anyway.. After I landed on China and started with the classes I found out I don't like the dynamic of the classes and the teachers don't even prepare anything prior the class, it's cold and they don't care too much about teaching but about money.. I said I wanted to reduce the amount of hours per week and the manager of this private school started threatening me to report me to the authorities to get my student's X2 cancelled. This person refused to continue with the class and I left. Now I'm scared cause I am afraid of he cancelling my visa or reporting me to the authorities or something. What chances does he have to do that? What possibilities do I have to sort this out?

Thanks in advance to whoever replies this message. A little bit of help on this would be much appreciated