Can i visit Shandong province, when i'm on visa free transit stay in Beijing?

I will arrive from Thailand to Beijing, and depart to Vietnam from Beijing.
During my stay in Beijing, i would like to make a quick visit with one overnight stay to Yanggu, in Shandong province (train to Jinan, car to Yanggu). Is that ok?