They have many ways to know the direction, of course the compass would help. But before the compass was invented, the travelers would hire a local people to guide the way, or they had maps, or they asked people the directions when they traveled. Now the silk road route is indeed disappeared under sand in the desert, but in ancient times, it was beautiful oasis instead of desert, the environment was better at that times.

Hope it helps!