If the museum is not a must, time is enough. The museum is small and would not take you too much time. You can visit other places first and see if you have time. The nearest bus stop to the silk Museum is called Pingmen. There are buses 游1，54， 31 to Lingering Garden directly, about 25 minutes. 游1，游2 bus can be taken between Tiget Hill and Longering Garden, 15 minutes or so. You can take taxi instead of bus.