Hongcun and Xidi in one day?

My plan is to go direct from get down from Huangshan in the evening and go directly by taxi to Hongcun. I will then get up early the next morning to Hongcun and Xidi in one day and then catch the 1725 bus from Xidi back to Huangshan Bus Terminal to catch a late train to Wuyuan. Does this sound possible? I don't want to be too rushed, but neither Xidi or Hongcun seem like large places. I figured a half day for each would be okay. If this is too much, which village should I visit if I can only choose one?