With hand carry luggage to visit the Big Buddha in HK

I know it is a bit tough to carry my hand carry luggage from Airport to visit Big Buddha at Lantau Island but is it possible? I am just carrying a hand carry luggage and intend to take bus no. 23 up to Big Buddha? Do u think the bus no. 23 would be crowded at about 6 to 7 am?