Suggest you stay in Tsim Sha Tsui area, nearby the MTR station. There is convenient transportation to every attractions you mentioned and it is within walking ditance to Avenue of Stars, China Ferry temrinal to Macau. Mirador Mansion is a building having many cheaper hostels inside. For other budget Hong Kong hotels , you may do some search work on the internet according to their locations.