Thanx again for providing helpful information. Buses from varanasi to ghazipur are available form early morning to late night( both pvt and roadways but roadways are better) and there is one passenger at 5AM and I saw lot of people on station at that time so I guess its safe to travel at that time.