If you are concerned then fly for sure. Hue airport is 15kms from town, around 25mins, a taxi will cost approx 150,000 ($7) on the meter, or there is a very quick airport express bus for 50,000 p.psn (but you need to be specific with the driver about your destination) or you can arrange a car through your hotel for around 200,000 i think.
Flights with Vietnam Airlines start at about $60. Make sure you book on the real site not one of the many copycats.