"Right or wrong" simply doesn't enter into it here. Language is very flexible when it comes to word usage in non-technical contexts, and it also evolves. If a word is used in a certain way so commonly that it's actually in the dictionary, it is perfectly acceptable usage, whether you personally prefer it or not.
Now, it may be advisable to avoid certain words or usages in specific contexts. For example, you wouldn't want to be using slang terms in a job interview, but that doesn't make slang terms "wrong" (blanket statement), just not deemed appropriate by society in certain contexts.
Using your example of the word "literally," (which I "literally" discussed in my OP 😉), the way it's being used will be very obvious based on the context, so there is no danger of the word losing its primary meaning. If you are confused whether someone was actually physically "blown away" in your example sentence, then I don't know what to tell you. The context makes it patently obvious it's being used as hyperbole.