The only advice I can offer is that you make sure you take advantage of campus visits, and ask lots of questions. Find out what the graphic design program is like at the college you're thinking about. I made the mistake of signing up for the graphic design program at a local community college (2 year program) and it was a complete nightmare. Just to give you an idea, here's my little story:
I wanted to do more computer-oriented design, and the teacher I had basically told us not to use computers. One of the classes I took, aptly named "Graphic Design I", was a class where we would get 1 or 2 projects every week, and they were all "think outside of the box" type projects. One of our first projects consisted of cutting out hundreds of black squares from construction paper with an xacto knife and gluing them in different formations that would represent the principles of graphic design. On top of doing the actual cutting, we were to sketch out a certain number of ideas in a sketchpad (I think it was something like 8 sketches for each principle). As if the project didn't sound annoying and tedious enough, the teacher wanted everything to be cut precisely using rulers and took points off for even the slightest of glue marks left behind.
As you can guess, the projects that came to follow didn't get any better. Each one got more ridiculous than the last. Even on projects that left room for computer-aided design, the teacher would advise against it. They corrected me when I went to resize some images on photoshop and advised that I actually take the images to a photocopier and zoom in or zoom out on that. Can someone tell me how that would be more efficient? Not only is it a waste of time, but also a waste of paper. Anyways, I finally just dropped all the classes. I got absolutely zero enjoyment out of any of it and I planned on changing majors at the end of the semester anyways, so I figured why waste my time when I'm already wasting my money.
I'm curious if every graphic design program is like this (maybe someone can confirm this?). I probably wouldn't mind trying it again somewhere else if the program was geared more towards what I want to do. For now I just plan on doing it as a hobby though.