Only you know the answer. What do you want to do with your life? Do you want to revolutionize the world, or just do what you want to? And in that case, what do you want? What job feels survivable for you? I decided that my goal is musician, simply because I live for music, and I want to make it a bigger part of my life. Getting a job grinding through from 7-5 just seems like it will make me eventually go crazy. I want to see and change the world, show my creative side, stand on stage and do what I do best. But that is my dream. What is it that gets you going?
If you find games design fun, research it more and find out if it's the job for you. You said you know some who work with it? Go with them and observe the kind of work you get to do. Remember, their opinions do not reflect yours. Do you enjoy working with computers and sitting making code all day? Cause from what I read it seems like you got the capability to become a good programmer.