Arcade games aside, I think the first time I started gaming was with my Gameboy pocket. From there I upgraded to Gameboy color and a hand-me-down SNES. Probably mid 90's. Come 2000 I got a computer and lost all hope of not becoming a computer nerd.
I grew up with an SNES and N64, as others have, but I didn't really start gaming with any sense of taste until WoW I downloaded Steam, bought the Orange Box, and started reading the Escapist like a prosthetic Bible.
I played my first games on the SNES at the age of four all the way back in 1995. However this was more of a casual playing just to kill time. I didnt truly get into gaming until the late N64/ early gamecube era.
I don't know what my very first taste of video games was, it could've been on one of my neighbors computers when I was 3, or it might have been my dad's Atari; but my first system was an NES. I know it's not the beginning of video games but I still feel like I can refer to the majority of people here as "kids".