Where I Came from? I came from Nethack, Civilization, and Close Combat; and a less casual set of games there has rarely been. Heck, my mother used to play ZZT on weekends.
And tell me, would you not rather have Battle for Wesnoth, The Bard's Tale, or Aralon - full, open, deep, rewarding experiences - than pretty yet ultimately limited experiences like Infinity Blade?
By all means, keep making Infinity Blades. But do not let them take over. Do not pull a Microsoft here, replacing all your Skyrims, STALKERs, and Half-Lifes with Kinectimals, angry birds, and Fruit Ninja clones. This is the root of the backlash, I feel, and it is vital not to ignore it - that while the extent and vehement nature of the anger may be unwarranted, our "hardcore" games of the modern age may well be superseded by an industry eager to chase this new golden cow. Remember, fellow gamers, the story of the PC, utterly abandoned by Microsoft when they had a more lucrative system. Microsoft are back, sure, but they're back for the casuals, make no mistake. Take note of the fate of gaming on the Wii - buried in shovelware, six feet under in under six years. Watch Microsoft and Sony focus on making their consoles family friendly at the expense of their "hardcore" contingent, and realize that this is not a question of coexistence, but of survival.