Funnily enough, while this is a very interesting concept, you aren't the first to think of something along those lines.
There's a very obscure first person RTS (which isn't what you're describing, but it means you are controlling an RTS from the first person perspective as if you were an actual field commander.)
But more specifically, there was a game series (I can't remember the name, though it was fairly well known - Ah. That's it. Dungeon Keeper - http://www.pcgamer.com/2010/08/07/why-dungeon-keeper-has-never-been-beaten/) where you were a demon overlord or something similar in charge of a dungeon, and had to build the dungeon as well as minions to defeat adventurers and heroes that try and enter the dungeon.
You also had several abilities you could use, and one of these was to take over one of your minions and control it from the first person perspective.
Anyway... It's still an interesting idea, and it has never really been repeated. (or implemented quite like you suggest either.)