I think Gordon is the G-man, for the following reasons.
First, in Half Life 2 and Episode 1 and 2, G-man's funny speech patterns are mainly oriented around figures of speech that are a little ironic for someone who's not bound by time and space. Things like "Gorden, it's.... time... to do...