It does not have to be time!
You're going by the cliched model of x,y,z,t which sci-fi dribbles about all the time, but this is not accurate. You could easily, as was already mentioned, have the fourth dimension be R, G or B - or, say, T (temperature), H (humidity), P (pressure), or any other quantity. You could theoretically have it as another distance - or, you could have no distance dimensions at all and go by temp, humid and press if you want. All it needs to be a dimension is a quantity orthogonal to the dimensions already present.
If want to look at conventional Spacetime then, yes, time is the fourth by convention. Come to think of it, you were probably just talking about Spacetime anyway.
You're going by the cliched model of x,y,z,t which sci-fi dribbles about all the time, but this is not accurate. You could easily, as was already mentioned, have the fourth dimension be R, G or B - or, say, T (temperature), H (humidity), P (pressure), or any other quantity. You could theoretically have it as another distance - or, you could have no distance dimensions at all and go by temp, humid and press if you want. All it needs to be a dimension is a quantity orthogonal to the dimensions already present.
If want to look at conventional Spacetime then, yes, time is the fourth by convention. Come to think of it, you were probably just talking about Spacetime anyway.