That's still a "game". Not a "video game", sure, but still a game.
But, that brings up an interesting point. Snakes & Ladders -- roll dice, move forward, zero agency, pure luck. The "walking simulator" of boardgames. Loved by children (simple and they frequently win), universally shunned...