Well, it's certainly true that the public can blame the Brexiter politicians. It's a nice, easy way to dodge their own responsibility.
Nor do I suspect it will translate much into election votes. Brexit is a hardline Tory project, but the Tories have a teflon-like nature such that if it turns sour, they'll ditch Boris and co. and pack them off to the backbenches (and likely from there early retirement from politics to take up deliciously well-paid private sector jobs) and pretend it was just some weird aberration... but here there are, back for business again! And the public likely as not will mostly swallow it.
The Tory press will back them up. After all, if Brexit turns sour, it's their fuck-up too and they aren't going to admit they sold the public a duff policy and they certainly aren't going to back Labour. So they'll sell whatever excuses they can grasp as well.