Maybe I just live in a smarter-than-average area, but I have never heard anyone say "go to British". I would understand what a person meant by "He speaks British", but I would totally call a person out and laugh at them for "go to British". As would nearly everyone I know.