Brexit supporters gathered in London but elsewhere the atmosphere was muted