Over half of Brits are fearing a Brexit backlash at Eurovision