Ministers accused of failing to secure rights of Britons with foreign spouses in EU