A Tory minister admitted that they may deny some human rights in the process of removing Britain from the EU.