Dutton expects the US to take about 250 more refugees from Australia as part of the refugee swap deal.