Critics say rarely used authority could expand power to detain and expel people without due process