"Were it otherwise, the Government could simply remove people from the United States without providing any process and then, once they were in a foreign country, deny them any right to return for a hearing or opportunity to present their case from abroad," he wrote.
In March, Trump officials flew the Venezuelan men to the prison, despite a verbal order from Boasberg for the aircraft to turn around. Boasberg subsequently started a contempt investigation, though the dramatic battle between the judicial and executive branches has been paused by an appeals court.
The administration has denied violating his order.
Gelernt said in a statement on Thursday Boasberg had "begun the process of giving these men their right to challenge their removal."
"Remarkably, although the government does not dispute the men were denied due process, it still was not willing to do what was right without a court order," he said.