A battle could be brewing over the future of a now-empty prison whose owners have expressed interest in contracting with ICE.