Residents of the admittedly deteriorating complex, one of few permanently affordable housing sites in the parish, are being cast into an unfavorable housing market that will force many to move further from their workplaces, their children’s schools and their families, tenant advocates have argued.