The government has "instructed action" in a strong message to those involved in an Ipswich tower block after residents from 80 flats were suddenly evacuated.
It comes three months after a prohibition notice was served to residents of floors seven to nine of Cardinal Lofts due to fire risk.
Grey GR has organised hotels and meals for residents as it looks to source longer-term accommodation.
The Secretary of State for Levelling Up, Housing and Communities Michael Gove said it is "not the first time" Grey GR and Railpen had let people down badly, adding he had "instructed action this day" from the office's layers.
Mr Gove said: “The safety of residents must be the top priority.
"This is not the first time Grey GR and Railpen have badly let down people living in their buildings.
“They must fix them urgently, so that people can get back in their homes.
“Our new laws are clear. The liability is clear. Our intention and commitment to prosecute those who do not do the right thing is clear.
“I have now instructed action this day from our lawyers.”
He met with Ipswich MP Tom Hunt over the issue on Wednesday.
Mr Hunt said: "The situation at Cardinal Lofts is appalling.
“Again, we have a number of my constituents being told with no notice they need to leave their homes with no certainty at all over timescales.
“To say all of this must be discombobulating and distressing is an understatement.
“The scale of the defects are such I think the works could take a long time. If this is so, we will most likely need more compensation than just the cost of temporary accommodation.
“As I’ve said before, we need a regulatory framework that holds badly behaving freeholders and agents to account.
“Many of the key defects with Cardinal Lofts were known about a number of years ago, but no action was taken.”
Ipswich mayor John Cook called the evacuation of the residents at Cardinal Lofts “shocking”.
He added: “My heart goes out to the residents who have already suffered more than enough.
“We need the government to get a grip of this now. Everyone caught up in this scandal has my total support.”
Neil MacDonald, Ipswich Borough Council portfolio holder for housing, added: "My heart goes out to the poor residents caught up in this. It's not their fault that they have been uprooted from their homes and now face an uncertain future.
“The indifferent government needs to act to ensure speedy access to the Building Safety Fund for rebuilding and that the freeholder, Grey GR, is held to account."
Jack Abbott, Labour's prospective parliamentary candidate for Ipswich, said: "The scandal that is the building safety crisis continues, with even more people in Ipswich now affected by this misery.
"Grotesque market failure combined with an indifferent government means people in the town and across the country are living through hell.
"It's been nearly six years since the Grenfell tragedy, but we've seen barely any lasting change. This will keep happening until the government decides to take these issues seriously - simply relying on the market is a weak, flawed and irresponsible approach."
Grey GR issued a statement on Tuesday regarding the evacuation.
It said: "We will continue to communicate as further updates become available and wish to do all that we can to ease the understandable distress this will cause.
"We are working with our project team to determine next steps. All decisions made will be in the best interests and safety of residents, and in accordance with the advice of the Suffolk Fire and Rescue Service.
"We are also in direct contact with the Department for Levelling Up, Housing and Communities and we are providing key updates to the local MP.”
Railpen, which owns Grey GR, was approached for comment.
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules here