Can a government fine a school?

What is usually the penalty if a school does not comply with regulations set forth by the government? This can include public as well as private schools.