During his tenure, Ben Carson has continually tried to diminish HUD -- but to little effect in Detroit.