Reducing the duct diameter by a factor of 2 decreased the duct area by a factor of 4. No wonder why the fan current went up. I suspect that the fan motors and the dimming lights share the same circuit or the same phase in the same subpanel. Fix the fan ducting or reduce the fan size.