We investigate the longitudinal impedance due to coherent undulator radiation in a rectangular waveguide. We find that the impedance exhibits narrow peaks at resonant frequencies at which waveguide modes are in synchronism with particle motion in the undulator. Analytical calculations are compared with numerical simulations carried out with a computer code that solves parabolic equation for the electromagnetic field.