Hi,
The PIT is clocked from the Peripheral set 0 clock derived from the system clock which is divided by System clock divider 0. See Figure 10-1 of the device Reference manual. So if this divider is set to div by 1 (default value of CGM_SC_DC0 register) then the PIT is clocked from system clock. If you select ext osc (or ext clock) as system clock then PIT cannot run slowly, unless crystal and ext clock have different frequency. Similarly if PLL is used as system clock, it does not matter.
BR, Petr