Can the high frequency clock be enabled while in DS (0)? I am seeing the clock get shut down when I go into DS but I am not sure if it's me or the MCU doing it yet. The documentation isn't clear on what the expected behavior for these pins is. The bits (PAXX_XTAL_OE) are set in the PIO_WAKEUP_EN1 register which implies that there is a power mode component to the functionality.
I have XTAL_PDM_DIS and OSC32M_PDM_DIS set to 0 in PMU_CTRL_2 so the clocks themselves should be running.