Hi Peter,
I do not have a soundbite, so I can only offer some general help with the codec. The codec can be configured for 32 kHz in a number of ways. I would bet that the soundbite supports one of these two.
One way is to select 48 kHz, and then simply run the clock slower by programming the ESAI. (I'm assuming the AK4584's clock MCLK is generated by the ESAI). The frequency of MCLK can be changed by modifying the TPMn bits in the TCCR register and/or the RPMn bits in the RCCR register.
But another way is to change the MCLK to LRCK ratio. When you are setup for 48 kHz sample rate, the MCLK/LRCK ratio is likely to be 256fs or 512fs. If you change that ratio to 368fs or 768fs (respectively) you will then have a 32 kHz sample rate. This can be done be changing the slot-length in the TCR or RCR (or both, depending on your application) from 32-bits to 24-bits.
Note that 192fs, 384fs and 768fs modes are only available when the ak4556 is in slave mode. I am assuming that the soundbite allows the AK4556 to be configured for slave mode. (otherwise, it's pretty useless).