I am looking at the Schematics of the TWRK60N512 RevD. The potentiometer pin 2 is connected to ADC1_DM1. The second differential input of the ADC ADC1_DP1 is pulled high to 3.3V on one of the 20pin connectors.
If your ADC software is measuring differential than indeed 3.28V will equal a reading close to zero and when pin2 is at 0V than the ADC measures the pullup voltage of 3.3V which corresponds to about 32267.
So everything is ok. The potentiometer is just connected in a strange way.
On a side note, beware that the potentiometer is a 5K resistor and the input resistance of the ADC is also 5K. This is not ideal since for a precise measurement the ADC should have a much higher resistance. So dont expect precise results from this setup.