Hello Sander,
According to PN512's datasheet, it seems that TestSel1Reg[TstBusBitSel] field is used to map any bit from the testbus to be propagated to SIGOUT pin, however, if you look to Aux1/Aux2 pin description you will notice that TestBus signals can also be mapped to Aux1/Aux2 pins (AnalogTestReg). Please check that AnalogTestReg that controls AUX1 and AUX2 pins uses combination 1111 to map the TestBus-bits that are defined in TestSel1Reg. Have you tried to check if Aux1/Aux2 signals show the testBus signal that is configured in TestSel1Reg?
If I am correct, SIGOUT pin is controlled in the TxSelReg[SigOutSel] and combination for this register defines the 0011 for TestBus signals, after setting this field to 0011, you will be able to map this testBus signals to SIGOUT as well. Have you already done this configuration?
Hope this helps!
Regards,
Isaac