Hi, James,
Regarding your question, I think the PCM data is in complementary format, pls refer to the following diagram in UM10914.pdf.

In 16 bits complementary, for the positive data, it is from 0, 1,2... to 0x7FFF, the 0x7FFF is the maximum. For negative value, it is from 0xFFFF, 0xFFFE, 0xFFFD...0x8000, the 0xFFFF approaches to zero, 0x8000 is the minimum value.
This is the complementary data format description:

I conclusion, I think it is okay the PCM data is from 0~5 or 65530~65535 in silent environment.
Hope it can help you
BR
XiangJun Rong