Hi Teckna,
MQX 3.8.1 installation contains pre-built MQX libraries (in the lib folder).
MQX 4.0 lib folder is almost empty after installation, users are required to compile MQX 4.0 libraries with their build tools. Also some BSPs have been completely removed from MQX 4.0, check release notes.