Hi
The VIVANTE_SDK_DIR which is gpu source code folder and it is not open for customer, you can try YOCTO.cmake with exported Yocto SDK. The build will use gpu relate .so files from VIVANTE_SDK_DIR or buildroot/yocto sdk.
-DEXTERNAL_VIV_SDK =< yocto sdk sysroot>

Best Regards
Zhiming