So I finally find what was wrong using the fontconfig-utils package
FYI fc-list can list the embedded fonts, and none was appearing ...
So what was missing is the package : liberation-fonts
Once installed fc-list could list the fonts and gstreamer textoverlay was then working ...
So guessing that you use yocto : add liberation-fonts into IMAGE_INSTALL of the image built
Regards,
Aurelien BOUIN