Hello,
yes, you need to tell the compiler where your header files are.
This depends a little bit for each compiler.
Select the project, then use the menu Project > Properties. Then the settings are in C/C++ Build > Settings.
Below is a screenshot for ARM gcc:

I hope this helps.
PS: MCU10.2 is rathe old. I recommend that you use the latest 10.4 release.