The second column, the one with a folder symbol, defines if all the subfolders should be searched as well.
Check the "Access Paths" topic in the manual, this preference panel is described.
To open a specific header like math.h, I usually use the Ctrl-D shortcut. Just enter the filename and CW opens it, it does consider the search path of the current project.
Daniel