After various tests I could find the problem :smileyhappy:
The problem is the security module IBM Security Trusteer Rapport that my bank uses to provide a safe access to the bank site.
After I uninstalled it the build works very fast again.
When using parallel build, one instance of GCC is called to build each file and I think this security module was scanning each instance of GCC.
My project has more than 100 files to build and each file took more than 30 seconds to be compiled because of that software :smileysad:
Thanks for the help, David Seymour.
I was already using parallel build that way in the post.
I think this post can help other users with similar problems.