Hi,
Can you let us know which BSP are you working with?
Overall, the changes should be made under the DTB of ATF, in which under the i2c4 you should see the VR5510 being referenced. On your specific case, you should move it to the i2c1 node:

Please, let us know.