I had already tested that but it seems I found the problem. SOmething is overwriting the control register as anything I set in the dts is not implemented. When I check the control register in linux thanks to devmem2, it shows up as 0000000. When I manually seet it to 20100, it works without any issues. If anyone has any idea what could cause this, be my guest. For now at least we have a solution, thanks for your help.