Sorry, this is the only way --> repo sync the whole project, clone the kernel and u-boot source code, and then apply the patches for i.MX (c_patch).
So after you downloaded the Android source code before patch, it is better to make a copy and store it in another folder.