Hello,
For reviewing the design on the custom board, I would recommend checking the post The best way to build a PCB first time right with KW45 (Automotive) or K32W1/MCXW71 (IoT/Industrial), this post includes the overall characteristics that a KW45 board must have, including the recommendations in KW45 Hardware Design Recommendations Public
As you mentioned that the keys have not been written yet, you will need to program keys to device; Writing RoTKTH and SB3KDK keys to fuse is essential. And the error in the image shows fail in programming SB3KDK key.
Could you help us confirm if your KW45 custom board its intended for use same as the KW45B41Z-EVK or to a custom end application?
If the intention it's to use the KW45 board with functionality same as the KW45B41Z-EVK, you can use the default SBKDK and RoTKTH keys described in AN14003 Chapter 5.2.1
If you want to use your board for a different custom end application; You will need to generate the custom keys and signed image [process described in chapter 4.2 and in the Jupyter Notebook example]; for custom keys, you must generate the .sb3 file using the .xip file to configure for the custom keys.
Best Regards
Luis