ptp_qoriq driver crashes at boot time

[vm18553]

I'm getting the following kernel crash at boot time from ptp_qoriq driver

[ 5.374889] Hardware name: Freescale LS1021A
[ 5.374894] Backtrace:
[ 5.374920] [<8020ca9c>] (dump_backtrace) from [<8020cde4>] (show_stack+0x20/0x24)
[ 5.374930] r7:200d0093 r6:80c73e30 r5:00000000 r4:80c73e30
[ 5.374943] [<8020cdc4>] (show_stack) from [<807af14c>] (dump_stack+0x80/0x94)
[ 5.374959] [<807af0cc>] (dump_stack) from [<80270b90>] (register_lock_class+0x190/0x610)
[ 5.374966] r7:00000000 r6:9ddc2a78 r5:00000000 r4:00000000
[ 5.374978] [<80270a00>] (register_lock_class) from [<80272c90>] (__lock_acquire.constprop.0+0x6c/0x950)
[ 5.374988] r10:600d0013 r9:80c12f34 r8:80c4970c r7:9f14e900 r6:811a9010 r5:00000000
[ 5.374991] r4:00000000
[ 5.374999] [<80272c24>] (__lock_acquire.constprop.0) from [<8027368c>] (lock_acquire+0x118/0x238)
[ 5.375008] r10:600d0013 r9:80c12f34 r8:80c78f70 r7:00000000 r6:00000000 r5:00000000
[ 5.375011] r4:00000000
[ 5.375022] [<80273574>] (lock_acquire) from [<807c7f74>] (rt_spin_lock+0x64/0x74)
[ 5.375032] r10:00000000 r9:00000002 r8:9ddc2a00 r7:14e75970 r6:c4c60bf7 r5:7f00a34c
[ 5.375035] r4:9ddc2a14
[ 5.375065] [<807c7f10>] (rt_spin_lock) from [<7f00a34c>] (ptp_qoriq_settime+0x48/0x88 [ptp_qoriq])
[ 5.375070] r5:9ddc2a14 r4:9ddc2a94
[ 5.375094] [<7f00a304>] (ptp_qoriq_settime [ptp_qoriq]) from [<7f00aa00>] (ptp_qoriq_init+0x20c/0x340 [ptp_qoriq])
[ 5.375104] r9:00000002 r8:9ddc2a94 r7:00000000 r6:9ddc2a14 r5:9fff4098 r4:9ddc2a00
[ 5.375128] [<7f00a7f4>] (ptp_qoriq_init [ptp_qoriq]) from [<7f00acb4>] (ptp_qoriq_probe+0xe4/0x19c [ptp_qoriq])
[ 5.375136] r8:7f00d014 r7:811e33bc r6:00000000 r5:9f227400 r4:9ddc2a00
[ 5.375157] [<7f00abd0>] (ptp_qoriq_probe [ptp_qoriq]) from [<805ecebc>] (platform_drv_probe+0x44/0x80)
[ 5.375163] r6:00000000 r5:7f00d014 r4:9f227410
[ 5.375173] [<805ece78>] (platform_drv_probe) from [<805eb400>] (really_probe+0x1ec/0x28c)
[ 5.375178] r5:9f227410 r4:811e33b8
[ 5.375187] [<805eb214>] (really_probe) from [<805eb56c>] (__driver_attach+0xcc/0xd0)
[ 5.375197] r10:7f00d1d4 r9:7f00d1c0 r8:00000000 r7:80c54d80 r6:9f227444 r5:7f00d014
[ 5.375201] r4:9f227410 r3:00000007
[ 5.375213] [<805eb4a0>] (__driver_attach) from [<805e9744>] (bus_for_each_dev+0x88/0xac)
[ 5.375221] r7:80c54d80 r6:805eb4a0 r5:7f00d014 r4:00000000
[ 5.375231] [<805e96bc>] (bus_for_each_dev) from [<805eae80>] (driver_attach+0x2c/0x30)
[ 5.375237] r6:00000000 r5:9ddb9b00 r4:7f00d014
[ 5.375245] [<805eae54>] (driver_attach) from [<805ea9a4>] (bus_add_driver+0x194/0x214)
[ 5.375254] [<805ea810>] (bus_add_driver) from [<805ebdb4>] (driver_register+0x88/0x104)
[ 5.375261] r7:7f00d280 r6:00000000 r5:ffffe000 r4:7f00d014
[ 5.375271] [<805ebd2c>] (driver_register) from [<805ece70>] (__platform_driver_register+0x50/0x58)
[ 5.375276] r5:ffffe000 r4:7f010000
[ 5.375294] [<805ece20>] (__platform_driver_register) from [<7f010020>] (ptp_qoriq_driver_init+0x20/0x1000 [ptp_qoriq])
[ 5.375313] [<7f010000>] (ptp_qoriq_driver_init [ptp_qoriq]) from [<80201718>] (do_one_initcall+0x54/0x174)
[ 5.375325] [<802016c4>] (do_one_initcall) from [<802b9c8c>] (do_init_module+0x74/0x230)
[ 5.375334] r8:00000000 r7:7f00d280 r6:9de61740 r5:80c12f34 r4:7f00d080
[ 5.375343] [<802b9c18>] (do_init_module) from [<802bbc58>] (load_module+0x1288/0x1788)
[ 5.375351] r7:7f00d280 r6:80c7913c r5:80c12f34 r4:7f00d080
[ 5.375360] [<802ba9d0>] (load_module) from [<802bc378>] (SyS_finit_module+0xb4/0xcc)
[ 5.375370] r10:00000000 r9:9dd90000 r8:80207e24 r7:0000017b r6:76f75578 r5:00000008
[ 5.375373] r4:00000000
[ 5.375385] [<802bc2c4>] (SyS_finit_module) from [<80207c40>] (ret_fast_syscall+0x0/0x54)
[ 5.375392] r6:00000000 r5:01592ec0 r4:01593ab0

Following are my hardware & kernel setting

Processor -  Freescale LS1021A

Kernel      -  4.14.53-rt34

I tried this  fix from 5.4-rt kernel but it didn't fix my issue.

Any help is appreciated. Thanks