Kdump + Crash in I.MX

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Kdump + Crash in I.MX

Kdump + Crash in I.MX

Here is a summary including kdump + crash porting in i.mx, the tool is very useful in crash issue.

Overview

  • What is Kdump + Crash
  • Preconditions
    • kernel
    • kexec
  • Step actions
  • Crash tool
  • Analysis of use cases

 

Besides that, I summary the dumper tools including kdump and pstore, the respective patches shown as below:

Kdump:

Customer can apply below patch in config and cmdline, which has been confirmed on linux os. As memory is very precious to android, so kdump is not worth adopting.

Config:

       First kernel:

      CONFIG_KEXEC=y

      CONFIG_SYSFS=y

      CONFIG_DEBUG_INFO=Y

       Capture kernel:

      CONFIG_CRASH_DUMP=y

      CONFIG_PROC_VMCORE=y

Cmdline:

       crashkernel=512M

Pstore:

Customer can apply below patch in config and dts showing as below, which has been confirmed on linux and android os.

Config:

CONFIG_PSTORE_PMSG=y

Dts:

+               ramoops@0x91f00000 {

+                       compatible = "ramoops";

+                       reg = <0 0x91f00000 0 0x00100000>;

+                       record-size     = <0x00020000>;

+                       console-size    = <0x00020000>;

+                       ftrace-size     = <0x00020000>;

+                       pmsg-size       = <0x00020000>;

+               };

+

                decoder_boot: decoder-boot@84000000 {

                        reg = <0 0x84000000 0 0x2000000>;

                        no-map;

 

Reproduce steps

  1. Reboot the system by enter below command:

      $ reboot

  1. Check the related log by enter below command:

      $ ls /sys/fs/pstore/

         console-ramoops-0 pmsg-ramoops-0

Attachments
Comments

Dts:

+               ramoops@0x91f00000 {

+                       compatible = "ramoops";

+                       reg = <0 0x91f00000 0 0x00100000>;

+                       record-size     = <0x00020000>;

+                       console-size    = <0x00020000>;

+                       ftrace-size     = <0x00020000>;

+                       pmsg-size       = <0x00020000>;

+               };

+

                decoder_boot: decoder-boot@84000000 {

                        reg = <0 0x84000000 0 0x2000000>;

                        no-map;

 

where exactly I have to add lines?

%3CLINGO-SUB%20id%3D%22lingo-sub-1124321%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3EKdump%20%2B%20Crash%20in%20I.MX%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1124321%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CP%3EHere%20is%20a%20summary%20including%20kdump%20%2B%20crash%20porting%20in%20i.mx%2C%20the%20tool%20is%20very%20useful%20in%20crash%20issue.%3C%2FP%3E%0A%3CH1%20style%3D%22color%3A%20%23646464%3B%20background-color%3A%20%23ffffff%3B%20border%3A%200px%3B%20font-weight%3A%20600%3B%20font-size%3A%2026px%3B%22%20id%3D%22toc-hId-382454127%22%20id%3D%22toc-hId-1298499484%22%3EOverview%3C%2FH1%3E%0A%3CUL%3E%0A%3CLI%3EWhat%20is%26nbsp%3BKdump%20%2B%20Crash%3C%2FLI%3E%0A%3CLI%3EPreconditions%0A%3CUL%3E%0A%3CLI%3Ekernel%3C%2FLI%3E%0A%3CLI%3Ekexec%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3CLI%3EStep%20actions%3C%2FLI%3E%0A%3CLI%3ECrash%20tool%3C%2FLI%3E%0A%3CLI%3EAnalysis%20of%20use%20cases%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CBR%20%2F%3E%0A%3CP%3EBesides%20that%2C%26nbsp%3B%3CSPAN%3EI%20summary%20the%20dumper%20tools%20including%20kdump%20and%20pstore%2C%20the%26nbsp%3Brespective%20patches%20shown%20as%20below%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSTRONG%20style%3D%22font-size%3A%2016.0pt%3B%22%3EKdump%3A%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3ECustomer%20can%20apply%20below%20patch%20in%20config%20and%20cmdline%2C%20which%20has%20been%20confirmed%20on%20linux%20os.%20As%20memory%20is%20very%20precious%20to%20android%2C%20so%20kdump%20is%20not%20worth%20adopting.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EConfig%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20First%20kernel%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%20style%3D%22margin-left%3A%2021.0pt%3B%22%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3CSPAN%3ECONFIG_KEXEC%3Dy%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%20style%3D%22margin-left%3A%2021.0pt%3B%22%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20CONFIG_SYSFS%3Dy%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%20style%3D%22margin-left%3A%2021.0pt%3B%22%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20CONFIG_DEBUG_INFO%3DY%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20Capture%20kernel%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%20style%3D%22margin-left%3A%2021.0pt%3B%22%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3C%2FSPAN%3E%3CSPAN%3ECONFIG_CRASH_DUMP%3Dy%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%20style%3D%22margin-left%3A%2021.0pt%3B%22%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20CONFIG_PROC_VMCORE%3Dy%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3ECmdline%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3CSPAN%3Ecrashkernel%3D512M%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSTRONG%20style%3D%22font-size%3A%2016.0pt%3B%22%3EPstore%3A%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3ECustomer%20can%20apply%20below%20patch%20in%20config%20and%20dts%20showing%20as%20below%2C%20which%20has%20been%20confirmed%20on%20linux%20and%20android%20os.%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EConfig%3A%20%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%20style%3D%22text-indent%3A%2021.0pt%3B%22%3E%3CSPAN%3ECONFIG_PSTORE_PMSG%3Dy%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EDts%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20ramoops%400x91f00000%20%7B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20compatible%20%3D%20%22ramoops%22%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20reg%20%3D%20%26lt%3B0%200x91f00000%200%200x00100000%26gt%3B%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20record-size%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3D%20%26lt%3B0x00020000%26gt%3B%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20console-size%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3D%20%26lt%3B0x00020000%26gt%3B%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3Bftrace-size%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3D%20%26lt%3B0x00020000%26gt%3B%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20pmsg-size%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3D%20%26lt%3B0x00020000%26gt%3B%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%7D%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%2B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20decoder_boot%3A%20decoder-boot%4084000000%20%7B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20reg%20%3D%20%26lt%3B0%200x84000000%200%200x2000000%26gt%3B%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20no-map%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EReproduce%20steps%3C%2FSPAN%3E%3C%2FP%3E%0A%3COL%3E%0A%3CLI%3E%3CSPAN%3E%20Reboot%20the%20system%20by%20enter%20below%20command%3A%3C%2FSPAN%3E%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%24%20reboot%3C%2FSPAN%3E%3C%2FP%3E%0A%3COL%20start%3D%222%22%3E%0A%3CLI%3E%3CSPAN%3E%20Check%20the%20related%20log%20by%20enter%20below%20command%3A%3C%2FSPAN%3E%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%24%20ls%20%2Fsys%2Ffs%2Fpstore%2F%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3Bconsole-ramoops-0%20pmsg-ramoops-0%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1705034%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3ERe%3A%20Kdump%20%2B%20Crash%20in%20I.MX%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1705034%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CP%3E%3CSTRONG%3EDts%3A%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20ramoops%400x91f00000%20%7B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20compatible%20%3D%20%22ramoops%22%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20reg%20%3D%20%26lt%3B0%200x91f00000%200%200x00100000%26gt%3B%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20record-size%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3D%20%26lt%3B0x00020000%26gt%3B%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20console-size%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3D%20%26lt%3B0x00020000%26gt%3B%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3Bftrace-size%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3D%20%26lt%3B0x00020000%26gt%3B%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20pmsg-size%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%3D%20%26lt%3B0x00020000%26gt%3B%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20%7D%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%2B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20decoder_boot%3A%20decoder-boot%4084000000%20%7B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20reg%20%3D%20%26lt%3B0%200x84000000%200%200x2000000%26gt%3B%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSTRONG%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%20no-map%3B%3C%2FSTRONG%3E%3C%2FP%3E%3CBR%20%2F%3E%3CP%3E%3CSTRONG%3Ewhere%20exactly%20I%20have%20to%20add%20lines%3F%3C%2FSTRONG%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E
No ratings
Version history
Last update:
‎05-23-2022 01:32 AM
Updated by: