data2/text/range/10001-15000/749901.txt

Ticket Name: Linux/TDA2: Segmentation fault

Query Text:
Part Number: TDA2 Tool/software: Linux i am using SDK_VISION_03_04_00_00 I made a LINK of my algorithm and ran it in sample_app. The program started to run well, but it would appear about ten minutes later. follow is the log [HOST] [DSP1 ] 1094.048831 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1094.149972 s: AHD_Detect_times = 97.403772 ms,success=0 [HOST] [DSP1 ] 1094.150064 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1094.251082 s: AHD_Detect_times = 97.282800 ms,success=0 [HOST] [DSP1 ] 1094.251143 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1094.352254 s: AHD_Detect_times = 97.394972 ms,success=0 [HOST] [DSP1 ] 1094.352315 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1094.453303 s: AHD_Detect_times = 97.219344 ms,success=0 [HOST] [DSP1 ] 1094.453333 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1094.554474 s: AHD_Detect_times = 97.379104 ms,success=0 [HOST] [DSP1 ] 1094.554535 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1094.655584 s: AHD_Detect_times = 97.270472 ms,success=0 [HOST] [DSP1 ] 1094.655615 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 ****** Segmentation fault caught .... Broadcast message from systemd-journald@dra7xx-evm (Wed 2018-10-24 06:52:24 UTC): systemd[1]: Caught <SEGV>, dumped core as pid 426. Broadcast message from systemd-journald@dra7xx-evm (Wed 2018-10-24 06:52:24 UTC): systemd[1]: Freezing execution. ./start: line 4: 863 Segmentation fault (core dumped) ./sample_app.out root@dra7xx-evm:~# [ 1088.140580] virtio_rpmsg_bus virtio0: msg received with no recipient [ 1088.146972] virtio_rpmsg_bus virtio0: msg received with no recipient [ 1187.290318] systemd-journald[126]: Failed to send WATCHDOG=1 notification message: Connection refused i donot know what is the problem, What should I check? thanks SHUAI

Responses:
[HOST] [DSP1 ] 1158.886841 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1158.987921 s: AHD_Detect_times = 97.415181 ms,success=0 [HOST] [DSP1 ] 1158.987982 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1159.088940 s: AHD_Detect_times = 97.229625 ms,success=0 [HOST] [DSP1 ] 1159.089001 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1159.190111 s: AHD_Detect_times = 97.391353 ms,success=0 [HOST] [DSP1 ] 1159.190172 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1159.291221 s: AHD_Detect_times = 97.270193 ms,success=0 [HOST] [DSP1 ] 1159.291282 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1159.392423 s: AHD_Detect_times = 97.426917 ms,success=0 [HOST] [DSP1 ] 1159.392484 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [HOST] [DSP1 ] 1159.493594 s: AHD_Detect_times = 97.354561 ms,success=0 [HOST] [DSP1 ] 1159.493625 s: i32SignNumber=1 eModel=2 left=593 right=714 top=335 bottom=520 [ 1152.846126] omap-iommu 40d02000.mmu: iommu fault: da 0x98c03000 flags 0x0 [ 1152.852951] remoteproc1: crash detected in 40800000.dsp: type mmufault [ 1152.859604] omap-iommu 40d02000.mmu: 40d02000.mmu: errs:0x00000002 da:0x98c03000 pgd:0xed196630 *pgd:0xad93c801 pte:0xed93c80c *pte:0x00000000 [ 1152.872650] remoteproc1: handling crash #1 in 40800000.dsp9 ms,success=0 [HOST] [DSP1 ] 1159.594827 s: i32SignNumber=1 eModel=2 left593 right=714 top=335 bottom=520 [ 1152.885615] remoteproc1: recovering 40800000.dsp ****** Segmentation fault caught ....[ 1152.900696] dra7_clear_dsp_edma_xbar: Clearing all EDMA XBAR routings to DSP1 [ 1152.910451] dra7_wait_dsp_edma_compl: waiting for DSP1 EDMA traffic on TPCC to complete [ 1152.920096] dra7_wait_dsp_edma_compl: DSP1 EDMA transaction may be ongoing during shutdown! TPCC is active! [ 1152.930085] dra7_wait_dsp_edma_compl: waiting for DSP1 EDMA traffic on TPTC0 to complete [ 1152.938609] dra7_wait_dsp_edma_compl: DSP1 EDMA transaction may be ongoing during shutdown! TPTC0 is active! [ 1152.948615] dra7_wait_dsp_edma_compl: waiting for DSP1 EDMA traffic on TPTC1 to complete [ 1152.964474] omap_hwmod: timer5: _wait_target_disable failed rBoadcast message from systemd-journald@dra7xx-evm (Wed 2018-0-24 06:52:54 UTC): systemd[1]: Caught <ABRT>, dumped core as pid 779. [ 1152.998005] omap_hwmod: mmu1_dsp1: _wait_target_disable failed Broadcast message from systemd-journald@dra7xx-evm (Wed 201-10-24 06:52:54 UTC): systemd[1]: Freezing execution. [ 1153.011197] omap_hwmod: mmu0_dsp1: _wait_target_disable failed Broadcast message from systemd-journald@dra7xx-evm (Wed 2018-0-24 06:52:54 UTC): systemd[1]: Caught <SEGV>, dumped core as pid 784. [ 1153.021144] remoteproc1: stopped remote processor 40800000.dsp [ 1153.045630] remoteproc1: powering up 40800000.dspd 2018-0-24 06:52:54 UTC): systemd[1]: Freezing execution. [ 1153.057406] remoteproc1: Booting fw image dra7-dsp1-fw.xe66, size 2340479 [ 1153.072033] omap_hwmod: mmu0_dsp1: _wait_target_disable failed [ 1153.077925] omap-iommu 40d01000.mmu: 40d01000.mmu: version 3.0 [ 1153.083869] omap-iommu 40d02000.mmu: 40d02000.mmu: version 3.0 [ 1153.115111] omap-rproc 40800000.dsp: mbox_request_channel failed: -19 [ 1153.121728] remoteproc1: can't start rproc 40800000.dsp: -16 [ 1153.165676] omap_hwmod: mmu1_dsp1: _wait_target_disable failed [ 1153.178670] omap_hwmod: mmu0_dsp1: _wait_target_disable failed [ 1153.217114] remoteproc1: rproc_boot() failed -16 [ 1153.221885] virtio_rpmsg_bus: probe of virtio0 failed with error -16 [ 1153.237146] remoteproc1: registered virtio0 (type 7) [ 1153.708240] ------------[ cut here ]------------ [ 1153.712888] WARNING: CPU: 0 PID: 159 at lib/kobject_uevent.c:403 add_uevent_var+0xc4/0xcc() [ 1153.721285] add_uevent_var: buffer size too small [ 1153.726004] Modules linked in: cmemk(O) memcache(O) xhci_plat_hcd xhci_hcd usbcore rpmsg_proto dwc3 udc_core virtio_rpmsg_bus bc_example(O) extcon_usb_gpio pvrsrvkm(O) c_can_platform omap_aes_driver c_can ahci_platform omap_sham can_dev libahci_platform libahci libata scsi_mod dwc3_omap extcon rtc_omap omap_rng rng_core omap_des omap_remoteproc remoteproc virtio virtio_ring sch_fq_codel [ 1153.760848] CPU: 0 PID: 159 Comm: systemd-journal Tainted: G O 4.4.84-00027-g018eb62 #2 [ 1153.770015] Hardware name: Generic DRA74X (Flattened Device Tree) [ 1153.776129] Backtrace: [ 1153.778596] [<c0013a9c>] (dump_backtrace) from [<c0013c98>] (show_stack+0x18/0x1c) [ 1153.786192] r7:c02b6b60 r6:60070013 r5:00000000 r4:c0953590 [ 1153.791902] [<c0013c80>] (show_stack) from [<c02b3868>] (dump_stack+0x8c/0xa0) [ 1153.799154] [<c02b37dc>] (dump_stack) from [<c00357dc>] (warn_slowpath_common+0x88/0xb8) [ 1153.807274] r7:c02b6b60 r6:00000193 r5:00000009 r4:ee611d18 [ 1153.812979] [<c0035754>] (warn_slowpath_common) from [<c0035844>] (warn_slowpath_fmt+0x38/0x40) [ 1153.821708] r8:c088a8c4 r7:ef24ec10 r6:eda6f000 r5:c0974930 r4:c0847980 [ 1153.828464] [<c0035810>] (warn_slowpath_fmt) from [<c02b6b60>] (add_uevent_var+0xc4/0xcc) [ 1153.836671] r3:000007b2 r2:c0847980 [ 1153.840268] r4:eda6f000 [ 1153.842816] [<c02b6aa0>] (add_uevent_var) from [<c050bcec>] (of_device_uevent+0x194/0x1c4) [ 1153.851109] r3:cfffb322 r2:00000000 r1:c088a8c4 [ 1153.855756] r4:ef64a134 [ 1153.858304] [<c050bb58>] (of_device_uevent) from [<c03e6d64>] (dev_uevent+0x7c/0x1d4) [ 1153.866161] r9:eda6a000 r8:eda6f000 r7:eda6a000 r6:ef24ec10 r5:eda6f000 r4:ef24ec18 [ 1153.873965] [<c03e6ce8>] (dev_uevent) from [<c03e4e98>] (uevent_show+0xa4/0x118) [ 1153.881386] r7:eda6a000 r6:c06d7970 r5:ef24ec18 r4:ef05dd00 [ 1153.887090] [<c03e4df4>] (uevent_show) from [<c03e54b4>] (dev_attr_show+0x24/0x50) [ 1153.894685] r9:eda6a000 r8:ed06b600 r7:ef24ec18 r6:c06d7970 r5:c0964060 r4:eebfc600 [ 1153.902492] [<c03e5490>] (dev_attr_show) from [<c018594c>] (sysfs_kf_seq_show+0x90/0xfc) [ 1153.910611] r5:00001000 r4:eebfc600 [ 1153.914213] [<c01858bc>] (sysfs_kf_seq_show) from [<c01843f4>] (kernfs_seq_show+0x2c/0x30) [ 1153.922506] r9:ee611e58 r8:ee611f78 r7:ed865f00 r6:00000001 r5:00000000 r4:eebfc600 [ 1153.930314] [<c01843c8>] (kernfs_seq_show) from [<c01427f0>] (seq_read+0x1b0/0x4fc) [ 1153.938001] [<c0142640>] (seq_read) from [<c018514c>] (kernfs_fop_read+0x120/0x1a4) [ 1153.945685] r10:00000000 r9:00001000 r8:ee611f78 r7:00000000 r6:c018502c r5:00001000 [ 1153.953571] r4:ed06b600 [ 1153.956119] [<c018502c>] (kernfs_fop_read) from [<c011fe74>] (__vfs_read+0x34/0xdc) [ 1153.963801] r10:00000000 r9:00001000 r8:00001000 r7:00000000 r6:c018502c r5:ee611f78 [ 1153.971690] r4:ed865f00 [ 1153.974235] [<c011fe40>] (__vfs_read) from [<c01206b4>] (vfs_read+0x80/0x10c) [ 1153.981395] r9:00001000 r8:004f5738 r7:00000000 r6:ee611f78 r5:ed865f00 r4:004f5738 [ 1153.989200] [<c0120634>] (vfs_read) from [<c0120f8c>] (SyS_read+0x44/0x98) [ 1153.996097] r9:00001000 r8:004f5738 r7:00000000 r6:00000000 r5:ed865f00 r4:ed865f00 [ 1154.003902] [<c0120f48>] (SyS_read) from [<c000fbe0>] (ret_fast_syscall+0x0/0x3c) [ 1154.011411] r9:ee610000 r8:c000fda4 r7:00000003 r6:00001000 r5:00000000 r4:004f05d8 [ 1154.019255] ---[ end trace 7e9de38f4a84b1cb ]---

Hi Shuai, I see you get some iommu faults. Can you check if those documents can help you to debug them: processors.wiki.ti.com/.../IPC_MMU_fault_debug www.ti.com/.../sprac12.pdf Regards, Yordan

Hi :Yordan the log is diffrent each time ! The errors reported have been changing. SHUAI

Hi Shuaj, I have pinged Linux expert for further help. Regards, Yordan

Hi Shuai, Can you please run the below command on your target, and attach the output (configs.txt). zcat /proc/config.gz > configs.txt Please also provide the output of the below command run on the target: cat /proc/meminfo Regards Shravan

Hi Shravan [HOST] [HOST ] 55.705545 s: SYSTEM: IPC: De-init DONE !!! [HOST] [HOST ] 55.705545 s: SYSTEM: System A15 De-Init Done !!! root@dra7xx-evm:~# zcat /proc/config.gz > configs.txt root@dra7xx-evm:~# root@dra7xx-evm:~# root@dra7xx-evm:~# cat /proc/meminfo MemTotal: 616988 kB MemFree: 453284 kB MemAvailable: 499500 kB Buffers: 208 kB Cached: 57440 kB SwapCached: 0 kB Active: 38296 kB Inactive: 26712 kB Active(anon): 8720 kB Inactive(anon): 7860 kB Active(file): 29576 kB Inactive(file): 18852 kB Unevictable: 0 kB Mlocked: 0 kB HighTotal: 260096 kB HighFree: 211280 kB LowTotal: 356892 kB LowFree: 242004 kB SwapTotal: 0 kB SwapFree: 0 kB Dirty: 0 kB Writeback: 0 kB AnonPages: 7392 kB Mapped: 8952 kB Shmem: 9224 kB Slab: 17572 kB SReclaimable: 6800 kB SUnreclaim: 10772 kB KernelStack: 856 kB PageTables: 324 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 308492 kB Committed_AS: 37912 kB VmallocTotal: 245760 kB VmallocUsed: 0 kB VmallocChunk: 0 kB CmaTotal: 204800 kB CmaFree: 130808 kB root@dra7xx-evm:~#

# # Automatically generated file; DO NOT EDIT. # Linux/arm 4.4.84 Kernel Configuration # CONFIG_ARM=y CONFIG_ARM_HAS_SG_CHAIN=y CONFIG_MIGHT_HAVE_PCI=y CONFIG_SYS_SUPPORTS_APM_EMULATION=y CONFIG_HAVE_PROC_CPU=y CONFIG_STACKTRACE_SUPPORT=y CONFIG_LOCKDEP_SUPPORT=y CONFIG_TRACE_IRQFLAGS_SUPPORT=y CONFIG_RWSEM_XCHGADD_ALGORITHM=y CONFIG_ARCH_HAS_BANDGAP=y CONFIG_FIX_EARLYCON_MEM=y CONFIG_GENERIC_HWEIGHT=y CONFIG_GENERIC_CALIBRATE_DELAY=y CONFIG_NEED_DMA_MAP_STATE=y CONFIG_ARCH_SUPPORTS_UPROBES=y CONFIG_VECTORS_BASE=0xffff0000 CONFIG_ARM_PATCH_PHYS_VIRT=y CONFIG_GENERIC_BUG=y CONFIG_PGTABLE_LEVELS=2 CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config" CONFIG_IRQ_WORK=y CONFIG_BUILDTIME_EXTABLE_SORT=y # # General setup # CONFIG_INIT_ENV_ARG_LIMIT=32 CONFIG_CROSS_COMPILE="" # CONFIG_COMPILE_TEST is not set CONFIG_LOCALVERSION="" CONFIG_LOCALVERSION_AUTO=y CONFIG_HAVE_KERNEL_GZIP=y CONFIG_HAVE_KERNEL_LZMA=y CONFIG_HAVE_KERNEL_XZ=y CONFIG_HAVE_KERNEL_LZO=y CONFIG_HAVE_KERNEL_LZ4=y # CONFIG_KERNEL_GZIP is not set CONFIG_KERNEL_LZMA=y # CONFIG_KERNEL_XZ is not set # CONFIG_KERNEL_LZO is not set # CONFIG_KERNEL_LZ4 is not set CONFIG_DEFAULT_HOSTNAME="(none)" CONFIG_SWAP=y CONFIG_SYSVIPC=y CONFIG_SYSVIPC_SYSCTL=y CONFIG_POSIX_MQUEUE=y CONFIG_POSIX_MQUEUE_SYSCTL=y CONFIG_CROSS_MEMORY_ATTACH=y CONFIG_FHANDLE=y CONFIG_USELIB=y # CONFIG_AUDIT is not set CONFIG_HAVE_ARCH_AUDITSYSCALL=y # - configs.txt 1/5186 0%

Hi Shuai, Please attach the file config.txt, please don't paste the output as is. Regards Shravan

configs.txt

Hi Shravan configs.txt has up here Regards shuai

Hi Shuai, Please check the status of the iommu registers to find out where the iommu fault has occured. You can check the iommu register status using the below command on the target: cat /sys/kernel/debug/omap_iommu/<iommu_id>/regs This will give the address of the IOMMU fault. You can then use CCS and debugger to add a hardware watch-point at the address of the IOMMU fault, to figure out the backtrace for the error on the DSP. Regards Shravan

Hi Shravan have memory leak shuai