July 2020 - kernelnewbies@kernelnewbies.org - Kernelnewbies Mailing Lists

TPM error 256 (TPM_RC_INITIALIZE)
by Tomek The Messenger July 8, 2020

July 8, 2020

Hi Was anyone dealing with TPM? I have error during TPM initialization: tpm tpm0: A TPM error (256) occurred continue seltest And I have similar error when executing /sbin/reboot: tpm tpm0: A TMP error (256) occurred stopping the TPM What I might say is that in filesystem there are files: dev/tmp0 dev/tmprm0 Looking solution in google I found two different opinions: One is not to matter with this error: "Yeah, those messages are confusing if you are not used to them, maybe I get to clean that up at some point. In this case, the kernel <https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git/tre…> assumes that the platform has started the TPM, but as RC_INITIALIZE shows this is not the case. So the kernel will happily start the TPM and retry the action, but you do not get any success message for that. But you should get your /dev/tpm* if everything works." Second opinion is: "The device is usable but not with a full potential. It's seems that TPM is not getting initialized correctly in the firmware." Is something needed to debug here? Maybe I should ask authors of this drivers what those errors during linux startup and close mean?

1 0

Kbuild support for rebuilding a single driver gone?
by Bjørn Mork July 8, 2020

July 8, 2020

I have "always" tested simple patches by rebuilding just the affected driver on whatever kernel I happen to run. Like this: bjorn@miraculix:/usr/local/src/git/linux$ make -C /lib/modules/4.19.0-9-amd64/build M=$(pwd)/drivers/net/usb clean make: Entering directory '/usr/src/linux-headers-4.19.0-9-amd64' CLEAN /usr/local/src/git/linux/drivers/net/usb/Module.symvers make: Leaving directory '/usr/src/linux-headers-4.19.0-9-amd64' bjorn@miraculix:/usr/local/src/git/linux$ make -C /lib/modules/4.19.0-9-amd64/build M=$(pwd)/drivers/net/usb qmi_wwan.ko make: Entering directory '/usr/src/linux-headers-4.19.0-9-amd64' CC [M] /usr/local/src/git/linux/drivers/net/usb/qmi_wwan.o MODPOST 1 modules CC /usr/local/src/git/linux/drivers/net/usb/qmi_wwan.mod.o LD [M] /usr/local/src/git/linux/drivers/net/usb/qmi_wwan.ko make: Leaving directory '/usr/src/linux-headers-4.19.0-9-amd64' But this is broken for some reason with recent Debian (bullseye/sid) kernels, based on 5.6 or 5.7 kernels. They will always compile all source files in the directory, even of most of them are not necessary for the requested target: bjorn@miraculix:/usr/local/src/git/linux$ make -C /lib/modules/5.7.0-1-amd64/build M=$(pwd)/drivers/net/usb clean make: Entering directory '/usr/src/linux-headers-5.7.0-1-amd64' CLEAN /usr/local/src/git/linux/drivers/net/usb/Module.symvers make: Leaving directory '/usr/src/linux-headers-5.7.0-1-amd64' bjorn@miraculix:/usr/local/src/git/linux$ make -C /lib/modules/5.7.0-1-amd64/build M=$(pwd)/drivers/net/usb qmi_wwan.ko make: Entering directory '/usr/src/linux-headers-5.7.0-1-amd64' AR /usr/local/src/git/linux/drivers/net/usb/built-in.a CC [M] /usr/local/src/git/linux/drivers/net/usb/catc.o CC [M] /usr/local/src/git/linux/drivers/net/usb/kaweth.o CC [M] /usr/local/src/git/linux/drivers/net/usb/pegasus.o CC [M] /usr/local/src/git/linux/drivers/net/usb/rtl8150.o CC [M] /usr/local/src/git/linux/drivers/net/usb/r8152.o CC [M] /usr/local/src/git/linux/drivers/net/usb/hso.o CC [M] /usr/local/src/git/linux/drivers/net/usb/lan78xx.o CC [M] /usr/local/src/git/linux/drivers/net/usb/asix_devices.o CC [M] /usr/local/src/git/linux/drivers/net/usb/asix_common.o CC [M] /usr/local/src/git/linux/drivers/net/usb/ax88172a.o LD [M] /usr/local/src/git/linux/drivers/net/usb/asix.o CC [M] /usr/local/src/git/linux/drivers/net/usb/ax88179_178a.o CC [M] /usr/local/src/git/linux/drivers/net/usb/cdc_ether.o CC [M] /usr/local/src/git/linux/drivers/net/usb/cdc_eem.o CC [M] /usr/local/src/git/linux/drivers/net/usb/dm9601.o CC [M] /usr/local/src/git/linux/drivers/net/usb/sr9700.o CC [M] /usr/local/src/git/linux/drivers/net/usb/sr9800.o CC [M] /usr/local/src/git/linux/drivers/net/usb/smsc75xx.o CC [M] /usr/local/src/git/linux/drivers/net/usb/smsc95xx.o CC [M] /usr/local/src/git/linux/drivers/net/usb/gl620a.o CC [M] /usr/local/src/git/linux/drivers/net/usb/net1080.o CC [M] /usr/local/src/git/linux/drivers/net/usb/plusb.o CC [M] /usr/local/src/git/linux/drivers/net/usb/rndis_host.o CC [M] /usr/local/src/git/linux/drivers/net/usb/cdc_subset.o CC [M] /usr/local/src/git/linux/drivers/net/usb/zaurus.o CC [M] /usr/local/src/git/linux/drivers/net/usb/mcs7830.o CC [M] /usr/local/src/git/linux/drivers/net/usb/usbnet.o CC [M] /usr/local/src/git/linux/drivers/net/usb/int51x1.o CC [M] /usr/local/src/git/linux/drivers/net/usb/cdc-phonet.o CC [M] /usr/local/src/git/linux/drivers/net/usb/kalmia.o CC [M] /usr/local/src/git/linux/drivers/net/usb/ipheth.o CC [M] /usr/local/src/git/linux/drivers/net/usb/sierra_net.o CC [M] /usr/local/src/git/linux/drivers/net/usb/cx82310_eth.o CC [M] /usr/local/src/git/linux/drivers/net/usb/cdc_ncm.o CC [M] /usr/local/src/git/linux/drivers/net/usb/huawei_cdc_ncm.o CC [M] /usr/local/src/git/linux/drivers/net/usb/lg-vl600.o CC [M] /usr/local/src/git/linux/drivers/net/usb/qmi_wwan.o CC [M] /usr/local/src/git/linux/drivers/net/usb/cdc_mbim.o CC [M] /usr/local/src/git/linux/drivers/net/usb/ch9200.o MODPOST 1 modules CC [M] /usr/local/src/git/linux/drivers/net/usb/qmi_wwan.mod.o LD [M] /usr/local/src/git/linux/drivers/net/usb/qmi_wwan.ko make: Leaving directory '/usr/src/linux-headers-5.7.0-1-amd64' Why is this? Am I doing something wrong here? This is quite annoying. Not only does it take much more time than necessary. It also causes the build to fail if any of the unnecessary source files fail to build. Which is expected with my use case, building unmodified drivers from a different kernel version. E.g trying to rebuild qmi_wwan from the current net/master repo on a Debian 5.6 kernel fails because r8152.c implement new ethtool_ops fields: bjorn@miraculix:/usr/local/src/git/linux$ make -C /lib/modules/5.6.0-2-amd64/build M=$(pwd)/drivers/net/usb clean make: Entering directory '/usr/src/linux-headers-5.6.0-2-amd64' CLEAN /usr/local/src/git/linux/drivers/net/usb/Module.symvers make: Leaving directory '/usr/src/linux-headers-5.6.0-2-amd64' bjorn@miraculix:/usr/local/src/git/linux$ make -C /lib/modules/5.6.0-2-amd64/build M=$(pwd)/drivers/net/usb qmi_wwan.ko make: Entering directory '/usr/src/linux-headers-5.6.0-2-amd64' AR /usr/local/src/git/linux/drivers/net/usb/built-in.a CC [M] /usr/local/src/git/linux/drivers/net/usb/catc.o CC [M] /usr/local/src/git/linux/drivers/net/usb/kaweth.o CC [M] /usr/local/src/git/linux/drivers/net/usb/pegasus.o CC [M] /usr/local/src/git/linux/drivers/net/usb/rtl8150.o CC [M] /usr/local/src/git/linux/drivers/net/usb/r8152.o /usr/local/src/git/linux/drivers/net/usb/r8152.c: In function ‘r8152_tx_csum’: /usr/local/src/git/linux/drivers/net/usb/r8152.c:2004:4: error: implicit declaration of function ‘tcp_v6_gso_csum_prep’ [-Werror=implicit-function-declaration] 2004 | tcp_v6_gso_csum_prep(skb); | ^~~~~~~~~~~~~~~~~~~~ /usr/local/src/git/linux/drivers/net/usb/r8152.c: At top level: /usr/local/src/git/linux/drivers/net/usb/r8152.c:6360:3: error: ‘const struct ethtool_ops’ has no member named ‘supported_coalesce_params’ 6360 | .supported_coalesce_params = ETHTOOL_COALESCE_USECS, | ^~~~~~~~~~~~~~~~~~~~~~~~~ /usr/local/src/git/linux/drivers/net/usb/r8152.c:6360:31: error: ‘ETHTOOL_COALESCE_USECS’ undeclared here (not in a function); did you mean ‘ETHTOOL_SCOALESCE’? 6360 | .supported_coalesce_params = ETHTOOL_COALESCE_USECS, | ^~~~~~~~~~~~~~~~~~~~~~ | ETHTOOL_SCOALESCE cc1: some warnings being treated as errors make[2]: *** [/usr/src/linux-headers-5.6.0-2-common/scripts/Makefile.build:273: /usr/local/src/git/linux/drivers/net/usb/r8152.o] Error 1 make[1]: *** [/usr/src/linux-headers-5.6.0-2-common/Makefile:1704: /usr/local/src/git/linux/drivers/net/usb] Error 2 make: *** [/usr/src/linux-headers-5.6.0-2-common/Makefile:180: sub-make] Error 2 make: Leaving directory '/usr/src/linux-headers-5.6.0-2-amd64' This is obviously completely irrelevent for the qmi_wwan build. How to I get back the old dependency based building? Bjørn

3 4

How can I investigate the cause of "watchdog: BUG: soft lockup"?
by 孙世龙 sunshilong July 8, 2020

July 8, 2020

Hi, list I encountered the error of "watchdog: BUG: soft lockup" when I sent data through the can bus. Could you please give me some hint on how to investigate the cause deeply? Thank you for your attention to this matter. The most related log(full log is seen at the footnote): Jul 3 10:22:36 yx kernel: [ 1120.688506] CAN[0][0] RX: FIFO overrun Jul 3 10:23:31 yx kernel: [ 1176.166058] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [rt_cansend:1837] ... Jul 3 10:23:31 yx kernel: [ 1176.166252] Call Trace: Jul 3 10:23:31 yx kernel: [ 1176.166261] _raw_spin_lock+0x20/0x30 Jul 3 10:23:31 yx kernel: [ 1176.166270] can_write+0x6c/0x2c0 [advcan] Jul 3 10:23:31 yx kernel: [ 1176.166276] ? dequeue_signal+0xae/0x1a0 Jul 3 10:23:31 yx kernel: [ 1176.166281] ? recalc_sigpending+0x1b/0x50 Jul 3 10:23:31 yx kernel: [ 1176.166286] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:23:31 yx kernel: [ 1176.166292] __vfs_write+0x3a/0x190 Jul 3 10:23:31 yx kernel: [ 1176.166298] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:23:31 yx kernel: [ 1176.166302] ? security_file_permission+0x3b/0xc0 Jul 3 10:23:31 yx kernel: [ 1176.166307] vfs_write+0xb8/0x1b0 Jul 3 10:23:31 yx kernel: [ 1176.166312] ksys_write+0x5c/0xe0 Jul 3 10:23:31 yx kernel: [ 1176.166316] __x64_sys_write+0x1a/0x20 Jul 3 10:23:31 yx kernel: [ 1176.166321] do_syscall_64+0x87/0x250 Jul 3 10:23:31 yx kernel: [ 1176.166326] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Here is the full log: Jul 3 10:06:16 yx kernel: [ 140.313856] CAN[0][0] RX: FIFO overrun Jul 3 10:06:59 yx kernel: [ 183.323792] CAN[0][0] RX: FIFO overrun Jul 3 10:07:42 yx kernel: [ 226.329465] CAN[0][0] RX: FIFO overrun Jul 3 10:08:24 yx kernel: [ 268.362822] CAN[0][0] RX: FIFO overrun Jul 3 10:09:07 yx kernel: [ 311.372488] CAN[0][0] RX: FIFO overrun Jul 3 10:09:50 yx kernel: [ 354.377996] CAN[0][0] RX: FIFO overrun Jul 3 10:10:32 yx kernel: [ 396.411726] CAN[0][0] RX: FIFO overrun Jul 3 10:11:15 yx kernel: [ 439.421156] CAN[0][0] RX: FIFO overrun Jul 3 10:11:58 yx kernel: [ 482.426522] CAN[0][0] RX: FIFO overrun Jul 3 10:12:40 yx kernel: [ 524.460688] CAN[0][0] RX: FIFO overrun Jul 3 10:13:23 yx kernel: [ 567.469857] CAN[0][0] RX: FIFO overrun Jul 3 10:14:06 yx kernel: [ 610.475021] CAN[0][0] RX: FIFO overrun Jul 3 10:14:48 yx kernel: [ 652.509597] CAN[0][0] RX: FIFO overrun Jul 3 10:15:31 yx kernel: [ 695.518491] CAN[0][0] RX: FIFO overrun Jul 3 10:16:14 yx kernel: [ 738.523551] CAN[0][0] RX: FIFO overrun Jul 3 10:16:55 yx kernel: [ 779.558139] CAN[0][0] RX: FIFO overrun Jul 3 10:17:38 yx kernel: [ 822.566773] CAN[0][0] RX: FIFO overrun Jul 3 10:18:21 yx kernel: [ 865.571697] CAN[0][0] RX: FIFO overrun Jul 3 10:19:03 yx kernel: [ 907.607049] CAN[0][0] RX: FIFO overrun Jul 3 10:19:46 yx kernel: [ 950.615449] CAN[0][0] RX: FIFO overrun Jul 3 10:20:29 yx kernel: [ 993.620196] CAN[0][0] RX: FIFO overrun Jul 3 10:21:11 yx kernel: [ 1035.655974] CAN[0][0] RX: FIFO overrun Jul 3 10:21:54 yx kernel: [ 1078.664116] CAN[0][0] RX: FIFO overrun Jul 3 10:22:36 yx kernel: [ 1120.688506] CAN[0][0] RX: FIFO overrun Jul 3 10:23:31 yx kernel: [ 1176.166058] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [rt_cansend:1837] Jul 3 10:23:31 yx kernel: [ 1176.166066] Modules linked in: bnep snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_pcm snd_seq_midi snd_seq_midi_event snd_rawmidi intel_rapl intel_soc_dts_thermal intel_soc_dts_iosf intel_powerclamp coretemp kvm_intel snd_seq punit_atom_debug crct10dif_pclmul crc32_pclmul ghash_clmulni_intel snd_seq_device cryptd intel_cstate snd_timer hci_uart snd lpc_ich advcan(OE) mei_txe btqca soundcore mei btbcm btintel bluetooth ecdh_generic rfkill_gpio pwm_lpss_platform mac_hid pwm_lpss parport_pc ppdev lp parport autofs4 i915 kvmgt vfio_mdev mdev vfio_iommu_type1 vfio kvm irqbypass drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops igb drm dca ahci i2c_algo_bit libahci video i2c_hid hid Jul 3 10:23:31 yx kernel: [ 1176.166204] CPU: 0 PID: 1837 Comm: rt_cansend Tainted: G OE 4.19.84-solve-alc-failure #1 Jul 3 10:23:31 yx kernel: [ 1176.166209] I-pipe domain: Linux Jul 3 10:23:31 yx kernel: [ 1176.166218] RIP: 0010:queued_spin_lock_slowpath+0xd9/0x1a0 Jul 3 10:23:31 yx kernel: [ 1176.166223] Code: 48 03 34 c5 00 67 37 91 48 89 16 8b 42 08 85 c0 75 09 f3 90 8b 42 08 85 c0 74 f7 48 8b 32 48 85 f6 74 07 0f 0d 0e eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 0f 84 96 00 00 Jul 3 10:23:31 yx kernel: [ 1176.166226] RSP: 0018:ffffbe6f4c17bd08 EFLAGS: 00000202 ORIG_RAX: 00000000ffffff13 Jul 3 10:23:31 yx kernel: [ 1176.166231] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 Jul 3 10:23:31 yx kernel: [ 1176.166234] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Jul 3 10:23:31 yx kernel: [ 1176.166236] RBP: ffffbe6f4c17bd08 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:23:31 yx kernel: [ 1176.166239] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Jul 3 10:23:31 yx kernel: [ 1176.166241] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 Jul 3 10:23:31 yx kernel: [ 1176.166244] FS: 00007ff04533c940(0000) GS:ffff96003ba00000(0000) knlGS:0000000000000000 Jul 3 10:23:31 yx kernel: [ 1176.166247] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 3 10:23:31 yx kernel: [ 1176.166250] CR2: 00007f799c003000 CR3: 00000000ab0fe000 CR4: 00000000001006f0 Jul 3 10:23:31 yx kernel: [ 1176.166252] Call Trace: Jul 3 10:23:31 yx kernel: [ 1176.166261] _raw_spin_lock+0x20/0x30 Jul 3 10:23:31 yx kernel: [ 1176.166270] can_write+0x6c/0x2c0 [advcan] Jul 3 10:23:31 yx kernel: [ 1176.166276] ? dequeue_signal+0xae/0x1a0 Jul 3 10:23:31 yx kernel: [ 1176.166281] ? recalc_sigpending+0x1b/0x50 Jul 3 10:23:31 yx kernel: [ 1176.166286] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:23:31 yx kernel: [ 1176.166292] __vfs_write+0x3a/0x190 Jul 3 10:23:31 yx kernel: [ 1176.166298] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:23:31 yx kernel: [ 1176.166302] ? security_file_permission+0x3b/0xc0 Jul 3 10:23:31 yx kernel: [ 1176.166307] vfs_write+0xb8/0x1b0 Jul 3 10:23:31 yx kernel: [ 1176.166312] ksys_write+0x5c/0xe0 Jul 3 10:23:31 yx kernel: [ 1176.166316] __x64_sys_write+0x1a/0x20 Jul 3 10:23:31 yx kernel: [ 1176.166321] do_syscall_64+0x87/0x250 Jul 3 10:23:31 yx kernel: [ 1176.166326] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jul 3 10:23:31 yx kernel: [ 1176.166330] RIP: 0033:0x7ff04885d4bd Jul 3 10:23:31 yx kernel: [ 1176.166334] Code: bf 20 00 00 75 10 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ae fc ff ff 48 89 04 24 b8 01 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 f7 fc ff ff 48 89 d0 48 83 c4 08 48 3d 01 Jul 3 10:23:31 yx kernel: [ 1176.166337] RSP: 002b:00007ff04533ba70 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Jul 3 10:23:31 yx kernel: [ 1176.166342] RAX: ffffffffffffffda RBX: 000000000153ca00 RCX: 00007ff04885d4bd Jul 3 10:23:31 yx kernel: [ 1176.166344] RDX: 0000000000000001 RSI: 00007ff04533bac0 RDI: 000000000000000e Jul 3 10:23:31 yx kernel: [ 1176.166347] RBP: 00007ff04533bbb0 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:23:31 yx kernel: [ 1176.166349] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ff0491783e0 Jul 3 10:23:31 yx kernel: [ 1176.166352] R13: 00007ffc5d6b9b1f R14: 00007ff04533cc00 R15: 00000000004041b0 Jul 3 10:23:32 yx kernel: [ 1176.170065] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [rt_cansend:1835] Jul 3 10:23:32 yx kernel: [ 1176.170075] Modules linked in: bnep snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_pcm snd_seq_midi snd_seq_midi_event snd_rawmidi intel_rapl intel_soc_dts_thermal intel_soc_dts_iosf intel_powerclamp coretemp kvm_intel snd_seq punit_atom_debug crct10dif_pclmul crc32_pclmul ghash_clmulni_intel snd_seq_device cryptd intel_cstate snd_timer hci_uart snd lpc_ich advcan(OE) mei_txe btqca soundcore mei btbcm btintel bluetooth ecdh_generic rfkill_gpio pwm_lpss_platform mac_hid pwm_lpss parport_pc ppdev lp parport autofs4 i915 kvmgt vfio_mdev mdev vfio_iommu_type1 vfio kvm irqbypass drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops igb drm dca ahci i2c_algo_bit libahci video i2c_hid hid Jul 3 10:23:32 yx kernel: [ 1176.170221] CPU: 3 PID: 1835 Comm: rt_cansend Tainted: G OEL 4.19.84-bros-slove-alc-failure #1 Jul 3 10:23:32 yx kernel: [ 1176.170226] I-pipe domain: Linux Jul 3 10:23:32 yx kernel: [ 1176.170236] RIP: 0010:queued_spin_lock_slowpath+0x13f/0x1a0 Jul 3 10:23:32 yx kernel: [ 1176.170242] Code: 6b ff ff ff eb e4 ba 00 01 00 00 8b 07 30 e4 09 d0 a9 00 01 ff ff 0f 85 fe fe ff ff 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 8b 07 <84> c0 75 f8 b8 01 00 00 00 66 89 07 5d c3 f3 90 48 8b 32 48 85 f6 Jul 3 10:23:32 yx kernel: [ 1176.170245] RSP: 0018:ffffbe6f4c16bd08 EFLAGS: 00000202 ORIG_RAX: 00000000ffffff13 Jul 3 10:23:32 yx kernel: [ 1176.170250] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 Jul 3 10:23:32 yx kernel: [ 1176.170252] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Jul 3 10:23:32 yx kernel: [ 1176.170255] RBP: ffffbe6f4c16bd08 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:23:32 yx kernel: [ 1176.170257] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Jul 3 10:23:32 yx kernel: [ 1176.170259] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 Jul 3 10:23:32 yx kernel: [ 1176.170263] FS: 00007ff045526940(0000) GS:ffff96003bb80000(0000) knlGS:0000000000000000 Jul 3 10:23:32 yx kernel: [ 1176.170266] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 3 10:23:32 yx kernel: [ 1176.170268] CR2: 000000c8203a5000 CR3: 00000000ab0fe000 CR4: 00000000001006e0 Jul 3 10:23:32 yx kernel: [ 1176.170271] Call Trace: Jul 3 10:23:32 yx kernel: [ 1176.170282] _raw_spin_lock+0x20/0x30 Jul 3 10:23:32 yx kernel: [ 1176.170292] can_write+0x6c/0x2c0 [advcan] Jul 3 10:23:32 yx kernel: [ 1176.170298] ? dequeue_signal+0xae/0x1a0 Jul 3 10:23:32 yx kernel: [ 1176.170303] ? recalc_sigpending+0x1b/0x50 Jul 3 10:23:32 yx kernel: [ 1176.170308] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:23:32 yx kernel: [ 1176.170315] __vfs_write+0x3a/0x190 Jul 3 10:23:32 yx kernel: [ 1176.170321] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:23:32 yx kernel: [ 1176.170325] ? security_file_permission+0x3b/0xc0 Jul 3 10:23:32 yx kernel: [ 1176.170330] vfs_write+0xb8/0x1b0 Jul 3 10:23:32 yx kernel: [ 1176.170335] ksys_write+0x5c/0xe0 Jul 3 10:23:32 yx kernel: [ 1176.170339] __x64_sys_write+0x1a/0x20 Jul 3 10:23:32 yx kernel: [ 1176.170345] do_syscall_64+0x87/0x250 Jul 3 10:23:32 yx kernel: [ 1176.170349] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jul 3 10:23:32 yx kernel: [ 1176.170354] RIP: 0033:0x7ff04885d4bd Jul 3 10:23:32 yx kernel: [ 1176.170358] Code: bf 20 00 00 75 10 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ae fc ff ff 48 89 04 24 b8 01 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 f7 fc ff ff 48 89 d0 48 83 c4 08 48 3d 01 Jul 3 10:23:32 yx kernel: [ 1176.170361] RSP: 002b:00007ff045525530 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Jul 3 10:23:32 yx kernel: [ 1176.170366] RAX: ffffffffffffffda RBX: 000000000000ffdc RCX: 00007ff04885d4bd Jul 3 10:23:32 yx kernel: [ 1176.170368] RDX: 0000000000000001 RSI: 00007ff045525580 RDI: 000000000000000e Jul 3 10:23:32 yx kernel: [ 1176.170371] RBP: 00007ff045525670 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:23:32 yx kernel: [ 1176.170373] R10: 00007ff030000078 R11: 0000000000000246 R12: 00007ff045526878 Jul 3 10:23:32 yx kernel: [ 1176.170379] R13: 00007ff045525be0 R14: 000000000000001c R15: 0000000000000007 Jul 3 10:23:59 yx kernel: [ 1204.166060] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [rt_cansend:1837] Jul 3 10:23:59 yx kernel: [ 1204.166067] Modules linked in: bnep snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_pcm snd_seq_midi snd_seq_midi_event snd_rawmidi intel_rapl intel_soc_dts_thermal intel_soc_dts_iosf intel_powerclamp coretemp kvm_intel snd_seq punit_atom_debug crct10dif_pclmul crc32_pclmul ghash_clmulni_intel snd_seq_device cryptd intel_cstate snd_timer hci_uart snd lpc_ich advcan(OE) mei_txe btqca soundcore mei btbcm btintel bluetooth ecdh_generic rfkill_gpio pwm_lpss_platform mac_hid pwm_lpss parport_pc ppdev lp parport autofs4 i915 kvmgt vfio_mdev mdev vfio_iommu_type1 vfio kvm irqbypass drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops igb drm dca ahci i2c_algo_bit libahci video i2c_hid hid Jul 3 10:23:59 yx kernel: [ 1204.166207] CPU: 0 PID: 1837 Comm: rt_cansend Tainted: G OEL 4.19.84-bros-slove-alc-failure #1 Jul 3 10:23:59 yx kernel: [ 1204.166212] I-pipe domain: Linux Jul 3 10:23:59 yx kernel: [ 1204.166221] RIP: 0010:queued_spin_lock_slowpath+0xd9/0x1a0 Jul 3 10:23:59 yx kernel: [ 1204.166226] Code: 48 03 34 c5 00 67 37 91 48 89 16 8b 42 08 85 c0 75 09 f3 90 8b 42 08 85 c0 74 f7 48 8b 32 48 85 f6 74 07 0f 0d 0e eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 0f 84 96 00 00 Jul 3 10:23:59 yx kernel: [ 1204.166228] RSP: 0018:ffffbe6f4c17bd08 EFLAGS: 00000202 ORIG_RAX: 00000000ffffff13 Jul 3 10:23:59 yx kernel: [ 1204.166233] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 Jul 3 10:23:59 yx kernel: [ 1204.166236] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Jul 3 10:23:59 yx kernel: [ 1204.166238] RBP: ffffbe6f4c17bd08 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:23:59 yx kernel: [ 1204.166240] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Jul 3 10:23:59 yx kernel: [ 1204.166243] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 Jul 3 10:23:59 yx kernel: [ 1204.166246] FS: 00007ff04533c940(0000) GS:ffff96003ba00000(0000) knlGS:0000000000000000 Jul 3 10:23:59 yx kernel: [ 1204.166249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 3 10:23:59 yx kernel: [ 1204.166251] CR2: 00007f799c003000 CR3: 00000000ab0fe000 CR4: 00000000001006f0 Jul 3 10:23:59 yx kernel: [ 1204.166253] Call Trace: Jul 3 10:23:59 yx kernel: [ 1204.166263] _raw_spin_lock+0x20/0x30 Jul 3 10:23:59 yx kernel: [ 1204.166272] can_write+0x6c/0x2c0 [advcan] Jul 3 10:23:59 yx kernel: [ 1204.166277] ? dequeue_signal+0xae/0x1a0 Jul 3 10:23:59 yx kernel: [ 1204.166283] ? recalc_sigpending+0x1b/0x50 Jul 3 10:23:59 yx kernel: [ 1204.166287] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:23:59 yx kernel: [ 1204.166293] __vfs_write+0x3a/0x190 Jul 3 10:23:59 yx kernel: [ 1204.166299] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:23:59 yx kernel: [ 1204.166303] ? security_file_permission+0x3b/0xc0 Jul 3 10:23:59 yx kernel: [ 1204.166308] vfs_write+0xb8/0x1b0 Jul 3 10:23:59 yx kernel: [ 1204.166313] ksys_write+0x5c/0xe0 Jul 3 10:23:59 yx kernel: [ 1204.166318] __x64_sys_write+0x1a/0x20 Jul 3 10:23:59 yx kernel: [ 1204.166322] do_syscall_64+0x87/0x250 Jul 3 10:23:59 yx kernel: [ 1204.166327] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jul 3 10:23:59 yx kernel: [ 1204.166331] RIP: 0033:0x7ff04885d4bd Jul 3 10:23:59 yx kernel: [ 1204.166335] Code: bf 20 00 00 75 10 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ae fc ff ff 48 89 04 24 b8 01 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 f7 fc ff ff 48 89 d0 48 83 c4 08 48 3d 01 Jul 3 10:23:59 yx kernel: [ 1204.166338] RSP: 002b:00007ff04533ba70 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Jul 3 10:23:59 yx kernel: [ 1204.166343] RAX: ffffffffffffffda RBX: 000000000153ca00 RCX: 00007ff04885d4bd Jul 3 10:23:59 yx kernel: [ 1204.166345] RDX: 0000000000000001 RSI: 00007ff04533bac0 RDI: 000000000000000e Jul 3 10:23:59 yx kernel: [ 1204.166347] RBP: 00007ff04533bbb0 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:23:59 yx kernel: [ 1204.166350] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ff0491783e0 Jul 3 10:23:59 yx kernel: [ 1204.166352] R13: 00007ffc5d6b9b1f R14: 00007ff04533cc00 R15: 00000000004041b0 Jul 3 10:24:00 yx kernel: [ 1204.170062] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [rt_cansend:1835] Jul 3 10:24:00 yx kernel: [ 1204.170070] Modules linked in: bnep snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_pcm snd_seq_midi snd_seq_midi_event snd_rawmidi intel_rapl intel_soc_dts_thermal intel_soc_dts_iosf intel_powerclamp coretemp kvm_intel snd_seq punit_atom_debug crct10dif_pclmul crc32_pclmul ghash_clmulni_intel snd_seq_device cryptd intel_cstate snd_timer hci_uart snd lpc_ich advcan(OE) mei_txe btqca soundcore mei btbcm btintel bluetooth ecdh_generic rfkill_gpio pwm_lpss_platform mac_hid pwm_lpss parport_pc ppdev lp parport autofs4 i915 kvmgt vfio_mdev mdev vfio_iommu_type1 vfio kvm irqbypass drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops igb drm dca ahci i2c_algo_bit libahci video i2c_hid hid Jul 3 10:24:00 yx kernel: [ 1204.170209] CPU: 3 PID: 1835 Comm: rt_cansend Tainted: G OEL 4.19.84-bros-slove-alc-failure #1 Jul 3 10:24:00 yx kernel: [ 1204.170214] I-pipe domain: Linux Jul 3 10:24:00 yx kernel: [ 1204.170223] RIP: 0010:queued_spin_lock_slowpath+0x13f/0x1a0 Jul 3 10:24:00 yx kernel: [ 1204.170228] Code: 6b ff ff ff eb e4 ba 00 01 00 00 8b 07 30 e4 09 d0 a9 00 01 ff ff 0f 85 fe fe ff ff 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 8b 07 <84> c0 75 f8 b8 01 00 00 00 66 89 07 5d c3 f3 90 48 8b 32 48 85 f6 Jul 3 10:24:00 yx kernel: [ 1204.170231] RSP: 0018:ffffbe6f4c16bd08 EFLAGS: 00000202 ORIG_RAX: 00000000ffffff13 Jul 3 10:24:00 yx kernel: [ 1204.170236] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 Jul 3 10:24:00 yx kernel: [ 1204.170238] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Jul 3 10:24:00 yx kernel: [ 1204.170241] RBP: ffffbe6f4c16bd08 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:24:00 yx kernel: [ 1204.170243] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Jul 3 10:24:00 yx kernel: [ 1204.170245] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 Jul 3 10:24:00 yx kernel: [ 1204.170249] FS: 00007ff045526940(0000) GS:ffff96003bb80000(0000) knlGS:0000000000000000 Jul 3 10:24:00 yx kernel: [ 1204.170251] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 3 10:24:00 yx kernel: [ 1204.170254] CR2: 000000c8203a5000 CR3: 00000000ab0fe000 CR4: 00000000001006e0 Jul 3 10:24:00 yx kernel: [ 1204.170256] Call Trace: Jul 3 10:24:00 yx kernel: [ 1204.170265] _raw_spin_lock+0x20/0x30 Jul 3 10:24:00 yx kernel: [ 1204.170274] can_write+0x6c/0x2c0 [advcan] Jul 3 10:24:00 yx kernel: [ 1204.170280] ? dequeue_signal+0xae/0x1a0 Jul 3 10:24:00 yx kernel: [ 1204.170285] ? recalc_sigpending+0x1b/0x50 Jul 3 10:24:00 yx kernel: [ 1204.170290] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:24:00 yx kernel: [ 1204.170296] __vfs_write+0x3a/0x190 Jul 3 10:24:00 yx kernel: [ 1204.170302] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:24:00 yx kernel: [ 1204.170306] ? security_file_permission+0x3b/0xc0 Jul 3 10:24:00 yx kernel: [ 1204.170311] vfs_write+0xb8/0x1b0 Jul 3 10:24:00 yx kernel: [ 1204.170316] ksys_write+0x5c/0xe0 Jul 3 10:24:00 yx kernel: [ 1204.170320] __x64_sys_write+0x1a/0x20 Jul 3 10:24:00 yx kernel: [ 1204.170325] do_syscall_64+0x87/0x250 Jul 3 10:24:00 yx kernel: [ 1204.170330] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jul 3 10:24:00 yx kernel: [ 1204.170334] RIP: 0033:0x7ff04885d4bd Jul 3 10:24:00 yx kernel: [ 1204.170338] Code: bf 20 00 00 75 10 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ae fc ff ff 48 89 04 24 b8 01 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 f7 fc ff ff 48 89 d0 48 83 c4 08 48 3d 01 Jul 3 10:24:00 yx kernel: [ 1204.170341] RSP: 002b:00007ff045525530 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Jul 3 10:24:00 yx kernel: [ 1204.170346] RAX: ffffffffffffffda RBX: 000000000000ffdc RCX: 00007ff04885d4bd Jul 3 10:24:00 yx kernel: [ 1204.170348] RDX: 0000000000000001 RSI: 00007ff045525580 RDI: 000000000000000e Jul 3 10:24:00 yx kernel: [ 1204.170350] RBP: 00007ff045525670 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:24:00 yx kernel: [ 1204.170353] R10: 00007ff030000078 R11: 0000000000000246 R12: 00007ff045526878 Jul 3 10:24:00 yx kernel: [ 1204.170355] R13: 00007ff045525be0 R14: 000000000000001c R15: 0000000000000007 Jul 3 10:24:08 yx kernel: [ 1212.410060] rcu: INFO: rcu_sched self-detected stall on CPU Jul 3 10:24:08 yx kernel: [ 1212.410075] rcu: 0-....: (14999 ticks this GP) idle=8de/1/0x4000000000000002 softirq=15317/15317 fqs=7496 Jul 3 10:24:08 yx kernel: [ 1212.410079] rcu: (t=15000 jiffies g=17909 q=591) Jul 3 10:24:08 yx kernel: [ 1212.410087] NMI backtrace for cpu 0 Jul 3 10:24:08 yx kernel: [ 1212.410092] CPU: 0 PID: 1837 Comm: rt_cansend Tainted: G OEL 4.19.84-bros-slove-alc-failure #1 Jul 3 10:24:08 yx kernel: [ 1212.410096] I-pipe domain: Linux Jul 3 10:24:08 yx kernel: [ 1212.410099] Call Trace: Jul 3 10:24:08 yx kernel: [ 1212.410103] <IRQ> Jul 3 10:24:08 yx kernel: [ 1212.410113] dump_stack+0x9e/0xc8 Jul 3 10:24:08 yx kernel: [ 1212.410118] nmi_cpu_backtrace+0x95/0xa0 Jul 3 10:24:08 yx kernel: [ 1212.410123] ? lapic_can_unplug_cpu+0xb0/0xb0 Jul 3 10:24:08 yx kernel: [ 1212.410128] nmi_trigger_cpumask_backtrace+0x90/0xd0 Jul 3 10:24:08 yx kernel: [ 1212.410132] arch_trigger_cpumask_backtrace+0x19/0x20 Jul 3 10:24:08 yx kernel: [ 1212.410137] rcu_dump_cpu_stacks+0x94/0xc8 Jul 3 10:24:08 yx kernel: [ 1212.410141] rcu_check_callbacks+0x707/0x870 Jul 3 10:24:08 yx kernel: [ 1212.410148] ? tick_sched_do_timer+0x60/0x60 Jul 3 10:24:08 yx kernel: [ 1212.410152] update_process_times+0x3d/0x70 Jul 3 10:24:08 yx kernel: [ 1212.410157] tick_sched_handle+0x29/0x60 Jul 3 10:24:08 yx kernel: [ 1212.410161] tick_sched_timer+0x3c/0x80 Jul 3 10:24:08 yx kernel: [ 1212.410166] __hrtimer_run_queues+0x106/0x270 Jul 3 10:24:08 yx kernel: [ 1212.410171] hrtimer_interrupt+0x116/0x240 Jul 3 10:24:08 yx kernel: [ 1212.410177] smp_apic_timer_interrupt+0x59/0x130 Jul 3 10:24:08 yx kernel: [ 1212.410182] ? smp_call_function_single_interrupt+0xd0/0xd0 Jul 3 10:24:08 yx kernel: [ 1212.410186] __ipipe_do_IRQ+0x31/0x40 Jul 3 10:24:08 yx kernel: [ 1212.410192] __ipipe_do_sync_stage+0x173/0x180 Jul 3 10:24:08 yx kernel: [ 1212.410196] __ipipe_do_sync_pipeline+0x9b/0xa0 Jul 3 10:24:08 yx kernel: [ 1212.410201] dispatch_irq_head+0xe6/0x110 Jul 3 10:24:08 yx kernel: [ 1212.410205] __ipipe_dispatch_irq+0xd9/0x1c0 Jul 3 10:24:08 yx kernel: [ 1212.410210] __ipipe_handle_irq+0x86/0x1e0 Jul 3 10:24:08 yx kernel: [ 1212.410215] apic_timer_interrupt+0x12/0x40 Jul 3 10:24:08 yx kernel: [ 1212.410218] </IRQ> Jul 3 10:24:08 yx kernel: [ 1212.410223] RIP: 0010:queued_spin_lock_slowpath+0xd9/0x1a0 Jul 3 10:24:08 yx kernel: [ 1212.410228] Code: 48 03 34 c5 00 67 37 91 48 89 16 8b 42 08 85 c0 75 09 f3 90 8b 42 08 85 c0 74 f7 48 8b 32 48 85 f6 74 07 0f 0d 0e eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 0f 84 96 00 00 Jul 3 10:24:08 yx kernel: [ 1212.410231] RSP: 0018:ffffbe6f4c17bd08 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 Jul 3 10:24:08 yx kernel: [ 1212.410236] RAX: 0000000000040101 RBX: 0000000000000001 RCX: 0000000000040000 Jul 3 10:24:08 yx kernel: [ 1212.410238] RDX: ffff96003ba350c0 RSI: 0000000000000000 RDI: ffffffffc069cc20 Jul 3 10:24:08 yx kernel: [ 1212.410241] RBP: ffffbe6f4c17bd08 R08: 00007ff04533bac1 R09: ffff96001e06ac68 Jul 3 10:24:08 yx kernel: [ 1212.410243] R10: ffff95ff34a27f38 R11: 0000000000000000 R12: 0000000000000000 Jul 3 10:24:08 yx kernel: [ 1212.410246] R13: 00007ff04533bac0 R14: ffff95ff34a27f00 R15: 00007ff04533bac0 Jul 3 10:24:08 yx kernel: [ 1212.410255] _raw_spin_lock+0x20/0x30 Jul 3 10:24:08 yx kernel: [ 1212.410262] can_write+0x6c/0x2c0 [advcan] Jul 3 10:24:08 yx kernel: [ 1212.410267] ? dequeue_signal+0xae/0x1a0 Jul 3 10:24:08 yx kernel: [ 1212.410273] ? recalc_sigpending+0x1b/0x50 Jul 3 10:24:08 yx kernel: [ 1212.410277] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:24:08 yx kernel: [ 1212.410283] __vfs_write+0x3a/0x190 Jul 3 10:24:08 yx kernel: [ 1212.410289] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:24:08 yx kernel: [ 1212.410293] ? security_file_permission+0x3b/0xc0 Jul 3 10:24:08 yx kernel: [ 1212.410298] vfs_write+0xb8/0x1b0 Jul 3 10:24:08 yx kernel: [ 1212.410302] ksys_write+0x5c/0xe0 Jul 3 10:24:08 yx kernel: [ 1212.410307] __x64_sys_write+0x1a/0x20 Jul 3 10:24:08 yx kernel: [ 1212.410312] do_syscall_64+0x87/0x250 Jul 3 10:24:08 yx kernel: [ 1212.410317] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jul 3 10:24:08 yx kernel: [ 1212.410321] RIP: 0033:0x7ff04885d4bd Jul 3 10:24:08 yx kernel: [ 1212.410325] Code: bf 20 00 00 75 10 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ae fc ff ff 48 89 04 24 b8 01 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 f7 fc ff ff 48 89 d0 48 83 c4 08 48 3d 01 Jul 3 10:24:08 yx kernel: [ 1212.410327] RSP: 002b:00007ff04533ba70 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Jul 3 10:24:08 yx kernel: [ 1212.410332] RAX: ffffffffffffffda RBX: 000000000153ca00 RCX: 00007ff04885d4bd Jul 3 10:24:08 yx kernel: [ 1212.410334] RDX: 0000000000000001 RSI: 00007ff04533bac0 RDI: 000000000000000e Jul 3 10:24:08 yx kernel: [ 1212.410337] RBP: 00007ff04533bbb0 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:24:08 yx kernel: [ 1212.410339] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ff0491783e0 Jul 3 10:24:08 yx kernel: [ 1212.410342] R13: 00007ffc5d6b9b1f R14: 00007ff04533cc00 R15: 00000000004041b0 Jul 3 10:24:08 yx kernel: [ 1212.410351] Sending NMI from CPU 0 to CPUs 3: Jul 3 10:24:08 yx kernel: [ 1212.414061] NMI backtrace for cpu 3 Jul 3 10:24:08 yx kernel: [ 1212.414064] CPU: 3 PID: 1835 Comm: rt_cansend Tainted: G OEL 4.19.84-bros-slove-alc-failure #1 Jul 3 10:24:08 yx kernel: [ 1212.414068] I-pipe domain: Linux Jul 3 10:24:08 yx kernel: [ 1212.414070] RIP: 0010:queued_spin_lock_slowpath+0x13f/0x1a0 Jul 3 10:24:08 yx kernel: [ 1212.414073] Code: 6b ff ff ff eb e4 ba 00 01 00 00 8b 07 30 e4 09 d0 a9 00 01 ff ff 0f 85 fe fe ff ff 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 8b 07 <84> c0 75 f8 b8 01 00 00 00 66 89 07 5d c3 f3 90 48 8b 32 48 85 f6 Jul 3 10:24:08 yx kernel: [ 1212.414075] RSP: 0018:ffffbe6f4c16bd08 EFLAGS: 00000202 Jul 3 10:24:08 yx kernel: [ 1212.414078] RAX: 0000000000040101 RBX: 0000000000000001 RCX: ffffbe6f4c16bec8 Jul 3 10:24:08 yx kernel: [ 1212.414080] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffc069cc20 Jul 3 10:24:08 yx kernel: [ 1212.414082] RBP: ffffbe6f4c16bd08 R08: 00007ff045525581 R09: ffff96001e06ac68 Jul 3 10:24:08 yx kernel: [ 1212.414084] R10: ffff95ff34a27f38 R11: 0000000000000000 R12: 0000000000000000 Jul 3 10:24:08 yx kernel: [ 1212.414086] R13: 00007ff045525580 R14: ffff95ff34a27f00 R15: 00007ff045525580 Jul 3 10:24:08 yx kernel: [ 1212.414088] FS: 00007ff045526940(0000) GS:ffff96003bb80000(0000) knlGS:0000000000000000 Jul 3 10:24:08 yx kernel: [ 1212.414090] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 3 10:24:08 yx kernel: [ 1212.414092] CR2: 000000c8203a5000 CR3: 00000000ab0fe000 CR4: 00000000001006e0 Jul 3 10:24:08 yx kernel: [ 1212.414093] Call Trace: Jul 3 10:24:08 yx kernel: [ 1212.414095] _raw_spin_lock+0x20/0x30 Jul 3 10:24:08 yx kernel: [ 1212.414097] can_write+0x6c/0x2c0 [advcan] Jul 3 10:24:08 yx kernel: [ 1212.414099] ? dequeue_signal+0xae/0x1a0 Jul 3 10:24:08 yx kernel: [ 1212.414100] ? recalc_sigpending+0x1b/0x50 Jul 3 10:24:08 yx kernel: [ 1212.414102] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:24:08 yx kernel: [ 1212.414104] __vfs_write+0x3a/0x190 Jul 3 10:24:08 yx kernel: [ 1212.414106] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:24:08 yx kernel: [ 1212.414107] ? security_file_permission+0x3b/0xc0 Jul 3 10:24:08 yx kernel: [ 1212.414109] vfs_write+0xb8/0x1b0 Jul 3 10:24:08 yx kernel: [ 1212.414111] ksys_write+0x5c/0xe0 Jul 3 10:24:08 yx kernel: [ 1212.414113] __x64_sys_write+0x1a/0x20 Jul 3 10:24:08 yx kernel: [ 1212.414114] do_syscall_64+0x87/0x250 Jul 3 10:24:08 yx kernel: [ 1212.414116] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jul 3 10:24:08 yx kernel: [ 1212.414118] RIP: 0033:0x7ff04885d4bd Jul 3 10:24:08 yx kernel: [ 1212.414120] Code: bf 20 00 00 75 10 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ae fc ff ff 48 89 04 24 b8 01 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 f7 fc ff ff 48 89 d0 48 83 c4 08 48 3d 01 Jul 3 10:24:08 yx kernel: [ 1212.414122] RSP: 002b:00007ff045525530 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Jul 3 10:24:08 yx kernel: [ 1212.414126] RAX: ffffffffffffffda RBX: 000000000000ffdc RCX: 00007ff04885d4bd Jul 3 10:24:08 yx kernel: [ 1212.414128] RDX: 0000000000000001 RSI: 00007ff045525580 RDI: 000000000000000e Jul 3 10:24:08 yx kernel: [ 1212.414130] RBP: 00007ff045525670 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:24:08 yx kernel: [ 1212.414132] R10: 00007ff030000078 R11: 0000000000000246 R12: 00007ff045526878 Jul 3 10:24:08 yx kernel: [ 1212.414134] R13: 00007ff045525be0 R14: 000000000000001c R15: 0000000000000007 Jul 3 10:24:35 yx kernel: [ 1240.166063] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [rt_cansend:1837] Jul 3 10:24:35 yx kernel: [ 1240.166071] Modules linked in: bnep snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_pcm snd_seq_midi snd_seq_midi_event snd_rawmidi intel_rapl intel_soc_dts_thermal intel_soc_dts_iosf intel_powerclamp coretemp kvm_intel snd_seq punit_atom_debug crct10dif_pclmul crc32_pclmul ghash_clmulni_intel snd_seq_device cryptd intel_cstate snd_timer hci_uart snd lpc_ich advcan(OE) mei_txe btqca soundcore mei btbcm btintel bluetooth ecdh_generic rfkill_gpio pwm_lpss_platform mac_hid pwm_lpss parport_pc ppdev lp parport autofs4 i915 kvmgt vfio_mdev mdev vfio_iommu_type1 vfio kvm irqbypass drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops igb drm dca ahci i2c_algo_bit libahci video i2c_hid hid Jul 3 10:24:35 yx kernel: [ 1240.166211] CPU: 0 PID: 1837 Comm: rt_cansend Tainted: G OEL 4.19.84-bros-slove-alc-failure #1 Jul 3 10:24:35 yx kernel: [ 1240.166215] I-pipe domain: Linux Jul 3 10:24:35 yx kernel: [ 1240.166224] RIP: 0010:queued_spin_lock_slowpath+0xd9/0x1a0 Jul 3 10:24:35 yx kernel: [ 1240.166229] Code: 48 03 34 c5 00 67 37 91 48 89 16 8b 42 08 85 c0 75 09 f3 90 8b 42 08 85 c0 74 f7 48 8b 32 48 85 f6 74 07 0f 0d 0e eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 0f 84 96 00 00 Jul 3 10:24:35 yx kernel: [ 1240.166232] RSP: 0018:ffffbe6f4c17bd08 EFLAGS: 00000202 ORIG_RAX: 00000000ffffff13 Jul 3 10:24:35 yx kernel: [ 1240.166237] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 Jul 3 10:24:35 yx kernel: [ 1240.166239] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Jul 3 10:24:35 yx kernel: [ 1240.166242] RBP: ffffbe6f4c17bd08 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:24:35 yx kernel: [ 1240.166244] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Jul 3 10:24:35 yx kernel: [ 1240.166246] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 Jul 3 10:24:35 yx kernel: [ 1240.166250] FS: 00007ff04533c940(0000) GS:ffff96003ba00000(0000) knlGS:0000000000000000 Jul 3 10:24:35 yx kernel: [ 1240.166252] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 3 10:24:35 yx kernel: [ 1240.166255] CR2: 00007f799c003000 CR3: 00000000ab0fe000 CR4: 00000000001006f0 Jul 3 10:24:35 yx kernel: [ 1240.166257] Call Trace: Jul 3 10:24:35 yx kernel: [ 1240.166266] _raw_spin_lock+0x20/0x30 Jul 3 10:24:35 yx kernel: [ 1240.166275] can_write+0x6c/0x2c0 [advcan] Jul 3 10:24:35 yx kernel: [ 1240.166281] ? dequeue_signal+0xae/0x1a0 Jul 3 10:24:35 yx kernel: [ 1240.166286] ? recalc_sigpending+0x1b/0x50 Jul 3 10:24:35 yx kernel: [ 1240.166291] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:24:35 yx kernel: [ 1240.166297] __vfs_write+0x3a/0x190 Jul 3 10:24:35 yx kernel: [ 1240.166303] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:24:35 yx kernel: [ 1240.166307] ? security_file_permission+0x3b/0xc0 Jul 3 10:24:35 yx kernel: [ 1240.166312] vfs_write+0xb8/0x1b0 Jul 3 10:24:35 yx kernel: [ 1240.166316] ksys_write+0x5c/0xe0 Jul 3 10:24:35 yx kernel: [ 1240.166321] __x64_sys_write+0x1a/0x20 Jul 3 10:24:35 yx kernel: [ 1240.166326] do_syscall_64+0x87/0x250 Jul 3 10:24:35 yx kernel: [ 1240.166331] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jul 3 10:24:35 yx kernel: [ 1240.166335] RIP: 0033:0x7ff04885d4bd Jul 3 10:24:35 yx kernel: [ 1240.166339] Code: bf 20 00 00 75 10 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ae fc ff ff 48 89 04 24 b8 01 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 f7 fc ff ff 48 89 d0 48 83 c4 08 48 3d 01 Jul 3 10:24:35 yx kernel: [ 1240.166342] RSP: 002b:00007ff04533ba70 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Jul 3 10:24:35 yx kernel: [ 1240.166346] RAX: ffffffffffffffda RBX: 000000000153ca00 RCX: 00007ff04885d4bd Jul 3 10:24:35 yx kernel: [ 1240.166349] RDX: 0000000000000001 RSI: 00007ff04533bac0 RDI: 000000000000000e Jul 3 10:24:35 yx kernel: [ 1240.166351] RBP: 00007ff04533bbb0 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:24:35 yx kernel: [ 1240.166354] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ff0491783e0 Jul 3 10:24:35 yx kernel: [ 1240.166356] R13: 00007ffc5d6b9b1f R14: 00007ff04533cc00 R15: 00000000004041b0 Jul 3 10:24:36 yx kernel: [ 1240.170065] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [rt_cansend:1835] Jul 3 10:24:36 yx kernel: [ 1240.170073] Modules linked in: bnep snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_pcm snd_seq_midi snd_seq_midi_event snd_rawmidi intel_rapl intel_soc_dts_thermal intel_soc_dts_iosf intel_powerclamp coretemp kvm_intel snd_seq punit_atom_debug crct10dif_pclmul crc32_pclmul ghash_clmulni_intel snd_seq_device cryptd intel_cstate snd_timer hci_uart snd lpc_ich advcan(OE) mei_txe btqca soundcore mei btbcm btintel bluetooth ecdh_generic rfkill_gpio pwm_lpss_platform mac_hid pwm_lpss parport_pc ppdev lp parport autofs4 i915 kvmgt vfio_mdev mdev vfio_iommu_type1 vfio kvm irqbypass drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops igb drm dca ahci i2c_algo_bit libahci video i2c_hid hid Jul 3 10:24:36 yx kernel: [ 1240.170212] CPU: 3 PID: 1835 Comm: rt_cansend Tainted: G OEL 4.19.84-bros-slove-alc-failure #1 Jul 3 10:24:36 yx kernel: [ 1240.170218] I-pipe domain: Linux Jul 3 10:24:36 yx kernel: [ 1240.170226] RIP: 0010:queued_spin_lock_slowpath+0x13f/0x1a0 Jul 3 10:24:36 yx kernel: [ 1240.170231] Code: 6b ff ff ff eb e4 ba 00 01 00 00 8b 07 30 e4 09 d0 a9 00 01 ff ff 0f 85 fe fe ff ff 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 8b 07 <84> c0 75 f8 b8 01 00 00 00 66 89 07 5d c3 f3 90 48 8b 32 48 85 f6 Jul 3 10:24:36 yx kernel: [ 1240.170234] RSP: 0018:ffffbe6f4c16bd08 EFLAGS: 00000202 ORIG_RAX: 00000000ffffff13 Jul 3 10:24:36 yx kernel: [ 1240.170239] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 Jul 3 10:24:36 yx kernel: [ 1240.170241] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Jul 3 10:24:36 yx kernel: [ 1240.170243] RBP: ffffbe6f4c16bd08 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:24:36 yx kernel: [ 1240.170246] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Jul 3 10:24:36 yx kernel: [ 1240.170248] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 Jul 3 10:24:36 yx kernel: [ 1240.170251] FS: 00007ff045526940(0000) GS:ffff96003bb80000(0000) knlGS:0000000000000000 Jul 3 10:24:36 yx kernel: [ 1240.170254] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 3 10:24:36 yx kernel: [ 1240.170257] CR2: 000000c8203a5000 CR3: 00000000ab0fe000 CR4: 00000000001006e0 Jul 3 10:24:36 yx kernel: [ 1240.170259] Call Trace: Jul 3 10:24:36 yx kernel: [ 1240.170268] _raw_spin_lock+0x20/0x30 Jul 3 10:24:36 yx kernel: [ 1240.170276] can_write+0x6c/0x2c0 [advcan] Jul 3 10:24:36 yx kernel: [ 1240.170282] ? dequeue_signal+0xae/0x1a0 Jul 3 10:24:36 yx kernel: [ 1240.170288] ? recalc_sigpending+0x1b/0x50 Jul 3 10:24:36 yx kernel: [ 1240.170292] ? __set_task_blocked+0x3c/0xa0 Jul 3 10:24:36 yx kernel: [ 1240.170298] __vfs_write+0x3a/0x190 Jul 3 10:24:36 yx kernel: [ 1240.170304] ? apparmor_file_permission+0x1a/0x20 Jul 3 10:24:36 yx kernel: [ 1240.170309] ? security_file_permission+0x3b/0xc0 Jul 3 10:24:36 yx kernel: [ 1240.170313] vfs_write+0xb8/0x1b0 Jul 3 10:24:36 yx kernel: [ 1240.170318] ksys_write+0x5c/0xe0 Jul 3 10:24:36 yx kernel: [ 1240.170323] __x64_sys_write+0x1a/0x20 Jul 3 10:24:36 yx kernel: [ 1240.170327] do_syscall_64+0x87/0x250 Jul 3 10:24:36 yx kernel: [ 1240.170332] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jul 3 10:24:36 yx kernel: [ 1240.170336] RIP: 0033:0x7ff04885d4bd Jul 3 10:24:36 yx kernel: [ 1240.170340] Code: bf 20 00 00 75 10 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ae fc ff ff 48 89 04 24 b8 01 00 00 00 0f 05 <48> 8b 3c 24 48 89 c2 e8 f7 fc ff ff 48 89 d0 48 83 c4 08 48 3d 01 Jul 3 10:24:36 yx kernel: [ 1240.170343] RSP: 002b:00007ff045525530 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Jul 3 10:24:36 yx kernel: [ 1240.170347] RAX: ffffffffffffffda RBX: 000000000000ffdc RCX: 00007ff04885d4bd Jul 3 10:24:36 yx kernel: [ 1240.170350] RDX: 0000000000000001 RSI: 00007ff045525580 RDI: 000000000000000e Jul 3 10:24:36 yx kernel: [ 1240.170352] RBP: 00007ff045525670 R08: 0000000000000000 R09: 0000000000000000 Jul 3 10:24:36 yx kernel: [ 1240.170355] R10: 00007ff030000078 R11: 0000000000000246 R12: 00007ff045526878 Jul 3 10:24:36 yx kernel: [ 1240.170357] R13: 00007ff045525be0 R14: 000000000000001c R15: 0000000000000007

2 6

printk() format %pS wrong symbol
by William Tambe July 7, 2020

July 7, 2020

I am seeing an issue in our Linux port where printk() format %pS will print a symbol as: kernel_init+0x120/0x120 where the offset within the function 0x120, is the same as the function size 0x120; in fact, the largest offset within the function should be 0x11f. When printing above symbol+offset in gdb, the correct symbol is displayed as follow: (gdb) p (void*)(kernel_init+0x120) $1 = (void *) 0x589a28 <ret_for_syscall> What could be the cause of printk() format %pS printing an incorrect symbol. Where can I find in the Linux source code, the function handling the format %pS ?

2 6

What are the relations between queued_spin_lock_slowpath function and __raw_spin_lock function?
by 孙世龙 sunshilong July 7, 2020

July 7, 2020

Hi, list What are the relations between queued_spin_lock_slowpath function and __raw_spin_lock function? For your convenience, here are the URLs of the related code snippets: https://elixir.bootlin.com/linux/v4.19.84/source/include/linux/spinlock_api… https://elixir.bootlin.com/linux/v4.19.84/source/kernel/locking/qspinlock.c… Though I have carefully read the related code snippet, I still can't answer this question. I would be grateful to have some help with this question. Thank you for your attention to this matter. Best regards.

1 0

For a bug in lib/vsprintf.c where should a patch be sent to ?
by William Tambe July 6, 2020

July 6, 2020

For a bug in lib/vsprintf.c where should a patch be sent to ?

3 3

There is "softlockup_tick()" function in the source code of linux-2.6.32, but what's the corresponding function name in the linux-4.9 or later?
by 孙世龙 sunshilong July 6, 2020

July 6, 2020

Hi, list There is "softlockup_tick()" function in the source code of linux-2.6.32(refer to https://elixir.bootlin.com/linux/v2.6.32.39/source/kernel/softlockup.c#L104) but what's the corresponding function in the linux-4.9 or later? There is not even a source code file named by softlockup.c in the linux-4.9 or later? Thank you for your attention to this matter.

2 2

Git pull and untracked files
by Gautam Bhat July 5, 2020

July 5, 2020

Hi, When I do a git pull to get the latest changes (from v5.2) , git status shows the following files as untracked: scripts/conmakehash scripts/pnmtologo scripts/sortextable I don't see the files in .gitignore too but in the earlier version i.e. v5.2 it is present. These files are binaries, should I go ahead and delete them? -Gautam.

2 3

modprobe rbtree-test nnodes=1000 gets soft lockup
by jim.cromie＠gmail.com July 3, 2020

July 3, 2020

hey fellow noobs/readers modprobe rbtree-test nnodes=1000 gets soft lockup timing seems semi-quadratic large sets seem to knock it over, I cut perf_loops in 1/10, expecting that to fix it, it didnt. does anyone else see this ? bash-5.0# modprobe rbtree_test [ 17.808044][ T233] rbtree testing [ 17.817992][ T233] -> test 1 (latency of nnodes insert+delete): 25770 cycles [ 17.829363][ T233] -> test 2 (latency of nnodes cached insert+delete): 25066 cycles [ 17.831705][ T233] -> test 3 (latency of inorder traversal): 2333 cycles [ 17.832994][ T233] -> test 4 (latency to fetch first node) [ 17.833931][ T233] non-cached: 21 cycles [ 17.834756][ T233] cached: 13 cycles [ 17.910160][ T233] augmented rbtree testing [ 17.931726][ T233] -> test 1 (latency of nnodes insert+delete): 55888 cycles [ 17.954803][ T233] -> test 2 (latency of nnodes cached insert+delete): 54948 cycles [ 18.052785][ T233] dynamic_debug:ddebug_remove_module: removing module "rbtree_test" modprobe: ERROR: could not insert 'rbtree_test': Resource temporarily unavailable bash-5.0# modprobe rbtree_test nnodes=500 [ 33.843314][ T235] rbtree testing [ 33.919317][ T235] -> test 1 (latency of nnodes insert+delete): 196957 cycles [ 34.002251][ T235] -> test 2 (latency of nnodes cached insert+delete): 209320 cycles [ 34.008807][ T235] -> test 3 (latency of inorder traversal): 12848 cycles [ 34.010039][ T235] -> test 4 (latency to fetch first node) [ 34.011065][ T235] non-cached: 24 cycles [ 34.011795][ T235] cached: 13 cycles [ 35.955906][ T235] augmented rbtree testing [ 36.099845][ T235] -> test 1 (latency of nnodes insert+delete): 373062 cycles [ 36.246031][ T235] -> test 2 (latency of nnodes cached insert+delete): 372324 cycles [ 38.821936][ T235] dynamic_debug:ddebug_remove_module: removing module "rbtree_test" modprobe: ERROR: could not insert 'rbtree_test': Resource temporarily unavailable bash-5.0# modprobe rbtree_test nnodes=1000 [ 46.987262][ T237] rbtree testing [ 47.157653][ T237] -> test 1 (latency of nnodes insert+delete): 441603 cycles [ 47.342749][ T237] -> test 2 (latency of nnodes cached insert+delete): 475413 cycles [ 47.355668][ T237] -> test 3 (latency of inorder traversal): 29168 cycles [ 47.356965][ T237] -> test 4 (latency to fetch first node) [ 47.357917][ T237] non-cached: 36 cycles [ 47.358638][ T237] cached: 13 cycles [ 55.581422][ T237] augmented rbtree testing [ 55.891384][ T237] -> test 1 (latency of nnodes insert+delete): 803375 cycles [ 56.200665][ T237] -> test 2 (latency of nnodes cached insert+delete): 796702 cycles [ 66.887909][ T237] dynamic_debug:ddebug_remove_module: removing module "rbtree_test" modprobe: ERROR: could not insert 'rbtree_test': Resource temporarily unavailable bash-5.0# modprobe rbtree_test nnodes=1500 [ 81.481918][ T239] rbtree testing [ 81.763810][ T239] -> test 1 (latency of nnodes insert+delete): 730506 cycles [ 82.066386][ T239] -> test 2 (latency of nnodes cached insert+delete): 778610 cycles [ 82.086648][ T239] -> test 3 (latency of inorder traversal): 48465 cycles [ 82.087706][ T239] -> test 4 (latency to fetch first node) [ 82.088728][ T239] non-cached: 61 cycles [ 82.089511][ T239] cached: 13 cycles [ 101.149656][ T239] augmented rbtree testing [ 101.622513][ T239] -> test 1 (latency of nnodes insert+delete): 1225584 cycles [ 102.112011][ T239] -> test 2 (latency of nnodes cached insert+delete): 1263990 cycles [ 127.491941][ T239] dynamic_debug:ddebug_remove_module: removing module "rbtree_test" modprobe: ERROR: could not insert 'rbtree_test': Resource temporarily unavailable bash-5.0# modprobe rbtree_test nnodes=2000 [ 147.626834][ T241] rbtree testing [ 148.032627][ T241] -> test 1 (latency of nnodes insert+delete): 1051510 cycles [ 148.439514][ T241] -> test 2 (latency of nnodes cached insert+delete): 1049853 cycles [ 148.465867][ T241] -> test 3 (latency of inorder traversal): 63728 cycles [ 148.466980][ T241] -> test 4 (latency to fetch first node) [ 148.468084][ T241] non-cached: 24 cycles [ 148.468941][ T241] cached: 13 cycles [ 172.494679][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [modprobe:241] [ 172.495922][ C0] Modules linked in: rbtree_test(E+) crc32_pclmul(E) ghash_clmulni_intel(E) crct10dif_pclmul(E) crc32c_intel(E) serio_raw(E) [ 172.497859][ C0] CPU: 0 PID: 241 Comm: modprobe Tainted: G E 5.8.0-rc3-00017-gcd430eec8fdf #190 [ 172.499592][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.13.0-2.fc32 04/01/2014 [ 172.501049][ C0] RIP: 0010:__sanitizer_cov_trace_pc+0x30/0x60 [ 172.501937][ C0] Code: 8b 14 25 40 7c 01 00 65 8b 05 7c ca d6 7e a9 00 01 ff 00 74 0f f6 c4 01 74 3c 8b 82 cc 19 00 00 85 c0 74 32 8b 82 a8 19 00 00 <83> f8 02 75 27 48 8b b2 b0 19 00 00 8b 92 ac 19 00 00 48 8b 06 48 [ 172.505047][ C0] RSP: 0018:ffffc900000ebd38 EFLAGS: 00000246 [ 172.506028][ C0] RAX: 0000000000000000 RBX: 0000000000000007 RCX: ffffffffc002619e [ 172.507369][ C0] RDX: ffff88800776ddc0 RSI: ffffffffc0028460 RDI: ffff888004c0b480 [ 172.508651][ C0] RBP: 0000000000000537 R08: ffff888004c03190 R09: 0000000000000000 [ 172.509815][ C0] R10: ffff888004c13798 R11: 0000000031343254 R12: ffff888004c03190 [ 172.511013][ C0] R13: 000000000000005d R14: 0000000000000001 R15: 0000000011e954f4 [ 172.512316][ C0] FS: 00007f4173fcd740(0000) GS:ffff888007a00000(0000) knlGS:0000000000000000 [ 172.513627][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 172.514646][ C0] CR2: 000055ae6dee3660 CR3: 0000000005c3a005 CR4: 0000000000360ef0 [ 172.516089][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 172.517247][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 172.518529][ C0] Call Trace: [ 172.519032][ C0] check+0xcd/0x230 [rbtree_test] [ 172.519801][ C0] rbtree_test_init+0x4a2/0x1000 [rbtree_test] [ 172.520827][ C0] ? 0xffffffffc0016000 [ 172.521582][ C0] do_one_initcall+0x5f/0x270 [ 172.522263][ C0] ? _cond_resched+0x16/0x40 [ 172.522913][ C0] ? kmem_cache_alloc_trace+0x1eb/0x220 [ 172.523741][ C0] ? do_init_module+0x23/0x250 [ 172.524539][ C0] do_init_module+0x5c/0x250 [ 172.525239][ C0] __do_sys_finit_module+0xac/0x110 [ 172.526245][ C0] do_syscall_64+0x4d/0x90 [ 172.527034][ C0] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 172.528178][ C0] RIP: 0033:0x7f41740f743d [ 172.529006][ C0] Code: Bad RIP value. [ 172.529693][ C0] RSP: 002b:00007ffc31454ea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 172.531206][ C0] RAX: ffffffffffffffda RBX: 000055ac3eac3b40 RCX: 00007f41740f743d [ 172.532539][ C0] RDX: 0000000000000000 RSI: 000055ac3eac3e10 RDI: 0000000000000003 [ 172.533709][ C0] RBP: 0000000000040000 R08: 0000000000000000 R09: 000000000000000b [ 172.534860][ C0] R10: 0000000000000003 R11: 0000000000000246 R12: 0000000000000000 [ 172.535983][ C0] R13: 000055ac3eac3e10 R14: 000055ac3eac3be0 R15: 000000000000000b [ 183.785924][ T241] augmented rbtree testing [ 184.431255][ T241] -> test 1 (latency of nnodes insert+delete): 1672622 cycles [ 185.082000][ T241] -> test 2 (latency of nnodes cached insert+delete): 1681097 cycles [ 207.628654][ C0] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 207.629842][ C0] (detected by 0, t=60002 jiffies, g=24045, q=4) [ 207.631329][ C0] rcu: All QSes seen, last rcu_sched kthread activity 60002 (4294874745-4294814743), jiffies_till_next_fqs=3, root ->qsmask 0x0 [ 207.633795][ C0] rcu: rcu_sched kthread starved for 60002 jiffies! g24045 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 [ 207.635773][ C0] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior. [ 207.637720][ C0] rcu: RCU grace-period kthread stack dump: [ 207.638771][ C0] rcu_sched R running task 0 11 2 0x00004000 [ 207.640034][ C0] Call Trace: [ 207.640791][ C0] __schedule+0x27d/0x780 [ 207.641831][ C0] ? __mod_timer+0x27f/0x540 [ 207.642706][ C0] schedule+0x4a/0xb0 [ 207.643324][ C0] schedule_timeout+0xa9/0x1a0 [ 207.644207][ C0] ? __next_timer_interrupt+0x110/0x110 [ 207.645320][ C0] rcu_gp_kthread+0x4a2/0xa70 [ 207.646391][ C0] ? rcu_barrier+0x200/0x200 [ 207.647267][ C0] kthread+0x13c/0x160 [ 207.648177][ C0] ? __kthread_bind_mask+0x80/0x80 [ 207.649102][ C0] ret_from_fork+0x22/0x30 [ 230.366727][ T241] dynamic_debug:ddebug_remove_module: removing module "rbtree_test" modprobe: ERROR: could not insert 'rbtree_test': Resource temporarily unavailable bash-5.0#

1 0

How do you investigate the cause of total hang? Is there some information that I should pay attention to in order to get some hint?
by 孙世龙 sunshilong July 3, 2020

July 3, 2020

Hi, list My x86 machine(linux4.19) sometimes hangs, suddenly not responding in any way to the mouse or the keyboard. How can I investigate why it hung up? Is there extra information I can find for a clue? Is there anything less drastic than power-off to get some kind of action, if only some limited shell or just beeps, but might give a clue? Thank you for your attention to this matter.

2 2