OpenWrt/LEDE Project

  • Status Assigned
  • Percent Complete
    0%
  • Task Type Bug Report
  • Category Base system
  • Assigned To
    Yousong Zhou
  • Operating System All
  • Severity Critical
  • Priority Very Low
  • Reported Version openwrt-19.07
  • Due in Version Undecided
  • Due Date Undecided
  • Private
Attached to Project: OpenWrt/LEDE Project
Opened by Hannu Nyman - 23.11.2019

FS#2624 - [19.07] wired LAN crashes repeatedly after backport commit r10733-436dbf12aa

My new 19.07 build r10733-436dbf12aa for ipq806x/R7800 started to crash the LAN connectivity immediately after the reboot. The reason is something netfilter-related. Log below.

Wireless seems to work, but wired LAN causes repeated kernel errors.

Previous known OK build was r10697-a1ff175dbf (20191116), and after I noticed this new build r10733-436dbf12aa crashing, I looked at the 19.07 commit log and looked for possible culprits.

As the most recent commit looked as the probable culprit based on the nature (netfilter), I made test build of r10732-b177b180bb and that works ok. (I then also rebuilt with r10734-15ce616c2d and naturally that crashes, too.)

router: ipq806x/R7800
kernel: 4.14.155

Good: r10732-b177b180bb
Bad: r10733-436dbf12aa

https://git.openwrt.org/?p=openwrt/openwrt.git;a=commitdiff;h=436dbf12aa7381bd6db1b03b36be5a73df386eb4;hp=b177b180bbdb30978aca75d59337246aed2ac268

I have not yest tested master, but as that is a commit done there today and immediately backported to 19.07, it is quite possible that the same things happens in master.

Kernel log example:

[   88.600536] ------------[ cut here ]------------
[   88.600685] WARNING: CPU: 1 PID: 0 at net/netfilter/nf_conntrack_rtcache.c:197 nf_conn_rtcache_destroy+0xb0/0x218 [nf_conntrack_rtcache]
[   88.604265] Modules linked in: pppoe ppp_async ath10k_pci ath10k_core ath pptp pppox ppp_mppe ppp_generic mac80211 iptable_nat ipt_REJECT ipt_MASQUERADE cfg80211 xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_esp xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_FLOWOFFLOAD xt_DSCP xt_CT xt_CLASSIFY slhc nf_reject_ipv4 nf_nat_redirect nf_nat_masquerade_ipv4 nf_conntrack_ipv4 nf_nat_ipv4 nf_log_ipv4 nf_flow_table_hw nf_flow_table nf_defrag_ipv4 nf_conntrack_rtcache nf_conntrack_netlink iptable_raw iptable_mangle iptable_filter ipt_ah ipt_ECN ip_tables crc_ccitt compat chaoskey fuse sch_cake sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex
[   88.664955]  cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred ledtrig_usbport xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6t_NPT ip6t_MASQUERADE nf_nat_masquerade_ipv6 nf_nat nf_conntrack nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 msdos ip_gre gre ifb sit tunnel4 ip_tunnel tun vfat fat hfsplus cifs nls_utf8 nls_iso8859_15 nls_iso8859_1 nls_cp850 nls_cp437 nls_cp1250 sha1_generic md5 md4 ecb des_generic
[   88.736015]  usb_storage leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_of_simple ohci_platform ohci_hcd phy_qcom_dwc3 ahci ehci_platform sd_mod ahci_platform libahci_platform libahci libata scsi_mod ehci_hcd gpio_button_hotplug ext4 mbcache jbd2 exfat crc32c_generic
[   88.760160] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G        W       4.14.155 #0
[   88.782365] Hardware name: Generic DT based system
[   88.789444] [<c030f2c4>] (unwind_backtrace) from [<c030b498>] (show_stack+0x14/0x20)
[   88.794287] [<c030b498>] (show_stack) from [<c079e644>] (dump_stack+0x94/0xa8)
[   88.802189] [<c079e644>] (dump_stack) from [<c031fb58>] (__warn+0xf0/0x11c)
[   88.809209] [<c031fb58>] (__warn) from [<c031fc44>] (warn_slowpath_null+0x20/0x28)
[   88.816096] [<c031fc44>] (warn_slowpath_null) from [<bf5a312c>] (nf_conn_rtcache_destroy+0xb0/0x218 [nf_conntrack_rtcache])
[   88.823754] [<bf5a312c>] (nf_conn_rtcache_destroy [nf_conntrack_rtcache]) from [<c06d30f0>] (nf_hook_slow+0x38/0xd4)
[   88.834742] [<c06d30f0>] (nf_hook_slow) from [<c06dbaf0>] (ip_forward+0x304/0x3a4)
[   88.845491] [<c06dbaf0>] (ip_forward) from [<c06dab94>] (ip_rcv+0x26c/0x290)
[   88.852870] [<c06dab94>] (ip_rcv) from [<c0697e84>] (__netif_receive_skb_core+0xa2c/0xbc8)
[   88.860076] [<c0697e84>] (__netif_receive_skb_core) from [<c069a358>] (netif_receive_skb_internal+0xc0/0xd4)
[   88.868161] [<c069a358>] (netif_receive_skb_internal) from [<c077e408>] (br_handle_frame_finish+0x4d8/0x528)
[   88.878136] [<c077e408>] (br_handle_frame_finish) from [<c077e6d4>] (br_handle_frame+0x27c/0x2bc)
[   88.887942] [<c077e6d4>] (br_handle_frame) from [<c0697b60>] (__netif_receive_skb_core+0x708/0xbc8)
[   88.896703] [<c0697b60>] (__netif_receive_skb_core) from [<c069815c>] (process_backlog+0xa8/0x160)
[   88.905562] [<c069815c>] (process_backlog) from [<c069a794>] (net_rx_action+0x144/0x31c)
[   88.914587] [<c069a794>] (net_rx_action) from [<c03015c8>] (__do_softirq+0xf0/0x264)
[   88.922837] [<c03015c8>] (__do_softirq) from [<c03240fc>] (irq_exit+0xdc/0x148)
[   88.930563] [<c03240fc>] (irq_exit) from [<c030e4cc>] (handle_IPI+0xb4/0x1ac)
[   88.937586] [<c030e4cc>] (handle_IPI) from [<c03014b8>] (gic_handle_irq+0x9c/0xb8)
[   88.944878] [<c03014b8>] (gic_handle_irq) from [<c030c08c>] (__irq_svc+0x6c/0x90)
[   88.952334] Exception stack(0xdd461f80 to 0xdd461fc8)
[   88.959923] 1f80: 00000001 00000000 00000000 c0315200 ffffe000 c0b03cb8 c0b03c6c 00000000
[   88.964962] 1fa0: 00000000 512f04d0 00000000 00000000 dd461fc8 dd461fd0 c030862c c0308630
[   88.973091] 1fc0: 60000013 ffffffff
[   88.981252] [<c030c08c>] (__irq_svc) from [<c0308630>] (arch_cpu_idle+0x38/0x44)
[   88.984562] [<c0308630>] (arch_cpu_idle) from [<c03588e0>] (do_idle+0xe8/0x1bc)
[   88.992193] [<c03588e0>] (do_idle) from [<c0358c28>] (cpu_startup_entry+0x1c/0x20)
[   88.999222] [<c0358c28>] (cpu_startup_entry) from [<423017cc>] (0x423017cc)
[   89.006868] ---[ end trace b7d04976bb2993e8 ]---
[   89.020620] ------------[ cut here ]------------
[   89.020665] WARNING: CPU: 1 PID: 0 at net/netfilter/nf_conntrack_rtcache.c:197 nf_conn_rtcache_destroy+0xb0/0x218 [nf_conntrack_rtcache]
[   89.024304] Modules linked in: pppoe ppp_async ath10k_pci ath10k_core ath pptp pppox ppp_mppe ppp_generic mac80211 iptable_nat ipt_REJECT ipt_MASQUERADE cfg80211 xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_esp xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_FLOWOFFLOAD xt_DSCP xt_CT xt_CLASSIFY slhc nf_reject_ipv4 nf_nat_redirect nf_nat_masquerade_ipv4 nf_conntrack_ipv4 nf_nat_ipv4 nf_log_ipv4 nf_flow_table_hw nf_flow_table nf_defrag_ipv4 nf_conntrack_rtcache nf_conntrack_netlink iptable_raw iptable_mangle iptable_filter ipt_ah ipt_ECN ip_tables crc_ccitt compat chaoskey fuse sch_cake sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex
[   89.084961]  cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred ledtrig_usbport xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6t_NPT ip6t_MASQUERADE nf_nat_masquerade_ipv6 nf_nat nf_conntrack nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 msdos ip_gre gre ifb sit tunnel4 ip_tunnel tun vfat fat hfsplus cifs nls_utf8 nls_iso8859_15 nls_iso8859_1 nls_cp850 nls_cp437 nls_cp1250 sha1_generic md5 md4 ecb des_generic
[   89.156117]  usb_storage leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_of_simple ohci_platform ohci_hcd phy_qcom_dwc3 ahci ehci_platform sd_mod ahci_platform libahci_platform libahci libata scsi_mod ehci_hcd gpio_button_hotplug ext4 mbcache jbd2 exfat crc32c_generic
[   89.180242] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G        W       4.14.155 #0
[   89.202422] Hardware name: Generic DT based system
[   89.209468] [<c030f2c4>] (unwind_backtrace) from [<c030b498>] (show_stack+0x14/0x20)
[   89.214324] [<c030b498>] (show_stack) from [<c079e644>] (dump_stack+0x94/0xa8)
[   89.222224] [<c079e644>] (dump_stack) from [<c031fb58>] (__warn+0xf0/0x11c)
[   89.229251] [<c031fb58>] (__warn) from [<c031fc44>] (warn_slowpath_null+0x20/0x28)
[   89.236121] [<c031fc44>] (warn_slowpath_null) from [<bf5a312c>] (nf_conn_rtcache_destroy+0xb0/0x218 [nf_conntrack_rtcache])
[   89.243766] [<bf5a312c>] (nf_conn_rtcache_destroy [nf_conntrack_rtcache]) from [<c06d30f0>] (nf_hook_slow+0x38/0xd4)
[   89.254779] [<c06d30f0>] (nf_hook_slow) from [<c06dbaf0>] (ip_forward+0x304/0x3a4)
[   89.265534] [<c06dbaf0>] (ip_forward) from [<c06dab94>] (ip_rcv+0x26c/0x290)
[   89.272913] [<c06dab94>] (ip_rcv) from [<c0697e84>] (__netif_receive_skb_core+0xa2c/0xbc8)
[   89.280118] [<c0697e84>] (__netif_receive_skb_core) from [<c069a358>] (netif_receive_skb_internal+0xc0/0xd4)
[   89.288199] [<c069a358>] (netif_receive_skb_internal) from [<c077e408>] (br_handle_frame_finish+0x4d8/0x528)
[   89.298179] [<c077e408>] (br_handle_frame_finish) from [<c077e6d4>] (br_handle_frame+0x27c/0x2bc)
[   89.307984] [<c077e6d4>] (br_handle_frame) from [<c0697b60>] (__netif_receive_skb_core+0x708/0xbc8)
[   89.316749] [<c0697b60>] (__netif_receive_skb_core) from [<c069815c>] (process_backlog+0xa8/0x160)
[   89.325605] [<c069815c>] (process_backlog) from [<c069a794>] (net_rx_action+0x144/0x31c)
[   89.334632] [<c069a794>] (net_rx_action) from [<c03015c8>] (__do_softirq+0xf0/0x264)
[   89.342880] [<c03015c8>] (__do_softirq) from [<c03240fc>] (irq_exit+0xdc/0x148)
[   89.350604] [<c03240fc>] (irq_exit) from [<c030e4cc>] (handle_IPI+0xb4/0x1ac)
[   89.357635] [<c030e4cc>] (handle_IPI) from [<c03014b8>] (gic_handle_irq+0x9c/0xb8)
[   89.364925] [<c03014b8>] (gic_handle_irq) from [<c030c08c>] (__irq_svc+0x6c/0x90)
[   89.372387] Exception stack(0xdd461f80 to 0xdd461fc8)
[   89.379949] 1f80: 00000001 00000000 00000000 c0315200 ffffe000 c0b03cb8 c0b03c6c 00000000
[   89.384986] 1fa0: 00000000 512f04d0 00000000 00000000 dd461fc8 dd461fd0 c030862c c0308630
[   89.393137] 1fc0: 60000013 ffffffff
[   89.401296] [<c030c08c>] (__irq_svc) from [<c0308630>] (arch_cpu_idle+0x38/0x44)
[   89.404600] [<c0308630>] (arch_cpu_idle) from [<c03588e0>] (do_idle+0xe8/0x1bc)
[   89.412238] [<c03588e0>] (do_idle) from [<c0358c28>] (cpu_startup_entry+0x1c/0x20)
[   89.419267] [<c0358c28>] (cpu_startup_entry) from [<423017cc>] (0x423017cc)
[   89.426973] ---[ end trace b7d04976bb2993e9 ]---
[   89.433868] ------------[ cut here ]------------
[   89.438700] WARNING: CPU: 1 PID: 0 at net/netfilter/nf_conntrack_rtcache.c:197 nf_conn_rtcache_destroy+0xb0/0x218 [nf_conntrack_rtcache]
[   89.443227] Modules linked in: pppoe ppp_async ath10k_pci ath10k_core ath pptp pppox ppp_mppe ppp_generic mac80211 iptable_nat ipt_REJECT ipt_MASQUERADE cfg80211 xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_esp xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_FLOWOFFLOAD xt_DSCP xt_CT xt_CLASSIFY slhc nf_reject_ipv4 nf_nat_redirect nf_nat_masquerade_ipv4 nf_conntrack_ipv4 nf_nat_ipv4 nf_log_ipv4 nf_flow_table_hw nf_flow_table nf_defrag_ipv4 nf_conntrack_rtcache nf_conntrack_netlink iptable_raw iptable_mangle iptable_filter ipt_ah ipt_ECN ip_tables crc_ccitt compat chaoskey fuse sch_cake sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex
[   89.503856]  cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred ledtrig_usbport xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6t_NPT ip6t_MASQUERADE nf_nat_masquerade_ipv6 nf_nat nf_conntrack nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 msdos ip_gre gre ifb sit tunnel4 ip_tunnel tun vfat fat hfsplus cifs nls_utf8 nls_iso8859_15 nls_iso8859_1 nls_cp850 nls_cp437 nls_cp1250 sha1_generic md5 md4 ecb des_generic
[   89.575047]  usb_storage leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_of_simple ohci_platform ohci_hcd phy_qcom_dwc3 ahci ehci_platform sd_mod ahci_platform libahci_platform libahci libata scsi_mod ehci_hcd gpio_button_hotplug ext4 mbcache jbd2 exfat crc32c_generic
[   89.599166] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G        W       4.14.155 #0
[   89.621345] Hardware name: Generic DT based system
[   89.628387] [<c030f2c4>] (unwind_backtrace) from [<c030b498>] (show_stack+0x14/0x20)
[   89.633245] [<c030b498>] (show_stack) from [<c079e644>] (dump_stack+0x94/0xa8)
[   89.641147] [<c079e644>] (dump_stack) from [<c031fb58>] (__warn+0xf0/0x11c)
[   89.648174] [<c031fb58>] (__warn) from [<c031fc44>] (warn_slowpath_null+0x20/0x28)
[   89.655045] [<c031fc44>] (warn_slowpath_null) from [<bf5a312c>] (nf_conn_rtcache_destroy+0xb0/0x218 [nf_conntrack_rtcache])
[   89.662687] [<bf5a312c>] (nf_conn_rtcache_destroy [nf_conntrack_rtcache]) from [<c06d30f0>] (nf_hook_slow+0x38/0xd4)
[   89.673703] [<c06d30f0>] (nf_hook_slow) from [<c06dbaf0>] (ip_forward+0x304/0x3a4)
[   89.684457] [<c06dbaf0>] (ip_forward) from [<c06dab94>] (ip_rcv+0x26c/0x290)
[   89.691837] [<c06dab94>] (ip_rcv) from [<c0697e84>] (__netif_receive_skb_core+0xa2c/0xbc8)
[   89.699044] [<c0697e84>] (__netif_receive_skb_core) from [<c069a358>] (netif_receive_skb_internal+0xc0/0xd4)
[   89.707121] [<c069a358>] (netif_receive_skb_internal) from [<c077e408>] (br_handle_frame_finish+0x4d8/0x528)
[   89.717102] [<c077e408>] (br_handle_frame_finish) from [<c077e6d4>] (br_handle_frame+0x27c/0x2bc)
[   89.726906] [<c077e6d4>] (br_handle_frame) from [<c0697b60>] (__netif_receive_skb_core+0x708/0xbc8)
[   89.735674] [<c0697b60>] (__netif_receive_skb_core) from [<c069815c>] (process_backlog+0xa8/0x160)
[   89.744529] [<c069815c>] (process_backlog) from [<c069a794>] (net_rx_action+0x144/0x31c)
[   89.753557] [<c069a794>] (net_rx_action) from [<c03015c8>] (__do_softirq+0xf0/0x264)
[   89.761804] [<c03015c8>] (__do_softirq) from [<c03240fc>] (irq_exit+0xdc/0x148)
[   89.769528] [<c03240fc>] (irq_exit) from [<c030e4cc>] (handle_IPI+0xb4/0x1ac)
[   89.776558] [<c030e4cc>] (handle_IPI) from [<c03014b8>] (gic_handle_irq+0x9c/0xb8)
[   89.783849] [<c03014b8>] (gic_handle_irq) from [<c030c08c>] (__irq_svc+0x6c/0x90)
[   89.791312] Exception stack(0xdd461f80 to 0xdd461fc8)
[   89.798871] 1f80: 00000001 00000000 00000000 c0315200 ffffe000 c0b03cb8 c0b03c6c 00000000
[   89.803911] 1fa0: 00000000 512f04d0 00000000 00000000 dd461fc8 dd461fd0 c030862c c0308630
[   89.812062] 1fc0: 60000013 ffffffff
[   89.820218] [<c030c08c>] (__irq_svc) from [<c0308630>] (arch_cpu_idle+0x38/0x44)
[   89.823524] [<c0308630>] (arch_cpu_idle) from [<c03588e0>] (do_idle+0xe8/0x1bc)
[   89.831160] [<c03588e0>] (do_idle) from [<c0358c28>] (cpu_startup_entry+0x1c/0x20)
[   89.838191] [<c0358c28>] (cpu_startup_entry) from [<423017cc>] (0x423017cc)
[   89.845897] ---[ end trace b7d04976bb2993ea ]---
[   89.852796] ------------[ cut here ]------------
[   89.857629] WARNING: CPU: 1 PID: 0 at net/netfilter/nf_conntrack_rtcache.c:197 nf_conn_rtcache_destroy+0xb0/0x218 [nf_conntrack_rtcache]
[   89.862149] Modules linked in: pppoe ppp_async ath10k_pci ath10k_core ath pptp pppox ppp_mppe ppp_generic mac80211 iptable_nat ipt_REJECT ipt_MASQUERADE cfg80211 xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_esp xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_FLOWOFFLOAD xt_DSCP xt_CT xt_CLASSIFY slhc nf_reject_ipv4 nf_nat_redirect nf_nat_masquerade_ipv4 nf_conntrack_ipv4 nf_nat_ipv4 nf_log_ipv4 nf_flow_table_hw nf_flow_table nf_defrag_ipv4 nf_conntrack_rtcache nf_conntrack_netlink iptable_raw iptable_mangle iptable_filter ipt_ah ipt_ECN ip_tables crc_ccitt compat chaoskey fuse sch_cake sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex
[   89.922786]  cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred ledtrig_usbport xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6t_NPT ip6t_MASQUERADE nf_nat_masquerade_ipv6 nf_nat nf_conntrack nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 msdos ip_gre gre ifb sit tunnel4 ip_tunnel tun vfat fat hfsplus cifs nls_utf8 nls_iso8859_15 nls_iso8859_1 nls_cp850 nls_cp437 nls_cp1250 sha1_generic md5 md4 ecb des_generic
[   89.993974]  usb_storage leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_of_simple ohci_platform ohci_hcd phy_qcom_dwc3 ahci ehci_platform sd_mod ahci_platform libahci_platform libahci libata scsi_mod ehci_hcd gpio_button_hotplug ext4 mbcache jbd2 exfat crc32c_generic
[   90.018095] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G        W       4.14.155 #0
[   90.040268] Hardware name: Generic DT based system
[   90.047312] [<c030f2c4>] (unwind_backtrace) from [<c030b498>] (show_stack+0x14/0x20)
[   90.052168] [<c030b498>] (show_stack) from [<c079e644>] (dump_stack+0x94/0xa8)
[   90.060070] [<c079e644>] (dump_stack) from [<c031fb58>] (__warn+0xf0/0x11c)
[   90.067098] [<c031fb58>] (__warn) from [<c031fc44>] (warn_slowpath_null+0x20/0x28)
[   90.073967] [<c031fc44>] (warn_slowpath_null) from [<bf5a312c>] (nf_conn_rtcache_destroy+0xb0/0x218 [nf_conntrack_rtcache])
[   90.081613] [<bf5a312c>] (nf_conn_rtcache_destroy [nf_conntrack_rtcache]) from [<c06d30f0>] (nf_hook_slow+0x38/0xd4)
[   90.092626] [<c06d30f0>] (nf_hook_slow) from [<c0738a3c>] (ip6_forward+0x5e8/0x684)
[   90.103384] [<c0738a3c>] (ip6_forward) from [<c073a38c>] (ipv6_rcv+0x318/0x380)
[   90.110762] [<c073a38c>] (ipv6_rcv) from [<c0697e84>] (__netif_receive_skb_core+0xa2c/0xbc8)
[   90.118053] [<c0697e84>] (__netif_receive_skb_core) from [<c069a358>] (netif_receive_skb_internal+0xc0/0xd4)
[   90.126738] [<c069a358>] (netif_receive_skb_internal) from [<c077e408>] (br_handle_frame_finish+0x4d8/0x528)
[   90.136546] [<c077e408>] (br_handle_frame_finish) from [<c077e6d4>] (br_handle_frame+0x27c/0x2bc)
[   90.146351] [<c077e6d4>] (br_handle_frame) from [<c0697b60>] (__netif_receive_skb_core+0x708/0xbc8)
[   90.155118] [<c0697b60>] (__netif_receive_skb_core) from [<c069815c>] (process_backlog+0xa8/0x160)
[   90.163974] [<c069815c>] (process_backlog) from [<c069a794>] (net_rx_action+0x144/0x31c)
[   90.173000] [<c069a794>] (net_rx_action) from [<c03015c8>] (__do_softirq+0xf0/0x264)
[   90.181248] [<c03015c8>] (__do_softirq) from [<c03240fc>] (irq_exit+0xdc/0x148)
[   90.188975] [<c03240fc>] (irq_exit) from [<c030e4cc>] (handle_IPI+0xb4/0x1ac)
[   90.196004] [<c030e4cc>] (handle_IPI) from [<c03014b8>] (gic_handle_irq+0x9c/0xb8)
[   90.203293] [<c03014b8>] (gic_handle_irq) from [<c030c08c>] (__irq_svc+0x6c/0x90)
[   90.210757] Exception stack(0xdd461f80 to 0xdd461fc8)
[   90.218318] 1f80: 00000001 00000000 00000000 c0315200 ffffe000 c0b03cb8 c0b03c6c 00000000
[   90.223355] 1fa0: 00000000 512f04d0 00000000 00000000 dd461fc8 dd461fd0 c030862c c0308630
[   90.231506] 1fc0: 60000013 ffffffff
[   90.239665] [<c030c08c>] (__irq_svc) from [<c0308630>] (arch_cpu_idle+0x38/0x44)
[   90.242968] [<c0308630>] (arch_cpu_idle) from [<c03588e0>] (do_idle+0xe8/0x1bc)
[   90.250603] [<c03588e0>] (do_idle) from [<c0358c28>] (cpu_startup_entry+0x1c/0x20)
[   90.257634] [<c0358c28>] (cpu_startup_entry) from [<423017cc>] (0x423017cc)
[   90.265323] ---[ end trace b7d04976bb2993eb ]---
tapper82 commented on 23.11.2019 15:52

Hi same on master. build info is r11580-09c428ec6b

target is mvebu

PussAzuki commented on 23.11.2019 16:39

Here the same problem happened, also r11580-09c428ec6b

target is ramips ,mt7620

and I paste the log

https://paste.ubuntu.com/p/hHKm7MFBVN/

Project Manager
Yousong Zhou commented on 23.11.2019 16:46

Looks like the ops got registered twice to init_net. Building a new image for testing now.

Project Manager
Yousong Zhou commented on 23.11.2019 17:33

Pushed fix to master, 19.07, 18.06 branches. https://git.openwrt.org/?p=openwrt/openwrt.git;a=commitdiff;h=1c5df850a07690451f2878a310c0ea67d0690836

Sorry for the inconvenience.

Hannu Nyman commented on 23.11.2019 18:01

I tested with 19.07 and r10735-2a2f9ffe8 seems stable again.

I think that this bug might be left open for a few hours/days, as people will still stumble upon this bug in the near future, as faulty buildbot snapshot builds are available for some targets in all branches.

Just for reference for those who run into this bug, the corresponding fix commit is
* in master: 1c5df850a
* in 18.06: 8f6debf63

harvester commented on 23.11.2019 18:16

@Yousong Zhou

Tested on master branch (kernel version 4.19.85) and it's working

tapper82 commented on 24.11.2019 12:59

Thanks for the quick fix. Now running r11582-b3779e920e all is good

Loading...

Available keyboard shortcuts

Tasklist

Task Details

Task Editing