OpenWrt/LEDE Project

  • Status Unconfirmed
  • Percent Complete
    0%
  • Task Type Bug Report
  • Category Kernel
  • Assigned To No-one
  • Operating System All
  • Severity High
  • Priority Very Low
  • Reported Version Trunk
  • Due in Version Undecided
  • Due Date Undecided
  • Votes
  • Private
Attached to Project: OpenWrt/LEDE Project
Opened by mistepien - 17.11.2018

FS#1956 - hwnat on edgerouter er-x mt7621

I got somethink like this on edgerouter er-x (ramips). Router was on but there was no access. I had to turn it off and turn in on once again.

Nov 17 17:38:47 thorgal kernel: [15761.908512] Sending NMI from CPU 3 to CPUs 2:
Nov 17 17:38:47 thorgal kernel: [15761.996426] rcu_sched I 0 8 2 0×00100000 Nov 17 17:38:47 thorgal kernel: [15762.007336] Stack : 805a0000 8fc42bc0 8fc5fe30 8fc5fe30 81221380 8fc5fe30 805a0000 81221380
Nov 17 17:38:47 thorgal kernel: [15762.023980] 00000003 8008601c 00178244 81221380 81221380 8fc5fe30 805a0000 81221380
Nov 17 17:38:47 thorgal kernel: [15762.040623] 00000003 805a61b8 805ae510 8048b900 00000001 8fc5fe30 805a0000 00178244
Nov 17 17:38:47 thorgal kernel: [15762.057265] 81221380 8048e828 00000002 80082118 805a0000 00000000 8fc5febc 00000001
Nov 17 17:38:47 thorgal kernel: [15762.073907] 00000000 812213ec 00178244 8008656c 8fc42bc0 01400001 00000001 805ae400
Nov 17 17:38:47 thorgal kernel: [15762.090549] ...
Nov 17 17:38:47 thorgal kernel: [15762.095410] Call Trace:
Nov 17 17:38:47 thorgal kernel: [15762.100290] [<8048b7e0>] schedule+0x7a0/0×854 Nov 17 17:38:47 thorgal kernel: [15762.109303] [<8048b900>] schedule+0x6c/0×84 Nov 17 17:38:47 thorgal kernel: [15762.117629] [<8048e828>] schedule_timeout+0x17c/0x1b8
Nov 17 17:38:47 thorgal kernel: [15762.127680] [<80082734>] rcu_gp_kthread+0×560/0×950 Nov 17 17:38:47 thorgal kernel: [15762.137395] [<8004b638>] kthread+0×130/0×144 Nov 17 17:38:47 thorgal kernel: [15762.145892] [<8000b0d8>] ret_from_kernel_thread+0×14/0x1c
Nov 17 17:38:47 thorgal kernel: [15775.236942] NMI backtrace for cpu 2
Nov 17 17:38:47 thorgal kernel: [15775.236964] rcu_sched R running task 0 8 2 0×00100000 Nov 17 17:38:47 thorgal kernel: [15775.236978] Stack : 805a0000 8fc42bc0 8fc5fe30 8fc5fe30 81221380 8fc5fe30 805a0000 81221380
Nov 17 17:38:47 thorgal kernel: [15775.237015] 00000003 8008601c 00178244 81221380 81221380 8fc5fe30 805a0000 81221380
Nov 17 17:38:47 thorgal kernel: [15775.237051] 00000003 805a61b8 805ae510 8048b900 00000001 8fc5fe30 805a0000 00178244
Nov 17 17:38:47 thorgal kernel: [15775.237087] 81221380 8048e828 00000002 80082118 805a0000 00000000 8fc5febc 00000001
Nov 17 17:38:47 thorgal kernel: [15775.237122] 00000000 812213ec 00178244 8008656c 8fc42bc0 01400001 00000001 805ae400
Nov 17 17:38:47 thorgal kernel: [15775.237158] ...
Nov 17 17:38:47 thorgal kernel: [15775.237167] Call Trace:
Nov 17 17:38:47 thorgal kernel: [15775.237183] [<8048b7e0>]
schedule+0x7a0/0×854 Nov 17 17:38:47 thorgal kernel: [15775.237198] [<8048b900>] schedule+0x6c/0×84 Nov 17 17:38:47 thorgal kernel: [15775.237215] [<8048e828>] schedule_timeout+0x17c/0x1b8
Nov 17 17:38:47 thorgal kernel: [15775.237229] [<80082734>] rcu_gp_kthread+0×560/0×950 Nov 17 17:38:47 thorgal kernel: [15775.237248] [<8004b638>] kthread+0×130/0×144 Nov 17 17:38:47 thorgal kernel: [15775.237263] [<8000b0d8>] ret_from_kernel_thread+0×14/0x1c
Nov 17 17:38:47 thorgal kernel: [15775.427526] CPU: 2 PID: 5010 Comm: kworker/2:0 Not tainted 4.14.81 #0
Nov 17 17:38:47 thorgal kernel: [15775.440361] Workqueue: events_power_efficient nf_flow_dnat_port [nf_flow_table]
Nov 17 17:38:47 thorgal kernel: [15775.454895] Stack : 805326f4 8fc11d24 805a0000 8e120380 80532788 00000002 805ae400 805a60ac
Nov 17 17:38:47 thorgal kernel: [15775.471538] 000000e0 8006f8ec 8fddf3fc 805a8947 805a0000 00000001 8fc11ce8 532616b0
Nov 17 17:38:47 thorgal kernel: [15775.488181] 00000000 00000000 00000000 00004030 00000000 000000e7 00000008 00000000
Nov 17 17:38:47 thorgal kernel: [15775.504822] 00000000 805b0000 0006b829 00000000 00000000 00000000 805d0000 00000002
Nov 17 17:38:47 thorgal kernel: [15775.521463] 805ae400 805a60ac 000000e0 805a0000 00000002 802a2be8 00000008 80610008
Nov 17 17:38:47 thorgal kernel: [15775.538106] ...
Nov 17 17:38:47 thorgal kernel: [15775.542964] Call Trace:
Nov 17 17:38:47 thorgal kernel: [15775.547836] [<800106c0>] show_stack+0×58/0×100 Nov 17 17:38:47 thorgal kernel: [15775.556696] [<8047261c>] dump_stack+0x9c/0xe0
Nov 17 17:38:47 thorgal kernel: [15775.565368] [<804794c4>] nmi_cpu_backtrace+0xe4/0×108 Nov 17 17:38:47 thorgal kernel: [15775.575414] [<804795b0>] nmi_trigger_cpumask_backtrace+0xc8/0×168 Nov 17 17:38:47 thorgal kernel: [15775.587537] [<80084018>] rcu_dump_cpu_stacks+0xc4/0x13c
Nov 17 17:38:47 thorgal kernel: [15775.597927] [<80083474>] rcu_check_callbacks+0×310/0×814 Nov 17 17:38:47 thorgal kernel: [15775.608501] [<800869e8>] update_process_times+0×34/0x7c
Nov 17 17:38:47 thorgal kernel: [15775.618911] [<800975cc>] tick_handle_periodic+0×34/0xd0
Nov 17 17:38:47 thorgal kernel: [15775.629316] [<80325e80>] gic_compare_interrupt+0×70/0×80 Nov 17 17:38:47 thorgal kernel: [15775.639886] [<80076e90>] handle_percpu_devid_irq+0xbc/0x1a8
Nov 17 17:38:47 thorgal kernel: [15775.650987] [<800711e0>] generic_handle_irq+0×40/0×58 Nov 17 17:38:47 thorgal kernel: [15775.661039] [<80251f5c>] gic_handle_local_int+0x9c/0xe8
Nov 17 17:38:47 thorgal kernel: [15775.671428] [<8025211c>] gic_irq_dispatch+0×10/0×20 Nov 17 17:38:47 thorgal kernel: [15775.681129] [<800711e0>] generic_handle_irq+0×40/0×58 Nov 17 17:38:47 thorgal kernel: [15775.691173] [<8048f9a4>] do_IRQ+0x1c/0x2c
Nov 17 17:38:47 thorgal kernel: [15775.699144] [<802510ec>] plat_irq_dispatch+0xfc/0×138 Nov 17 17:38:47 thorgal kernel: [15775.709191] [<8000b5e8>] except_vec_vi_end+0xb8/0xc4
Nov 17 17:38:47 thorgal kernel: [15775.719064] [<80069db4>] queued_spin_lock_slowpath+0x1e4/0x2e0
Nov 17 17:38:47 thorgal kernel: [15775.730675] [<8ef1d190>] nf_flow_table_iterate+0×338/0x7b0 [nf_flow_table]
Nov 17 17:39:15 thorgal ddns-scripts[1426]: myddns_ipv4: Get registered/public IP for szafa.mywire.org failed - retry 2/0 in 60 seconds
Nov 17 17:41:47 thorgal kernel: [15941.959647] Sending NMI from CPU 3 to CPUs 2:
Nov 17 17:41:47 thorgal kernel: [15945.502291] NMI backtrace for cpu 2
Nov 17 17:41:47 thorgal kernel: [15945.509227] CPU: 2 PID: 5010 Comm: kworker/2:0 Not tainted 4.14.81 #0
Nov 17 17:41:47 thorgal kernel: [15945.522053] Workqueue: events_power_efficient nf_flow_dnat_port [nf_flow_table]
Nov 17 17:41:47 thorgal kernel: [15945.536588] Stack : 805326f4 8fc11d24 805a0000 8e120380 80532788 00000002 805ae400 805a60ac
Nov 17 17:41:47 thorgal kernel: [15945.553233] 000000e0 8006f8ec 8fddf3fc 805a8947 805a0000 00000001 8fc11ce8 532616b0
Nov 17 17:41:47 thorgal kernel: [15945.569875] 00000000 00000000 00000000 000049e8 00000000 0000010b 00000008 00000000
Nov 17 17:41:47 thorgal kernel: [15945.586517] 00000000 805b0000 0007f745 00000000 00000000 00000000 805d0000 00000002
Nov 17 17:41:47 thorgal kernel: [15945.603156] 805ae400 805a60ac 000000e0 805a0000 00000002 802a2be8 00000008 80610008
Nov 17 17:41:47 thorgal kernel: [15945.619796] ...
Nov 17 17:41:47 thorgal kernel: [15945.624654] Call Trace:
Nov 17 17:41:47 thorgal kernel: [15945.629526] [<800106c0>] show_stack+0×58/0×100 Nov 17 17:41:47 thorgal kernel: [15945.638387] [<8047261c>] dump_stack+0x9c/0xe0
Nov 17 17:41:47 thorgal kernel: [15945.647060] [<804794c4>] nmi_cpu_backtrace+0xe4/0×108 Nov 17 17:41:47 thorgal kernel: [15945.657105] [<804795b0>] nmi_trigger_cpumask_backtrace+0xc8/0×168 Nov 17 17:41:47 thorgal kernel: [15945.669229] [<80084018>] rcu_dump_cpu_stacks+0xc4/0x13c
Nov 17 17:41:47 thorgal kernel: [15945.679621] [<80083474>] rcu_check_callbacks+0×310/0×814 Nov 17 17:41:47 thorgal kernel: [15945.690193] [<800869e8>] update_process_times+0×34/0x7c
Nov 17 17:41:47 thorgal kernel: [15945.700599] [<800975cc>] tick_handle_periodic+0×34/0xd0
Nov 17 17:41:47 thorgal kernel: [15945.711004] [<80325e80>] gic_compare_interrupt+0×70/0×80 Nov 17 17:41:47 thorgal kernel: [15945.721571] [<80076e90>] handle_percpu_devid_irq+0xbc/0x1a8
Nov 17 17:41:47 thorgal kernel: [15945.732668] [<800711e0>] generic_handle_irq+0×40/0×58 Nov 17 17:41:47 thorgal kernel: [15945.742719] [<80251f5c>] gic_handle_local_int+0x9c/0xe8
Nov 17 17:41:47 thorgal kernel: [15945.753110] [<8025211c>] gic_irq_dispatch+0×10/0×20 Nov 17 17:41:47 thorgal kernel: [15945.762809] [<800711e0>] generic_handle_irq+0×40/0×58 Nov 17 17:41:47 thorgal kernel: [15945.772855] [<8048f9a4>] do_IRQ+0x1c/0x2c
Nov 17 17:41:47 thorgal kernel: [15945.780825] [<802510ec>] plat_irq_dispatch+0xfc/0×138 Nov 17 17:41:47 thorgal kernel: [15945.790875] [<8000b5e8>] except_vec_vi_end+0xb8/0xc4
Nov 17 17:41:47 thorgal kernel: [15945.800747] [<80069db4>] queued_spin_lock_slowpath+0x1e4/0x2e0
Nov 17 17:41:47 thorgal kernel: [15945.812371] [<8ef1d190>] nf_flow_table_iterate+0×338/0x7b0 [nf_flow_table]

More frequently I have this:
Nov 17 12:13:14 thorgal kernel: [123236.003832] ————[ cut here ]———— Nov 17 12:13:14 thorgal kernel: [123236.013239] WARNING: CPU: 3 PID: 0 at net/sched/sch_generic.c:320 dev_watchdog+0x1ac/0×324 Nov 17 12:13:14 thorgal kernel: [123236.029874] NETDEV WATCHDOG: eth0 (mtk_soc_eth): transmit queue 0 timed out
Nov 17 12:13:14 thorgal kernel: [123236.043896] Modules linked in: pppoe ppp_async pppox ppp_generic nf_conntrack_ipv6 iptable_nat ipt_REJECT ipt_MASQUERADE xt_time xt_tc
pudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit
xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_FLOWOFFLOAD xt_DSCP xt_CT xt_CLASSIFY slhc nf_reject_ipv4 nf_nat_redirect nf_nat_masquerade_ipv4 nf_conntrac
k_ipv4 nf_nat_ipv4 nf_nat nf_log_ipv4 nf_flow_table_hw nf_flow_table nf_defrag_ipv6 nf_defrag_ipv4 nf_conntrack_rtcache nf_conntrack_netlink iptable_raw iptable_mangle ip
table_filter ipt_ECN ip_tables crc_ccitt sch_cake nf_conntrack act_skbedit act_mirred em_u32 cls_u32 cls_tcindex cls_flow cls_route cls_fw sch_tbf sch_htb sch_hfsc
Nov 17 12:13:14 thorgal kernel: [123236.184720] sch_ingress xt_set ip_set_list_set ip_set_hash_netiface ip_set_hash_netport ip_set_hash_netnet ip_set_hash_net ip_set_has
h_netportnet ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set
_bitmap_ip ip_set nfnetlink ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables x_tables ifb tun leds_gpio gpio_button_hotplug
Nov 17 12:13:14 thorgal kernel: [123236.267833] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 4.14.81 #0
Nov 17 12:13:14 thorgal kernel: [123236.279945] Stack : 00000000 8fede440 805a0000 8006f714 805d0000 8056cd28 00000000 00000000
Nov 17 12:13:14 thorgal kernel: [123236.296745] 80537698 8fc15dc4 8fc44e7c 805a8947 80532788 00000001 8fc15d68 532616b0
Nov 17 12:13:14 thorgal kernel: [123236.313548] 00000000 00000000 80610000 00003b80 00000000 000000ca 00000008 00000000
Nov 17 12:13:14 thorgal kernel: [123236.330352] 00000000 805b0000 00041639 70617773 00000000 00000000 805d0000 8037ffc8
Nov 17 12:13:14 thorgal kernel: [123236.347151] 00000009 00000140 00000003 8fede440 00000000 802a2be8 0000000c 8061000c
Nov 17 12:13:14 thorgal kernel: [123236.363954] ...
Nov 17 12:13:14 thorgal kernel: [123236.368981] Call Trace:
Nov 17 12:13:14 thorgal kernel: [123236.374032] [<800106c0>] show_stack+0×58/0×100 Nov 17 12:13:14 thorgal kernel: [123236.383060] [<8047261c>] dump_stack+0x9c/0xe0
Nov 17 12:13:14 thorgal kernel: [123236.391897] [<8002e368>] warn+0xe0/0×114 Nov 17 12:13:14 thorgal kernel: [123236.400209] [<8002e3cc>] warn_slowpath_fmt+0×30/0x3c
Nov 17 12:13:14 thorgal kernel: [123236.410261] [<8037ffc8>] dev_watchdog+0x1ac/0×324 Nov 17 12:13:14 thorgal kernel: [123236.419800] [<800866a4>] call_timer_fn.isra.3+0×24/0×84 Nov 17 12:13:14 thorgal kernel: [123236.430360] [<800868c0>] run_timer_softirq+0x1bc/0×248 Nov 17 12:13:14 thorgal kernel: [123236.440750] [<8048fae0>]
do_softirq+0×128/0x2ec
Nov 17 12:13:14 thorgal kernel: [123236.450279] [<80032a94>] irq_exit+0xac/0xc8
Nov 17 12:13:14 thorgal kernel: [123236.458769] [<802510ec>] plat_irq_dispatch+0xfc/0×138 Nov 17 12:13:14 thorgal kernel: [123236.468983] [<8000b5e8>] except_vec_vi_end+0xb8/0xc4
Nov 17 12:13:14 thorgal kernel: [123236.479027] [<8000cfb0>] r4k_wait_irqoff+0x1c/0×24 Nov 17 12:13:14 thorgal kernel: [123236.488751] [<8006678c>] do_idle+0xe4/0×168 Nov 17 12:13:14 thorgal kernel: [123236.497240] [<80066a08>] cpu_startup_entry+0×24/0x2c
Nov 17 12:13:14 thorgal kernel: [123236.507364] —[ end trace 003324f4695475ea ]— Nov 17 12:13:14 thorgal kernel: [123236.529199] mtk_soc_eth 1e100000.ethernet eth0: dma_cfg:80000065
Nov 17 12:13:14 thorgal kernel: [123236.541328] mtk_soc_eth 1e100000.ethernet eth0: tx_ring=0, base=0ec20000, max=0, ctx=2144, dtx=2144, fdx=2143, next=2144
Nov 17 12:13:14 thorgal kernel: [123236.563144] mtk_soc_eth 1e100000.ethernet eth0: rx_ring=0, base=0f3a0000, max=0, calc=1468, drx=1469
Nov 17 12:13:14 thorgal kernel: [123236.586305] mtk_soc_eth 1e100000.ethernet: 0×100 = 0x6060000c, 0x10c = 0×80818 Nov 17 12:13:14 thorgal kernel: [123236.606376] mtk_soc_eth 1e100000.ethernet: PPE started

In this case system goes on and it works. Maybe this is a same problem?
Kernel in trunk is 4.14.81. SQM is disabled.

Loading...

Available keyboard shortcuts

Tasklist

Task Details

Task Editing