Unexpected switch reboots

DOWNLOAD THE LATEST FIRMWARE HERE
craig.moscardini
Member
 
Posts: 14
Joined: Tue Nov 05, 2019 6:14 am
Has thanked: 0 time
Been thanked: 1 time

Unexpected switch reboots

Fri Feb 28, 2020 9:56 am

I am having issues with switches rebooting themselves. We've seen this for a long time, but a lot have been resolved after updating to 1.5.5. Now all reboots are consistently the same as per the log below. There's nothing to explain the cause other than the watchdog rebooted the switch. BTW this isn't a grounding issue!


Code: Select all
Jan 1 00:00:10 system: Setting MAC address from flash configuration: EC:13:B2:81:81:1E
Jan 1 00:00:12 system: starting ntpclient
Jan 1 00:00:13 admin: adding lan (eth0) to firewall zone lan
Jan 1 00:00:13 dropbear[639]: Running in background
Jan 1 00:00:14 netonix: 1.5.5 on WS-12-250-DC
Jan 1 00:00:17 UI: web config OK
Jan 1 00:00:30 switch[817]: temp sensor version 3
Jan 1 00:00:30 switch[819]: Detected cold (watchdog) boot
Jan 1 00:00:31 Port: link state changed to 'down' on port 12
Jan 1 00:00:31 Port: link state changed to 'down' on port 3
Jan 1 00:00:31 Port: link state changed to 'down' on port 4
Jan 1 00:00:31 Port: link state changed to 'down' on port 5
Jan 1 00:00:31 Port: link state changed to 'down' on port 8
Jan 1 00:00:31 Port: link state changed to 'down' on port 9
Jan 1 00:00:31 Port: link state changed to 'down' on port 1
Jan 1 00:00:31 switch[819]: PoE enabled on port 1, PoE Smart is starting cable check
Jan 1 00:00:31 switch[819]: PoE enabled on port 3, PoE Smart is starting cable check
Jan 1 00:00:32 switch[819]: PoE enabled on port 4, PoE Smart is starting cable check
Jan 1 00:00:32 switch[819]: PoE enabled on port 5, PoE Smart is starting cable check
Jan 1 00:00:32 switch[819]: PoE enabled on port 12, PoE Smart is starting cable check
Jan 1 00:00:32 monitor: restarting vtss_appl
Jan 1 00:00:34 system: starting ntpclient

Beanhammer
Member
 
Posts: 10
Joined: Tue Aug 16, 2016 10:38 am
Has thanked: 0 time
Been thanked: 0 time

Re: Unexpected switch reboots

Fri Feb 28, 2020 9:58 am

I'm interested in this issue as we are also experiencing the same issues.


Jan 1 00:00:10 system: Setting MAC address from flash configuration: EC:13:B2:81:A6:5C
Jan 1 00:00:11 system: starting ntpclient
Jan 1 00:00:12 admin: adding lan (eth0) to firewall zone lan
Jan 1 00:00:13 dropbear[639]: Running in background
Jan 1 00:00:14 netonix: 1.5.5 on WS-12-250-DC
Jan 1 00:00:17 UI: web config OK
Jan 1 00:00:31 switch[815]: temp sensor version 3
Jan 1 00:00:31 switch[817]: Detected cold (watchdog) boot
Jan 1 00:00:32 Port: link state changed to 'down' on port 4
Jan 1 00:00:32 Port: link state changed to 'down' on port 2
Jan 1 00:00:32 Port: link state changed to 'down' on port 3
Jan 1 00:00:32 Port: link state changed to 'down' on port 1
Jan 1 00:00:32 Port: link state changed to 'down' on port 5
Jan 1 00:00:33 switch[817]: PoE enabled on port 1, PoE Smart is starting cable check
Jan 1 00:00:33 switch[817]: PoE enabled on port 2, PoE Smart is starting cable check
Jan 1 00:00:33 switch[817]: PoE enabled on port 3, PoE Smart is starting cable check
Jan 1 00:00:33 switch[817]: PoE enabled on port 4, PoE Smart is starting cable check
Jan 1 00:00:34 switch[817]: PoE enabled on port 6, PoE Smart is starting cable check
Jan 1 00:00:34 system: starting ntpclient

User avatar
Dave
Employee
Employee
 
Posts: 723
Joined: Tue Apr 08, 2014 6:28 pm
Has thanked: 1 time
Been thanked: 158 times

Re: Unexpected switch reboots

Fri Feb 28, 2020 12:32 pm

I asked Stephen to look at this for you.

User avatar
Stephen
Employee
Employee
 
Posts: 971
Joined: Sun Dec 24, 2017 8:56 pm
Has thanked: 77 times
Been thanked: 170 times

Re: Unexpected switch reboots

Fri Feb 28, 2020 3:48 pm

Can you guys PM me your config's for the switch's that are having these issue's? Also before that if there are any passwords locking down the system please remove them first so I can access them. Then use Device->Backup to download the .ncfg file and send it to me.

Ludvik
Experienced Member
 
Posts: 105
Joined: Tue Nov 08, 2016 1:50 pm
Has thanked: 15 times
Been thanked: 15 times

Re: Unexpected switch reboots

Fri Feb 28, 2020 8:08 pm

Check free memory. If it going near to zero, the switch reboot itself.
viewtopic.php?f=17&t=4788

craig.moscardini
Member
 
Posts: 14
Joined: Tue Nov 05, 2019 6:14 am
Has thanked: 0 time
Been thanked: 1 time

Re: Unexpected switch reboots

Sat Feb 29, 2020 3:31 am

Stephen wrote:Can you guys PM me your config's for the switch's that are having these issue's? Also before that if there are any passwords locking down the system please remove them first so I can access them. Then use Device->Backup to download the .ncfg file and send it to me.


Thanks config sent by PM

craig.moscardini
Member
 
Posts: 14
Joined: Tue Nov 05, 2019 6:14 am
Has thanked: 0 time
Been thanked: 1 time

Re: Unexpected switch reboots

Sat Feb 29, 2020 10:17 am

Had another switch reboot. Here's the log. I'll PM the config.


Code: Select all
Jan 1 00:00:10 system: Setting MAC address from flash configuration: EC:13:B2:81:A5:36
Jan 1 00:00:11 system: starting ntpclient
Jan 1 00:00:13 admin: adding lan (eth0) to firewall zone lan
Jan 1 00:00:13 dropbear[639]: Running in background
Jan 1 00:00:14 netonix: 1.5.5 on WS-12-250-DC
Jan 1 00:00:17 UI: web config OK
Jan 1 00:00:24 Port: link state changed to 'up' (1G) on port 2
Jan 1 00:00:30 switch[818]: temp sensor version 3
Jan 1 00:00:30 switch[819]: Detected cold (watchdog) boot
Jan 1 00:00:31 Port: link state changed to 'down' on port 6
Jan 1 00:00:31 Port: link state changed to 'down' on port 4
Jan 1 00:00:31 Port: link state changed to 'down' on port 5
Jan 1 00:00:31 Port: link state changed to 'down' on port 2
Jan 1 00:00:31 switch[819]: PoE enabled on port 1, PoE Smart is starting cable check
Jan 1 00:00:32 Port: link state changed to 'down' on port 8
Jan 1 00:00:32 Port: link state changed to 'down' on port 9
Jan 1 00:00:32 Port: link state changed to 'down' on port 1
Jan 1 00:00:32 switch[819]: PoE enabled on port 2, PoE Smart is starting cable check
Jan 1 00:00:32 switch[819]: PoE enabled on port 4, PoE Smart is starting cable check
Jan 1 00:00:32 switch[819]: PoE enabled on port 5, PoE Smart is starting cable check
Jan 1 00:00:32 switch[819]: PoE enabled on port 6, PoE Smart is starting cable check
Jan 1 00:00:34 system: starting ntpclient
Jan 1 00:00:37 switch[819]: Port 1 cable check results: Open, Open, Open, Open
Jan 1 00:00:37 switch[819]: Port 1 passed PoE Smart cable check, turning on power
Jan 1 00:00:37 switch[819]: Port 2 cable check results: Ok, Ok, Ok, Ok
Jan 1 00:00:37 switch[819]: Port 2 passed PoE Smart cable check, turning on power
Jan 1 00:00:37 switch[819]: Port 4 cable check results: Open, Open, Open, Open
Jan 1 00:00:37 switch[819]: Port 4 passed PoE Smart cable check, turning on power
Jan 1 00:00:37 switch[819]: Port 5 cable check results: Open, Open, Open, Open
Jan 1 00:00:37 switch[819]: Port 5 passed PoE Smart cable check, turning on power
Jan 1 00:00:37 switch[819]: Port 6 cable check results: Ok, Ok, Short, Short
Jan 1 00:00:37 switch[819]: Port 6 passed PoE Smart cable check, turning on power
Jan 1 00:00:38 Port: link state changed to 'up' (10M-H) on port 1
Jan 1 00:00:39 Port: link state changed to 'down' on port 1
Jan 1 00:00:39 Port: link state changed to 'up' (1G) on port 5
Jan 1 00:00:40 Port: link state changed to 'up' (10M-F) on port 6
Jan 1 00:00:40 Port: link state changed to 'up' (1G) on port 4
Jan 1 00:00:40 Port: link state changed to 'up' (1G) on port 2
Jan 1 00:00:42 Port: link state changed to 'up' (1G) on port 1
Jan 1 00:00:42 Port: link state changed to 'up' (1G) on port 9
Jan 1 00:00:42 Port: link state changed to 'up' (1G) on port 8
Jan 1 00:00:43 Port: link state changed to 'down' on port 5
Jan 1 00:00:44 Port: link state changed to 'down' on port 4
Jan 1 00:00:45 Port: link state changed to 'up' (100M-F) on port 5
Jan 1 00:00:46 Port: link state changed to 'up' (100M-F) on port 4
Jan 1 00:00:47 system: starting ntpclient
Jan 1 00:01:01 system: starting ntpclient
Jan 1 00:01:03 Port: link state changed to 'down' on port 8
Jan 1 00:01:03 Port: link state changed to 'down' on port 9
Jan 1 00:01:03 Port: link state changed to 'down' on port 1
Jan 1 00:01:04 Port: link state changed to 'down' on port 6
Jan 1 00:01:04 Port: link state changed to 'down' on port 5
Jan 1 00:01:05 Port: link state changed to 'down' on port 4
Jan 1 00:01:05 Port: link state changed to 'up' (100M-F) on port 6
Jan 1 00:01:06 Port: link state changed to 'up' (1G) on port 5
Jan 1 00:01:07 Port: link state changed to 'up' (1G) on port 4
Jan 1 00:01:14 Port: link state changed to 'up' (1G) on port 8
Jan 1 00:01:14 Port: link state changed to 'up' (1G) on port 1
Jan 1 00:01:14 system: starting ntpclient
Jan 1 00:01:14 Port: link state changed to 'up' (1G) on port 9
Jan 1 00:01:27 system: starting ntpclient
Jan 1 00:01:28 Port: link state changed to 'down' on port 2
Jan 1 00:01:31 Port: link state changed to 'up' (1G) on port 2
Jan 1 00:01:41 system: starting ntpclient
Jan 1 00:01:48 Port: link state changed to 'down' on port 2
Jan 1 00:01:50 Port: link state changed to 'up' (1G) on port 2
Jan 1 00:01:54 system: starting ntpclient
Jan 1 00:02:07 system: starting ntpclient
Feb 29 14:10:44 system: time set by NTP server
Feb 29 14:11:36 monitor: restarting vtss_appl

craig.moscardini
Member
 
Posts: 14
Joined: Tue Nov 05, 2019 6:14 am
Has thanked: 0 time
Been thanked: 1 time

Re: Unexpected switch reboots

Tue Mar 03, 2020 10:02 am

Is there any news on this issue?

User avatar
Stephen
Employee
Employee
 
Posts: 971
Joined: Sun Dec 24, 2017 8:56 pm
Has thanked: 77 times
Been thanked: 170 times

Re: Unexpected switch reboots

Tue Mar 03, 2020 4:46 pm

Thank you for the config's. Only news so far is that I am actively troubleshooting the problem right now. I may have some more questions as the situation develops and I'll ask them here.

Beanhammer
Member
 
Posts: 10
Joined: Tue Aug 16, 2016 10:38 am
Has thanked: 0 time
Been thanked: 0 time

Re: Unexpected switch reboots

Thu Mar 12, 2020 5:42 am

Any updates on this?

Next
Return to Hardware and software issues

Who is online

Users browsing this forum: No registered users and 8 guests