DAEMON pmon init: 2024 May 28 06:49:33.486065 str2-7050cx3-acs-14 INFO pmon#supervisord 2024-05-28 06:49:33,484 INFO spawned: 'stormond' with pid 38 stormond running state: 024 May 28 06:49:37.025765 str2-7050cx3-acs-14 INFO pmon#stormond[38]: /usr/share/stormond/fsio-rw-stats.json not present. 2024 May 28 06:49:37.026035 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Starting Storage Monitoring Daemon 2024 May 28 06:49:37.026322 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Storage Device: mmcblk0, Device Model: 016GB0, Serial: 0xb0b652af 2024 May 28 06:49:37.027087 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Storage Device: sda, Device Model: StorFly VSFBM4XC032G-A001, Serial: P1T14005503712220004 2024 May 28 06:49:37.028633 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Polling Interval set to 3600 seconds 2024 May 28 06:49:37.028946 str2-7050cx3-acs-14 INFO pmon#stormond[38]: FSIO JSON file Interval set to 86400 seconds 2024 May 28 06:49:37.030388 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Storage Device: mmcblk0, Firmware: 0x0300000000000000, health: 100.0%, Temp: N/AC, FS IO Reads: 235, FS IO Writes: 0 2024 May 28 06:49:37.030772 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Latest FSIO Reads: 235, Latest FSIO Writes: 0 2024 May 28 06:49:37.030944 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Disk IO Reads: N/A, Disk IO Writes: N/A, Reserved Blocks: N/A 2024 May 28 06:49:37.202646 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Storage Device: sda, Firmware: 0202-000, health: 87.305%, Temp: 38C, FS IO Reads: 15205, FS IO Writes: 4157 2024 May 28 06:49:37.203150 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Latest FSIO Reads: 15205, Latest FSIO Writes: 4157 2024 May 28 06:49:37.203375 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Disk IO Reads: 541253, Disk IO Writes: 891966, Reserved Blocks: 100 bind mount: 2024 May 28 06:55:05.477387 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Caught signal 'SIGTERM' 2024 May 28 06:55:05.477387 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Syncing latest procfs reads and writes to disk 2024 May 28 06:55:05.477387 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Syncing total and latest procfs reads and writes from STATE_DB to JSON file 2024 May 28 06:55:05.477387 str2-7050cx3-acs-14 INFO pmon#supervisord 2024-05-28 06:55:05,476 INFO waiting for stormond to stop 2024 May 28 06:55:05.478956 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Exiting with SIGTERM 2024 May 28 06:55:05.479162 str2-7050cx3-acs-14 INFO pmon#stormond[38]: Shutting down Storage Monitoring Daemon 2024 May 28 06:55:05.643444 str2-7050cx3-acs-14 INFO pmon#supervisord 2024-05-28 06:55:05,642 WARN stopped: stormond (exit status 143) container: root@str2-7050cx3-acs-14:/usr/share/stormond# ls -il total 4 654085 -rw-r--r-- 1 root root 294 May 28 06:55 fsio-rw-stats.json host: admin@str2-7050cx3-acs-14:/host/pmon/stormond$ ls -il total 4 654085 -rw-r--r-- 1 root root 294 May 28 06:55 fsio-rw-stats.json admin@str2-7050cx3-acs-14:/host/pmon/stormond$ planned reboots: cold reboot: admin@str2-7050cx3-acs-14:/host/pmon/stormond$ sudo reboot admin@str2-7050cx3-acs-14:/host/pmon/stormond$ sudo reboot requested COLD shutdown /host: 102.9 MiB (107925504 bytes) trimmed on /dev/sda1 Watchdog armed for 180 seconds Tue May 28 06:57:46 AM UTC 2024 Rebooting with platform x86_64-arista_7050cx3_32s specific tool ... INFO: Running powercycle script INFO: Initiating powercycle through CPLD INFO: Powercycle triggered from CPLD logs: 2024 May 28 06:57:35.065241 str2-7050cx3-acs-14 INFO pmon#supervisord 2024-05-28 06:57:35,064 INFO waiting for supervisor-proc-exit-listener, rsyslogd, ledd, xcvrd, psud, syseepromd, stormond, thermalctld, pcied to die 2024 May 28 06:57:35.619328 str2-7050cx3-acs-14 INFO pmon#stormond[115]: Caught signal 'SIGTERM' 2024 May 28 06:57:35.619328 str2-7050cx3-acs-14 INFO pmon#stormond[115]: Syncing latest procfs reads and writes to disk 2024 May 28 06:57:35.619369 str2-7050cx3-acs-14 INFO pmon#stormond[115]: Syncing total and latest procfs reads and writes from STATE_DB to JSON file 2024 May 28 06:57:35.621220 str2-7050cx3-acs-14 INFO pmon#stormond[115]: Exiting with SIGTERM 2024 May 28 06:57:35.621220 str2-7050cx3-acs-14 INFO pmon#stormond[115]: Shutting down Storage Monitoring Daemon 2024 May 28 06:57:35.777662 str2-7050cx3-acs-14 INFO pmon#supervisord 2024-05-28 06:57:35,776 WARN stopped: stormond (exit status 143) . . client_loop: send disconnect: Broken pipe assrinivasan@sonic-mgmt-ashwinsrinivasan:/var/src/sonic-mgmt-int$ ash str2-7050cx3-acs-14 10.3.146.40 Warning: Permanently added '10.3.146.40' (RSA) to the list of known hosts. Debian GNU/Linux 12 \n \l . . 2024 May 28 07:00:45.718004 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Starting Storage Monitoring Daemon 2024 May 28 07:00:45.719329 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Storage Device: mmcblk0, Device Model: 016GB0, Serial: 0xb0b652af 2024 May 28 07:00:45.731116 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Storage Device: sda, Device Model: StorFly VSFBM4XC032G-A001, Serial: P1T14005503712220004 2024 May 28 07:00:45.740773 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Polling Interval set to 3600 seconds 2024 May 28 07:00:45.740773 str2-7050cx3-acs-14 INFO pmon#stormond[37]: FSIO JSON file Interval set to 86400 seconds 2024 May 28 07:00:45.757278 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Storage Device: mmcblk0, Firmware: 0x0300000000000000, health: 100.0%, Temp: N/AC, FS IO Reads: 470, FS IO Writes: 0 2024 May 28 07:00:45.757278 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Latest FSIO Reads: 235, Latest FSIO Writes: 0 2024 May 28 07:00:45.772581 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Disk IO Reads: N/A, Disk IO Writes: N/A, Reserved Blocks: N/A 2024 May 28 07:00:45.888232 str2-7050cx3-acs-14 INFO python[6580]: ansible-dut_basic_facts Invoked 2024 May 28 07:00:46.092079 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Storage Device: sda, Firmware: 0202-000, health: 87.305%, Temp: 36C, FS IO Reads: 38840, FS IO Writes: 7765 2024 May 28 07:00:46.092314 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Latest FSIO Reads: 23581, Latest FSIO Writes: 3013 2024 May 28 07:00:46.092433 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Disk IO Reads: 541315, Disk IO Writes: 891969, Reserved Blocks: 100 soft reboot: admin@str2-7050cx3-acs-14:~$ sudo soft-reboot requested COLD shutdown Watchdog armed for 180 seconds client_loop: send disconnect: Broken pipe logs: 2024 May 28 07:02:39.229435 str2-7050cx3-acs-14 INFO pmon#supervisord 2024-05-28 07:02:39,227 INFO waiting for supervisor-proc-exit-listener, rsyslogd, ledd, xcvrd, psud, syseepromd, stormond, thermalctld, pcied to die 2024 May 28 07:02:39.822875 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Caught signal 'SIGTERM' 2024 May 28 07:02:39.822875 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Syncing latest procfs reads and writes to disk 2024 May 28 07:02:39.822956 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Syncing total and latest procfs reads and writes from STATE_DB to JSON file 2024 May 28 07:02:39.825010 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Exiting with SIGTERM 2024 May 28 07:02:39.825368 str2-7050cx3-acs-14 INFO pmon#stormond[37]: Shutting down Storage Monitoring Daemon 2024 May 28 07:02:40.002435 str2-7050cx3-acs-14 INFO pmon#supervisord 2024-05-28 07:02:40,001 WARN stopped: stormond (exit status 143) . . 2024 May 28 07:05:26.186310 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Starting Storage Monitoring Daemon 2024 May 28 07:05:26.186310 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Storage Device: mmcblk0, Device Model: 016GB0, Serial: 0xb0b652af 2024 May 28 07:05:26.186310 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Storage Device: sda, Device Model: StorFly VSFBM4XC032G-A001, Serial: P1T14005503712220004 2024 May 28 07:05:26.186358 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Polling Interval set to 3600 seconds 2024 May 28 07:05:26.186397 str2-7050cx3-acs-14 INFO pmon#stormond[36]: FSIO JSON file Interval set to 86400 seconds 2024 May 28 07:05:26.186397 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Storage Device: mmcblk0, Firmware: 0x0300000000000000, health: 100.0%, Temp: N/AC, FS IO Reads: 705, FS IO Writes: 0 2024 May 28 07:05:26.186448 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Latest FSIO Reads: 235, Latest FSIO Writes: 0 2024 May 28 07:05:26.186496 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Disk IO Reads: N/A, Disk IO Writes: N/A, Reserved Blocks: N/A 2024 May 28 07:05:26.417495 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Storage Device: sda, Firmware: 0202-000, health: 87.305%, Temp: 36C, FS IO Reads: 62931, FS IO Writes: 11025 2024 May 28 07:05:26.417495 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Latest FSIO Reads: 24091, Latest FSIO Writes: 3260 2024 May 28 07:05:26.417495 str2-7050cx3-acs-14 INFO pmon#stormond[36]: Disk IO Reads: 541360, Disk IO Writes: 891971, Reserved Blocks: 100 warm reboot: admin@str2-7050cx3-acs-14:~$ sudo warm-reboot -f docker.socket Watchdog armed for 180 seconds 1 client_loop: send disconnect: Broken pipe assrinivasan@sonic-mgmt-ashwinsrinivasan:/var/src/sonic-mgmt-int$ ash str2-7050cx3-acs-14 10.3.146.40 . . admin@str2-7050cx3-acs-14:~$ redis-cli -n 6 hgetall "STORAGE_INFO|sda" 1) "device_model" 2) "StorFly VSFBM4XC032G-A001" 3) "serial" 4) "P1T14005503712220004" 5) "firmware" 6) "0202-000" 7) "health" 8) "87.305" 9) "temperature" 10) "36" 11) "latest_fsio_reads" 12) "24091" 13) "latest_fsio_writes" 14) "3260" 15) "disk_io_reads" 16) "541360" 17) "disk_io_writes" 18) "891971" 19) "reserved_blocks" 20) "100" 21) "total_fsio_reads" 22) "62931" 23) "total_fsio_writes" 24) "11025" admin@str2-7050cx3-acs-14:~$ redis-cli -n 6 hgetall "STORAGE_INFO|mmcblk0" 1) "device_model" 2) "016GB0" 3) "serial" 4) "0xb0b652af" 5) "firmware" 6) "0x0300000000000000" 7) "health" 8) "100.0" 9) "temperature" 10) "N/A" 11) "latest_fsio_reads" 12) "235" 13) "latest_fsio_writes" 14) "0" 15) "disk_io_reads" 16) "N/A" 17) "disk_io_writes" 18) "N/A" 19) "reserved_blocks" 20) "N/A" 21) "total_fsio_reads" 22) "705" 23) "total_fsio_writes" 24) "0" admin@str2-7050cx3-acs-14:~$ crash scenarios: daemon crash before planned reboot: daemon crash after planned reboot: root@str2-7050cx3-acs-14:/# ps aux | grep stormond root 37 1.0 0.3 67864 49624 pts/0 S 07:13 0:01 /usr/bin/python3 /usr/local/bin/stormond root 76 0.0 0.0 3324 1400 pts/1 S+ 07:14 0:00 grep stormond root@str2-7050cx3-acs-14:/# kill -9 37 root@str2-7050cx3-acs-14:/# 2024 May 28 07:15:03.874551 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Starting Storage Monitoring Daemon 2024 May 28 07:15:03.874862 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Storage Device: mmcblk0, Device Model: 016GB0, Serial: 0xb0b652af 2024 May 28 07:15:03.875384 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Storage Device: sda, Device Model: StorFly VSFBM4XC032G-A001, Serial: P1T14005503712220004 2024 May 28 07:15:03.876343 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Polling Interval set to 3600 seconds 2024 May 28 07:15:03.876343 str2-7050cx3-acs-14 INFO pmon#stormond[77]: FSIO JSON file Interval set to 86400 seconds 2024 May 28 07:15:03.877915 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Storage Device: mmcblk0, Firmware: 0x0300000000000000, health: 100.0%, Temp: N/AC, FS IO Reads: 818, FS IO Writes: 0 2024 May 28 07:15:03.877915 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Latest FSIO Reads: 113, Latest FSIO Writes: 0 2024 May 28 07:15:03.878200 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Disk IO Reads: N/A, Disk IO Writes: N/A, Reserved Blocks: N/A 2024 May 28 07:15:03.947773 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Storage Device: sda, Firmware: 0202-000, health: 87.305%, Temp: 33C, FS IO Reads: 87525, FS IO Writes: 14335 2024 May 28 07:15:03.947773 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Latest FSIO Reads: 24594, Latest FSIO Writes: 3310 2024 May 28 07:15:03.947773 str2-7050cx3-acs-14 INFO pmon#stormond[77]: Disk IO Reads: 541406, Disk IO Writes: 891983, Reserved Blocks: 100 UTILITY admin@str2-7050cx3-acs-14:/usr$ cat ./local/lib/python3.11/dist-packages/ssdutil/main.py | grep -i ssdutil SYSLOG_IDENTIFIER = "ssdutil" from ssd_util import SsdUtil log.log_warning("Platform specific SsdUtil module not found. Falling down to the generic implementation") from sonic_platform_base.sonic_storage.ssd import SsdUtil log.log_error("Failed to import default SsdUtil. Error: {}".format(str(e)), True) return SsdUtil(diskdev) def ssdutil(): ssdutil() usage: admin@str2-7050cx3-acs-14:/usr$ sudo ssdutil Device Model : StorFly VSFBM4XC032G-A001 Health : 87.305% Temperature : 33C admin@str2-7050cx3-acs-14:/usr