Solaris 11.4 is suddenly hanging forever when I boot -- how do I diagnose and fix this?
by shachter from LinuxQuestions.org on (#5C8K8)
Esteemed Colleagues:
Solaris 11.4 is giving me grief. It used to work. Now it hangs forever when I try to boot it. I am able to boot single-user, by modifying the GRUB menu either by adding "-s" to the multiboot line, or by adding "-m milestone=single-user". I booted single-user and permanently modified the GRUB menu, adding "-v -m verbose", hoping that this would produce useful information, but it did not. I reboot (with or without "-p" makes no difference) and after a while I type ESC to see the startup messages. The last thing I see is:
Reading ZFS config: done.
Mounting ZFS filesystems: (55/55)
There is no error message, and I suspect that the problem is not with /lib/svc/method/fs-local, but with the thing that happens next. I cannot determine what the thing is, that is making it hang. The only way out is to power-cycle, which of course one tries to avoid doing, but it is the only way out. I power-cycle and then reboot once again single-user, and once there I type "svcadm milestone -s -T 200 all", hoping that this will show me the point at which it hangs. It does not. It says "svcadm: Unexpected libscf error on line 2380: entity not found." and I remain in single-user mode. If I type "exit", then at this point the behavior seems to depend on how I got into single-user mode, but if I got there by way of "-s" and not by way of "-m milestone=single-user", I see:
logout
svc.startd: Returning to milestone all.
This Solaris instance has UUID 216ca207-d4e1-47b8-85a8-ae7027494944
dump device is /dev/zvol/dsk/rpool/dump size 7 GB (8130 MB)
Reading ZFS config: done.
Mounting ZFS filesystems: (55/55)
and then it hangs, and there is nothing to do but to power-cycle. At this point I must have done a cold restart at least 20 times, which can't be good. I actually have to lean on the power button. If I just touch it gently, it says:
WARNING: Power off requested from power button or SC, powering down the system!
and then, a few minutes later:
WARNING: Failed to shut down the system!
I should just give up on Solaris once and for all -- I have been tempted for years to do that -- but I have been using Solaris since 1983, and it is like giving up on a bad marriage that has already lasted many years. You keep on thinking that if you just invest a little more time, the thing that needed to be fixed will be finally fixed, and you will be happy again. So we beat on, boats against the current, borne back ceaselessly into the past. How do I diagnose and fix this problem? Thank you in advance for any and all replies.
jay at m5 dot chicago dot il dot us
Solaris 11.4 is giving me grief. It used to work. Now it hangs forever when I try to boot it. I am able to boot single-user, by modifying the GRUB menu either by adding "-s" to the multiboot line, or by adding "-m milestone=single-user". I booted single-user and permanently modified the GRUB menu, adding "-v -m verbose", hoping that this would produce useful information, but it did not. I reboot (with or without "-p" makes no difference) and after a while I type ESC to see the startup messages. The last thing I see is:
Reading ZFS config: done.
Mounting ZFS filesystems: (55/55)
There is no error message, and I suspect that the problem is not with /lib/svc/method/fs-local, but with the thing that happens next. I cannot determine what the thing is, that is making it hang. The only way out is to power-cycle, which of course one tries to avoid doing, but it is the only way out. I power-cycle and then reboot once again single-user, and once there I type "svcadm milestone -s -T 200 all", hoping that this will show me the point at which it hangs. It does not. It says "svcadm: Unexpected libscf error on line 2380: entity not found." and I remain in single-user mode. If I type "exit", then at this point the behavior seems to depend on how I got into single-user mode, but if I got there by way of "-s" and not by way of "-m milestone=single-user", I see:
logout
svc.startd: Returning to milestone all.
This Solaris instance has UUID 216ca207-d4e1-47b8-85a8-ae7027494944
dump device is /dev/zvol/dsk/rpool/dump size 7 GB (8130 MB)
Reading ZFS config: done.
Mounting ZFS filesystems: (55/55)
and then it hangs, and there is nothing to do but to power-cycle. At this point I must have done a cold restart at least 20 times, which can't be good. I actually have to lean on the power button. If I just touch it gently, it says:
WARNING: Power off requested from power button or SC, powering down the system!
and then, a few minutes later:
WARNING: Failed to shut down the system!
I should just give up on Solaris once and for all -- I have been tempted for years to do that -- but I have been using Solaris since 1983, and it is like giving up on a bad marriage that has already lasted many years. You keep on thinking that if you just invest a little more time, the thing that needed to be fixed will be finally fixed, and you will be happy again. So we beat on, boats against the current, borne back ceaselessly into the past. How do I diagnose and fix this problem? Thank you in advance for any and all replies.
jay at m5 dot chicago dot il dot us