How to unlock gatekeepers / normal LUNs locked by EMC Solutions Enabler (stordaemons)

At times we get into a situation where in the gatekeepers(GK) and normal LUNs are locked by EMC Symmetrix stordaemons which causes the OS native and powermt commands to fail

Solaris: powermt check fails to remove a dead path and says the device in use and cfgadm shows a disk as failed

AIX: rmdev command failes and volume group fails to activate / PV goes missing..

This below command will list all the GK and normal LUNs locked by storapid

1:root@server1:/home/root # symcfg list -semaphores

S Y M A P I S E M A P H O R E S

Lock Proc.

ID Key State Type Wait Lock Full Path Specification

------ ---------- -------- ---- ----- ----------------------------

1048580 0x450020b4 Unlocked GK 0 /dev/rhdiskpower5

19922950 0x450020b6 Locked GK 0 /dev/rhdiskpower6

170917896 0x45002251 Locked GK 0 /dev/rhdisk4

1:root@server1:/home/root #

From the above output, hdisk4 is is a GK device and this is fine..But it also locked hdiskpower6 which is a regular LUN and this is wrong..

Solution:

Stop all stordaemons

1:root@server1:/home/root # stordaemon list

Available Daemons ('[*]': Currently Running):

[*] storapid EMC Solutions Enabler Base Daemon

storgnsd EMC Solutions Enabler GNS Daemon

storrdfd EMC Solutions Enabler RDF Daemon

storevntd EMC Solutions Enabler Event Daemon

[*] storwatchd EMC Solutions Enabler Watchdog Daemon

storsrmd EMC Solutions Enabler SRM Daemon

storora64d EMC Solutions Enabler SRM Oracle Daemon, 64-bit

storudb64d EMC Solutions Enabler SRM UDB Daemon, 64-bit

storsybs12.5_64d EMC Solutions Enabler SRM Sybase 12.5 Daemon, 64-bit

storsybs15_64d EMC Solutions Enabler SRM Sybase 15 Daemon, 64-bit

storstpd EMC Solutions Enabler STP Daemon

storsrvd EMC Solutions Enabler SYMAPI Server Daemon

1:root@server1:/home/root # stordaemon shutdown storapid

storapid Told to shutdown

Waiting for daemon(s) to shutdown. This may take several seconds.

1:root@server1:/home/root # stordaemon shutdown storwatchd

storwatchd Told to shutdown

Waiting for daemon(s) to shutdown. This may take several seconds.

1:root@server1:/home/root #

This should remove the lock and we should be able to use the commands like rmdev, cfgadm, powermt check without any issues..Worst case if this also doesn't solve the problem, remove EMC Solutions Enabler, do your stuff and reinstall again..