Thanks for the quick response!
I neglected (in a panic (:<) ) to mention the hardware (SS10) and OS
(2.3). Please pardon the oversight.
Original question:
>
> Can anyone tell me what the following panic message means.
>
> Aug 1 13:57:15 cms107 unix: panic: recursive mutex_enter. mutex fc374280 caller fc384570
>
SUMMARY: look at patch 101318-74 and set hosts up for crash analysis.
In greater detail....
Sukhmeet Singh wrote that "Mutual exclusion locks (mutexes) are used
to serialize the execution of threads." He also directed me to a nice
sun-managers SUMMARY archive at http://aurora.latech.edu/sunman.html.
Kevin Sheehan (What is a Consulting Poster Child?) enlightened me
further with the comment " that a kernel thread holding a mutex tried
to acquire it again, which is a no-no." He also pointed out the
utility of a crash. I'll suggest the hosts (7) be setup to provied
crashes in the future.
Philip Kao pointed out a problem with patch 101318-64 and suggested
backing out the patch and installing a later patch. A later patch had
already been installed (101318-70, see showrev -p below).
Juergen Peus checked sunsolve, with some references. They did not seem
to quite fit my problem, perhaps because they make references that do
not quite meet my situation.
Eugene Choi suggests patch 101318-74. The README for this patch
references a fix for 1176350 and "increases the concurrency through
the SYS V shared memory operations." Theses hosts make VERY HEAVY use
of shared memory.
Aditya Talwar provided general disucssion on panics and suggested a
book recently published on the subject. I quote Aditya now.
>
>There is a new book out on panics:
>
>
>I recently had the sincere pleasure to read
>
> Panic! Unix System Crash Dump Analysis
> Chris Drake and Kimberley Brown
> Prentice Hall
> ISBN 0-13-149386-8
> I paid $44.00
>
>This book is basically about using adb to debug panic dumps. To explain
>how to do this, however, you have to explain a lot about Unix internals.
>The book uses SPARC, both SunOS 4 and Solaris 2, for its examples but
>much of what it shows applies to other flavors of Unix as well.
>
>This is the first place I have seen that has a clear explanation of
>
> * WATCHDOG RESETS
> * WINDOW UNDERFLOW
> * SILO OVERFLOW
> * BAD TRAP
> * SunOS 4 multiprocessing
> * SunOS 5 multiprocessing
>
>not to mention the ins and outs of adb.
>
>The book goes to great extents to error on the side of explaining things
>in enough depth, yet in a gentle enough manner, for even the non-computer-
>scientist-user-now-systems-administrator to follow. This might seem a
>little redundent for people who have the source code and understand it
>(the book goes so far as to explain that there are usually four bytes in
>a word on modern RISC machines), but for the rest of us, it is really
>helpful. Most times in the book where it refers to knowledge that should
>
I've already placed by order!
mark@leav-156-100.army.mil (Mark B. Hamby)
freeman@sdt.com (Art Freeman)
Philip.Kao@artecon.com (Philip Kao)
James.E.Coby.Jr@cdc.com (James Coby)
Paulo Licio de Geus <paulo@dcc.unicamp.br>
Graeme Robertson <graemer@icefire.nz.unisys.com>
sunman@criterion.com (Aditya Talwar)
eugene@lucas.emi.com (Eugene Choi)
martin.williams@research.natpower.co.uk
Juergen Peus <grobi@uni-paderborn.de>
Kevin.Sheehan@uniq.com.au (Kevin Sheehan {Consulting Poster Child})
Sukhmeet Singh <joey@kbs.citri.edu.au>
COURTIER Denis Athesa <COURTIER@ulysse.cea.fr>
Patch: 101219-01 Obsoletes: Packages: SUNWxildg.2 1.1,REV=2.0.0,PATCH=1, SUNWxilow.2 1.1,REV=2.0.0,PATCH=1
Patch: 101262-02 Obsoletes: Packages: SUNWxgldg.2 4.0,REV=2.0.12,PATCH=3, SUNWxglrt.2 4.0,REV=2.0.12,PATCH=3
Patch: 101267-01 Obsoletes: Packages: SUNWcsu.2 11.5.0,REV=2.0.18,PATCH=11
Patch: 101306-01 Obsoletes: Packages: SUNWcsr.2 11.5.0,REV=2.0.19,PATCH=3
Patch: 101316-01 Obsoletes: Packages: SUNWcsu.3 11.5.0,REV=2.0.18,PATCH=2
Patch: 101317-03 Obsoletes: Packages: SUNWlpr.2 11.5.0,REV=2.0.18,PATCH=3, SUNWlpu.2 11.5.0,REV=2.0.18,PATCH=3, SUNWscpu.2 11.5.0,REV=2.0.18,PATCH=4
Patch: 101317-04 Obsoletes: Packages: SUNWlpr.3 11.5.0,REV=2.0.18,PATCH=4, SUNWlpu.3 11.5.0,REV=2.0.18,PATCH=4, SUNWscpu.3 11.5.0,REV=2.0.18,PATCH=5
Patch: 101318-13 Obsoletes: 101267-01,101326-01,101349-01 Packages: SUNWcar.2 11.5.0,REV=2.0.18,PATCH=16, SUNWcsr.3 11.5.0,REV=2.0.19,PATCH=27, SUNWcsu.4 11.5.0,REV=2.0.18,PATCH=38, SUNWdfb.2 11.5.0,REV=2.0.18,PATCH=5
Patch: 101318-29 Obsoletes: 101267-01,101326-01,101349-01,101319-02,101346-03 Packages: SUNWcar.3 11.5.0,REV=2.0.18,PATCH=35, SUNWcsr.4 11.5.0,REV=2.0.19,PATCH=52, SUNWcsu.5 11.5.0,REV=2.0.18,PATCH=71, SUNWdfb.3 11.5.0,REV=2.0.18,PATCH=21
Patch: 101325-03 Obsoletes: Packages: SUNWcsu.6 11.5.0,REV=2.0.18,PATCH=31
Patch: 101327-02 Obsoletes: Packages: SUNWcsu.7 11.5.0,REV=2.0.18,PATCH=44
Patch: 101328-01 Obsoletes: Packages: SUNWcsu.8 11.5.0,REV=2.0.18,PATCH=17, SUNWdoc.2 11.5.0,REV=2.0.18,PATCH=1
Patch: 101329-04 Obsoletes: 101315-01 Packages: SUNWcsu.9 11.5.0,REV=2.0.18,PATCH=46, SUNWnisu.2 11.5.0,REV=2.0.18,PATCH=3
Patch: 101331-03 Obsoletes: Packages: SUNWcsu.10 11.5.0,REV=2.0.18,PATCH=35
Patch: 101344-05 Obsoletes: Packages: SUNWcsr.5 11.5.0,REV=2.0.19,PATCH=21, SUNWcsu.11 11.5.0,REV=2.0.18,PATCH=29
Patch: 101345-02 Obsoletes: Packages: SUNWcsu.12 11.5.0,REV=2.0.18,PATCH=19
Patch: 101347-01 Obsoletes: Packages: SUNWcsr.6 11.5.0,REV=2.0.19,PATCH=10
Patch: 101350-01 Obsoletes: Packages: SUNWcsr.7 11.5.0,REV=2.0.19,PATCH=24, SUNWcsu.13 11.5.0,REV=2.0.18,PATCH=33
Patch: 101359-01 Obsoletes: Packages: SUNWcsu.14 11.5.0,REV=2.0.18,PATCH=18
Patch: 101362-03 Obsoletes: 101307-01 Packages: SUNWowrqd.2 3.3.19,REV=0.93.09.17,PATCH=6
Patch: 101371-03 Obsoletes: Packages: SUNWcsu.15 11.5.0,REV=2.0.18,PATCH=57
Patch: 101378-01 Obsoletes: Packages: SUNWcsr.8 11.5.0,REV=2.0.19,PATCH=16
Patch: 101378-02 Obsoletes: Packages: SUNWcsr.9 11.5.0,REV=2.0.19,PATCH=43
Patch: 101384-01 Obsoletes: none Packages: SUNWadmap.2 6.0.9,PATCH=1, SUNWadmfw.2 6.0.8,PATCH=1
Patch: 101406-01 Obsoletes: Packages: SUNWcsr.10 11.5.0,REV=2.0.19,PATCH=26
Patch: 101409-01 Obsoletes: Packages: SUNWcsu.16 11.5.0,REV=2.0.18,PATCH=36, SUNWtoo.2 11.5.0,REV=2.0.18,PATCH=1
Patch: 101416-01 Obsoletes: Packages: SUNWcsu.17 11.5.0,REV=2.0.18,PATCH=47
Patch: 101418-01 Obsoletes: Packages: SUNWcsu.18 11.5.0,REV=2.0.18,PATCH=40
Patch: 101448-01 Obsoletes: Packages: SUNWcsu.19 11.5.0,REV=2.0.18,PATCH=50
Patch: 101484-01 Obsoletes: Packages: SUNWbcp.2 11.5.0,REV=2.0.18,PATCH=1
Patch: 101493-01 Obsoletes: Packages: SUNWcg6.2 11.5.0,REV=2.0.18,PATCH=1
Patch: 101494-01 Obsoletes: Packages: SUNWcsu.20 11.5.0,REV=2.0.18,PATCH=63
Patch: 101495-01 Obsoletes: Packages: SUNWtltk.2 3.3.18,REV=0.93.09.07,PATCH=01
Patch: 101246-02 Obsoletes: Packages: SUNWlibCf 3.0,REV=93.11.11
Patch: 101317-12 Obsoletes: Packages: SUNWlpr.4 11.5.0,REV=2.0.18,PATCH=12, SUNWlpu.4 11.5.0,REV=2.0.18,PATCH=12, SUNWscpu.4 11.5.0,REV=2.0.18,PATCH=16
Patch: 101318-70 Obsoletes: 101267-01,101294-02,101315-01,101316-02,101319-02,101326-01,101329-16,101344-11,101346-03,101349-01,101406-01,101411-04,101485-01,101500-04,101597-02,101637-01,101672-01,101674-01,101694-01,101831-01,101855-02,101859-01,101869-01,101881-01,102445-01 Packages: SUNWcar.4 11.5.0,REV=2.0.18,PATCH=100, SUNWcsr.11 11.5.0,REV=2.0.19,PATCH=159, SUNWcsu.21 11.5.0,REV=2.0.18,PATCH=225, SUNWdfb.4 11.5.0,REV=2.0.18,PATCH=65, SUNWkvm.2 11.5.0,REV=2.0.18,PATCH=17, SUNWnisu.3 11.5.0,REV=2.0.
18,PATCH=43
Patch: 101327-08 Obsoletes: Packages: SUNWcsu.22 11.5.0,REV=2.0.18,PATCH=200
Patch: 101331-05 Obsoletes: Packages: SUNWcsu.23 11.5.0,REV=2.0.18,PATCH=213
Patch: 101347-02 Obsoletes: Packages: SUNWcsr.12 11.5.0,REV=2.0.19,PATCH=127
Patch: 101362-36 Obsoletes: 101307-01 101457-01 101687-01 101593-02 Packages: SUNWowrqd.3 3.3.19,REV=0.93.09.17,PATCH=144
Patch: 101615-02 Obsoletes: Packages: SUNWcsu.24 11.5.0,REV=2.0.18,PATCH=161, SUNWscpu.5 11.5.0,REV=2.0.18,PATCH=13
Patch: 101631-02 Obsoletes: Packages: SUNWcar.5 11.5.0,REV=2.0.18,PATCH=81, SUNWcsr.13 11.5.0,REV=2.0.19,PATCH=138
Patch: 101739-07 Obsoletes: 101371-04 Packages: SUNWcsu.25 11.5.0,REV=2.0.18,PATCH=227
Patch: 101889-03 Obsoletes: Packages: SUNWowrqd.4 3.3.19,REV=0.93.09.17,PATCH=105
Patch: 102034-01 Obsoletes: Packages: SUNWcsu.26 11.5.0,REV=2.0.18,PATCH=194
This archive was generated by hypermail 2.1.2 : Fri Sep 28 2001 - 23:10:30 CDT