SUMMARY: Solaris as FC SAN client and multipathing

From: Tony Howat <t.howat_at_arts.ac.uk>
Date: Thu Jul 29 2004 - 05:48:44 EDT
Tony Howat wrote:

> Q: How I get going with mounting a SAN partition using Sun Fiber card on 
> Solaris 8 running on a 280R?
> 
> I need to be able to create and mount a newly created SAN partition on 
> an existing IBM FAST600 FC SAN system.
> 
> We have an SG-XPCI2FC-QF2 2Gb PCI Dual FC Network Adapter, as 
> recommended by our suppliers for the purpose. My brain keeps telling me 
> we need the HBA version, but both Sun and our suppliers say this is 
> correct.
> 
> Now, documentation is minimal to non existent. The manual for the card 
> covers installation and playing around with boot net. I started to think 
> I needed a HBA as I'd suspected in the first place, but looking at that 
> manual it's equally useless. Sun confirm the part should connect to the 
> SAN and allow me to mount partitions.
> 
> Could someone point me at documentation which covers actually 
> configuring the card, any software installation, and using a SAN 
> partition under Solaris?
> 
> So far I have got this far, working from the Sun StorEdge 2G FC PCI 
> Double Channel Network Adapter Network Installation Guide (816-5001-10):
> 
> show-devs
>  /pci@8,600000/SUNW,qlc@4
>  /pci@8,600000/SUNW,qlc@4/fp@0,0
>  /pci@8,600000/SUNW,qlc@4/fp@0,0/disk
>  /pci@8,700000/SUNW,qlc@2,1
>  /pci@8,700000/SUNW,qlc@2
> 
> To me that looks like two cards - one being the on board controller on 
> the 280R and one being the add in card I'm trying to configure.
> 
> I've tried Qlogic's drivers but they don't detect the card:
> http://www.sun.com/products-n-solutions/hardware/docs/pdf/816-5002-14.pdf
> 
> Anyone got notes on this sort of thing?
> 
> Any pointers welcome, I'm working utterly blind on this.
> 

Thanks to Mark Wiederspahn, Mike Ekholm and Kevin Smith for their help.

The procedure is this (MW):

To start with, from this page is (http://www.sun.com/storage/san/)
is a link to the sun drivers:
http://javashoplm.sun.com/ECom/docs/Welcome.jsp?StoreId=8&PartDetailId=StoreEdgeSw-4.0-G-F&TransactionId=Try

Download the "Install_it Script SAN 4.4.1, English" under optional
products, and install that software.

The sun drivers kind of suck because they require 10 packages
and 15 patches to be applied in a specific order.  The install_it script
will install those packages/patches in that order.

Once the products are installed, reboot and run cfgadm -al and see if
you see your disk.

#cfgadm -al
Ap_Id                          Type         Receptacle   Occupant
Condition
c0                             scsi-bus     connected    configured
unknown
c0::dsk/c0t6d0                 CD-ROM       connected    configured
unknown
c1                             fc-private   connected    configured
unknown
c1::21000004cf6efe8d           disk         connected    configured
unknown
c1::21000004cf6f1b1f           disk         connected    configured
unknown
c2                             scsi-bus     connected    configured
unknown
c2::rmt/0                      tape         connected    configured
unknown
c3                             fc-fabric    connected    configured
unknown
c3::200800a0b813180d           disk         connected    configured
unknown
c3::210000e08b1014ba           unknown      connected    unconfigured
unknown
c3::210000e08b102c41           unknown      connected    unconfigured
unknown
c3::210000e08b1071ba           unknown      connected    unconfigured
unknown
c3::210000e08b10a241           unknown      connected    unconfigured
unknown
c3::210000e08b10e33c           unknown      connected    unconfigured
unknown
c3::500308c13e646003           tape         connected    unconfigured
unknown
c4                             fc           connected    unconfigured
unknown
usb0/1                         unknown      empty        unconfigured ok
usb0/2                         unknown      empty        unconfigured ok
usb0/3                         unknown      empty        unconfigured ok
usb0/4                         unknown      empty        unconfigured ok

(apologies for wrapping. the FC SAN stuff is on c3)

If cfgadm sees your adapter/disk, run cfgadm -c (fiber_ctrl) to pickup
the disk.

(TH) Also add to /kernel/drv/sd.conf

#
# added for SAN
#
name="sd" class="scsi"
   target=0 lun=1;
name="sd" class="scsi"
   target=0 lun=2;
name="sd" class="scsi"
   target=0 lun=3;
name="sd" class="scsi"
   target=0 lun=4;
name="sd" class="scsi"
   target=0 lun=5;
name="sd" class="scsi"
   target=0 lun=7;
name="sd" class="scsi"
   target=0 lun=8;
name="sd" class="scsi"
   target=0 lun=9;

to scan the LUNs designated to SAN space.

boot -r

format will show :

AVAILABLE DISK SELECTIONS:
        0. c1t0d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
           /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf6f1b1f,0
        1. c1t1d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
           /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf6efe8d,0
        2. c3t200800A0B813180Dd3
           <IBM-1722-600-0520 cyl 51198 alt 2 hd 64 sec 64>
           /pci@8,700000/SUNW,qlc@2/fp@0,0/ssd@w200800a0b813180d,3

So, we're off.

Now, in terms of sorting out multipathing I asked a second question to 
the list, about how to get multipathing working. The software I needed 
(Sun Traffic Manager) is already within the SAN package I installed 
earlier, so it is a matter of configuration.

Thanks to Jochen who replied :

1. check with array vendor (IBM) if configuration is ok for STMS (or 
MPxIO, other name)
2. you need to edit /kernel/drv/scsi_vhci.conf, mpxio
is disabled by default. also you need to edit vendor/product there. look 
at the comments and watch the spaces, they need to be exactly as shown 
there.
Use format and inq-command to find out vendor/product.
3. you will also want to add to /etc/system:

set fp:fp_offline_ticker=15
set fp:fp_retry_count=2

with the default setting of these variables path failover takes 2 
minutes, now its 45 seconds.
4. boot -r
Your devices should show in format on new controller
number with path
/scsi_vhci/ssd@g012301230123...

Richard Voss also suggested setting auto-failback="enable" in 
/kernel/drv/scsi_vhci.conf

After following these steps the SAN device now appears in format as :

AVAILABLE DISK SELECTIONS:
        0. c1t0d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
           /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf6f1b1f,0
        1. c1t1d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
           /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf6efe8d,0
        2. c5t600A0B80001323B80000000040F2051Dd0
           <IBM-1722-600-0520 cyl 51198 alt 2 hd 64 sec 64>
           /scsi_vhci/ssd@g600a0b80001323b80000000040f2051d

...and should multipath.

-- 
Tony Howat
UNIX Network Administrator
University Of The Arts London
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers
Received on Thu Jul 29 05:49:08 2004

This archive was generated by hypermail 2.1.8 : Thu Mar 03 2016 - 06:43:36 EST