Friday 23 December 2011

Install EMC Storage in Fedora Linux

Install EMC Storage in Fedora Linux

Here we are installing EMC storage in Fedora 13 (which is not recommended by EMC). EMC's software Powerpath will
not support with Fedora. So here we are using the package called Multipath. That is default with fedora.

1. Try to boot from the fedora optical Media.
2. Press Esc button when you will get the first boot loader menu for the boot prompt.
3. In that boot prompt. Type:
# Linux mpath
Then press Enter.
(If you are not getting the basic video driver then do the following step)

# Linux mpath xdriver=vesa nomodeset

4. Install fedora with all the available packages. (In the mean time you can configure the storage also. In storage you have to create virtual disk[s].)
5. Configure the IP addresses.
6. Connect the storage with server through switch.
7. start the iscsi daemons:
# /etc/init.d/iscsid start
# /etc/init.d/iscsi start
8. Configure your iscsi daemons with the following commands:
# iscsiadm -m discovery -t sendtargets -p IP-OF-STORAGE
192.168.0.6:3260,4 iqn.1992-04.com.emc:cx.fcnmm102000029.b1
192.168.0.3:3260,1 iqn.1992-04.com.emc:cx.fcnmm102000029.a0
192.168.0.4:3260,2 iqn.1992-04.com.emc:cx.fcnmm102000029.a1
192.168.0.5:3260,3 iqn.1992-04.com.emc:cx.fcnmm102000029.b0
9. Note down the record id (such as iqn.2001-05.com.doe:test) found by the discovery. You need the same for login. Login, must use a node record id found by the discovery:

# iscsiadm --mode node --targetname iqn.2001-05.com.doe:test --portal 192.168.1.60:3260 –login
10. Then you have to assign the virtual disk to your server. That should be done inside the storage configuration window. In the assign menu give the ip/name of the server. If it is successfully assigned then check the new devices are mounted or not in the server.
# fdisk –l
If it is mounted you will get another two devices like /dev/sdc and /dev/sde. (It may differ as per your drive configurations)
11. Start the service multipathd
# /etc/init.d/multipathd start

12. Then edit your grub.conf (add the word "mpath" to the kernel portion like below)
# vi /etc/grub.conf
kernel /vmlinuz-2.6.33.3-85.fc13.i686.PAE ro root=UUID=388a2022-a23d-4987-a51b-f157b4f32280 rd_NO_LUKS rd_NO_LVM rd_NO_MD rd_NO_DM LANG=en_US.UTF-8 SYSFONT=latarcyrheb-sun16 KEYTABLE=us nomodeset mpath rhgb quiet
13. Here we can do the multipath section. Follow the steps.
Start the multipathd daemon.
# /etc/init.d/multipathd start
# chkconfig multipathd on
14. Execute the following commands to check the status of multipathing. And note down the wwid of the storage.
# multipath –ll
EMC (3600601606d082900d043704fc2f6df11) dm-0 DGC,VRAID
size=3.0T features='1 queue_if_no_path' hwhandler='1 emc' wp=rw
|-+- policy='round-robin 0' prio=2 status=active
| |- 14:0:0:0 sde 8:64 active ready running
| `- 11:0:0:0 sdb 8:16 active ready running
`-+- policy='round-robin 0' prio=0 status=enabled
|- 12:0:0:0 sdc 8:32 active ready running
`- 13:0:0:0 sdd 8:48 active ready running

If getting a message like this. That means the multipath is working properly.

15. Edit the multipathd.conf file as per below.
# vi /etc/multipathd.conf
Edit the last portion of the file like this. (Add the wwid in to the file.)

multipath {
wwid 3600601606d082900d043704fc2f6df11 (add this line)
# wwid 36001517975a9e0001473e5c712478694 (disable this line)
alias EMC
}
16. Restart the multipathd daemon.
# /etc/init.d/multipathd restart
17. Ensure that the storage is mounted.
# fdisk –l
If the multipath is perfectly configured you will get two drives like dm-0 and dm-1 inside /dev.
# fdisk –l
For Eg:
Disk /dev/sda: 292.0 GB,

Device Boot Start End Blocks Id System
/dev/sda1 * 1 64 512000 83 Linux
/dev/sda2 64 6438 51200000 83 Linux
/dev/sda3 6438 21860 123874304 83 Linux
/dev/sda4 21860 35501 109568000 5 Extended
/dev/sda5 21860 28234 51200000 83 Linux
/dev/sda6 28234 32314 32768000 82 Linux swap / Solaris
/dev/sda7 32314 35501 25596928 83 Linux

Disk /dev/sdb: 16298.5 GB

Disk /dev/sdb doesn't contain a valid partition table.

Disk /dev/sde: 16298.5 GB

Disk /dev/sde doesn't contain a valid partition table.

Disk /dev/dm-0: 16298.5 GB

Disk /dev/dm-0 doesn't contain a valid partition table.

Disk /dev/dm-1: 16298.5 GB

Disk /dev/dm-1 doesn't contain a valid partition table.

Here you can see /dev/sdb, /dev/sde, /dev/dm-0 and /dev/dm-1. These all are the same disk. If we created one partition in one disk that will automatically reflect on others.
Want to create a partition? That we can do with dev/dm-0. No need to do anything in /dev/dm-1.
Create one partition in /dev/dm-0.
# fdisk /dev/dm-0
You can use different tools for creating partition.
(for eg: parted).

18. Create one partition and format with ext3/ext4 filesystem. Then
# fdisk –l

For Eg:
Disk /dev/sda: 292.0 GB,

Device Boot Start End Blocks Id System
/dev/sda1 * 1 64 512000 83 Linux
/dev/sda2 64 6438 51200000 83 Linux
/dev/sda3 6438 21860 123874304 83 Linux
/dev/sda4 21860 35501 109568000 5 Extended
/dev/sda5 21860 28234 51200000 83 Linux
/dev/sda6 28234 32314 32768000 82 Linux swap / Solaris
/dev/sda7 32314 35501 25596928 83 Linux

Disk /dev/sdb: 16298.5 GB

Device Boot Start End Blocks Id System
/dev/sdb1 1 267350 2147483647+ ee GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sde'! The util fdisk doesn't support GPT. Use GNU Parted.

Disk /dev/sde: 16298.5 GB

Device Boot Start End Blocks Id System
/dev/sde1 1 267350 2147483647+ ee GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sde'! The util fdisk doesn't support GPT. Use GNU Parted.

Disk /dev/dm-0: 16298.5 GB

Device Boot Start End Blocks Id System
/dev/dm-0p1 1 267350 2147483647+ ee GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sde'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/dm-1: 16298.5 GB

Disk /dev/dm-1 doesn't contain a valid partition table.
Now you can see one partition is created in /dev/dm-0 as /dev/dm-0p1.
It is also mapped in /dev/mapper. See the below details.
# ll /dev/dm* /dev/mapper/
brw-rw----. 1 root disk 253, 0 Dec 2 11:47 /dev/dm-0
brw-rw----. 1 root disk 253, 1 Dec 2 11:47 /dev/dm-1

/dev/mapper/:
total 0
crw-rw----. 1 root root 10, 62 Dec 2 11:46 control
lrwxrwxrwx. 1 root root 7 Dec 2 11:47 EMC -> ../dm-0
lrwxrwxrwx. 1 root root 7 Dec 2 11:47 EMCp1 -> ../dm-1
The configuration part is almost over. Now we have to mount /dev/dm-0p1 as a directory.

For that we need to edit the /etc/fstab file.

# vi /etc/fstab

Add one more line at the end of the file. You must mount the partition as a _netdev. See the below details.

#
# /etc/fstab
# Created by anaconda on Wed Dec 1 13:04:07 2010
#
# Accessible filesystems, by reference, are maintained under '/dev/disk'
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info
#
# cat /etc/fstab
LABEL=/ / ext3 defaults 1 1
#LABEL=/home /home ext3 defaults 1 2
LABEL=/boot /boot ext3 defaults 1 2
tmpfs /dev/shm tmpfs defaults 0 0
devpts /dev/pts devpts gid=5,mode=620 0 0
sysfs /sys sysfs defaults 0 0
proc /proc proc defaults 0 0
LABEL=SWAP-ddf1_4c534 swap swap defaults 0 0
/dev/hda /media/dvd auto defaults 0 0
/dev/dm-1 /home ext4 _netdev 0 0

(Here I am mounting as /home partition. You can mount as a different partition.)

19. After that we have to rebuild the kernel file.
# cd /boot/
Take a back-up of initramfs-2.6.33.3-85.fc13.i686.PAE.img file.
# cp initramfs-2.6.33.3-85.fc13.i686.PAE.img initramfs-2.6.33.3- 85.fc13.i686.PAE.img.old
delete initramfs-2.6.33.3-85.fc13.i686.PAE.img file.
#rm initramfs-2.6.33.3-85.fc13.i686.PAE.img
Rebuild initramfs-2.6.33.3-85.fc13.i686.PAE.img file.
#mkinitrd --with=dm-multipath -v -f initramfs-2.6.33.3-85.fc13.i686.PAE.img `uname -r`
20. Reboot the server.
21. After rebooting make sure that your storage is mounted as /home partition.
df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda3 117G 6.2G 105G 6% /
tmpfs 7.9G 608K 7.9G 1% /dev/shm
/dev/sda1 485M 28M 433M 6% /boot
/dev/sda7 25G 173M 23G 1% /tmp
/dev/sda5 49G 440M 46G 1% /var
/dev/mapper/EMCp1 16.1T 181M 16.0T 1% /home

22. If the partition is mounted change the kernel to the old settings.

Take a back-up of the new initramfs-2.6.33.3-85.fc13.i686.PAE.img file.
#mv initramfs-2.6.33.3-85.fc13.i686.PAE.img initramfs-2.6.33.3-85.fc13.i686.PAE.img.new


Rename the old backup file to the real name.
#mv initramfs-2.6.33.3-85.fc13.i686.PAE.img.old initramfs-2.6.33.3-85.fc13.i686.PAE.img
# init 6

23. After rebooting make sure that your storage is mounted as /home partition.
df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda3 117G 6.2G 105G 6% /
tmpfs 7.9G 608K 7.9G 1% /dev/shm
/dev/sda1 485M 28M 433M 6% /boot
/dev/sda7 25G 173M 23G 1% /tmp
/dev/sda5 49G 440M 46G 1% /var
/dev/mapper/EMCp1 16.1T 181M 16.0T 1% /home

No comments:

Post a Comment