vmware下linux 软raid0 过程

vmware下linux 软raid0 过程 2008-10-15 21:53:47

分类： LINUX

事先在vnware下添加几块虚拟磁盘,

进入系统后:

fdisk -l 查看所有都磁盘

对新加对磁盘分区:

fdisk /dev/sdb

1. n 新增分区

2. p 选择主分区

3. t 选择系统分区模式

4. fd 选择linux raid

5 w 保存

对/devsdc同样对操作

这样,raid分区完毕,接下来创建raid

mdadm --create /dev/md0 --level=0 --raid-devices=2 /dev/sdb /dev/sdc

创建mdadm对config文件:

cp /usr/share/doc/mdadm-2.5.4/mdadm.conf-example /etc/mdadm.conf

修改它:

echo DEVICE /dev/sd[bc]1 >>/etc/mdadm.conf

mdadm -Ds >> /etc/mdadm.conf

此步骤完成

接着使用lvm管理

创建pv

pvcreate /dev/md1

查看: pvdisplay

创建vg

vgcreate VgOnRaid /dev/md1 /dev/md2

如果还有别的块设备如上面的/dev/md2的话,这里的/dev/md1就是2个磁盘做raid0

查看: vgdisplay

创建lv

lvcreate -l xxxx VgOnRaid -n LvOnRaid

查看: lvdisplay

mount -t ext3 /dev

写入fstab

[root@TSM54-Test ~]# fdisk -l

Disk /dev/sda: 15.0 GB, 15032385536 bytes

255 heads, 63 sectors/track, 1827 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sda1 * 1 13 104391 83 Linux

/dev/sda2 14 1827 14570955 8e Linux LVM

Disk /dev/sdb: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

Disk /dev/sdc: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

Disk /dev/sdd: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

Disk /dev/sde: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

一.创建Soft RAID

1.创建raid分区

[root@TSM54-Test ~]# fdisk /dev/sdb

The number of cylinders for this disk is set to 1044.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

1) software that runs at boot time (e.g., old versions of LILO)

2) booting and partitioning software from other OSs

(e.g., DOS FDISK, OS/2 FDISK)

Command (m for help): n

Command action

e extended

p primary partition (1-4)

Partition number (1-4): 1

First cylinder (1-1044, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-1044, default 1044):

Using default value 1044

Command (m for help): t

Selected partition 1

Hex code (type L to list codes): L

0 Empty 1e Hidden W95 FAT1 80 Old Minix be Solaris boot

1 FAT12 24 NEC DOS 81 Minix / old Lin bf Solaris

2 XENIX root 39 Plan 9 82 Linux swap / So c1 DRDOS/sec (FAT-

3 XENIX usr 3c PartitionMagic 83 Linux c4 DRDOS/sec (FAT-

4 FAT16 <32M 40 Venix 80286 84 OS/2 hidden C: c6 DRDOS/sec (FAT-

5 Extended 41 PPC PReP Boot 85 Linux extended c7 Syrinx

6 FAT16 42 SFS 86 NTFS volume set da Non-FS data

7 HPFS/NTFS 4d QNX4.x 87 NTFS volume set db CP/M / CTOS / .

8 AIX 4e QNX4.x 2nd part 88 Linux plaintext de Dell Utility

9 AIX bootable 4f QNX4.x 3rd part 8e Linux LVM df BootIt

a OS/2 Boot Manag 50 OnTrack DM 93 Amoeba e1 DOS access

b W95 FAT32 51 OnTrack DM6 Aux 94 Amoeba BBT e3 DOS R/O

c W95 FAT32 (LBA) 52 CP/M 9f BSD/OS e4 SpeedStor

e W95 FAT16 (LBA) 53 OnTrack DM6 Aux a0 IBM Thinkpad hi eb BeOS fs

f W95 Ext'd (LBA) 54 OnTrackDM6 a5 FreeBSD ee EFI GPT

10 OPUS 55 EZ-Drive a6 OpenBSD ef EFI (FAT-12/16/

11 Hidden FAT12 56 Golden Bow a7 NeXTSTEP f0 Linux/PA-RISC b

12 Compaq diagnost 5c Priam Edisk a8 Darwin UFS f1 SpeedStor

14 Hidden FAT16 <3 61 SpeedStor a9 NetBSD f4 SpeedStor

16 Hidden FAT16 63 GNU HURD or Sys ab Darwin boot f2 DOS secondary

17 Hidden HPFS/NTF 64 Novell Netware b7 BSDI fs fd Linux raid auto

18 AST SmartSleep 65 Novell Netware b8 BSDI swap fe LANstep

1b Hidden W95 FAT3 70 DiskSecure Mult bb Boot Wizard hid ff BBT

1c Hidden W95 FAT3 75 PC/IX

Hex code (type L to list codes): fd

Changed system type of partition 1 to fd (Linux raid autodetect)

Command (m for help): p

Disk /dev/sdb: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdb1 1 1044 8385898+ fd Linux raid autodetect

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

按照上面的方法分别把/dev/sdc,/dev/sdd/也创建raid分区。完成后，用fdisk -l查看

[root@TSM54-Test ~]# fdisk -l

Disk /dev/sda: 15.0 GB, 15032385536 bytes

255 heads, 63 sectors/track, 1827 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sda1 * 1 13 104391 83 Linux

/dev/sda2 14 1827 14570955 8e Linux LVM

Disk /dev/sdb: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdb1 1 1044 8385898+ fd Linux raid autodetect

Disk /dev/sdc: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdc1 1 1044 8385898+ fd Linux raid autodetect

Disk /dev/sdd: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdd1 1 1044 8385898+ fd Linux raid autodetect

Disk /dev/sde: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

2.创建阵列

mdadm可以支持LINEAR、RAID0 (striping)、 RAID1(mirroring)、 RAID4、RAID5、RAID6和MULTIPATH的阵列模式。

命令格式：

mdadm --create device -chunk=X --level=Y --raid-devices=Z devices

[root@TSM54-Test ~]# mdadm --create /dev/md0 --level=5 --raid-devices=3 /dev/sdb /dev/sdc /dev/sdd

mdadm: array /dev/md0 started.

--level表示创建的阵列模式，--raid-devices表示参与阵列的磁盘数量

3.配置文件

[root@TSM54-Test ~]#cp /usr/share/doc/mdadm-2.5.4/mdadm.conf-example /etc/mdadm.conf

[root@TSM54-Test ~]#echo DEVICE /dev/sd[bcd]1 >>/etc/mdadm.conf

[root@TSM54-Test ~]#mdadm -Ds >>/etc/mdadm.conf

4.格式化Raid

接下来，只要把/dev/md0作为一个单独的磁盘设备进行操作就可以：

[root@TSM54-Test ~]# mkfs.ext3 /dev/md0

mke2fs 1.39 (29-May-2006)

Filesystem label=

OS type: Linux

Block size=4096 (log=2)

Fragment size=4096 (log=2)

2097152 inodes, 4194272 blocks

209713 blocks (5.00%) reserved for the super user

First data block=0

Maximum filesystem blocks=0

128 block groups

32768 blocks per group, 32768 fragments per group

16384 inodes per group

Superblock backups stored on blocks:

32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,

4096000

Writing inode tables: done

Creating journal (32768 blocks): done

Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 36 mounts or

180 days, whichever comes first. Use tune2fs -c or -i to override.

[root@TSM54-Test ~]# mkdir /mnt/software

[root@TSM54-Test ~]# mount /dev/md0 /mnt/software

5. 开机自动挂载

更改/etc/fstab文件，添加一行

/dev/md0 /mnt/software ext3 defaults 0 0

二. 其他的操作

mdadm有7中模式，下面列出了7种模式的命令格式，详细的选项，请参考man手册。

ASSEMBLE MODE :madam --assemble md-device options-and-component-devices

mdadm --assembel --scan md-devices-and-options

mdamd --assembel --scan options

BUILD MODE: mdadm --build device --chunk=X --level=Y --raid-devices=Z devices

CREATE MODE: mdadm --create device --chunk=X --level=Y --raid-devices=Z devices

MANAGE MODE: mdadm device options devices

MISC MODE: mdadm options ... devices ...

MONITOR MODE: mdadm --monitor options... devices...

GROW MODE:

1.查看

MISC模式

#mdadm --detail /dev/md0

#mdadm -D /dev/md0

2.停止

MISC模式

#mdadm -S /dev/md0

3.启动

ASSEMBLE模式

#mdadm -A /dev/md0 /dev/sd[bcd]1

启动指定的RAID，可以理解为将一个raid重新装配到系统中。

如果在前面已经配置了/etc/mdadm.conf文件，可以使用：

#mdadm -As /dev/md0

4.添加删除磁盘

mdadm可以在Manage模式下，对运行中的阵列进行添加及删除磁盘。常用于标识failed磁盘，增加spare（冗余）磁盘，以及替换磁盘等。

[root@TSM54-Test ~]# mdadm /dev/md0 --fail /dev/sdd --remove /dev/sdd

mdadm: set /dev/sdd faulty in /dev/md0

mdadm: hot removed /dev/sdd

[root@TSM54-Test ~]# mdadm -D /dev/md0

/dev/md0:

Version : 00.90.03

Creation Time : Fri Aug 1 21:35:31 2008

Raid Level : raid5

Array Size : 16777088 (16.00 GiB 17.18 GB)

Device Size : 8388544 (8.00 GiB 8.59 GB)

Raid Devices : 3

Total Devices : 2

Preferred Minor : 0

Persistence : Superblock is persistent

Update Time : Fri Aug 1 23:34:12 2008

State : clean, degraded

Active Devices : 2

Working Devices : 2

Failed Devices : 0

Spare Devices : 0

Layout : left-symmetric

Chunk Size : 64K

UUID : 28a22990:eac5c231:3fe907f1:1145e264

Events : 0.6

Number Major Minor RaidDevice State

0 8 16 0 active sync /dev/sdb

1 8 32 1 active sync /dev/sdc

2 0 0 2 removed

[root@TSM54-Test ~]# mdadm /dev/md0 --add /dev/sdd

mdadm: re-added /dev/sdd

[root@TSM54-Test ~]# mdadm -D /dev/md0

/dev/md0:

Version : 00.90.03

Creation Time : Fri Aug 1 21:35:31 2008

Raid Level : raid5

Array Size : 16777088 (16.00 GiB 17.18 GB)

Device Size : 8388544 (8.00 GiB 8.59 GB)

Raid Devices : 3

Total Devices : 3

Preferred Minor : 0

Persistence : Superblock is persistent

Update Time : Fri Aug 1 23:34:12 2008

State : clean, degraded, recovering

Active Devices : 2

Working Devices : 3

Failed Devices : 0

Spare Devices : 1

Layout : left-symmetric

Chunk Size : 64K

Rebuild Status : 0% complete

UUID : 28a22990:eac5c231:3fe907f1:1145e264

Events : 0.6

Number Major Minor RaidDevice State

0 8 16 0 active sync /dev/sdb

1 8 32 1 active sync /dev/sdc

2 8 48 2 spare rebuilding /dev/sdd

--fail指定坏磁盘,--remove移走。

需要注意的是，对于某些RAID级别，如RAID0，是不能用--fail --remove --add的。

5.监控

MONITOR模式

# nohup mdadm --monitor --mail root --delay 200 /dev/md0 &

每200秒监控一次，当RAID出现错误时，发送邮件给root用户。

6.增加spare磁盘

可以通过在创建的时候指定冗余磁盘

#mdadm --create --verbose /dev/md0 --level=3 --raid-devices=3 -x1 /dev/sdb1 /dev/sdc1 /dev/sdd1 /dev/sde1

-x(--spare-devices=)参数指定冗余磁盘的数量。另外，对于full的阵列（例如已经有2个磁盘的RAID1），则直接使用-add参数，mdadm会自动把冗余的磁盘作为spare disk。

7.删除RAID

#mdadm -S /dev/md0

或

#rm /dev/md0

删除/etc/mdadm.conf文件；去除/etc/fstab文件中相关的行。

最后，用fdisk对磁盘进行重新分区。

三 RAID之上建立LVM

1.前面还有一个/dev/sde没有处理，下面先把它建立成一个RAID1

[root@TSM54-Test ~]# fdisk /dev/sde

The number of cylinders for this disk is set to 1044.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

1) software that runs at boot time (e.g., old versions of LILO)

2) booting and partitioning software from other OSs

(e.g., DOS FDISK, OS/2 FDISK)

Command (m for help): p

Disk /dev/sde: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

Command (m for help): n

Command action

e extended

p primary partition (1-4)

Partition number (1-4): 1

First cylinder (1-1044, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-1044, default 1044): +5000M

Command (m for help): n

Command action

e extended

p primary partition (1-4)

Partition number (1-4): 2

First cylinder (610-1044, default 610):

Using default value 610

Last cylinder or +size or +sizeM or +sizeK (610-1044, default 1044):

Using default value 1044

Command (m for help): p

Disk /dev/sde: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sde1 1 609 4891761 83 Linux

/dev/sde2 610 1044 3494137+ 83 Linux

Command (m for help): t

Partition number (1-4): 1

Hex code (type L to list codes): fd

Changed System type of partition 1 to fd (Linux raid autodetect)

Command (m for help): t

Partition number (1-4): 2

Hex code (type L to list codes): fd

Changed System type of partition 2 to fd (Linux raid autodetect)

Command (m for help): p

Disk /dev/sde: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sde1 1 609 4891761 fd Linux raid autodetect

/dev/sde2 610 1044 3494137+ fd Linux raid autodetect

Command (m for help): w

The partition table has been

Calling ioctl() to re-read partition table.

Syncing disks.

完成分区后，执行：

[root@TSM54-Test dev]# cd /dev/

[root@TSM54-Test dev]# ls -l md0

brw-r----- 1 root disk 9, 0 Aug 1 21:58 md0

[root@TSM54-Test dev]# mknod md1 b 9 1

[root@TSM54-Test dev]# mdadm --create /dev/md1 --level=1 --raid-devices=2 /dev/sde1 /dev/sde2

mdadm: largest drive (/dev/sde1) exceed size (3494016K) by more than 1%

Continue creating array? y

mdadm: array /dev/md1 started.

好了，RAID1也做完了，验证一下

[root@TSM54-Test dev]# mdadm -Ds

ARRAY /dev/md0 level=raid5 num-devices=3 UUID=28a22990:eac5c231:3fe907f1:1145e264

ARRAY /dev/md1 level=raid1 num-devices=2 UUID=57f24dd1:aed3606c:d467132e:a6b3a010

2. 开始建立LVM

首先确保/dev/md0已经卸载，使用#umount /mnt/software

（1）创建PV

[root@TSM54-Test ~]# pvcreate /dev/md0

Physical volume "/dev/md0" successfully created

[root@TSM54-Test ~]# pvcreate /dev/md1

Physical volume "/dev/md1" successfully created

[root@TSM54-Test ~]# pvdisplay

--- Physical volume ---

PV Name /dev/sda2

VG Name VolGroup00

PV Size 13.90 GB / not usable 21.45 MB

Allocatable yes (but full)

PE Size (KByte) 32768

Total PE 444

Free PE 0

Allocated PE 444

PV UUID BntsgG-UJLv-agT2-lZ7C-dXY2-51FB-Jxd5tA

--- NEW Physical volume ---

PV Name /dev/md0

VG Name

PV Size 16.00 GB

Allocatable NO

PE Size (KByte) 0

Total PE 0

Free PE 0

Allocated PE 0

PV UUID GriJk2-wyfl-o0CI-NY7t-g75X-zIx3-FJHf1u

--- NEW Physical volume ---

PV Name /dev/md1

VG Name

PV Size 3.33 GB

Allocatable NO

PE Size (KByte) 0

Total PE 0

Free PE 0

Allocated PE 0

PV UUID SImCO1-RmvK-OgfZ-dCFZ-LJNC-8wun-Bd9qzS

（2）创建VG

[root@TSM54-Test ~]# vgcreate LVMonRaid /dev/md0 /dev/md1

Volume group "LVMonRaid" successfully created

[root@TSM54-Test ~]# vgscan

Reading all physical volumes. This may take a while...

Found volume group "VolGroup00" using metadata type lvm2

Found volume group "LVMonRaid" using metadata type lvm2

创建了一个LVMonRaid的卷组。

（3）创建LV

[root@TSM54-Test ~]# lvcreate --size 5000M --name LogicLV1 LVMonRaid

Logical volume "LogicLV1" created

[root@TSM54-Test ~]# lvcreate --size 5000M --name LogicLV2 LVMonRaid

Logical volume "LogicLV2" created

[root@TSM54-Test ~]# lvscan

ACTIVE '/dev/VolGroup00/LogVol00' [12.88 GB] inherit

ACTIVE '/dev/VolGroup00/LogVol01' [1.00 GB] inherit

ACTIVE '/dev/LVMonRaid/LogicLV1' [4.88 GB] inherit

ACTIVE '/dev/LVMonRaid/LogicLV2' [4.88 GB] inherit

注：上面两条记录是装系统时默认创建的。

（4）格式化创建文件系统，并挂载使用

[root@TSM54-Test ~]# mkfs.ext3 /dev/LVMonRaid/LogicLV1

mke2fs 1.39 (29-May-2006)

Filesystem label=

OS type: Linux

Block size=4096 (log=2)

Fragment size=4096 (log=2)

640000 inodes, 1280000 blocks

64000 blocks (5.00%) reserved for the super user

First data block=0

Maximum filesystem blocks=1312817152

40 block groups

32768 blocks per group, 32768 fragments per group

16000 inodes per group

Superblock backups stored on blocks:

32768, 98304, 163840, 229376, 294912, 819200, 884736

Writing inode tables: done

Creating journal (32768 blocks): done

Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 35 mounts or

180 days, whichever comes first. Use tune2fs -c or -i to override.

[root@TSM54-Test ~]# mkfs.ext3 /dev/LVMonRaid/LogicLV2

mke2fs 1.39 (29-May-2006)

Filesystem label=

OS type: Linux

Block size=4096 (log=2)

Fragment size=4096 (log=2)

640000 inodes, 1280000 blocks

64000 blocks (5.00%) reserved for the super user

First data block=0

Maximum filesystem blocks=1312817152

40 block groups

32768 blocks per group, 32768 fragments per group

16000 inodes per group

Superblock backups stored on blocks:

32768, 98304, 163840, 229376, 294912, 819200, 884736

Writing inode tables: done

Creating journal (32768 blocks): done

Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 33 mounts or

180 days, whichever comes first. Use tune2fs -c or -i to override.

[root@TSM54-Test ~]# mkdir /mnt/doc

[root@TSM54-Test ~]# mkdir /mnt/music

[root@TSM54-Test ~]# mount -t ext3 /dev/LVMonRaid/LogicLV1 /mnt/doc

[root@TSM54-Test ~]# mount -t ext3 /dev/LVMonRaid/LogicLV2 /mnt/music

如果要开机自动挂载，更改/etc/fstab文件，添加如下两行：

/dev/LVMonRaid/LogicLV1 /mnt/doc ext3 defaults 0 0

/dev/LVMonRaid/LogicLV2 /mnt/music ext3 defaults 0 0

阅读(1073) | 评论(0) | 转发(0) |

上一篇：iptables 小结

下一篇：redhat的初始化过程