<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: VMware I/O Problems</title>
	<atom:link href="http://lonesysadmin.net/2006/05/20/vmware-io-problems/feed/" rel="self" type="application/rss+xml" />
	<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/</link>
	<description>Virtualization, System Administration, and Technology.</description>
	<lastBuildDate>Sat, 13 Mar 2010 17:02:36 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.1</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: stucky101</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-76117</link>
		<dc:creator>stucky101</dc:creator>
		<pubDate>Thu, 23 Apr 2009 01:34:36 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-76117</guid>
		<description>Bob

Not sure I follow you since the guide tells you to align partitions. They&#039;re not saying that you have to have partitions in the first place.
If I don&#039;t have partitions there is nothing to align.
What is the difference between aligning a partition and not having one in the first place except less hassle ? Am I missing something here ?

Besides, as per my discussion with an EMC engineer...
Quote :
&quot;There is absolutely no guarantee that any i/o will be aligned with our stripes. Clariion does not offer true Raid-3 in which all i/o&#039;s are forced to read exactly the same full stripe or nothing at all. All the alignment tools do is make sure the beginning of the filesystem is aligned with the lun&#039;s stripes but i/o&#039;s in general are not aligned&quot;
End quote

In other words you can align your partitions all you want you cannot prevent further disk crossing afterwards. 
I&#039;m still discussing with them why they say that but at the same time put so much emphasis on that one-time alignment.</description>
		<content:encoded><![CDATA[<p>Bob</p>
<p>Not sure I follow you since the guide tells you to align partitions. They&#8217;re not saying that you have to have partitions in the first place.<br />
If I don&#8217;t have partitions there is nothing to align.<br />
What is the difference between aligning a partition and not having one in the first place except less hassle ? Am I missing something here ?</p>
<p>Besides, as per my discussion with an EMC engineer&#8230;<br />
Quote :<br />
&#8220;There is absolutely no guarantee that any i/o will be aligned with our stripes. Clariion does not offer true Raid-3 in which all i/o&#8217;s are forced to read exactly the same full stripe or nothing at all. All the alignment tools do is make sure the beginning of the filesystem is aligned with the lun&#8217;s stripes but i/o&#8217;s in general are not aligned&#8221;<br />
End quote</p>
<p>In other words you can align your partitions all you want you cannot prevent further disk crossing afterwards.<br />
I&#8217;m still discussing with them why they say that but at the same time put so much emphasis on that one-time alignment.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Bob Plankers</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-76062</link>
		<dc:creator>Bob Plankers</dc:creator>
		<pubDate>Sat, 11 Apr 2009 05:17:11 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-76062</guid>
		<description>@Stucky101 -- yes, everything you suggest works just fine. What works way better, though, is to follow the best practices of your storage vendor and align your I/O by partitioning the disk.</description>
		<content:encoded><![CDATA[<p>@Stucky101 &#8212; yes, everything you suggest works just fine. What works way better, though, is to follow the best practices of your storage vendor and align your I/O by partitioning the disk.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: stucky101</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-76061</link>
		<dc:creator>stucky101</dc:creator>
		<pubDate>Sat, 11 Apr 2009 01:46:51 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-76061</guid>
		<description>Thoughts...

1. Why would I possibly want to create a partition table for a disk that will become a PV ?????
I have always created PV&#039;s on whole disks (pvcreate /dev/sdb) and that has been working just fine.

2. Even without LVM why bother with a partition ?
As far as I can see partitions do nothing but add problems (such as the alignment offset) and adds no value whatsoever. The only reason to partition is if you need to slice a disk into smaller disks (like the installer does with /boot and / etc...) That&#039;s it.
Other than that partitions have no purpose. 
Why create a partition that is as large as the entire disk when I want to use the entire disk anyway ?

[root@vm1 astuck]# /sbin/mkfs -t ext3 -j -m0 /dev/sdb
mke2fs 1.39 (29-May-2006)
/dev/sdb is entire device, not just one partition!
Proceed anyway? (y,n) y
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
1310720 inodes, 2621440 blocks
0 blocks (0.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2684354560
80 block groups
32768 blocks per group, 32768 fragments per group
16384 inodes per group
Superblock backups stored on blocks: 
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Writing inode tables: done                            
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 26 mounts or
180 days, whichever comes first.  Use tune2fs -c or -i to override.

Now I can easily expand the virtual disk on esx and run resizefs on /dev/sdb. No partition ever needed.</description>
		<content:encoded><![CDATA[<p>Thoughts&#8230;</p>
<p>1. Why would I possibly want to create a partition table for a disk that will become a PV ?????<br />
I have always created PV&#8217;s on whole disks (pvcreate /dev/sdb) and that has been working just fine.</p>
<p>2. Even without LVM why bother with a partition ?<br />
As far as I can see partitions do nothing but add problems (such as the alignment offset) and adds no value whatsoever. The only reason to partition is if you need to slice a disk into smaller disks (like the installer does with /boot and / etc&#8230;) That&#8217;s it.<br />
Other than that partitions have no purpose.<br />
Why create a partition that is as large as the entire disk when I want to use the entire disk anyway ?</p>
<p>[root@vm1 astuck]# /sbin/mkfs -t ext3 -j -m0 /dev/sdb<br />
mke2fs 1.39 (29-May-2006)<br />
/dev/sdb is entire device, not just one partition!<br />
Proceed anyway? (y,n) y<br />
Filesystem label=<br />
OS type: Linux<br />
Block size=4096 (log=2)<br />
Fragment size=4096 (log=2)<br />
1310720 inodes, 2621440 blocks<br />
0 blocks (0.00%) reserved for the super user<br />
First data block=0<br />
Maximum filesystem blocks=2684354560<br />
80 block groups<br />
32768 blocks per group, 32768 fragments per group<br />
16384 inodes per group<br />
Superblock backups stored on blocks:<br />
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632</p>
<p>Writing inode tables: done<br />
Creating journal (32768 blocks): done<br />
Writing superblocks and filesystem accounting information: done</p>
<p>This filesystem will be automatically checked every 26 mounts or<br />
180 days, whichever comes first.  Use tune2fs -c or -i to override.</p>
<p>Now I can easily expand the virtual disk on esx and run resizefs on /dev/sdb. No partition ever needed.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: How To Grow Linux Virtual Disks in VMware : Bob Plankers, The Lone Sysadmin</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-75574</link>
		<dc:creator>How To Grow Linux Virtual Disks in VMware : Bob Plankers, The Lone Sysadmin</dc:creator>
		<pubDate>Fri, 02 Jan 2009 15:36:16 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-75574</guid>
		<description>[...] 1: Grow the VMDK file, then create a new partition with fdisk. Align its beginning to be on a 128 byte boundary (use fdisk&#8217;s expert mode to make the beginning sector of the new partition evenly divisible [...]</description>
		<content:encoded><![CDATA[<p>[...] 1: Grow the VMDK file, then create a new partition with fdisk. Align its beginning to be on a 128 byte boundary (use fdisk&#8217;s expert mode to make the beginning sector of the new partition evenly divisible [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Eli Sand</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-75283</link>
		<dc:creator>Eli Sand</dc:creator>
		<pubDate>Mon, 27 Oct 2008 20:08:02 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-75283</guid>
		<description>This is a very interesting find for me - although I don&#039;t use ESX or a SAN, I am using VMWare Server 2.x and have found that disk i/o has been extremely CPU intensive on the host OS (guest OSes show no signs of CPU load, although the entire system is sluggish).

I noticed that indeed the same normal formatting is going on in the guest VMs here - an offset of 63 bytes for the first bit of data.  Thinking about it, this could very well make for similar performance issues like you noted.  Having everything in the guest offset by 63 bytes means that the host has to read 2 blocks for every 1 block the guest wants and then re-create a new virtual block of data (I&#039;m assuming).  This could be the cause of the poor disk i/o I&#039;m encountering (although I have heard that this wasn&#039;t a problem in VMWare Server 1.x - but I haven&#039;t done any testing).

Running dumpe2fs on the host to quickly get the formatted block size of the disk the guest VM&#039;s are on and then offsetting the first block of data in the guest disk to match might be the trick.  I&#039;ll be giving this a try and see how it turns out.  Hopefully it solves my problem!</description>
		<content:encoded><![CDATA[<p>This is a very interesting find for me &#8211; although I don&#8217;t use ESX or a SAN, I am using VMWare Server 2.x and have found that disk i/o has been extremely CPU intensive on the host OS (guest OSes show no signs of CPU load, although the entire system is sluggish).</p>
<p>I noticed that indeed the same normal formatting is going on in the guest VMs here &#8211; an offset of 63 bytes for the first bit of data.  Thinking about it, this could very well make for similar performance issues like you noted.  Having everything in the guest offset by 63 bytes means that the host has to read 2 blocks for every 1 block the guest wants and then re-create a new virtual block of data (I&#8217;m assuming).  This could be the cause of the poor disk i/o I&#8217;m encountering (although I have heard that this wasn&#8217;t a problem in VMWare Server 1.x &#8211; but I haven&#8217;t done any testing).</p>
<p>Running dumpe2fs on the host to quickly get the formatted block size of the disk the guest VM&#8217;s are on and then offsetting the first block of data in the guest disk to match might be the trick.  I&#8217;ll be giving this a try and see how it turns out.  Hopefully it solves my problem!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Bob Plankers</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-75162</link>
		<dc:creator>Bob Plankers</dc:creator>
		<pubDate>Mon, 06 Oct 2008 21:23:43 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-75162</guid>
		<description>Unless you use fdisk&#039;s expert mode to change the alignment of the partitions to be on 128 byte boundaries you are not successfully aligning your volumes.</description>
		<content:encoded><![CDATA[<p>Unless you use fdisk&#8217;s expert mode to change the alignment of the partitions to be on 128 byte boundaries you are not successfully aligning your volumes.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Scott</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-75160</link>
		<dc:creator>Scott</dc:creator>
		<pubDate>Mon, 06 Oct 2008 18:27:30 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-75160</guid>
		<description>Bob,

SAN/ESX/Linux/LVM is the most common OS &amp; disk setup I am doing lately.  When I get to my Linux VM install, I am using a Rescue Disk to create my disk partitions first, including LVM partitions.  I then reboot into install mode, and go through the normal OS install, including creating the LVM volume groups.
Is there a problem with this process?  Is the LVM I/O aligned in this case?</description>
		<content:encoded><![CDATA[<p>Bob,</p>
<p>SAN/ESX/Linux/LVM is the most common OS &amp; disk setup I am doing lately.  When I get to my Linux VM install, I am using a Rescue Disk to create my disk partitions first, including LVM partitions.  I then reboot into install mode, and go through the normal OS install, including creating the LVM volume groups.<br />
Is there a problem with this process?  Is the LVM I/O aligned in this case?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Tom Weiss</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-52097</link>
		<dc:creator>Tom Weiss</dc:creator>
		<pubDate>Wed, 07 Nov 2007 01:51:14 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-52097</guid>
		<description>Are there any recommendations for configuring geometries within a Guest O/S like Solaris?  The command `fdisk` provides the ability to override the geometry.
Also any recommendations on filesystem blocking?
Or should the work in the VM just be happily ignorant of the disk and disk i/o structures?</description>
		<content:encoded><![CDATA[<p>Are there any recommendations for configuring geometries within a Guest O/S like Solaris?  The command `fdisk` provides the ability to override the geometry.<br />
Also any recommendations on filesystem blocking?<br />
Or should the work in the VM just be happily ignorant of the disk and disk i/o structures?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: arcticdoggie</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-15434</link>
		<dc:creator>arcticdoggie</dc:creator>
		<pubDate>Tue, 19 Dec 2006 21:42:49 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-15434</guid>
		<description>What was the Disk I/O per sec you were seeing when you had this issue? How many VM&#039;s perphysical server?</description>
		<content:encoded><![CDATA[<p>What was the Disk I/O per sec you were seeing when you had this issue? How many VM&#8217;s perphysical server?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: CH</title>
		<link>http://lonesysadmin.net/2006/05/20/vmware-io-problems/comment-page-1/#comment-3448</link>
		<dc:creator>CH</dc:creator>
		<pubDate>Mon, 03 Jul 2006 13:11:10 +0000</pubDate>
		<guid isPermaLink="false">http://lonesysadmin.net/2006/05/20/vmware-io-problems/#comment-3448</guid>
		<description>Might be worth noting that VMFS3 will be aligned automatically in ESX 3.0. From the VI3 Installation guide, page 12:

VMFS3 Partitioning -  For best performance, use the VI Client or Web Access to set up your VMFS3 partitions, rather than using the ESX Server installer. Using the VI Client or Web Access ensures that the starting sectors of partitions are 64K‐ aligned, which improves storage performance.</description>
		<content:encoded><![CDATA[<p>Might be worth noting that VMFS3 will be aligned automatically in ESX 3.0. From the VI3 Installation guide, page 12:</p>
<p>VMFS3 Partitioning &#8211;  For best performance, use the VI Client or Web Access to set up your VMFS3 partitions, rather than using the ESX Server installer. Using the VI Client or Web Access ensures that the starting sectors of partitions are 64K‐ aligned, which improves storage performance.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
