Condusiv Technologies Blog

Condusiv Technologies Blog

Blogging @Condusiv

The Condusiv blog shares insight into the issues surrounding system and application performance—and how I/O optimization software is breaking new ground in solving those issues.

Is Fragmentation Robbing SAN Performance?

by Brian Morin 16. March 2015 09:39

This month Condusiv® announced the most significant development in the Diskeeper® product line to date – expanding our patented fragmentation prevention capabilities beyond server local storage or direct-attached storage (DAS) to now include Storage Area Networks, making it the industry's first real-time fragmentation solution for SAN storage.

Typically, as soon as we mention "fragmentation" and "SAN" in the same sentence, an 800 pound gorilla walks into the room and we’re met with some resistance as there is an assumption that RAID controllers and technologies within the SAN mitigate the problem of fragmentation at the physical layer.

As much as SAN technologies do a good job of managing blocks at the physical layer, the real problem why SAN performance degrades over time has nothing to do with the physical disk layer but rather fragmentation that is inherent to the Windows file system at the logical disk software layer.

In a SAN environment, the physical layer is abstracted from the Windows OS, so Windows doesn't even see the physical layer at all – that’s the SAN's job. Windows references the logical disk layer at the file system level.

Fragmentation is inherent to the fabric of Windows. When Windows writes a file, it is not aware of the size of the file or file extension, so it will break that file apart into multiple pieces with each piece allocated to its own address at the logical disk layer. Therefore, the logical disk becomes fragmented BEFORE the SAN even receives the data.

How does a fragmented logical disk create performance problems? Unnecessary IOPS (input/output operations per sec). If Windows sees a file existing as 20 separate pieces at the logical disk level, it will execute 20 separate I/O commands to process the whole file. That’s a lot of unnecessary I/O overhead to the server and, particularly, a lot of unnecessary IOPS to the underlying SAN for every write and subsequent read.

Diskeeper 15 Server prevents fragmentation from occurring in the first place at the file system layer. That means Windows will write files in a more contiguous or sequential fashion to the logical disk. Instead of breaking a file into 20 pieces that needs 20 separate I/O operations for every write and subsequent read, it will write that file in a more contiguous fashion so only minimal I/O is required.

Perhaps the best way to illustrate this is with a traffic analogy. Bottlenecks occur where freeways intersect. You could say the problem is not enough lanes (throughput) or the cars are too slow (IOPS), but we’re saying the easiest problem to solve is the fact of only one person per car!

By eliminating the Windows I/O "tax" at the source, organizations achieve greater I/O density, improved throughput, and less I/O required for any given workload – by simply filling the “car” with more people. Fragmentation prevention at the top of the technology stack ultimately means systems can process more data in less time.

When openBench Labs tested Diskeeper Server, they found throughput increased 1.3X. That is, from 75.1 MB/sec to 100 MB/sec. A manufacturing company saw their I/O density increase from 24KB to 45KB. This eliminated 400,000 I/Os per server per day, and the IT Director said it "eliminated any lag during peak operation."

Many administrators are led to believe they need to buy more IOPS to improve storage performance when in fact, the Windows I/O tax has made them more IOP dependent than they need to be because much of their workload is fractured I/O. By writing files in a more sequential fashion, the number of I/Os required to process a GB of data drops significantly so more data can be processed in less time.

Keep in mind, this is not just true for SANs with HDDs but SSDs as well. In a SAN environment, the Windows OS isn’t aware of the physical layer or storage media being used. The I/O overhead from splitting files apart at the logical disk means just as many unnecessary IOPS to SSD as HDD. SSD is only processing that inefficient I/O more quickly than a hard disk drive.

Diskeeper 15 Server is not a "defrag" utility. It doesn’t compete with the SAN for management of the physical layer by instructing the RAID controllers on the how to manage the data. Diskeeper’s patented proactive approach is the perfect complement to a SAN by ensuring only productive I/O is processed from server to storage to keep physical servers and SAN storage running like new.

With organizations spending tens of thousands of dollars on server and storage hardware and even hundreds of thousands of dollars on large SSD deployments, why give 25% or more performance over to fragmentation when it can be prevented altogether for a mere $400 per physical server at our lowest volume tier?

Try Diskeeper 15 Server for 30 Days ->

NEW V-locity 4 VM Accelerator Improves VM Performance by up to 50%

by Jeff Medina 10. December 2012 10:00

Today we are very excited to announce the release of V-locity 4 VM Accelerator. With this latest release, V-locity increases VM and application performance by up to 50% and does so without any additional storage hardware.

Let’s face it - in today’s world of virtual environments, we generate a tremendous amount of data and it’s only the beginning. In fact, findings included in a recent study by IDC titled “Extracting Value from Chaos” predict that in the next ten years we will create 50 times more information and 75 times more files.

The impact of this data explosion on server virtualization can often lead to I/O bottlenecks. This is because a physical server running multiple virtual machines (VMs) must often carry out far more I/O operations than one server running a single workload, and typical virtualization environments emulate I/O devices that run less efficiently than native I/O devices.

In essence, virtualization acts like a funnel, combining and mixing many disparate I/O streams, sending out to the disk what becomes a very random I/O pattern. To make matters worse, the more VMs are added, the more the issue is compounded as more I/O is "randomized." All of this has a very negative affect on storage performance, and renders time-honored techniques such as read-ahead buffers and caching algorithms far less effective than in conventional physical environments.

Storage I/O is the most critical issue in a virtualized environment, and can cause organizations to spend a great deal on storage, purchasing more and more disk spindles, but often using only a fraction of their capacity because of performance issues. The outcome is that, due to issues relating to performance bottlenecks in the storage infrastructure, some applications are deemed unable to be virtualized; however, a properly tuned storage environment might have accommodated those applications. So what’s the alternative? The answer is V-locity 4 VM Accelerator. 

V-locity 4 VM Accelerator provides:

  • Increased application performance up to 50%
  • Up to 50% faster access to frequently accessed files
  • Faster I/O performance without the cost of additional storage hardware
  • Increased VM density per physical server up to 50%
  • Extended hardware lifespan by eliminating unnecessary I/Os
  • Automatic and real-time operation for true “Set It and Forget It®” management 

What makes V-locity 4 so effective is its powerful toolkit of proactive technologies, including IntelliWrite,® V-Aware,® CogniSAN,® InvisiTasking® and the new IntelliMemory® RAM caching technology.

New! IntelliMemory™ Caching Technology
IntelliMemory intelligent caching technology boosts active data, improving I/O response time up to 50% or more while also eliminating unnecessary I/O operations from getting into the network or storage.

Improved! IntelliWrite® Technology
IntelliWrite automatically prevents the operating system from breaking files into pieces and writing those pieces in a performance penalized manner. This proactive approach improves performance up to 50% or more while preventing any negative impact to snapshots replication, data deduplication or thin provisioning growth. As this proactive approach happens at the server level, the network and shared storage simply has less I/O operations to transfer and process.

New! Performance Benefit Analyzer
The Performance Benefits Analyzer helps document the performance benefits of V-locity. The benefit analyzer looks at your current system performance, then compares these results to those after using V-locity to provide a detailed report showing specific improvements and benefits to your system.

V-Aware® Technology
V-Aware detects external resource usage from other virtual machines on the virtual platform and eliminates resource contention that might slow performance.

CogniSAN® Technology
CogniSAN detects external resource usage within a shared storage system, such as a SAN, and allows for transparent optimization by not competing for resources utilized by other VMs over the same storage infrastructure. And it does this without intruding in any way into SAN-layer operations.

InvisiTasking® Technology
InvisiTaksing allows all the V-locity 4 "background" operations within the VM to run with zero resource impact on current production.

Set It and Forget It®
Automatic and real-time operation.

For more details and a FREE trial, visit www.condusiv.com/products/v-locity or call a sales representative at 1-800-829-6468.

Windows 8 Released

by Alex Klein 29. October 2012 05:35

Microsoft officially released the next version of Windows last week – Windows 8. While this new release contains various technological advancements, issues with I/O performance and its effect on Windows systems still remains.

Every I/O operation that occurs takes a measureable amount of time. There’s no such thing as an instant I/O request, and simply put, the more I/Os necessary, the longer it will take for Windows to complete a particular task. 

To understand why this is still an issue on Windows 8 and even Windows Server 2012, let’s explore a bit deeper. When data is written within the Windows file system, it is naturally written in a non-optimized way. Thus when an application requests the data, the initial I/O request generally gets broken down and  splits into many additional requests (called split I/Os), and thus increases the time necessary to retrieve the information. So, as this activity naturally occurs on a daily basis, it takes more and more I/O requests and increasingly impacts the performance of your servers and workstations. 

The Windows built-in optimization tool, which is set to run on a weekly basis, attempts to handle the mounting I/O traffic, but that’s after you’ve already experienced the performance impact in the first place. For example, say I’m working on a project on a Tuesday afternoon – how is running the built-in optimization utility on Wednesday going to address this concern?

Proactive Windows I/O acceleration is the key to successful operations and improved response time to users and this is why Condusiv Technologies created our Diskeeper product. Diskeeper’s InvisiTasking and IntelliWrite technologies helps prevent the vast majority of extra I/O requests from occurring and does so without taking any additional resources from the system or other applications. This ensures that you get the least number of I/Os to go to the storage and allows your applications to run that much faster. 

 
In fact, recent independent testing by openBench labs shows up to 98% few I/O requests, server throughput increased by 130% and data throughput up to 5X faster on workstations. You can read more of this report here.

Diskeeper 2011 Professional Review in Smart Computing Magazine

by Colleen Toumayan 1. June 2011 09:24

Improve Data Performance 

For years, we have loved Diskeeper and the way it works in the background to keep your hard drives defragmented. Defragmentation programs have been available for decades, but Diskeeper is among the true innovators.With the release of 2011, the tool has gotten even better. 

Basic Bits 

Drive defragmenters aggregate the data—which drives normally break into chunks and store wherever necessary— into contiguous blocks. This speeds access time (and therefore system performance), and can literally prevent a drive from crashing.  Diskeeper takes a multipronged approach to defragmentation that eases its system impact and helps keep your drives humming along smoothly. For one thing, its IntelliWrite technology prevents fragmentation before it happens. Its new Efficient Mode feature improves the defragmenting process by identifying problem fragmentation. The Instant Defrag feature tidies up any leftover fragments it cannot process during the initial file save. Both of these happen on the fly, in the background,and with little to no impact on system resources.  

The full review is located here.

Tags: , , ,

Diskeeper | Diskeeper TV | InvisiTasking

Faster File Access Using Diskeeper on SAN

by karen 19. April 2011 06:33
When I asked Patrick Blanche, of Hobbs+Black Architects, whether he saw good results from his use of Diskeeper, this is what he said: 

“Good results? … you mean GREAT right!  Allow me to explain,

We are an architectural business and work with many small interrelated files that can get highly fragmented, so for us using Diskeeper Server is a must to maintain our performance. For the past few years Diskeeper has been working full time on all file servers in Michigan, Arizona even Utah, and the result has been significant improvement in the user experience.  Back before Diskeeper, (a time I would rather forget) we suffered from literally days of waiting for Windows built-in defrag to try and cope with our TB size volumes.  Finally Diskeeper came along and we have seen those issues vanish.”

Then we worked up a fine case study about the performance benefits to his company and now they are deploying Diskeeper on all of their servers and workstations company-wide!  

The complete case study is located here: http://downloads.diskeeper.com/pdf/HobbsBlackSANCaseStudy.pdf

 

Tags:

Diskeeper | Diskeeper TV | InvisiTasking

RecentComments

Comment RSS

Month List

Calendar

<<  December 2018  >>
MoTuWeThFrSaSu
262728293012
3456789
10111213141516
17181920212223
24252627282930
31123456

View posts in large calendar