Storage UPDATE--Storage Benchmarks--December 13, 2004

Don't let overzealous antispam software block your copy of Storage UPDATE--add [email protected] to your list of allowed senders and contacts.


This email newsletter comes to you free and is supported by the following advertisers, which offer products and services in which you might be interested. Please take a moment to visit these advertisers' Web sites and show your support for Storage UPDATE.

Free White Paper: High Availability for Windows Services

Windows IT Pro VIP


1. Commentary
- The Rise of Storage Benchmarks

2. Resource - External USB

3. New and Improved
- QLogic Offers Entry-Level and Enterprise-Class Innovation
- Tell Us About a Hot Product and Get a T-Shirt!

==== Sponsor: Free White Paper: High Availability for Windows Services ====

It is no stretch to say that Windows high availability must be a fundamental element in your short- and long-term strategic IT planning. This free white paper discusses the core issues surrounding Windows high availability, with a focus on business drivers and benefits. You'll learn about the current market solutions, technologies and real-world challenges including cost-benefit analyses. Plus, find out how to assess technical elements required in choosing a high availability solution, including the robustness of the technology, time-to-failover, and implementation difficulties. Download this white paper now!


==== 1. Commentary ====
by Elliot King, [email protected]

The Rise of Storage Benchmarks
Last month, Datacore--a 7-year-old storage software company specializing in storage control, management, and consolidation--released what it described as the first results for the Storage Performance Council SP-1 benchmark involving the iSCSI standard for storage connectivity. According to the company, the results indicate that in comparison to its own Fibre Channel mark, the iSCSI results achieved about half the performance at about half the price Moreover, the company argued, the absolute performance of the iSCSI configuration compared favorably to many more expensive "name brand" Fibre Channel arrays at a fraction of the cost.
The Datacore announcement raises several interesting concerns for storage administrators. Most important, the announcement might bring increased attention to the use of benchmarks in the storage community. If benchmarks become more widely used and understood, they could help smaller companies crack the tier-1 storage arena.
The industry considers the Storage Performance Council SP-1 benchmark to be the only objective test to evaluate enterprise storage subsystems. Announced after 4 years of development at the Computer Measurement Group conference in December 2001 and made available the following year, the benchmark gives vendors, Value Added Resellers (VARs), and IT managers a standardized, vendor-neutral methodology for measuring and comparing performance on storage subsystems. The need for a standard method of comparison emerged as storage networks became more pervasive. Storage networks are made up of many different components, and the performance capacities of a single component can't predict the end-to-end performance of an entire system.
The benchmarks were modeled after the Transaction Processing Performance Council (TPC) benchmarks, which measure the performance of database-centric information infrastructures. Two baseline statistics are generated. The first is Input/Output Operations per Second (IOP/s), a raw performance measure to gauge the level of workload a storage infrastructure can manage and its ability to keep up with demands during peak periods. The second summary statistic is Least Time Response (LTR), which measures the length of time necessary to complete tasks (e.g., backup and restore operations, rebuilding large databases) that are composed of a series of I/O requests.
As with the TPC benchmarks, the performance statistics can be compared according to the capacity of the system as well as the cost. In this way, end users can conduct apples-to-apples comparisons when evaluating storage infrastructures.
Although establishing the SPC benchmark tests has been a long and arduous process, the tests seem to be gaining momentum. Over the past year, 16 tests have been submitted for review. (Storage vendors themselves can conduct benchmarking tests, which are then are independently audited before the Storage Performance Council accepts by them for publication.) Major storage heavyweights--including Fujitsu, HP, IBM, StorageTek, and Sun--have published SPC-1 benchmark results this year. However, industry leader EMC hasn't yet posted any benchmark results.
According to Ziya Aral, chief technology officer and chairman of Datacore, the use of storage benchmarking has until now faced several challenges. The testing for the standard, he noted, wasn't trivial. He also argued that the concept of storage as a separate infrastructure that needs to be tested independently is only now gaining widespread attention. Finally, except for enterprises at the very high end, knowledge about storage benchmarks hasn't percolated widely through the storage community.
These days, the storage infrastructure represents an increasingly significant portion of the total IT environment. And while computer-processing power roughly doubles every 18 months, storage performance levels aren't increasing nearly as fast. Consequently, said Aral, the storage infrastructure can become a performance bottleneck.
The Datacore benchmark, Aral said, makes a compelling price/performance case for the use of iSCSI SANs. He noted that the test was completed on a network that uses true commodity components. Having the benchmark results, he added, gives smaller companies such as his more credibility as they introduce innovative technologies into arenas dominated by much larger companies.
Benchmarks, of course, aren't a panacea. As veterans of the TPC benchmarking wars know, the test environment is unlikely to match any individual company's production environment. In the database world, benchmarks should be the first step in the evaluation process, not the only or final step. And while the Storage Performance Council is working on SPC-2, the TPC has developed benchmarks for a wide array of different application environments. So, there's still work to be done in storage.
Nonetheless, the use of industry-accepted benchmarks could be an important step forward. As new storage technologies gain acceptance, a method to make valid performance comparisons is crucial.
Comment on this article at

==== Sponsor: Windows IT Pro VIP ====

Get Exclusive Access to Windows IT Pro Print Products Online!
Our VIP subscribers get online access to all of our print publications, plus a print subscription to Windows IT Pro and exclusive access to our banner-free VIP Web site. Now we've added even more content from the archives of SQL Server Magazine! You won't find a more complete and comprehensive resource anywhere--check it out!

==== Announcements ====
(from Windows IT Pro and its partners)

Holiday Offer from SQL Server Magazine
For a limited time, order SQL Server Magazine and get 30% off the newsstand price! As a special holiday bonus, you'll also receive the latest Top SQL Server Tips Guide free--includes over 60 helpful tips! In addition, you'll get free access to every article published in the magazine--online! Sign up now:

Try a Sample Issue of Windows Scripting Solutions
Windows Scripting Solutions is the monthly newsletter that shows you how to automate time-consuming, administrative tasks by using our simple downloadable code and scripting techniques. Sign up for a sample issue right now, and find out how you can save both time and money. Plus, get online access to our popular "Shell Scripting 101" series--click here!

Can Your Antispam Content Filter Inside Your Firewall Cope with New Email Threats and Intrusions?
Stopping these new techniques requires detection and prevention in real time at the SMTP connection point. In this free on-demand Web seminar, learn how you can prevent these new and evolving intrusions from harming your email system, while improving your email server performance, reducing IT infrastructure costs, and restoring worker productivity. Register now!

Get Your Fax Servers Up and Running Smarter, Faster, and More Cost-Effectively
In this free on-demand Web seminar, you'll learn the latest trends and developments in the fax market and best practices for seamless integration with Exchange and Outlook with real-time fax technologies. Find out integration faxing architecture and Multi-Function Device tactics, deployment techniques, and more. Register today!

==== 2. Resource ====

External USB
After forum member "Richnep" is switching to external USB drives for backup purposes. Can you recommend a multidrive rack or cage for USB 2.0? If so, please click the URL below and help out a fellow IT pro.

==== Event ==== (brought to you by Windows IT Pro)

Are You Using Best Practices when Managing Software Packaging and Pre-Deployment Preparation?
In this free on-demand Web seminar, you'll learn best practices for managing software packaging and pre-deployment preparation. Discover how your organization can benefit from managing the workflow of the pre-deployment process to cut time and costs. Plus, you'll learn about different business scenarios that show ROI improvements from accurate workflow management. Register now!

==== 3. New and Improved ====
by Jason Bovberg, [email protected]

QLogic Offers Entry-Level and Enterprise-Class Innovation
QLogic announced SANsurfer Express, software that lets you install a SAN in minutes (including host bus adapters (HBAs), switches, and disk arrays), and the SANbox 5602, a 4GB stackable Fibre Channel switch. SANsurfer Express is a simple, low-cost product designed for small and midsized business, featuring wizard-based installation and configuration for non-SAN experts. SANbox 5602 is an enterprise-class stackable switch with sixteen 4GB Fibre Channel ports, four 10GB stack interconnects for scalability while eliminating the cost and complexity of inter-switch links (ISLs), and dual hot-swap power and cooling for high availability. For pricing information, contact QLogic on the Web.

Tell Us About a Hot Product and Get a T-Shirt!
Have you used a product that changed your IT experience by saving you time or easing your daily burden? Tell us about the product, and we'll send you a T-shirt if we write about the product in a future Windows IT Pro What's Hot column. Send your product suggestions with information about how the product has helped you to [email protected]


==== Contact Us ====

About the commentary -- [email protected]
About the newsletter -- [email protected]
About technical questions --
About product news -- [email protected]
About your subscription -- [email protected]
About sponsoring UPDATE -- [email protected]


This email newsletter is brought to you by Windows IT Pro, the leading publication for IT professionals deploying Windows and related technologies. Subscribe today.

Manage Your Account
You are subscribed as #EmailAddr#.

You received this email message because you asked to receive additional information about products and services from the Windows IT Pro Network. To immediately unsubscribe, click this link:
Thank you!

View the Windows IT Pro privacy policy at

Windows IT Pro, a division of Penton Media, Inc.
221 East 29th Street, Loveland, CO 80538 Attention: Customer Service Department

Copyright 2004, Penton Media, Inc. All rights reserved.

Hide comments


  • Allowed HTML tags: <em> <strong> <blockquote> <br> <p>

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.