Competition, Comparison, Self Improvement, Benchmarking.

We do them in business. We do them in our careers. We do them in our leisure. ... and if you are like me you like to watch them on TV or live as well. Who is watching Lance Armstrong? or Tiger Woods? or their favorite sports team compete regularly.

IT professionals are no different.  Today, one of the business emhpasis points for IT is energy efficiency.  Now there is a way for you to quickly compare your own IT organization against itself and others.  This IT self-assessment tool takes about 2-3 minutes to complete and will answer these three questions

1. How efficient is your server infrastructure today?
2. How do you compare to your peers?
3. How much more efficient could you be?

The Community Window: Server Efficiency is a tool hosted on the Intel Premier IT Professionals website (http://ipip.intel.com) where registration is free and so is the information and best practices shared by other IT professionals throughout the industry.  Join and conduct your Server Efficiency self assessment today.   Chris

As I've blogged before, my job takes me to many places and I get see all kinds of cool technology when I get there. This example is no exception, I've put together a short video with Steve Cumings of HP showing a tour of the Performance Optimized DataCenter or abbreviated as "POD". Its actually the same size as a standard container for shipping anywhere around the world. These type of assets are vital in time of need such as disaster recovery. Take a look and let us know how you could use this cool technology.

I’m here this week in familiar stomping grounds, the Moscone Center, in San Francisco. Today’s event started off strong with John Chambers keynote address. His speech was very engaging as he wandered through the audience, capturing the attention of nearly 10K attendees. What caught my eye especially was his focus on collaboration and Web2.0. The example he used was the recent launch of the Cisco Unified Computing Solution (UCS) which was launched via online tools such as blogs, telepresence, and flicker, check out this photo:

This shows that the virtual launch reached 10x the audience at 1/10^th the cost! I am really glad to hear that since this is what I do for a living.

John also spoke about some emerging technologies and I found out that Cisco has been working very closely with the Dallas Cowboys on increasing the customer experience. I was a little disappointed to hear John is a Niners fan, but had to expect that coming from a man and a company that was named after San Fran’cisco’, so I give him a break on that one.

It was also very interesting to hear a bit about the history of the Cisco logo, looks like times have changed and so has the logo:

After the keynote, I caught up with John and Kirk Skaugen, Executive Vice President with Intel’s Digital Enterprise Group at the Intel booth where Kirk had a surprise. Intel presented to Cisco and John a XEON 5500 processor series wafer (code named Nehalem).

Here’s another shot with a the XEON 5500 wafer:

I’ll being covering more of the event and participating in social media events during the event. Look for future updates here in the Server Room.

Wm. Hank Lea

My grandfather was born in the early 1900’s.  By all accounts he was a hardworking man with a strong degree of curiosity.  He passed away in his late 80’s and before he died I remember talking to him about my pursuit of an Electrical Engineering degree.  He nodded politely, asked a few questions and when I helped to fix the electrical outlet in his garage I got the sense that he thought I was heading down the path to be an electrician.  I believe that thought pleased him.  Several years ago I was explaining to my five year old daughter in layman’s terms what I did for a living and what my company made.  I said things like “We make tiny engines that run computers” or “I work with computers that run websites like Webkinz® and Disney®”.  She seemed impressed.  Months later when she was asked by a parent of her friend what her dad did for a living I was a combination of proud and surprised to hear that she replied “They make chips…”  (proud moment) “…and salsa!” (um OK.  I still have work to do).

_

Now the other day she walked up to me and said something like “Dad, I am having trouble getting the Slingbox to work on mom’s iPod Touch.  It is connected to the Internet but the remote does not seem to be changing the channel.  Can you help me?”  Clearly she has made some progress up the technology curve, but it also struck me how far she has come.  Kids these days are surrounded by technology.  In our house alone there are at least the following electronic devices; Oven, Microwave, AppleTV, refrigerator, smoke detector (3), carbon monoxide detector, programmable thermostat, furnace, radio, garage door opener (2), wireless speakers, televisions (3), set top boxes (3), ceiling fans with remotes (3), netbook, Slingbox, Clear wireless router, remote outlet, sprinkler control box, iPod Touch, desktop computer, Wii, iPod shuffle (2), alarm clocks (3), oven timer, electronic light dimmer, cordless phones (4), AV receiver, DVD players (3), VCR, iPod docking station, security system, motion sensor, camcorder, camera (2), USB hub, music keyboard, AV switch, computer keyboard, battery chargers (4), Wii remotes (4), Wii Fit Pad, Wii drums, copier/fax/scanner, computer monitor, AC, Power supplies (4), RFID credit cards (2), washer, dryer, noise canceling headphones, answering machine, internet modem, cell phones (2), handheld GPS, auto GPS and electronic battleship.

_

I am sure I have forgotten several things and I did not count cars or anything at my children’s school.  I am also sure each of the electronic devices in our house has either a processor, microcontroller, ASIC or multiple of each.  Admittedly, the silicon content in our house is probably above average given where I work and the personalities my wife and I have.  But when I think back to my grandfather he had none of these silicon laden items.  I am sure he didn’t care since it is hard to miss something you never knew.  Of the hundreds of pieces of silicon in our house about a dozen or so are smart enough to connect to each other or to “the cloud” in some way.  I put “the cloud” in quotes because it is not only the most over-hyped word of it’s time it is also the best way to articulate what I suspect my children and many others think of the services that they get when all of this stuff gets connected.

_

I can safely say two things are fact. First, my grandchildren will have in their house many more pieces of silicon than I do. Second, they will have more pieces of silicon that can connect to each other and communicate with “the cloud”.  There are many billions of devices connected to the Internet today and that number will grow.  At Intel we are building silicon, and increasingly software assets, that facilitate the processing and movement of data both on those devices and between them. Servers are increasingly becoming an important part of that over-hyped cloud word. My cable company has a cloud delivering me my on demand video content, A social media site allows me to upload pictures into their cloud to share with my friends, someone just used a cloud architecture to develop a perpetual motion machine.  OK, one of those things was false.

_

My grandfather thought a cloud was something in the sky.  My children think it streams video to their handheld device.  What will our great-grandchildren think?

Every day in our personal lives, we’re bombarded with “opportunities” to get a better deal.  At the grocery store, we might be able to buy a single item for $2.50 or 3 for $5.00…which then forces us to go thru the mental gymnastics of figuring out how good of a deal it is, and whether or not we really need three 96 oz. bottles of salad dressing.

But there are some opportunities out there for adding a bunch of compute performance are a bit more straight-forward.

Case in point: Dell recently had Principled Technologies compare the performance for the Intel® Xeon® Processor E5520 and E5506 CPUs each running on a PowerEdge R710 server.  Both are 4 core processors, but the E5520 has many advantages over the E5506: 

• higher frequency (2.26 GHz vs. 2.13 GHz)
• faster QuickPath speeds (5.86 GT/s vs. 4.8 GT/s)
• faster memory support (1066 MHz vs. 800 MHz)
• Turbo Boost
• Hyper-Threading support.

Long story short:  Buying a slightly better processor with a server purchase can drastically increase your performance.  So if you are looking to buy a Dell PowerEdge server configured with Microsoft SQL Server 2008* and an Intel® Xeon® Processor E5506, for an additional $300 you can get up to 75% more performance by upgrading to an E5520 CPU.  More performance headroom in a similar power envelope, faster QuickPath and memory speeds, Hyper-Threading and Turbo Boost functionality – all for $300.  NOW THAT’S A GREAT VALUE!

Check out the summary document for the Dell R710 Principled Technologies performance testing, which also has comparative performance testing for the Xeon® E5540 and X5550 CPUs (also a great value for the money!), along with results for Microsoft Exchange.

NOTE:  System pricing from www.dell.com as of May 13, 2009.  Actual performance will vary based on configuration, usage and manufacturing variability. See the actual Principled Technology report in the following link for complete system configuration

The debate on how to best increase system capacity to accommodate growing applications has raged on for years; “scale up” with more CPU, memory, and I/O, or “scale out” with loosely connected systems.    Scaling out by adding networked systems to increase capacity has been a good economical solution for many IT managers because it allows them to grow by using less expensive, industry standard building blocks.  However, there are some notable exceptions to this line of thought.  One is that the class of applications that require shared memory and large database support are much better suited to run on a single, expandable system that scales up.  These are typically transaction processing, business intelligence and ERP solutions.   Until now, IT managers running applications that require scale-up systems larger than 4 or 8 CPUs have had limited platform choices and most were proprietary and expensive RISC-based servers.

The other problem with the scale out approach is the people, facilities, software and overhead costs and complexity of managing very large numbers of servers, which can grow to a point where the costs outweigh the performance and system cost benefits.  The industry solution to achieving better ROI has been to consolidate multiple scale-out servers onto single industry standard scale-up servers with virtualization solutions.  This is a good solution, but is limited by the number of application loads the IT manager feels comfortable placing on a single server, given the need to maintain peak performance and availability for each application.

Well, it looks like the scale-up, scale-out debate is about to take another turn.  In the server product update Intel gave on May 26th, they talked about new levels of system scalability and choice supported by the upcoming Nehalem-EX processor.  This processor will support systems that scale up to 8 sockets natively (shared memory, without any additional silicon), and up to 16 sockets and higher with node controllers from system manufactures that allow single systems to share memory beyond 8 sockets.   So far there are over 15 different designs from 8 OEMs that offer 8 socket or higher scalability.  But of course, for the class of application where scaling is important, socket count doesn’t tell the whole story of what’s needed for scalable performance.  Thread support, key for transaction processing and virtualization, scales at the rate of 16 threads per socket with 8 cores and Hyper Threading (2 threads per core).  That would be 128 threads for an 8-socket system, and 256 threads for 16 sockets.   And in order to keep those threads fed with data close to the CPU, each processor supports up to 24 MB of shared cache (1.5X current generation Xeon), and an impressive 16 memory slots per socket or 128 DIMMs on an 8-socket system.  In addition, the Scalable Memory Interconnect gives these systems 9 times the memory bandwidth of today’s top Xeon processor.  Finally, four QuickPath interconnect links per socket allow for high-bandwidth sharing of data across the system.

So the net of it is that the industry is going to see a broad selection of highly scalable, next-generation servers that significantly extend the economic advantage of industry standard scale-up solutions for business-critical, large database, and high-end virtualization/consolidation deployments.     I would expect these systems to give IT managers a very cost-effective alternative to the much more expensive and proprietary RISC-based servers they use today.

What are your thoughts?  Mike

Related Topics:

• NHM-EX Press Fact Sheet
• NHM-EX May 26th Press Briefing Video – condensed version
• IBM 8Socket Demo Video
• NHM-EX--A New Standard

Looks like the Intel® Xeon® processor 5500 series is making lots of noise in HPC.  The QPI and integrated memory controller are really providing the boost necessary to make it an all around performance leader for HPC applications.  With all this performance why did Intel add a third memory channel?

The third memory channel enables the platform to support a boat load of memory.  Matter-of-fact, up to 192GB can be supported in a two socket configuration.  It wasn’t too long ago when only 32GB was supported in a dual socket configuration.  By having the ability to support so much memory you can now meet the needs of almost every HPC application.  The 5500 series is intended for all server markets, but let’s face it, with the design changes Intel made with the new architecture the server segment gaining the most benefit appears to be HPC. 

It seemed like yesterday when the only way to have access to large memory configurations was through expensive, proprietary SMP systems.  The HPC market for large SMP systems is still out there but it is shrinking…fast.  Today, we are clustering low cost solutions to create some of the most powerful systems in the world.  Standard components are leading to lower and lower system costs, delivering a price/performance advantage alternative solutions cannot meet.

Now that a single dual socket node can support up to 192GB’s it is important to understand how to get there.  First, to enable 192GB you need 16GB DIMMs x 12 memory slots.  There will be a premium for a 16GB DIMM.  Knowing the options and determining the best, most cost effective solution is going to be dependent upon your environment.  When a large memory node is required, do you purchase the 16GB DIMM’s or go up to a Multi-socket solution?  If I decide to scale back on the memory (use 4GB or 8GB DIMMs instead of 16GB DIMMs) what is the performance impact to my application?  If I am cost sensitive, will the lower cost outweigh the lack of performance?  Can I use SSD’s (Solid State Disk drives) to compensate for any performance loss due to lower memory capacity?  There are many questions to think about when deciding the right configuration for your application and environment and I certainly can’t answer them here.

Let’s not forget the third memory channel enables a different set of optimal memory configurations.  Think x3 when deciding on how much memory to install into your node; 12GB, 24GB, 48GB, etc.  What happens when you don’t use an optimal configuration?  Well it depends, in most cases the impact is minimal, but let me add a bit of context around minimal:

·         Low bandwidth sensitivity (more dependent upon the processor for performance)

–        E.g. Monte Carlo, Black-Scholes (financial modeling), BLAST (bioinformatics), AMBER (molecular dynamics)

–        Expect less than a 2% difference between memory configurations*

Ÿ  Medium bandwidth sensitivity (somewhat balanced between memory and CPU usage)

–        E.g. CFD, Explicit FEA, Implicit FEA (with robust I/O system)

–        Expect approx. 5% degradation for non-optimal symmetrical configurations*

Ÿ  High bandwidth sensitivity (high access to the system memory)

–        E.g. WRF (weather), POP (climate), MILC (physics), Reservoir Simulation

–        Expect approx. 10% degradation for non-optimal symmetrical configurations*

The results are interesting.  In all three cases above, the degraded performance is always better than the performance you would have with only two memory channels.

When you hear about performance impact of non-optimal memory you can see by the examples above, it is application dependent and will not have a severe impact on your overall system performance.   

The Intel Xeon processor 5500 series offers support for huge memory nodes with the addition of the third memory channel.  Memory configurations in multiples of three are ideal, but if you decide to stay with a power of two configuration the performance should still exceed that of a solution based upon only two memory channels.

*Based upon Intel internal measurements

Today Intel provided a server product update for the upcoming Nehalem-EX processor and the expandable platforms based on it.  Here’s a recap of some of the interesting messages communicated to the press:

• Nehalem Architecture and Quick Path Architecture are coming to the EX (MP) segment, 4 Socket Servers and above. 
• EX Servers are ideal for server consolidation / virtualized applications, data demanding enterprise applications and technical computing environments.  Both Itanium and Xeon processors based systems represent an attractive alternative to more expensive, proprietary RISC-processor based systems.
• EX Servers are designed for the high-end.  They offer more capabilities (i.e. memory, RAS, cores/threads, sockets) than 2 Socket Servers that IT managers require for business drivers such as large scale server consolidation, high data demands, virtualization, and scalability.
• Up to eight cores / 16 threads and a whopping 24MB of cache.
• Up to 9x the memory bandwidth vs. today’s 4-Socket Xeon 7400.  The performance will be dramatic – the highest-ever jump from a previous generation processor. 
• 2x the memory capacity with up to 16 memory slots per socket (that’s 64 DIMMs on a 4 Socket Server), and four high-bandwidth QuickPath Interconnect links.
• New levels of scalability: from large memory 2 socket systems through 8 socket systems, and even more with OEM node controllers.  Matter of fact, there are over 15 8-Socket+ designs from 8 OEMs currently. 
• IBM showed their 8S Nehalem-EX server design running 128 threads (8 Sockets x 8 cores x 2 threads due to Hyper Threading)…an industry first. 
• New RAS features traditionally found on Itanium, such as Machine Check Architecture (MCA) Recovery which detects CPU, memory, and I/O errors, works with the OS to correct, and helps recover from otherwise fatal system errors. 
• Nehalem-EX is scheduled for production in the second half of 2009, with OEM systems in early 2010.

Stay tuned over the next few days – we’ll post a video from the event.  Also look for some informative blogs over the next 1-2 weeks that will offer more of an in depth view of Nehalem-EX’s 4 Socket capabilities, performance, scalability, RAS, and Virtualization.