HPC Advisory Council goes to Italy!

HPC Advisory Council goes to Italy!

 

Well, before we go to Italy, we have a workshop in Germany as part of the International Supercomputing conference (http://www.hpcadvisorycouncil.com/events/european_workshop/index.php). The registration for the Germany event is being done via the ISC’10 (http://www.supercomp.de/isc10/) registration web site – for more info or issues please contact me.

 

So once we will be back from Germany, the HPC Advisory Council will visit Italy and participate in the INTERNATIONAL ADVANCED RESEARCH WORKSHOP ON HIGH PERFORMANCE COMPUTING, GRIDS AND CLOUDS (http://www.hpcc.unical.it/hpc2010/). This is an open workshop, free of charge (yes, no registration fees are required for participants of the workshop). The aim of the Workshop is to discuss the future developments in the HPC technologies, and to contribute to assess the main aspects of Grids and Clouds, with special emphasis on solutions to grid  and cloud computing deployment. The council will be there and will contribute to the interesting discussions. So if you are in the area, or want to visit Italy in June, join us for the workshop (June 21 – 25).

 

Regards,

Gilad  Gilad Shainer    

 

gilad@hpcadvisorycouncil.com

MPI optimizations using the HPC Advisory Council HPC Center

Recently we have been working on performance optimizations for Platform MPI for the Swedish Meteorological and Hydrological Institute (SMHI).

The application we were testing the MPI optimization for is the “SMHI RCO application” which can use the ScaliMPI or the PMPI (Platform MPI).

At first we have tested the application performance on Scali MPI and Platform MPI and achieved the following results (using 144 ranks, 18 hosts 8 ranks each on the “Helios” cluster). The original Scali MPI based run was 474 seconds and the original Platform-MPI was 550 seconds.

We have modified the Platform MPI and the optimized results with Platform MPI demonstrated 450 seconds for the application run.

We want to thank the HPC Advisory Council for providing the resources for us to evaluate our optimizations and provide a better solution for the customer.

Regards,
Perry Schmidt
Platform

11 days away! HPC Advisory Council Switzerland Workshop 2010

We are just 11 days away from the 3-day HPC Advisory Council workshop in Lugano, Switzerland.  We have an extremely packed agenda with a slew of exciting topics and presenters( see below). Hope you can make it…psst…it’s free! Register now.

Agenda – Day 1

9:00-9:30 Welcome session (Gilad Shainer, HPC Advisory Council)
9:30-9:45 HPC in the Swiss National Supercomputing Centre (Dominik Ulmer, CSCS)
9:45-10:00 HPC Systems in the Swiss National Supercomputing Centre (Neil Stringfellow)
10:00-10:30 HPC Storage Systems at CSCS (Hussein N. Harake, CSCS)
10:30-10:45 The HPC Advisory Council recent activities (Gilad Shainer, HPC Advisory Council)
10:45-11:00 Coffee break
11:00-12:00 Sponsor presentations (IBM, Microsoft, HP)
12:00-13:00 Lunch
13:00-14:30 InfiniBand Architecture Overview (Erez Cohen)
14:30-15:15 Large scale applications scalability – past experience
15:15-15:30 Coffee break
15:30-16:15 InfiniBand storage tutorial (Toine Beckers, DataDirect Networks)
16:15-17:00 Using InfiniBand for High-Performance Visualization – HPV (Stefan Eilemann, Eyescale Software GmbH)
17:00-18:30 InfiniBand clustering basics hands-on training (Erez Cohen)
18:30-20:00 Evening Event

Agenda – Day 2

9:00-10:00 Advanced topics in HPC networking – adaptive/static routing, congestion avoidance (Sven-Arne Reinemo, Simula Research Laboratory)
10:00-10:45 Advanced HPC technologies – collectives operations and offloading (Gilad Shainer, HPC Advisory Council)
10:45-11:00 Coffee break
11:00-12:00 Sponsor presentations (Sun, AMD, Voltaire)
12:00-13:00 Lunch
13:00-13:45 Networking topologies – CLOS (Fat-Tree), 3D Torus, network management
13:45-14:00 Sponsor presentation (Dell) 
14:00-14:30 The JuRoPA Supercomputer – Experience from Building a Supercomputer (Hugo Falter, ParTec)
14:30-15:30 Swiss Supercomputer Center – What We Need from InfiniBand? (Sadaf Alam, CSCS)
15:30-16:00 Coffee break
16:00-18:00 Clustering fabric management and monitoring hands-on (Erez Cohen)
18:00-18:30 Q&A
18:30-20:00 Evening Event

Agenda – Day 3 (Industrial Day)

8:45-9:00 Industrial Day introduction (Gilad Shainer, HPC Advisory Council)
9:00-9:45 Keynote session: HPC – Challenges of the 21st century (Goldi Misra, Centre For Development of Advanced Computing)
9:45-10:30 HP
10:30-10:45 Coffee Break
10:45-11:30 Voltaire
11:30-12:15 Sun
12:15-1:00 IBM
1:00-14:00 Lunch
14:00-14:45 Dell
14:45-15:30 Microsoft
15:30-16:15 AMD Opteron™ processors scalability and roadmap (Herve Chevanne, AMD)
16:15-16:30 Coffee Break
16:30-17:00 Putting Personality into High-Performance Computing (John D. Leidel, Convey Computer Corporation)
17:00-17:30 Gateway Technology
17:30-18:00 DataDirect Networks
18:00-18:30 Advancements in Copper Cable Interconnects for HPC Applications (Russell Hornung and Henry N.Yates II, W.L. Gore & Associates)
18:30-18:45 Adjourn and prize raffle!

Upcoming HPC Advisory Council Events

The Council continues to be very active with our ongoing worldwide workshop programs. Many thanks to our members for adding their support and sponsoring the events, such as AMD, HP, IBM, Mellanox, Microsoft, Voltaire and more.

First up: The HPC Advisory Council and the Swiss Supercomputing Centre will host the HPC Advisory Council Switzerland Workshop 2010  in the Lugano Convention Centre, Lugano, Switzerland, from March 15-17, 2010. This is an excellent training and educational opportunity for European-based, HPC and data center IT professionals (See AGENDA). Attendance is FREE and registration is now OPEN.

Second: The HPC Advisory Council will hold the 2010 European Workshop on May 30th, 2010, in conjunction with the ISC’10 conference in Hamburg Germany. The workshop will be a full day workshop, and will include coffee breaks, lunch and dinner, courtesy of the HPC Advisory Council. Attendance to the workshop is a nominal fee of  30€ . Register today for the conference by clicking on the Council Workshop box when registering for ISC.

More workshop are being planned for the second half of 2010. Stay tuned for more info.

Hope to see you all there,

Brian Sparks

Platform Computing and Instrumental Extend Strategic Partnership to Advance High Performance Cloud Computing for Government Sector

As U.S. government agencies and departments evaluate the potential cost savings, service level improvements and greater resource utilization offered by various cloud computing models, there is a recognized need for a technology-agnostic platform that can support and integrate legacy, heterogeneous HPC environments while also managing a wide-range of hardware, operating systems and virtual machines. In order to maximize prior technology investments, government agencies must invest in technologies that prevent vendor lock-in and that work with multiple types of operating systems.

With that, I wanted to draw your attention to a partnership between Platform and Instrumental to advance High Performance Cloud Computing for the Government Sector.  The partnership enhances Platform’s global service capabilities and gives users an end-to-end, full service solution that maximizes the value of Platform’s private cloud management and HPC cloud-enabling software solutions, Platform ISF and Platform ISF Adaptive Cluster.  The full press release can be seen here

Dave Ellis
Principal Technologist
Instrumental, Inc.

HPC in 2010: A look at technology, issues, and opportunities

insideHPC talked with Gilad Shainer, the Chairman of the HPC Advisory Council, about what the organziation does, how its grown, and how it is helping catalyze developments for users and HPC businesses.  In addition talking about what the Council has already accomplished, Gilad also talks about the new research and focus areas that they are kicking off. The  Council’s mission is to help everyone, so papers, inf0rmation, best practices, and so on are all available for download at their website.

Video is posted here: http://insidehpc.com/hpc-2010-technology-issues-opportunities/

SC09 – Building the Fastest Networking Demonstration on the Show Floor

Now that SC09 is done we can look back on the council activities and achievements during the largest HPC show in the world. As we did during SC08 and ISC’09, the council members invested a huge amount of effort and brought together the fastest networking solution – a 120Gb/s InfiniBand network demonstration, as part of SCinet. You can see the networking diagram below and I would like to thank the following organization that helped to make this amazing demo a reality: AMD, Avago, Colfax Intl, Dell, HP, IBM, InfiniBand Trade Association, Koi Computers, LSI, Los Alamos National Laboratory, Luxtera, Mellanox Technologies, Microsoft, NVIDIA, Oak Ridge National Laboratory, RAID, Scalable Graphics, SGI, Sun Microsystems, Texas Advanced Computing Center, The University of Utah Center for High-Performance Computing, and Voltaire. 

SCinet Network Diagram

One of our council members, Scalable Graphics, helped to create a highly visual demo of a Peugeot car rendering in 3D (see picture below). The demo included an interactive component, where viewers wear glasses that tracked their position and moved the image accordantly.

3D Visualization Demo

Also during the conference, we held our semi-annual meeting, where we reviewed our plans for 2010. To recap, we will be building off our successful HPC Advisory Council Workshop in China and we will be hosting 4 workshops next year; the first one in March will be hosted in Switzerland together with the Swiss Supercomputing Center, and the second in May as part of the International Supercomputing Conference. More info can be found on the council main web pages.

Best regards,

Gilad, HPC Advisory Council Chairman.

Interconnect analysis: InfiniBand and 10GigE in High-Performance Computing

InfiniBand and Ethernet are the leading interconnect solutions for connecting servers and storage systems in high-performance computing and in enterprise (virtualized or not) data centers. Recently, the HPC Advisory Council has put together the most comprehensive database for high-performance computing applications to help users understand the performance, productivity, efficiency and scalability differences between InfiniBand and 10 Gigabit Ethernet.

In summary, there are a large number of HPC applications that need the lowest possible latency for best performance or the highest bandwidth (for example Oil&Gas applications as well as weather related applications). There are some HPC applications that are not latency sensitive. For example, gene sequencing and some bioinformatics applications are not sensitive to latency and scale well with TCP-based networks including GigE and 10GigE. For HPC converged networks, putting HPC message passing traffic and storage traffic on a single TCP network may not provide enough data throughput for either. Finally, there is a number of examples that show 10GigE has limited scalability for HPC applications and InfiniBand proves to be a better performance, price/performance, and power solution than 10GigE.

The complete report can be found under the HPC Advisory Council case studies or by clicking here.

IEEE Cluster 2009

The HPC Advisory Council participated in the “Workshop on High Performance Interconnects for Distributed Computing (HPI-DC’09)” part of the IEEE Cluster 2009 conference. Several members (Joshua More from AMD, Jeff Layton from Dell, and me) presented research results on “Scheduling Strategies for HPC as a Service (HPCaaS)”. You can find the presentation under the Content page/conference at the HPC Advisory Council main page.

The workshop was well organized by Ada Gavrilovska (Georgia Tech) and Pavan Balaji (Argonne National Lab) with the help from Steve Poole (Oak Ridge National Lab). Other interesting sessions were given by Nagi Rao (ORNL) on wide area InfiniBand, James Hofmann (Naval Research Lab) on Large Data project, Hari Subramoni (The Ohio State University) on InfiniBand RDMA over Ethernet (LLE) and others.

The next council event is the HPC China workshop. More data on the workshop is posted at – http://www.hpcadvisorycouncil.com/events/china_workshop/

Gilad Shainer HPC Advisory Council Chairman
gilad@hpcadvisorycouncil.com