Intersect360 Research Presents HPC & Hyperscale Trends @ Stanford Conference 2016 – 24-25 February

Guest post by:  Addison Snell, Intersect360 Research

 

By now it’s well-established that we have entered a new era for high performance computing. The industry is in a state of flux, evolving around new markets, new users, new applications, and new technologies. As these new demands affect product directions and the real-life problems they aim to address, there is an increasing need to compare outlooks and evaluations, with an eye to the future of hyperscale and HPC.

 

The HPC Advisory Council has taken the lead in bringing together gatherings across the international HPC community, and Intersect360 Research has partnered with the organization to link our ongoing research to this burgeoning conference series. At the next HPCAC workshop, taking place at Stanford University, February 24-25, 2016, I will present an overview of some of our newest research on the trends and dynamics changing our industry.

 

Of particular importance is the evolution of the hyperscale market, and its influence on HPC. Intersect360 Research has tracked “ultrascale internet” as an HPC segment since 2007, looking at the consumption of scalable technologies by companies like Google, Microsoft, and Facebook. Today many other companies are involved, including Chinese giants like Baidu, Alibaba, Tencent, and Qihoo, but beyond that, hundreds of other companies are part of this growing market. Going forward, we are tracking hyperscale as the deployment of web-scale application infrastructures that are independent from normal enterprise operations, with examples in social media, retail, telecom, transaction processing, and more.

 

There is still significant influence between HPC and hyperscale, in both directions, most notably in the areas of cognitive computing and artificial intelligence, where research at some of the top hyperscale companies leads the field. Standards like Open Compute Project, OpenStack, and Beiji/Scorpio also can drive acquisition decisions at traditional HPC-using organizations. Big data and analytics also transcend both HPC and hyperscale, driving I/O scalability in both markets. These trends are all included in the new hyperscale advisory service from Intersect360 Research.

 

Of course, there are also significant changes transpiring in HPC aside from hyperscale. Most notably, users are evaluating a wide range of processing technologies, including Xeon, Xeon Phi, GPU, POWER, FPGAs, ARM, and more. We have conducted a new study that dives deep into the usage and evaluation of these myriad options, along with related interconnect technologies like CAPI, NVlink, InfiniBand, and OmniPath. We’re also continuing to track changes in budget allocations, the growth of commercial uses of HPC, and the evolution of cloud computing in HPC.

 

All of these topics will be explored at the Stanford Conference, not only in my presentation but across the arc of the two-day event. View the agenda and register for the conference:  http://www.hpcadvisorycouncil.com/events/2016/stanford-workshop. I hope to see you there and at other HPCAC events in the near future!

Addison Snell

Data Science Summit 2016: Call for Participation

dss16_US_wideheader

Join us July 12-13, 2016 in SF for the 5th annual Data Science Summit. The Summit brings together 1400 developers and data scientists for talks and tutorials by the top minds in industry and research. Learn to leverage the best new advances in data science and applied machine learning, and discover how industry greats are building the next generation of data products and intelligent applications.

 

This non-profit event is organized jointly by Intel, Dato and O’Reilly. The conference agenda has been co-created with Dr. Ben Lorica, Chief Scientist of O’Reilly Media who serves as the content manager of the O’Reilly Strata Conferences.

 

Preliminary speakers, more coming soon…

 

  • Alex Smola – Carnegie Mellon University & Marianas Labs
  • Xavier Amatriain – Quora
  • Carlos Guestrin – Dato & University of Washington
  • Wes McKinney – Cloudera
  • Magdalena Balazinska – University of Washington
  • Anthony Goldbloom – CEO Kaggle
  • Mike Jordan – UC Berkeley
  • Kevin Novak – Uber
  • Chris Re – Stanford University

 

We invite all related companies and research labs to submit talks about novel case studies, algorithms and applications.  There are flexible sponsorship options for companies who want to get involved.

 

Expected audience: 1400 data scientists, developers, researchers, CTOs, VPs of Engineering and Product, VPs of data analytics, professors and students.

 

Date & Location: July 12-13, 2016 at the Fairmont San Francisco Hotel

 

Registration is open – please use this 20% off discount code when registering: hpccouncil20.

ISC 2015 event

The Top 10 Things I Liked about ISC15

Hello all!  My long over-due post on the Top 10 Things I liked about ISC15. Work, life, and health got in the way after the conference. I am caught up and ready to remember the good times in Frankfurt by listing my Top 10.

 

1. Women in HPC Workshop on Thursday afternoon
Now it’s not just because I was on one of the panels. It was a really good workshop! The technical presentations were very interesting. The lively discussion on diversity in HPC not only opened my eyes, but it also has opened up a lot of questions. I look forward to the continued discussion!

 

2. Catching up
I didn’t know Terry worked for HP now (great to see you!). Or that Paul was changing jobs, or that Mark was now at Dot Hill. I guess LinkedIn updates are not keeping me up to date. Great to see you all!

 

3. New friends
I know I am at risk for missing someone, but I will still name a few names: Toni, Alison, Nages, Anna, Patricia, Wendy, Brian. We had talked via email, but hadn’t gotten to know each other face-to-face. We had some great conversations and laughs at the Executive Lounge in the Marriott!

 

4. Technologies
I didn’t have much time to see booths other than my customer’s booths, so my opinion here may be a little skewed. But did you see the Smart City demo in Numascale’s booth? Great use of Big Data and compute power. NICE Software always shows great demos of modeling and simulation in the cloud – yes you can collaborate remotely in real-time!

 

5. Attendees
Congratulations ISC on breaking a record on the number of attendees!

 

6. Presentations
I was actively tweeting from Analyst Crossfire and Vendor Showdown. Lots of great sound bites. One of my favorites from Barry Bolding – “Everyone needs a Cray”. (Maybe you had to be there…)

 

7. Parties
I was a party-pooper this year opting for visiting with old and new friends. But there is one that I didn’t miss – its great at every ISC and SC – Beers-on-Bright.

 

8. My Roomie
As many of you know Lara and I are great friends, colleagues, partners, and marketers for this industry. After a long day of meetings, networking, and working, we still have the energy to chat and catch up. It’s a great way to end the day!

 

9. Germany – Did not Disappoint!
The food, old town, the weather, walking around. It was very nice.

 

10. On beyond Germany.
I visited Paris, Milan, and London before coming home. Great times, lots of pictures, and great food and wine!

 

As always, I want to hear your favorites. Feel free to add a comment on this post, on my website, or Twitter.

See you all in Austin!

Kim11-1024x819-300x239

Student Cluster Competition ISC’15 – the Results

It was a great competition. Universities from all around the world competing on building the best HPC system under the power limitation of 3000 Watts.

The results:

Fan Favorite award went to Purdue University & Universidad EAFIT

The highest Linpack score, and actually setting a new record of 10.7 Teraflop – Jamia Millia Islamia University

ISC_2015_July_15_DSC_6933_entr

Overall competition 3rd place  – University of Science and Technology of China

ISC_2015_July_15_DSC_6898_entr

Overall competition 2nd place – the defending champions of 2014, Centre for High Performance Computing (CHPC)

ISC_2015_July_15_DSC_6903_entr

And the Grand Champion – Tsinghua University

ISC_2015_July_15_DSC_6905f_entr

I want to congratulate all teams – by getting to ISC’15 after months of hard work and preparations, they already won. Now it is the time to start working on the 2016 competition. We plan to put out the call for participation by Aug.

ISC_2015_July_15_DSC_6916f_entr

2015 HPCAC-ISC Student Cluster Competition

2015 hero-banner-blank
The 4th annual HPCAC-ISC Student Cluster Competition (SCC) is a joint event hosted by the HPC Advisory Council (HPCAC) and the organizers of the International Supercomputing Conference (ISC). It is an excellent opportunity to showcase students’ HPC expertise in a friendly yet spirited competition. The SCC event will be held during the ISC’15 Conference and Exhibition in Frankfurt, Germany from July 13 to 15, 2015.

The competition will feature small teams that compete to demonstrate the incredible capabilities of state-of-the-art high-performance cluster hardware and software. In a real-time challenge, it will feature 11 teams of six undergraduate students from around the world to showcase the small clusters of their own design on the ISC’15 exhibit floor. In this three-day event, the university teams will race to demonstrate the greatest performance across a range of HPC benchmarks and applications. The participating teams for this year’s competition at ISC’15 are:

  1. Centre for High Performance Computing (CHPC), South Africa
  2. Purdue University and Universidad EAFIT, United States and Colombia
  3. Chemnitz University of Technology, Germany
  4. University of Science and Technology of China (USTC), China
  5. University of São Paulo (USP), Brazil
  6. University of Hamburg, Germany
  7. Jamia Millia Islamia University (JMI), India
  8. University of Tartu, Estonia
  9. Universitat Politecnica de Catalunya (UPC), Spain
  10. Tsinghua University, China
  11. National University of Defense Technology (NUDT), China

 

The students will have a unique opportunity to learn, experience and demonstrate how HPC can influence our world and day-to-day learning. This experience will help them enhance their knowledge and will become useful for their professional careers. The selected applications for the competition come from different areas of sciences that use HPC:

 

  • LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. LAMMPS has potentials for solid-state materials (metals, semiconductors) and soft matter (biomolecules, polymers) and coarse-grained or meso-scopic systems. It can be used to model atoms or, more generically, as a parallel particle simulator at the atomic, meso, or continuum scale. LAMMPS runs on single processors or in parallel using message-passing techniques and a spatial-decomposition of the simulation domain. LAMMPS is distributed as an open source code under the terms of the GPL.

 

  • PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine.

 

  • Octopus is a scientific program aimed at the ab initio virtual experimentation on a hopefully ever-increasing range of system types. Electrons are described quantum-mechanically within density-functional theory (DFT), in its time-dependent form (TDDFT) when doing simulations in time. Nuclei are described classically as point particles. Electron-nucleus interaction is described within the pseudo potential approximation.

 

There will be secret applications announced on each day of the competition. The intent is to present challenging problems for the teams, thus good teamwork within members of each team is required to analyze and solve the unfamiliar workload.

 

ISC15-Banner-125x125

 

The teams will have a constraint of power limited to 3 kW on their cluster configuration. The power draw from their compute cluster will have to stay under the 3 KW power limit. Aside from that, it is up for the team to use any of the hardware they can get from their equipment sponsors on the hardware side, as well as any compilers, software and operating systems level tuning they may deploy on the software stack to achieve the best application performance.

 

It all concludes with a ceremony on the main conference keynote stage to award and recognize all student participants in front of thousands of HPC luminaries. In the end, there will be five awards given:

  • Highest LINPACK, for the highest score received for the LINPACK benchmark under the power budget.
  • Fan Favorite, to be given to the team which receives the most unique votes from ISC participants during the Student Cluster Competition.
  • 1st, 2nd and 3rd Place Overall Winners, for the 3 overall winner awards given to the teams that are determined by the scoring of all the chosen HPC applications, benchmarks, as well as judging by the panel of HPC experts during the interview sessions.

 

For more information, please visit: http://hpcadvisorycouncil.com/events/2015/isc15-student-cluster-competition

Final Conference of 2014 – HPCAC South Africa Conference

Held in the famous Kruger National Park in South Africa, the last HPC Advisory Council conference for 2014. Many thanks to Brian Sparks for managing the event, as well as to Prof. Dhabaleswar K. Panda (Ohio State University), Hussein Harake (Swiss Supercomputing Centre), Dr. Robert Sinkovits (San Diego Supercomputing Center) and Addison Snell (Intersect360) for their presentations. 2015, here we go…

HPCAC_South_Africa_2014

 Gilad

ISC Big data logo

ISC Big Data 2014: From Data to Knowledge

The ISC Big Data Conference will be held this fall in Heidelberg, Germany, October 1-2, 2014.  This second annual big data conference will present attendees with the latest developments in data-centric computing from both industry players and researchers. The conference will explore all aspects of that data-to-knowledge path.

The conference will kick off on Wednesday, October 1, with a keynote entitled “The Internet of Things,” presented by Dirk Slama of Bosch Software Innovations. The second conference keynoter, Stefan Wrobel of the Fraunhofer Institute for Intelligent Analysis will talk about “Big Data – Successes and Challenges beyond the Hype.”

Continue reading

The HPC Advisory Council Spain Conference 2014

HPC Spain 2014 eblast_header

The HPC Advisory Council along with the University of Cantabria will host the HPC Advisory Council Spain Conference 2014 at the Aula Magna de la Facultad de Ciencias de la Universidad de Cantabria in Santander, Spain on September 24, 2014.

This year’s workshop will focus on High-Performance Computing essentials, new developments, emerging technologies, best practices and hands-on training. Some of the sessions to be presented:

Continue reading

The third HPCAC-ISC Student Cluster Competition will Start Tomorrow at ISC’14

The third HPCAC-ISC Student Cluster Competition, featured at ISC’14, is an opportunity to showcase student expertise in a friendly yet spirited competition. The competition will start tomorrow, and will feature small teams that compete to demonstrate the incredible capabilities of state-of- the-art high-performance cluster hardware and software. In a real-time challenge, eleven teams of six undergraduate and/or high school students from around the world will build a small cluster of their own design on the ISC exhibit floor and race to demonstrate the greatest performance across a series of benchmarks and applications.

Continue reading

The HPCAC Conference in Brazil

We had the first HPC Advisory Council conference in Brazil. Held together with the Sao Paulo University. We hosted around 70 HPC professionals and 50 students from the University.

The conference was sponsored by Inspur, NVIDIA, SGI, Supermicro and Newwald. InsideHPC covered the event and videos can be found on www.insidehpc.com. The presentations from the conference can be found on http://www.hpcadvisorycouncil.com/events/2014/brazil-workshop/agenda.php

For me it was my first visit in Brazil. Probably would be better to do it one month after (the world cup….) but still, was happy to be there. Great people, great food and increase usage of HPC for many applications.

I want to thank Alexandre Ramos from the University of Sao Paulo that helped us with organizing the conference.

HPCAC_Brazil_2014

Gilad Shainer