All posts by Cecelia Taylor

Intersect360 Research Presents HPC & Hyperscale Trends @ Stanford Conference 2016 – 24-25 February

Guest post by:  Addison Snell, Intersect360 Research


By now it’s well-established that we have entered a new era for high performance computing. The industry is in a state of flux, evolving around new markets, new users, new applications, and new technologies. As these new demands affect product directions and the real-life problems they aim to address, there is an increasing need to compare outlooks and evaluations, with an eye to the future of hyperscale and HPC.


The HPC Advisory Council has taken the lead in bringing together gatherings across the international HPC community, and Intersect360 Research has partnered with the organization to link our ongoing research to this burgeoning conference series. At the next HPCAC workshop, taking place at Stanford University, February 24-25, 2016, I will present an overview of some of our newest research on the trends and dynamics changing our industry.


Of particular importance is the evolution of the hyperscale market, and its influence on HPC. Intersect360 Research has tracked “ultrascale internet” as an HPC segment since 2007, looking at the consumption of scalable technologies by companies like Google, Microsoft, and Facebook. Today many other companies are involved, including Chinese giants like Baidu, Alibaba, Tencent, and Qihoo, but beyond that, hundreds of other companies are part of this growing market. Going forward, we are tracking hyperscale as the deployment of web-scale application infrastructures that are independent from normal enterprise operations, with examples in social media, retail, telecom, transaction processing, and more.


There is still significant influence between HPC and hyperscale, in both directions, most notably in the areas of cognitive computing and artificial intelligence, where research at some of the top hyperscale companies leads the field. Standards like Open Compute Project, OpenStack, and Beiji/Scorpio also can drive acquisition decisions at traditional HPC-using organizations. Big data and analytics also transcend both HPC and hyperscale, driving I/O scalability in both markets. These trends are all included in the new hyperscale advisory service from Intersect360 Research.


Of course, there are also significant changes transpiring in HPC aside from hyperscale. Most notably, users are evaluating a wide range of processing technologies, including Xeon, Xeon Phi, GPU, POWER, FPGAs, ARM, and more. We have conducted a new study that dives deep into the usage and evaluation of these myriad options, along with related interconnect technologies like CAPI, NVlink, InfiniBand, and OmniPath. We’re also continuing to track changes in budget allocations, the growth of commercial uses of HPC, and the evolution of cloud computing in HPC.


All of these topics will be explored at the Stanford Conference, not only in my presentation but across the arc of the two-day event. View the agenda and register for the conference: I hope to see you there and at other HPCAC events in the near future!

Addison Snell

Data Science Summit 2016: Call for Participation


Join us July 12-13, 2016 in SF for the 5th annual Data Science Summit. The Summit brings together 1400 developers and data scientists for talks and tutorials by the top minds in industry and research. Learn to leverage the best new advances in data science and applied machine learning, and discover how industry greats are building the next generation of data products and intelligent applications.


This non-profit event is organized jointly by Intel, Dato and O’Reilly. The conference agenda has been co-created with Dr. Ben Lorica, Chief Scientist of O’Reilly Media who serves as the content manager of the O’Reilly Strata Conferences.


Preliminary speakers, more coming soon…


  • Alex Smola – Carnegie Mellon University & Marianas Labs
  • Xavier Amatriain – Quora
  • Carlos Guestrin – Dato & University of Washington
  • Wes McKinney – Cloudera
  • Magdalena Balazinska – University of Washington
  • Anthony Goldbloom – CEO Kaggle
  • Mike Jordan – UC Berkeley
  • Kevin Novak – Uber
  • Chris Re – Stanford University


We invite all related companies and research labs to submit talks about novel case studies, algorithms and applications.  There are flexible sponsorship options for companies who want to get involved.


Expected audience: 1400 data scientists, developers, researchers, CTOs, VPs of Engineering and Product, VPs of data analytics, professors and students.


Date & Location: July 12-13, 2016 at the Fairmont San Francisco Hotel


Registration is open – please use this 20% off discount code when registering: hpccouncil20.

2015 HPCAC-ISC Student Cluster Competition

2015 hero-banner-blank
The 4th annual HPCAC-ISC Student Cluster Competition (SCC) is a joint event hosted by the HPC Advisory Council (HPCAC) and the organizers of the International Supercomputing Conference (ISC). It is an excellent opportunity to showcase students’ HPC expertise in a friendly yet spirited competition. The SCC event will be held during the ISC’15 Conference and Exhibition in Frankfurt, Germany from July 13 to 15, 2015.

The competition will feature small teams that compete to demonstrate the incredible capabilities of state-of-the-art high-performance cluster hardware and software. In a real-time challenge, it will feature 11 teams of six undergraduate students from around the world to showcase the small clusters of their own design on the ISC’15 exhibit floor. In this three-day event, the university teams will race to demonstrate the greatest performance across a range of HPC benchmarks and applications. The participating teams for this year’s competition at ISC’15 are:

  1. Centre for High Performance Computing (CHPC), South Africa
  2. Purdue University and Universidad EAFIT, United States and Colombia
  3. Chemnitz University of Technology, Germany
  4. University of Science and Technology of China (USTC), China
  5. University of São Paulo (USP), Brazil
  6. University of Hamburg, Germany
  7. Jamia Millia Islamia University (JMI), India
  8. University of Tartu, Estonia
  9. Universitat Politecnica de Catalunya (UPC), Spain
  10. Tsinghua University, China
  11. National University of Defense Technology (NUDT), China


The students will have a unique opportunity to learn, experience and demonstrate how HPC can influence our world and day-to-day learning. This experience will help them enhance their knowledge and will become useful for their professional careers. The selected applications for the competition come from different areas of sciences that use HPC:


  • LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. LAMMPS has potentials for solid-state materials (metals, semiconductors) and soft matter (biomolecules, polymers) and coarse-grained or meso-scopic systems. It can be used to model atoms or, more generically, as a parallel particle simulator at the atomic, meso, or continuum scale. LAMMPS runs on single processors or in parallel using message-passing techniques and a spatial-decomposition of the simulation domain. LAMMPS is distributed as an open source code under the terms of the GPL.


  • PyFR is an open-source Python based framework for solving advection-diffusion type problems on streaming architectures using the Flux Reconstruction approach of Huynh. The framework is designed to solve a range of governing systems on mixed unstructured grids containing various element types. It is also designed to target a range of hardware platforms via use of an in-built domain specific language derived from the Mako templating engine.


  • Octopus is a scientific program aimed at the ab initio virtual experimentation on a hopefully ever-increasing range of system types. Electrons are described quantum-mechanically within density-functional theory (DFT), in its time-dependent form (TDDFT) when doing simulations in time. Nuclei are described classically as point particles. Electron-nucleus interaction is described within the pseudo potential approximation.


There will be secret applications announced on each day of the competition. The intent is to present challenging problems for the teams, thus good teamwork within members of each team is required to analyze and solve the unfamiliar workload.




The teams will have a constraint of power limited to 3 kW on their cluster configuration. The power draw from their compute cluster will have to stay under the 3 KW power limit. Aside from that, it is up for the team to use any of the hardware they can get from their equipment sponsors on the hardware side, as well as any compilers, software and operating systems level tuning they may deploy on the software stack to achieve the best application performance.


It all concludes with a ceremony on the main conference keynote stage to award and recognize all student participants in front of thousands of HPC luminaries. In the end, there will be five awards given:

  • Highest LINPACK, for the highest score received for the LINPACK benchmark under the power budget.
  • Fan Favorite, to be given to the team which receives the most unique votes from ISC participants during the Student Cluster Competition.
  • 1st, 2nd and 3rd Place Overall Winners, for the 3 overall winner awards given to the teams that are determined by the scoring of all the chosen HPC applications, benchmarks, as well as judging by the panel of HPC experts during the interview sessions.


For more information, please visit:

ISC Big data logo

ISC Big Data 2014: From Data to Knowledge

The ISC Big Data Conference will be held this fall in Heidelberg, Germany, October 1-2, 2014.  This second annual big data conference will present attendees with the latest developments in data-centric computing from both industry players and researchers. The conference will explore all aspects of that data-to-knowledge path.

The conference will kick off on Wednesday, October 1, with a keynote entitled “The Internet of Things,” presented by Dirk Slama of Bosch Software Innovations. The second conference keynoter, Stefan Wrobel of the Fraunhofer Institute for Intelligent Analysis will talk about “Big Data – Successes and Challenges beyond the Hype.”

Continue reading

The HPC Advisory Council Spain Conference 2014

HPC Spain 2014 eblast_header

The HPC Advisory Council along with the University of Cantabria will host the HPC Advisory Council Spain Conference 2014 at the Aula Magna de la Facultad de Ciencias de la Universidad de Cantabria in Santander, Spain on September 24, 2014.

This year’s workshop will focus on High-Performance Computing essentials, new developments, emerging technologies, best practices and hands-on training. Some of the sessions to be presented:

Continue reading

Graph Lab Conference 2014

GraphLab Conference 2014

The GraphLab Conference is a non-profit event organized by the open source branch of GraphLab, to promote graph/big data analytics technologies in industry. This year it will be the largest trade-show of graph based systems and large scale machine learning.   The event will take place on Monday July 21, 2014 in San Francisco.

In 2013, we had 85% industry and 15% research labs and universities (around 570 data scientists, CTO, architects etc.). Last year’s videos are here. More than 900 data scientists, software engineers and big data analytics thinkers are expected to be in attendance.

GraphLabConference panorama

To date, we have received confirmations from the following companies Trifacta, Google, Microsoft, Datapad, Databricks (Spark), Pandora, Cloudera, Pivotal, Lab41, CMU and Adobe  for oral presentations.

Other organizations will provide demos, including:  GraphLab, Quantifind, bigML, Skytree, YarcData, Neo Technology, Franz, Atigeo, Georgia Tech, Alpine Data Labs, Cambridge Intelligence,,, RapidMiner, Sqrrl, Grappa, Objectivity, Ayasdi, Aurelius, Sense, Petuum, Tom Sawyer Software, Oracle, iPython, Continuum Analytics,  Systap, EPPICS, Sparsity Technologies, Domino Data Labs, Graphistry, Zipfian Academy, Telefonica, 0xdata, Cenzari (MusicGraph), Pacific Northwest National Lab, Zementis, Linkurious, ectML, CrossWise, Royal Caliber, Simularity, Ravel Law, Cytospace, Sumo Logic, Lumiata.  View the full list of exhibitors here.

The event will be held July 21, 2014 at the Hotel Nikko, 222 Mason Street, San Francisco, CA 94102.   Registration is open now. Get your conference tickets today!

HPC Training in Tel Aviv

PRACE Winter School 2014

Recognizing that HPC is one of the most important tools for innovative research, Israel became one of 25 nations to join the Partnership for Advanced Computing in Europe (PRACE) in January 2013. Israel’s Inter-University Computation Center (IUCC-MACHBA) represents Israel in the partnership.

IUCC plays an active role in several PRACE working groups, among them training, and is proud to host the PRACE 2014 Winter School in Tel Aviv. This brings international hands-on HPC training to Israel for the first time.

The 2014 Winter School will open on February 10 with a unique half-day workshop entitled “The Future of HPC: Israeli Innovation.” Researchers from throughout Israel and Europe will be attending the advanced HPC training sessions, and this opening workshop is a special opportunity to bring users and developers together to learn more about the Israeli technologies that power HPC research infrastructures.

The “Future of HPC” half-day workshop includes lectures from some of the leading experts in HPC technologies from industry and academia, with a focus on trends on the future of HPC technologies over the next five years.

For more information and to register please visit or send an email to