Tag Archives: Best Practices

Daily HPCAC happenings in Denver during SC17!

Attending SC17 in Denver?                                                           Include HPCAC #1858 in your day!
Operating a small to medium HPC center?
Interested in learning how others are managing resources with open source tools and low risk/low overhead hardware?
Seeking answers to questions about academic service centers and cost recovery models?
Want to just talk shop with other center managers and admins?

Gather at 11:30 AM daily at HPCAC Booth #1858 for three ‘in-booth BoFs’
“HPC for the rest of us”

Stanford University’s High Performance Computing Center Director, Steve Jones, and Michigan Technological University’s Research Computing Director, Dr. S. Gowtham co-host three low-key ‘Birds of a Feather’ sessions and hold open discussions on “HPC for the rest of us” during SC17 in Denver.

Always on the lookout for innovative and interesting new ways to manage resources, join these two SMEs daily as they share their expertise and experiences from the trenches …

Tue, Nov. 14: Managing HPC systems, the ins and outs of small to medium data centers.
Wed, Nov. 15: Running an academic service center; cost recovery, staffing, and sustainability.
Thu, Nov. 16: Training; User, staff, and user training; Courses in HPC, what’s working?

Be back by 1:30 PM Thursday and the LIVE REVEAL of the 2018 SCC Team Roster
Find out which 12 teams will compete at the annual ISC-HPCAC Student Cluster Competition in June!

Join us for all this and more …

Meet the SMEs:
As Director of Stanford University’s High Performance Computing Center, Steve Jones is responsible for the academic service center and its operations, including the cost recovery model, the sole funding source for this community based initiative. Jones oversees the centers infrastructure providing compute allocations to researchers at US National Labs, industry affiliates and many others. Jones offers an introductory course on High Performance Computing, has served on numerous peer review panels and serves as co-chair and host of the annual Stanford HPC Advisory Council Conferences.

Dr. Gowtham serves as the Director of Research Computing at Michigan Technological University overseeing nearly every aspect of the university’s HPC efforts. As a Research Associate Professor in Electrical and Computer Engineering, Gowtham teaches graduate courses in Scientific Computing. He also represents Michigan Tech in the Coalition for Academic Scientific Computation, HPC Advisory Council, XSEDE Campus Champion Program and at the annual Supercomputing Conferences, developing collaborations and partnerships with industry and other academic institutions and helping students and researchers discover internship, job and funding opportunities.

HPCAC Horizon – March 2017

Spring seeds possibilities …

Spring is near and abundant with opportunities to help each other and the broader community flourish! We return to sunny Lugano for Swiss Conference 2017 (10-12 April) and much like nature blossoms anew our annual program yields entirely new sessions and SMEs amidst a few constants and surprises .. like the evening event. Last year’s funicular ascent brought the group to new heights so here’s a hint for next month … every great kick-off requires?

This perennial favorite is thanks to our pioneering co-chair and host Hussein Harake and the Centro Svizzero di Calcolo Scientifico (CSCS) in collaboration with HPCAC members and this year’s sponsors – Atos, Lenovo, NVIDIA, Huawei, IBM, Intel, Mellanox and DDN – along with leaders across the global research community. It will be a great three days! Join us, registration continues through 31 March: http://bit.ly/2lWOTID

As Winter wanes especially for California, as does its homage in song that ‘it never rains’, we extend a huge thanks to our HPCAC members – attendees, SMEs and sponsors – Huawei, IBM, Intel, Mellanox, NVIDIA and Weka.IO – along with our brilliant co-chair and host Steve Jones, the Stanford High Performance Computing Center team and Stanford University! Thank you all for your contributions to a wildly successful Stanford Conference 2017.

We enjoyed a hardy turnout at Stanford University (07-08 February) with participants from far and near willingly taking on mudslides and monsoon-like weather to share and learn! Thank you Fortran for our daily forecast … one of my favorite timely takeaways learned over two days and twenty-two sessions featuring luminaries in keynotes, best practices and industry insight talks! We got more hands-on too including our first ‘Twilight Tutorial’ where over thirty students and seasoned SMEs took on Deep Learning live! An incredible start to the year, enjoy it here: http://hpcadvisorycouncil.com/events/2017/stanford-workshop/agenda.php

June yields opportunities to cultivate the future …

Through an amazing collaboration with the ISC Group we host the annual ISC-HPCAC Student Cluster Competition (SCC) which has grown over the last six years to a global phenomenon and the model for all others! Held during the ISC High Performance Conference and Exhibition in Frankfurt, Germany (18-22 June) the 2017 competition features twelve teams of six undergraduate students from universities across China, Germany, Singapore, Spain, the UK and the US along with regional winners from Africa, China and the US who will face-off in this world championship competition which runs from Monday through Wednesday (19-21 June).

Sponsor the SCC! This important training ground helps student teams learn how to scale HPC, developing skills they’ll use throughout their careers. Give our future lift by joining us and STEM champions like Airbus and the Portland Group! SCC sponsorships are offered as multi-party Baccalaureus and Magister levels or Doceo a single sponsor exclusive. All sponsor proceeds are applied in full to support the competition and teams. Non-monetary contributions or Licentia sponsorships, providing students teams with software, tools and training in advance of the competition, are also available.

These SCC sponsorships are ‘priceless’ helping each student go from novice to HPC ace in a few short months. Plus each team member takes the skills they develop as international competitors with them through their academic years into opportunities beyond – from summer internships to full time employment – providing reciprocal benefits for would be (sponsor) employers and (student)employees long after their competitions and commencement. More at: http://hpcadvisorycouncil.com/pdf/SCC_Sponsorship_Agreement.pdf

Sponsor the ISC STEM Student Day! Seeking talent? Seeking vacancies? Complementing the SCC focus we’re also very pleased to share in an exciting new initiative being launched at ISC this year! To encourage even more students to consider careers in HPC the ISC Group will bring more than 200 regional and international STEM students together on Wednesday (21 June) for the STEM Student Day providing participants with a free platform to discover HPC and its possibilities.

Students will tour the exhibition showcase and SCC competition, attend the awards ceremony and Thomas Sterling’s conference keynote and take part in a special evening that includes a career fair and gala dinner. Please join us and encourage others to support this critical program. Find out more information by contacting nages.sieslack@isc-group.com by 15 March or visit: http://www.isc-hpc.com/stem-student-day-gala.html

Beyond brand recognition or even the philanthropic feel good a big part of the HPCAC membership, its ‘heart’ (be it securing sponsorships for conferences and competitions supporting universities, students, centers and members) is YOU the network of expertise! You are inspiring possibility, championing HPC within the community and its profound impact on and with the world at large … that’s a value being created now to benefit years from now. To you and making a world of difference daily … Grazie … Merci … Danke … תודה ….. Engraziel … Dangge… Thank you!

See you in Switzerland, Germany, points between and beyond …

Next on HPCAC Horizon …Spain, China and more .. coming soon!

Get involved, find more information, access resources, connect with experts, register for conferences, become a conference and/or competition sponsor and more … visit the HPC Advisory Council http://hpcadvisorycouncil.com/index.php

Making it meaningful …

It is indeed the most wonderful time of the year! Everyone’s readying for time with dear and near ones. At the HPCAC we’re busy getting ready for next year …

Mark your calendars, make your plans, submit topics and get registered! We’ll kick-off the New Year with the Stanford Conference, 07-08 February and if you haven’t heard, read or divined we’re accepting submissions for the Stanford Conference through the end of this month. Thanks to everyone who has submitted already, look for that notification shortly! We head over the Alps to Lugano for the Swiss Conference, 10-12 April. The deadline to submit proposals for the Swiss Conference is 02 February. And keep in mind that early bird registration ends on 31 January so get registered early to take advantage of the reduced registration fee. Conference dates, locations, etc., for the China and Spain conferences will be shared separately. Judging from the year in review the event horizon ahead promises to be exceptional … and that is all … thanks to you … ALL!!!
As we wind down 2016 … what a year it was for me, my first with the HPCAC!
I close 2016 filled with gratitude! Thank you for your support of our efforts – as conference sponsors, presenters, attendees and hosts; as our community champions liking, following, posting, sharing extending our reach further, with more influence and impact than we’ve ever seen in our history! As student teams competing in the SCC and RDMA competitions, to you, all of your team sponsors, advisors, supporters and academic institutions for encouraging your participation and to the ISC Group, our brilliant bunch of SCC collaborators and the many friends of HPCAC who package, produce, promote, post, survey, tweet, tout, volunteer, judge, share and so much more … Thank you for your help on all of the things that connect us as ‘community’.
Much like an award nominee struggles with ordering honorary mentions I too grappled with the notion of rolling credits. I want to list everyone, by name, all first – particularly since this was an entire year of firsts for me. Since that’s not realistic … I start with our wonderful hosts, by name! Thank you … Steve, Vi, Pamela and Stanford HPCC, Hussein, Tatjana, Michele and CSCS, David, Marta, Rosa, Sergi and BSC! Thank you for being wonderful hosts and amazing collaborative partners! I learned a lot, have a lot to learn still but appreciate all of you, immensely and can’t wait to do it again in just a few short weeks and months from now!
And while I won’t call all of you out by name, thank you to our brilliant line-up of SMEs who gave us your time, insights and expertise. You are all divine and I look forward to the next opportunity to gather and learn more ~ you did see the deadlines for submissions, right? Serendipitous I think! Huge thanks to all of our attendees all over the world and to everyone who sacrificed time, to travel, learn and contribute. I hope you will plan to join us again in the coming weeks ~ registration is open.
Of course none of this would be possible without the support of our HPCAC members whose generosity sponsored these opportunities throughout the year. Thank you to everyone who drove the sponsorships for championing the program within your organization and to your organizations as well! Thank you all … Bright Computing, Colfax, Cycle Computing, DDN, Dell, Huawei, iFlytek, Intel, IBM, JD.com, JZ Tech, Mellanox, Megvii, NVIDIA, Ombibond, Panasas, The Portland Group, Rescale, SGI, Seagate, Sensetime, Sugon, Supermicro, ThinkParq … and to our media and industry partners ChinaByte, DOIT, GCG, HPCWire, insideHPC, Intersect360 Research, McMahon Consulting, OrionX.net, The Next Platform, TechTarget, WatchStor.com, ZD.net China … Thank you all for making 2016 remarkable! And if I made a glaring omission, I hope you will forgive … it was one of the fastest years I’ve ever experienced. A whirlwind!
There’s a couple of people that do get called out specifically … Pak and David, my HPCAC cohorts! I wish I could give them more than a simple shout out because a thanks relative to everything they do ‘around here’ is hardly sufficient. What’s more … they do everything with a smile, still and always. They suffer me well and are about the most wonderful humans on the planet! I believe they are actually able to leap tall buildings with a single bound! Thank you fellas, for everything! I appreciate you!
I would also be remiss if I didn’t give a thanks to the extended team of creative folks who shall continue to remain nameless. Thank you for taking care of the website, updates, pages, printing, ghost writing and editing, signage, printing, shipping, logistics, finance, etc. … pretty much every day it’s all y’all that I love!
Last but certainly not least is the Chairman. Himself. I missed the award presentation for outstanding leadership, but hey, there’s the picture anyway! It really was a huge nod and awesome! Given the list of nominees … I mean you talk about the who’s who in HPC. Thanks to everyone who gave your vote for our Chair! I believe it was a well-deserved, hard-earned, long overdue recognition … more so now based on what I’ve observed over the last year in terms of travel, work, etc. That’s actually one of the reasons for being here. It’s such a privilege to collaborate with someone like Gilad, who has the same passion for this crazy amazing thing we all do … it makes it all worth it … gives it meaning!

And that is sort of what my year has been … meaningful … thanks … to ALL OF YOU! And thanks to all of you … I look forward to more … so get ready!

Wishing you and yours ~ joy!

What do you get when you mix 21st Century HPC SMEs with 1st Century BC History?

The 5th Annual Spain Conference! Hosted by the Barcelona Supercomputing Center (BSC) in partnership with the HPC Advisory Council (HPCAC) and member sponsors Dell Inc., Mellanox Technologies and DDN Storage the one day conference takes place next Wednesday in León and will feature leading collaborations taking place within and beyond Spain’s borders. This year’s agenda underscores the collaborations that are critical to deriving the ‘answer’.

We’ll meet PhD powerhouse Rosa Badia, the driving force in development of programming models for complex platforms will share insights into BSC’s Big Data initiatives. National Research prize winner and author Dr. Jose Duato, whose work influenced routing algorithm designs in Sun’s Magnum switch and supercomputing class systems IBM BlueGene/L and Cray T3E, joins from the Universitat Politècnica de València to discuss ‘rCUDA’ and ongiong developments in remote GPU virtualization including the frameworks futures in cloud computing. We’ll also welcome Álvaro Fernández González and the Fundación Centro de Supercomputación (FSCSL) – the Castiella y Llión region’s research consortium exploring everything from optimizing energy efficiency and ROI of classic HPC architectures to stimulating economic development by partnering with local industry to drive innovation into comercial R&D.

There’s also the heavy hitter line-up of technologists. Co-founder of OpenMPI and 12 year veteran of two US labs, Richard Graham will examine the Co-Design collaboration opportunities that are going to be critical in achieving new breakthroughs. Our annual Swiss Conference host, Hussein Harake joins from CSCS to share his engineering insights and parallel file system fundamentals following his in-depth evaluation of BeeGFS. We’ll also welcome Tommaso Cecchi, who joined DDN after 12 years with the Italian consortium CINECA. Cecchi does a deep dive on DDN’s Infinite Memory Engine – flash cache for PFS. Representing one of many foundation members coined (by another of our presenters) the ‘rebel alliance’, IBMer Martina Naughton reveals the force of OpenPOWER providing analysis and lessons learned from various applied research projects and the complex systems that were required to address very real world problems. Dell’s (and My Favorite) Martin Hilgeman brings perspectives of a system builder to the massively parallel performance discussion – examining the continuous advances in multi-core architectures and its impact on users and computational work.

The day starts and ends with industry insights from industry notables Dan Olds and Addison Snell, both longtime contributors to our mission – from the conferences to the student cluster competitions and so much more! DanO sheds his SCC color commentary to kick-off the day with a new take on what is seemingly the hot topic in HPC these days – High Performance Interconnects (HPI). Ever the watcher over the technology industry the former Gabriel Consulting founder’s new venture with industry strategy and research firm OrionX brings him to us for the day to expand upon their recently published analysis of the HPI market, its futures and evaluation considerations. Marking ten years of Intersect360 Research success, we commemorate this accomplishment featuring company founder and HPC veteran Addison Snell as this year’s ‘end note’ – a retrospective of the HPC industry over the last decade and predictions of what it will look like a decade from now and results from the firms most recent end-user study.

I am really excited about next week thanks to all of you – our wonderful hosts and generous sponsors, all of our presenters and participants – and your teams, organizations and yours as well! The sharing of expertise, the consideration of time and support are gifts, greatly appreciated! Having the honor of putting brilliant people together with brilliant people, where amazing things happen … is for me anyway…‘the answer’!

See you in León! If you can’t make Spain we have an incredible line-up next month as well at our China Conference! And of course save the date for Stanford (07-08 Feb, 2017) and Lugano (10-12 Apr, 2017)!

Emerging Technology ~ ‘EMiT’ 2016 ~ Register Today!

Explore the cutting edge of computing at EMiT 2016 being hosted 02-03 June, 2016 at the Barcelona Supercomputing Center.

Along with a great line-up of invited talks, registration includes a visit to the Torre Girona Chapel and conference dinner at the city harbor.

HPCAC member High End Compute (HEC) in the UK and their 2016 EMiT chair Michael Bayne invite you to meet with key figures in the emerging computing communities. Discuss cutting edge advancements in technologies and techniques. Topics will explore the latest trends in hardware development for novel computing; how to exploit emerging tech for application development and focus on new techniques, their development and how to transfer to new areas. And much more.

Additional information, agenda and registration is available at the EMiT website: www.emit.tech

Hurry and register today ~ before registration closes ~ Thursday 26 May, 2016!


HPC Applications Best Practices

Wanted to let you know that we have extended the high-performance applications best practices to:


1. Extend the applications performance, optimization and profiling guidelines to cover nearly 30 different applications, both commercial and open source – http://www.hpcadvisorycouncil.com/best_practices.php


2. We have added the first case using RoCE (RDMA over Converged Ethernet) to the performance, optimization and profiling guidelines page. It is under the same link as in item 1


3. New – installations guides – for those who asked to get a detailed description on where to get the application from, what is needed to be installed, how to install on a cluster, and how to actually run the application – it is now posted under the HPC|Works subgroup – http://www.hpcadvisorycouncil.com/subgroups_hpc_works.php. We will be focusing on open source applications, which sometime it challenging to really find this info. At the moment we have installations guides for BQCD, Espresso and NAMD, and more will come in the near future.


If you would like to propose new applications to be covered under the performance, optimization and profiling guidelines, or to be added to the installations guides, please let us know via info@hpcadvisorycouncil.com.

Best regards,