There are no greater bragging rights in supercomputing than those that come with top ten listing on the bi-annual list of the world’s most powerful systems – the Top500. And there are no countries more inclined to throw themselves (and billions) into that competition this decade than the U.S. and China.
Today, the latest results were announced (much more on those here) but notably absent, aside from the expected first exascale machine in the U.S., “Frontier” at Oak Ridge National Laboratory, are China’s results, which if published, would have shown two separate exascale-class machines.
This would have been a major mainstream news story had China decided to publicize its results – and on several fronts.
The most obvious is being first to peak and sustained exascale with double-precision floating point on the LINPACK benchmark (the metric by which supercomputing performance is gauged). Further, this would have been demonstrated on two separate systems with two separate homegrown processor and accelerator architectures. Third, this would have meant several billions in investments in supercomputing technology across two sites (hence serious commitment from the Chinese government over the long haul).
All of this would have shown that despite its own billions in technology investments in the last decade, the U.S. could not arrive first with functional performance at exascale.
Yet China kept this quiet. Well, mostly.
Instead of the press-friendly, mainstream attention HPC gets twice each year they quietly discussed the systems in papers showing real-world application performance. And also, China made sure the word got out in other ways beyond the Top500.
In late October, The Next Platform confirmed and reported that two separate exascale supercomputers – the first with such capabilities in the world – hit above both peak and sustained exascale performance according to LINPACK. Since that time, many have wondered why China would choose not to publish these results given the intensive, public rivalry to secure top system status throughout the last decade.
When we first got word of benchmark results reaching exascale back in April (the benchmark results came in in March, just before trade restrictions cracked down on those exascale facilities and vendors, incidentally), the first inklings came from a contact at a facility in China – one well known to followers of the Top500. The conversation at that time was off record and indicated displeasure that so much engineering work would not be recognized globally, which means the decision to keep results quiet was made early, if not in advance. It took another several months to get enough comprehensive information for us to publish confirmation.
Ultimately, while China might have been able to knock the long-reigning #1 “Fugaku” powerhouse in Japan out of the running, that effect too might not have the lasting impression China hoped for with these dual exascale systems.
With Every Reason to Claim Bragging Rights …
All of this reminds us of all the many reasons China would have had to publicize the results beyond the obvious – claiming the title on not just one, but two, exascale machines. This would have made China the first in the world to an HPC performance milestone that has been the subject of billions of dollars of U.S. investments over the last several years.
A public announcement via the Top500 list in either its June edition or this week would have also drawn attention to the significant material investments China has made in homegrown semiconductor, networking, and software technologies. Much more detail can be found by diving into the Sunway and Phytium architectures and manufacturing backgrounds. And while there are no “new” architectures with either exascale system, they do represent a noteworthy scalability leap, in addition to noteworthy performance in demanding HPC areas that also show the systems’ capability to do mixed-precision (good for AI/ML) and tightly-coupled FP64-driven traditional supercomputing.
Having an HPC complement to its existing large-scale compute infrastructure among companies like Alibaba, Baidu, Tencent and others in China would be another source of bragging rights. These companies are all pushing to build their own native processors, accelerators, and software ecosystems. Having the supercomputing/research side of native technologies would be further signs of strength.
On that note, China would also be able to showcase systems that can handle both general-purpose HPC as well as emerging AI. When results were released for the quantum simulation work on the Sunway system, we believe China was not just showing real-world, tightly coupled HPC performance, but also that it could handle complex mixed precision workloads, which are common in AI (FP16, Int-8, etc). In short, it would be touting both AI and simulation capabilities – a valuable aspect for all emerging large systems – and all without the conventional Nvidia or AMD GPUs as U.S. and European systems deploy for AI, low precision capabilities.
And this may seem minor to those outside supercomputing – but think about it: In addition to showing technological prowess and scalability of multiple homegrown architectures, there is also the lost ability to show the hard work on the part of teams in China, often over a thousand throughout an entire cutting-edge system coming to life (manufacturers, designers, architects, programmers, sysadmins, etc.). That these HPC professionals did not have a chance to celebrate such a milestone on the international stage is a shame. Heated disputes between nations or not, let’s not forget these are people – many of whom have spent careers working toward this coveted goal. This does matter, even if the bigger international picture obscures it.
Competitive Strategy, Perception, and Of Course, Politics
While we have not confirmed a direct, single reason, we have gathered a multitude of views over the last couple of weeks from national lab HPC leads in the U.S., Japan, and Europe, all of whom agreed the lack of publicization is unexpected and baffling but is, generally speaking, purely political. However, given the nuanced views politically and technically, we do have some ideas.
As mentioned above, there could simply be some strategic silence on China’s part for competitive purposes. The Chinese government, which backed these systems to the tune of billions of dollars (not just the design and build but ongoing facilities and power), likely had the final say in the strategic announcement (or lack thereof) of the machines.
What is most interesting is that instead of listing on the Top500, the teams confirmed the systems’ existence through Gordon Bell Prize paper submissions. For reference, this is the most coveted award in supercomputing beyond top system status via the Top500. With its submissions for the Sunway system in particular, these submissions established the machines exist and are in production as well as showcasing performance and scalability – albeit with a cherry-picked set of applications.
That establishes that China was eager to show “real-world” production and use of these systems over claiming the highly publicized top place on the Top500 and crown for first to reach exascale. In short, they get the recognition for technical merit without putting system specs out there for LINPACK or the more real-world focused benchmarks in HPC like HPCG, Graph500, or Green500.
Since China has built systems simply to game the Top500 in the past – including a directly replicated AMD-ish looking system that was later removed from list – one might say these exascale machines are a game. But not so, according to those sources we spoke with for the original story close to the benchmark results. In that case, this is legitimate, the machines are highly capable, and that means the trade war – likely a big part of this story – is also at the heart of this lack of publicizing important results.
The timing on the most recent U.S. restrictions to bar relationships with the labs and vendors behind both exascale systems came in April, a month after benchmarks were run on each system. It is unclear whether the decision to withhold reporting on the achievement was due to waiting for the June Top500 list or for other reasons, but those we spoke with suspect the real delay was to keep from being knocked off the number one spot too quickly by the U.S..
The “Frontier” machine in the U.S. was expected to appear on today’s Top500 rankings at the top of the list, well above either of China’s systems. If China listed in June or for today’s list, assuming “Frontier” had taken the slot followed by “Aurora” at Argonne (with projected 2+ exaflops peak) it would only hold top placement for a relatively short time. That’s important considering the lifespan of these large machines (five years on average) and the potential for new machines to further supplant China, pushing its systems further down the list.
The semiconductor shortage was not expected to impact big systems as much as it did and China likely did not see “Frontier” being off the November list for that reason.
One of the opinions we gathered about why China chose silence one stands out as a bit “out there” on the surface but is worth repeating: if the U.S. and Europe are hell-bent on rolling out several exascale-class systems in the next three years, and China blew its budget on being first – and on two systems to boot – it might be in its best interest to take its ball and go home. In other words, if China “won’t play Top500” anymore, which has long been a yardstick for national supercomputing competition, is that list valuable any longer?
Put yet another way, by choosing to publish prize-geared papers using the machines as a “soft announce” or running LINPACK and letting those results “accidentally” slip without ever publishing, yes China loses the big press day of the top system, but only this last time. The list as a metric is no longer international in the way it’s been for years. The tit-for-tat of top systems has bounced between the U.S. and China for years.
It’s hard to claim dominance when your only real contender won’t come to the plate.
While the Top500 has driven architectures in its decades, from around 2008, it drove competition between the U.S. and China in particular – and with a fierceness that has finally resulted in a flame-out, this time by choice.
What is clear is that China has set itself on its own nationalistic technological path. There are problems with that, not the least of which is a lack of fabs and semiconductor manufacturing prowess. All of that lies beyond its borders – for now (she said ominously). With multiple architectural options to go with, a strong hyperscale base within China to trade hardware and software tooling with, and all the political reason to stay this course for the long term, the news China didn’t make during this Top500 list is much bigger than any announcement it might have.
None of this bodes well for the future of the Top500 list, of course. While its creators have been open about its shortcomings and have built companion benchmarks like HPCG and HPC-AI, for instance, the double-precision floating point metric is less important for bandwidth-limited real-world applications. Even still, the announcement of each list has meant the world pays attention to global supercomputing and that is a big deal – especially for the national labs and organizations that rely on funding for the next big machine. The international competition, especially between the U.S. and China, has also highlighted the growing ambitions of both with HPC as a touchstone topic.
We expect that the current TaihuLight and other Chinese systems on the list will appear until they are decommissioned. And perhaps we won’t see any other top ten-class machines from China for some time, perhaps years. Not because it doesn’t have them, but because it will chose other paths to publicizing.
Competing in public international competition would not just mean officially publicizing the existence of technics but also putting them under scrutinization. And they do not want to give it away. AI and HPC capabilities are the new ‘cold war’ and you’re not going to show the enemy all you’re guns. Where all the world is familiar with the Nvidia AMD and Intel CPU and GPU techniques (so are the Chinese) they create their own weapons and ammunition.
I have a better idea….
maybe it’s a case of “garbage in, garbage out” as is pretty typical with China these days. I suspect that they didn’t achieve what they claim to have achieved.
The US should keep quiet on weapons that are built here so that the other side doesn’t counter them. Russia and China do so why not us. As long as the US says we got it covered when the other side shows off new weapons, I’ll be satisfied. Stop giving the other side a chance to look at what we have so we can stay on top
It is obvious why the Chinese researchers choose to not publish their latest supercomputer progress. Any world-class achievements invite scrutiny from the US government and subsequent sanctions or addition to the Entity List. It is unfortunate that politics has an outsized impact in hindering the technological transparency.
US will sanction Chinese company or scientist who involved in the project. Silent is only peace for China.
Your probably pulled that outta your a$$ since the US constantly employs qualified scientists from other countries regardless of politics. This goes way back from operation paperclip. China is bound to fail as they always do, since they practice isolationism (a mix of nationalist communism) and this is mathematically bound to lead in decelerating science. Hope they open up to the world as they’re very smart people.
Westerners have been saying China would fail for decades with no result. Yet your own country and infrastructure is falling apart.
Decelerating science? Do you have any idea on what id actually going on with western companies flocking to China?
Compared to Americans that keep bombing 3rd world countries, China is actually doing something to improve people’s lives unlike backwards countries where poor healthcare leads to a million deaths. Guess that is the new American innovation.
After more than 70 years of continuous development, New China has been able to compete with the United States as a superpower in the field of cutting-edge technology. If you insist that China has slowed down its scientific and technological progress due to so-called “political system” issues, then the United Kingdom, the United States, and a series of countries that have been constantly overtaken by China, as well as slow developing regions such as Africa and India, Their technology is indeed accelerating rapidly. The so-called century long accumulation of science and technology, which Western scholars are proud of, appears so shallow under the socialist system that there will soon be more breakthroughs in many fields. This is a fact that the US government has to admit, as they have listed China as a comprehensive competitor. China has been implementing the socialist political system for more than 70 years, perhaps this is what you call “deceleration”.
There is no China exascale supercomputer, China regime CCP finds it as a humilation for their country so they choose to spread false/fake claims to protect their own so called dignity, people who believe China’s story of having an exascale supercomputer and the propaganda of choosing not to make it official or keeping it as a secret, basically have no idea how China regime works.
There are doubts about the definition of exaFLOPS, whether it means nominal performance R_{Peak} or payload performance R_{Max}; measured by which benchmark (and which real-life workload). There are limits for of supercomputers’ PAYLOAD performance, simply due to the laws of nature: the speed of light (and EM waves) is finite.
https://www.researchgate.net/publication/228367369_Reevaluating_Amdahl's_law_and_Gustafson's_law
https://link.springer.com/article/10.1007/s11227-020-03210-4
Formerly,
https://www.scmp.com/tech/policy/article/3015997/china-has-decided-not-fan-flames-super-computing-rivalry-amid-us
referring to political decision. Now they simply keep secret.
Around exascale, the limits approached. Only trial and error development goes on, see for example Aurora, Gyoukou, Fugaku, SpiNNaker, etc.
Yes, there is no China exascale supercomputer. There is no US exascale supercomputer, however. Have a look at
https://www.hpcwire.com/2022/05/30/top500-exascale-is-officially-here-with-debut-of-frontier/
Their first figure shows a ramp on the right side, and a narrow step on the left side. If it would be a similar ramp at the beginning of computing (to collect and distribute data at the beginning and at the end needs the same bus system, and the same behavior), the averaged efficiency would be below 1 eFLOPS. So, they have built a 2nd specialized hidden “supercomputer” just for distributing the data at the beginning. As
https://www.nextplatform.com/2022/05/30/frontier-step-by-step-over-decades-to-exascale/
noticed:
“As configured for the Linpack run, the Frontier system had a power draw of 21.1 megawatts, but
when the Frontier machine is first set loose on the Linpack, it draws an extra 15 megawatts of power as it is starts the job.”
(driving the I/O ports needs power, and that 2nd supercomputer draws some 15 MW extra power for the firs few minutes while the visible supercomputer makes zero FLOPS.). However, if this 2nd supercomputer would be visible, with its 36 MW power consumption it would not be “green” any more.
BTW, this one-time trick work for HPL only; see its HPCG efficiency.