As one of the first hyperscalers in the world, Yahoo, part of the Oath conglomerate that also includes AOL and that is owned by telecom giant Verizon, knows a thing or two about running applications at extreme scale. …
Five years ago, many bleeding edge IT shops had either implemented a Hadoop cluster for production use or at least had a cluster set aside to explore the mysteries of MapReduce and the HDFS storage system. …
When it comes to leveraging existing Hadoop infrastructure to extend what is possible with large volumes of data and various applications, Yahoo is in a unique position–it has the data and just as important, it has the long history with Hadoop, MapReduce and other key tools in the open source big data stack close at hand and manned with seasoned experts. …
In the decade that Hadoop has been a force, first as an independent research endeavor, then as a project at Yahoo, before moving swiftly into Facebook, LinkedIn, and other webscale datacenters, the entire data landscape changed. …
Without discounting the extraordinary amount of work and creativity that goes into developing the next big architectural trend, there is something to be said for being at the right place at the right time—and having the perfect blend of the correct skills and experiences to meet the moment. …
There are few more interesting trends in infrastructure right now than the pairing between high performance computing hardware and the software tapestries of deep neural networks. …
The hyperscale giants can’t wait for the IT industry to invent the technologies that they need for their own applications, but when the time is right an open source alternative grows up and out enough, they will often make the jump from their own software to another stack. …
All Content Copyright The Next Platform