AI
Google Pits Dataflow Against Spark
It is almost without question that search engine giant Google has the most sophisticated and scalable data analytics platform on the planet. …
Spark
Compute
Spark On Superdome X Previews In-Memory On The Machine
As readers of The Next Platform are well aware, Hewlett Packard Enterprise is staking a lot of the future of its systems business on The Machine, which embodies the evolving concepts for disaggregated and composable systems that are heavy on persistent storage that sometimes functions like shared memory, on various kinds of compute, and on the interconnects between the two. …
Control
Tachyon Caching Is Bigger Than Spark In-Memory
When the founding committer of the Spark in-memory computing framework becomes the CEO of a company that has dropped out of stealth mode and will very likely soon be offering support for a new storage caching layer for the modern, distributed computing era that will span beyond Spark, you have to stop and take notice. …
AI
Hadoop, Spark, Deep Learning Mesh on Single GPU Cluster
When it comes to leveraging existing Hadoop infrastructure to extend what is possible with large volumes of data and various applications, Yahoo is in a unique position–it has the data and just as important, it has the long history with Hadoop, MapReduce and other key tools in the open source big data stack close at hand and manned with seasoned experts. …
AI
Kafka Streaming Pulled Into Converged MapR Platform
Time and again, commercial Hadoop distributor MapR Technologies has demonstrated the value of the MapR-FS file system that underpins its Hadoop stack and differentiates it, more than any other feature, from the other Hadoop platforms with which it competes. …
AI
IBM Fashions Open Source Platform for Machine Learning
It’s funny how Hadoop continues to crop up as the prime example of an open source platform that finds an early niche as an experiment in enterprise IT shops then suddenly explodes into its own vibrant ecosystem. …
Code
Exascale HPC Needs An Application Innovation Spark
Every evolution in computing hardware brings with it big challenges for software developers. …
AI
MemSQL Wants To Be The Storage Engine For Spark
The Spark in-memory processing framework that came out of the AMPLab at the University of California at Berkeley is hotter than hot. …
AI
Spark Makes Hadoop Mainstream, Cloudera Jumps In
It is probably a good thing that Doug Cutting, the creator of Hadoop, named the batch-mode data analytics product he created at Yahoo after his child’s stuffed animal rather than something specific like MapReduce Engine. …
AI
How Can IBM Power8 Win Deals Away From Intel Xeon?
This is not the first time that Big Blue has found itself the underdog in the datacenter, and it probably will not be the last time, either. …