Code
ConocoPhillips Sparks Tooling For Seismic HPC, Cloud, AI/ML
Seismic processing and analysis at scale take scalable HPC resources but also need an analytics backend that can scale with massive datasets. …
Spark
Edge
Everybody Has Big Data – How To Cope With It
Enterprises are awash in data, and though many are tempted to save it all for later analysis – after all it worked for Google for many years – the store then analyze approach is poorly suited to environments with data sources that never stop. …
Edge
Big Data In Little Spaces: Hadoop And Spark At The Edge
The advent of scalable analytics in the form of Hadoop and Spark seems to be moving to the end of the Technology Hype Cycle. …
AI
Hadoop And Spark Get A Vector Performance Boost
Ever since the “Aurora” vector processor designed by NEC was launched last year, we have been wondering if it might be used as a tool to accelerate workloads other than the traditional HPC simulation and modeling jobs that are based on crunching numbers in single and double precision floating point. …
Uncategorized
Successful Machine Learning With A Global Data Fabric
One of the most common misconceptions about machine learning is that success is solely due to its dynamic algorithms. …
AI
Easing The Pain Of Prepping Data For AI
Organizations are turning to artificial intelligence and deep learning in hopes of being able to more quickly make the right business decisions, to remake their business models and become more efficient, and to improve the experience of their customers. …
AI
Flare Gives Spark SQL a Performance Boost
Spark has grown rapidly over the past several years to become a significant tool in the big data world. …
AI
Google Pits Dataflow Against Spark
It is almost without question that search engine giant Google has the most sophisticated and scalable data analytics platform on the planet. …
Compute
Spark On Superdome X Previews In-Memory On The Machine
As readers of The Next Platform are well aware, Hewlett Packard Enterprise is staking a lot of the future of its systems business on The Machine, which embodies the evolving concepts for disaggregated and composable systems that are heavy on persistent storage that sometimes functions like shared memory, on various kinds of compute, and on the interconnects between the two. …
Control
Tachyon Caching Is Bigger Than Spark In-Memory
When the founding committer of the Spark in-memory computing framework becomes the CEO of a company that has dropped out of stealth mode and will very likely soon be offering support for a new storage caching layer for the modern, distributed computing era that will span beyond Spark, you have to stop and take notice. …