Spark

When, at some point in the distant future, we look back to the pioneering days of the golden age of data wrangling, a number of words that sound rather ridiculous without context, like Hadoop or Mesos, will filter into the conversation. …

Although Spark has garnered a reputation as being a real-time analytics engine that is married to Hadoop, its life before being glued to that framework offers a different story. …

As a platform for doing analytics on large datasets that is much less costly than would be possible with parallel data warehouses, Hadoop and its myriad extensions and modified underpinnings has fulfilled its purpose. …