6 ms·
Hi all, Author here, great to see our paper on the front page today. Happy to answer any questions! Since Spark was already mentioned in the comments, you mig
by tiarkrompf 8y ago
Hi all,
Author here, great to see our paper on the front page today. Happy to answer any questions!
Since Spark was already mentioned in the comments, you might be interesting in the parallel/follow-on work we did applying similar techniques to accelerate Spark:
"Flare: Optimizing Apache Spark for Scale-Up Architectures and Medium-Size Data" (to appear at OSDI, preprint here: https://www.cs.purdue.edu/homes/rompf/papers/essertel-osdi18.pdf https://www.cs.purdue.edu/homes/rompf/papers/essertel-osdi18...)
If you're running Spark in production and are interested in trying it out, please leave your contact data here: https://flaredata.github.io https://flaredata.github.io. We're a small team and have a long waitlist, but should have some open slots in our private beta program this Fall.
Cheers,
- Tiark