Adaptive filter ordering in Spark
classification
💻 cs.DB
cs.DC
keywords
adaptivesparkadaptivelyapacheavailabledatadescribesdeveloped
read the original abstract
This report describes a technical methodology to render the Apache Spark execution engine adaptive. It presents the engineering solutions, which specifically target to adaptively reorder predicates in data streams with evolving statistics. The system extension developed is available as an open-source prototype. Indicative experimental results show its overhead and sensitivity to tuning parameters.
This paper has not been read by Pith yet.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.