Parallel query processing in a polystore
P Kranas, B Kolev, O Levchenko, E Pacitti… - Distributed and Parallel …, 2021 - Springer
Distributed and Parallel Databases, 2021•Springer
The blooming of different data stores has made polystores a major topic in the cloud and big
data landscape. As the amount of data grows rapidly, it becomes critical to exploit the
inherent parallel processing capabilities of underlying data stores and data processing
platforms. To fully achieve this, a polystore should:(i) preserve the expressivity of each data
store's native query or scripting language and (ii) leverage a distributed architecture to
enable parallel data integration, ie joins, on top of parallel retrieval of underlying partitioned …
data landscape. As the amount of data grows rapidly, it becomes critical to exploit the
inherent parallel processing capabilities of underlying data stores and data processing
platforms. To fully achieve this, a polystore should:(i) preserve the expressivity of each data
store's native query or scripting language and (ii) leverage a distributed architecture to
enable parallel data integration, ie joins, on top of parallel retrieval of underlying partitioned …
Abstract
The blooming of different data stores has made polystores a major topic in the cloud and big data landscape. As the amount of data grows rapidly, it becomes critical to exploit the inherent parallel processing capabilities of underlying data stores and data processing platforms. To fully achieve this, a polystore should: (i) preserve the expressivity of each data store’s native query or scripting language and (ii) leverage a distributed architecture to enable parallel data integration, i.e. joins, on top of parallel retrieval of underlying partitioned datasets. In this paper, we address these points by: (i) using the polyglot approach of the CloudMdsQL query language that allows native queries to be expressed as inline scripts and combined with SQL statements for ad-hoc integration and (ii) incorporating the approach within the LeanXcale distributed query engine, thus allowing for native scripts to be processed in parallel at data store shards. In addition, (iii) efficient optimization techniques, such as bind join, can take place to improve the performance of selective joins. We evaluate the performance benefits of exploiting parallelism in combination with high expressivity and optimization through our experimental validation.
Springer
顯示最佳搜尋結果。 查看所有結果