Title | An Adaptive Skew Insensitive Join Algorithm for Large Scale Data Analytics |
Authors | Liao, Wenjing Wang, Tengjiao Li, Hongyan Yang, Dongqing Qiu, Zhen Lei, Kai |
Affiliation | Peking Univ, Sch Elect & Comp Engn ECE, Shenzhen 518055, Peoples R China. Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China. |
Keywords | large-scale data analytics join skew adaptive |
Issue Date | 2014 |
Citation | WEB TECHNOLOGIES AND APPLICATIONS, APWEB 2014.8709(494-502). |
Abstract | With data explosion in recent years, timely and cost-effective analytics over large scale data has been a hotspot of data management research. Join is an important operation in database query. However, data skew happens naturally in many applications, which will severely degrade the performance of most join algorithms. To address this problem, this paper introduces an Adaptive Skew Insensitive(ASI) join algorithm to handle with serious data skew. Based on our cost analysis, ASI join algorithm can adaptively choose the best join algorithm for different inputs. Compared with several state-of-the-art join methods through adequate experiments, our method achieves significant improvement of join efficiency dealing with data skew. |
URI | http://hdl.handle.net/20.500.11897/405638 |
ISSN | 0302-9743 |
DOI | 10.1007/978-3-319-11116-2-44 |
Indexed | EI CPCI-S(ISTP) |
Appears in Collections: | 信息工程学院 信息科学技术学院 |