Title | A cost aware adaptive multiple table join evaluation in MapReduce |
Authors | Wang, Linqing Gao, Jun Wang, Tengjiao Li, Hongyan |
Affiliation | Key Laboratory of High Confidence Software Technologies, Peking University, Ministry of Education, China School of Electronics Engineering and Computer Science, Peking University, Beijing 100871, China |
Issue Date | 2012 |
Citation | 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2012.Chongqing, China. |
Abstract | Nowadays, MapReduce has become an effective tool for large scale data analysis. It is naturally designed for group-by aggregation tasks rather than join operator which is common in real analysis works. The existing join methods in MapReduce may earn different performances in different cases, which makes how to choose a good join plan from a join list difficult. The current static optimization can't generate an efficient evaluation plan for a given join list. In this paper, we will introduce some custom join technologies and then propose an adaptive join plan generator for multiple join depending on both rule-based model and cost-based model considering the intermediate data. ? 2012 IEEE. |
URI | http://hdl.handle.net/20.500.11897/294589 |
ISSN | 9781467300223 |
DOI | 10.1109/FSKD.2012.6233855 |
Indexed | EI |
Appears in Collections: | 高可信软件技术教育部重点实验室 信息科学技术学院 |