| Title | BDTune: Hierarchical Correlation-based Performance Analysis and Rule-based Diagnosis for Big Data Systems |
| Authors | Ren, Rui Jia, Zhen Wang, Lei Zhan, Jianfeng Yi, Tianxu |
| Affiliation | Chinese Acad Sci, Univ Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China. Peking Univ, Sch Software & Microelect, Beijing, Peoples R China. |
| Keywords | Big Data Systems Correlation-based Analysis Bottleneck Detection Root Causes Diagnosis |
| Issue Date | 2016 |
| Publisher | 4th IEEE International Conference on Big Data (Big Data) |
| Citation | 4th IEEE International Conference on Big Data (Big Data).2016,555-562. |
| Abstract | Although big data systems are in widespread use and there have much research efforts for improving big data systems performance, efficiently analysing and diagnosing performance bottlenecks over these massively distributed systems remain a major challenge. In this paper, we propose a hierarchical correlation-based analysis and rule-based diagnostic approach for big data systems. The key approaches lie in identifying performance bottlenecks, classifying root causes, analyzing performance according to multi-level performance metrics, and setting diagnostic rules for performance tuning. Based on this approach, we have implemented BDTune-a lightweight, extensible and transparent tool that can provide valuable insights into performance of big data applications with a very low overhead. We also report our experience on how to use BDTune to conduct performance analysis and performance bottlenecks diagnosis, and demonstrate BDTune can help users find the performance bottlenecks and provide optimization recommendations. |
| URI | http://hdl.handle.net/20.500.11897/470185 |
| Indexed | CPCI-S(ISTP) |
| Appears in Collections: | 软件与微电子学院 |
