Please use this identifier to cite or link to this item:
https://hdl.handle.net/20.500.14279/13837
Title: | Scalable near real-time failure localization of data center networks | Authors: | Outhred, Geoff Balakrishnan, Shobana Fitter, Percy Herodotou, Herodotos Ding, Bolin |
Major Field of Science: | Engineering and Technology | Field Category: | Electrical Engineering - Electronic Engineering - Information Engineering | Keywords: | data center networks;failure localization | Issue Date: | 1-Jan-2014 | Source: | 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2014; New York, NY; United States; 24 August 2014 through 27 August 2014 | Conference: | International Conference on Knowledge Discovery and Data Mining | Abstract: | Large-scale data center networks are complex - comprising several thousand network devices and several hundred thousand links - and form the critical infrastructure upon which all higher-level services depend on. Despite the built-in redundancy in data center networks, performance issues and device or link failures in the network can lead to user-perceived service interruptions. Therefore, determining and localizing user-impacting availability and performance issues in the network in near real time is crucial. Traditionally, both passive and active monitoring approaches have been used for failure localization. However, data from passive monitoring is often too noisy and does not effectively capture silent or gray failures, whereas active monitoring is potent in detecting faults but limited in its ability to isolate the exact fault location depending on its scale and granularity. Our key idea is to use statistical data mining techniques on large-scale active monitoring data to determine a ranked list of suspect causes, which we refine with passive monitoring signals. In particular, we compute a failure probability for devices and links in near real time using data from active monitoring, and look for statistically significant increases in the failure probability. We also correlate the probabilistic output with other failure signals from passive monitoring to increase the confidence of the probabilistic analysis. We have implemented our approach in the Windows Azure production environment and have validated its effectiveness in terms of localization accuracy, precision, and time to localization using known network incidents over the past three months. The correlated ranked list of devices and links is surfaced as a report that is used by network operators to investigate current issues and identify probable root causes. © 2014 ACM. | ISBN: | 978-145032956-9 | DOI: | 10.1145/2623330.2623365 | Rights: | © ACM | Type: | Conference Papers | Affiliation : | Microsoft Research Microsoft |
Publication Type: | Peer Reviewed |
Appears in Collections: | Δημοσιεύσεις σε συνέδρια /Conference papers or poster or presentation |
CORE Recommender
SCOPUSTM
Citations
10
30
checked on Mar 14, 2024
Page view(s)
299
Last Week
1
1
Last month
5
5
checked on Nov 7, 2024
Google ScholarTM
Check
Altmetric
Items in KTISIS are protected by copyright, with all rights reserved, unless otherwise indicated.