Please use this identifier to cite or link to this item: https://hdl.handle.net/20.500.14279/13837
Title: Scalable near real-time failure localization of data center networks
Authors: Outhred, Geoff 
Balakrishnan, Shobana 
Fitter, Percy 
Herodotou, Herodotos 
Ding, Bolin 
Major Field of Science: Engineering and Technology
Field Category: Electrical Engineering - Electronic Engineering - Information Engineering
Keywords: data center networks;failure localization
Issue Date: 1-Jan-2014
Source: 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2014; New York, NY; United States; 24 August 2014 through 27 August 2014
Conference: International Conference on Knowledge Discovery and Data Mining 
Abstract: Large-scale data center networks are complex - comprising several thousand network devices and several hundred thousand links - and form the critical infrastructure upon which all higher-level services depend on. Despite the built-in redundancy in data center networks, performance issues and device or link failures in the network can lead to user-perceived service interruptions. Therefore, determining and localizing user-impacting availability and performance issues in the network in near real time is crucial. Traditionally, both passive and active monitoring approaches have been used for failure localization. However, data from passive monitoring is often too noisy and does not effectively capture silent or gray failures, whereas active monitoring is potent in detecting faults but limited in its ability to isolate the exact fault location depending on its scale and granularity. Our key idea is to use statistical data mining techniques on large-scale active monitoring data to determine a ranked list of suspect causes, which we refine with passive monitoring signals. In particular, we compute a failure probability for devices and links in near real time using data from active monitoring, and look for statistically significant increases in the failure probability. We also correlate the probabilistic output with other failure signals from passive monitoring to increase the confidence of the probabilistic analysis. We have implemented our approach in the Windows Azure production environment and have validated its effectiveness in terms of localization accuracy, precision, and time to localization using known network incidents over the past three months. The correlated ranked list of devices and links is surfaced as a report that is used by network operators to investigate current issues and identify probable root causes. © 2014 ACM.
ISBN: 978-145032956-9
DOI: 10.1145/2623330.2623365
Rights: © ACM
Type: Conference Papers
Affiliation : Microsoft Research 
Microsoft 
Publication Type: Peer Reviewed
Appears in Collections:Δημοσιεύσεις σε συνέδρια /Conference papers or poster or presentation

CORE Recommender
Show full item record

SCOPUSTM   
Citations 10

30
checked on Mar 14, 2024

Page view(s) 10

301
Last Week
1
Last month
5
checked on Nov 21, 2024

Google ScholarTM

Check

Altmetric


Items in KTISIS are protected by copyright, with all rights reserved, unless otherwise indicated.