Please use this identifier to cite or link to this item: http://ktisis.cut.ac.cy/handle/10488/9178
Title: Towards a distributed multi-tier file system for cluster computing
Authors: Herodotou, Herodotos 
Keywords: Cache memory;Cluster computing;Data handling
Category: Electrical Engineering - Electronic Engineering - Information Engineering
Field: Engineering and Technology
Issue Date: 20-Jun-2016
Publisher: Institute of Electrical and Electronics Engineers Inc.
Source: 32nd IEEE International Conference on Data Engineering Workshops, 2016, Helsinki, Finland
metadata.dc.doi: 10.1109/ICDEW.2016.7495633
Abstract: Distributed storage systems running on clusters of commodity hardware are challenged by the ever-growing data storage and I/O demands of modern large-scale data analytics. A promising trend is to exploit the recent improvements in memory, storage media, and network technologies for sustaining high performance at low cost. While recent work explores using memory and SSDs as a cache for local storage or combining local with network-attached storage, no work has ever looked at all layers together in a distributed setting. We present a novel design for a distributed file system that is aware of heterogeneous storage media (e.g., memory, SSDs, HDDs, NAS) with different capacities and performance characteristics. The storage media are explicitly exposed to users and applications, allowing them to choose the distribution and placement of replicas in the cluster based on their own performance and fault tolerance requirements. At the same time, the system offers a variety of pluggable policies for automating data management for increased performance and better cluster utilization. We analyze the new trends and challenges that led to our application- and data-centric design choices, and discuss how those choices inspire new research opportunities for data-intensive processing systems.
URI: http://ktisis.cut.ac.cy/handle/10488/9178
ISBN: 978-150902108-6
Rights: © 2016 IEEE.
Type: Conference Papers
Appears in Collections:Δημοσιεύσεις σε συνέδρια/Conference papers

Show full item record

Page view(s) 50

34
Last Week
1
Last month
1
checked on Nov 20, 2017

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.