Please use this identifier to cite or link to this item:
https://hdl.handle.net/20.500.14279/10295
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kakoulli, Elena | - |
dc.contributor.author | Herodotou, Herodotos | - |
dc.date.accessioned | 2017-10-17T11:11:12Z | - |
dc.date.available | 2017-10-17T11:11:12Z | - |
dc.date.issued | 2017-05 | - |
dc.identifier.citation | Proceedings of the 2017 ACM International Conference on Management of Data, pp. 65-78 | en_US |
dc.identifier.isbn | 9781450341974 | - |
dc.identifier.uri | https://hdl.handle.net/20.500.14279/10295 | - |
dc.description.abstract | The ever-growing data storage and I/O demands of modern large-scale data analytics are challenging the current distributed storage systems. A promising trend is to exploit the recent improvements in memory, storage media, and networks for sustaining high performance and low cost. While past work explores using memory or SSDs as local storage or combine local with network-attached storage in cluster computing, this work focuses on managing multiple storage tiers in a distributed setting. We present OctopusFS, a novel distributed file system that is aware of heterogeneous storage media (e.g., memory, SSDs, HDDs, NAS) with different capacities and performance characteristics. The system offers a variety of pluggable policies for automating data management across the storage tiers and cluster nodes. The policies employ multi-objective optimization techniques for making intelligent data management decisions based on the requirements of fault tolerance, data and load balancing, and throughput maximization. At the same time, the storage media are explicitly exposed to users and applications, allowing them to choose the distribution and placement of replicas in the cluster based on their own performance and fault tolerance requirements. Our extensive evaluation shows the immediate benefits of using OctopusFS with data-intensive processing systems, such as Hadoop and Spark, in terms of both increased performance and better cluster utilization. | en_US |
dc.format | en_US | |
dc.language.iso | en | en_US |
dc.rights | © ACM | en_US |
dc.subject | Cluster computing | en_US |
dc.subject | Data handling | en_US |
dc.subject | Digital storage | en_US |
dc.subject | Distributed computer systems | en_US |
dc.subject | Distributed database systems | en_US |
dc.subject | Fault tolerance | en_US |
dc.subject | File organization | en_US |
dc.subject | Molluscs | en_US |
dc.subject | Multiobjective optimization | en_US |
dc.subject | Multiprocessing systems | en_US |
dc.subject | Storage management | en_US |
dc.title | OctopuSFS: A distributed file system with tiered storage management | en_US |
dc.type | Conference Papers | en_US |
dc.collaboration | Cyprus University of Technology | en_US |
dc.subject.category | Electrical Engineering - Electronic Engineering - Information Engineering | en_US |
dc.country | Cyprus | en_US |
dc.subject.field | Engineering and Technology | en_US |
dc.publication | Peer Reviewed | en_US |
dc.relation.conference | International Conference on Management of Data | en_US |
dc.identifier.doi | 10.1145/3035918.3064023 | en_US |
dc.identifier.scopus | 2-s2.0-85021250778 | - |
dc.identifier.url | https://api.elsevier.com/content/abstract/scopus_id/85021250778 | - |
dc.contributor.orcid | #NODATA# | - |
dc.contributor.orcid | #NODATA# | - |
dc.relation.volume | Part F127746 | en_US |
cut.common.academicyear | 2016-2017 | en_US |
item.languageiso639-1 | en | - |
item.cerifentitytype | Publications | - |
item.fulltext | No Fulltext | - |
item.grantfulltext | none | - |
item.openairetype | conferenceObject | - |
item.openairecristype | http://purl.org/coar/resource_type/c_c94f | - |
crisitem.author.dept | Department of Electrical Engineering, Computer Engineering and Informatics | - |
crisitem.author.dept | Department of Electrical Engineering, Computer Engineering and Informatics | - |
crisitem.author.faculty | Faculty of Engineering and Technology | - |
crisitem.author.faculty | Faculty of Engineering and Technology | - |
crisitem.author.orcid | 0000-0003-1489-807X | - |
crisitem.author.orcid | 0000-0002-8717-1691 | - |
crisitem.author.parentorg | Faculty of Engineering and Technology | - |
crisitem.author.parentorg | Faculty of Engineering and Technology | - |
Appears in Collections: | Δημοσιεύσεις σε συνέδρια /Conference papers or poster or presentation |
CORE Recommender
Items in KTISIS are protected by copyright, with all rights reserved, unless otherwise indicated.