HOME

TheInfoList



OR:

XtreemFS is an object-based, distributed file system for wide area networks.F. Hupfeld, T. Cortes, B. Kolbeck, E. Focht, M. Hess, J. Malo, J. Marti, J. Stender, E. Cesario
"XtreemFS - a case for object-based storage in Grid data management"
VLDB Workshop on Data Management in Grids. In: Proceedings of 33rd International Conference on Very Large Data Bases (VLDB) Workshops, 2007.
XtreemFS' outstanding feature is full (all components) and real (all failure scenarios, including network partitions)
fault tolerance Fault tolerance is the property that enables a system to continue operating properly in the event of the failure of one or more faults within some of its components. If its operating quality decreases at all, the decrease is proportional to the ...
, while maintaining
POSIX The Portable Operating System Interface (POSIX) is a family of standards specified by the IEEE Computer Society for maintaining compatibility between operating systems. POSIX defines both the system- and user-level application programming inte ...
file system semantics. Fault-tolerance is achieved by using Paxos-based
lease A lease is a contractual arrangement calling for the user (referred to as the ''lessee'') to pay the owner (referred to as the ''lessor'') for the use of an asset. Property, buildings and vehicles are common assets that are leased. Industr ...
negotiation algorithms and is used to replicate files and metadata.
SSL SSL may refer to: Entertainment * RoboCup Small Size League, robotics football competition * ''Sesame Street Live'', a touring version of the children's television show * StarCraft II StarLeague, a Korean league in the video game Natural language ...
and X.509 certificates support make XtreemFS usable over public networks. XtreemFS has been under development since early 2007. A first public release was made in August 2008. XtreemFS 1.0 was released in August 2009. The 1.0 release includes support for read-only replication with failover, data center replica maps, parallel reads and writes, and a native Windows client. The 1.1 added automatic on-close replication and POSIX advisory locks. In mid-2011, release 1.3 added read/write replication for files. Version 1.4 underwent extensive testing and is considered production-quality. An improved
Hadoop Apache Hadoop () is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage ...
integration and support for SSDs was added in version 1.5. XtreemFS is funded by the European Commission's IST programme. The original XtreemFS team founde
Quobyte
Inc. in 2013. Quobyte offers a professional storage system as a commercial product.


Features

* Secure connections to
Contrail (software) Contrail was a cloud federation computing project that ran from 1 October 2010 until 31 January 2014. Contrail produced open-source cloud stack software including Security, PaaS components, Distributed file system, Application Lifecycle managemen ...
Alt URL
/ref> * Clients for Linux, Windows and OS X * Open source (New BSD License since release 1.3) * Cross-site file replication with auto-failover * Partial replicas, objects fetched on demand *
POSIX The Portable Operating System Interface (POSIX) is a family of standards specified by the IEEE Computer Society for maintaining compatibility between operating systems. POSIX defines both the system- and user-level application programming inte ...
compatibility * Plugins for authentication policies, replica selection *
RAID0 In computer storage, the standard RAID levels comprise a basic set of RAID ("redundant array of independent disks" or "redundant array of inexpensive disks") configurations that employ the techniques of striping, mirroring, or parity to create la ...
( striping) with parallel I/O over stripesJ. Stender, B. Kolbeck, F. Hupfeld, E. Cesario, E. Focht, M. Hess, J. Malo, J. Marti
"Striping without Sacrifices: Maintaining POSIX Semantics in a Parallel File System"
1st USENIX Workshop on Large-Scale Computing (LASCO '08), Boston, 2008
* Read-only replication * Security (
SSL SSL may refer to: Entertainment * RoboCup Small Size League, robotics football competition * ''Sesame Street Live'', a touring version of the children's television show * StarCraft II StarLeague, a Korean league in the video game Natural language ...
, X.509 certificates) * Servers for Linux and Solaris Natively and Non-Native Windows Java & ANT based server. * experimental file system driver for
Hadoop Apache Hadoop () is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage ...
(added in version 1.2)


Use cases

* as a filer replacement (home directories and group shares), * in HPC cluster, * in
Hadoop Apache Hadoop () is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage ...
clusters, * for VM block storage * cross-branch data sharing * and many more use cases, all in a single system.


See also

* List of file systems, the distributed parallel fault-tolerant file system section *
Grid computing Grid computing is the use of widely distributed computer resources to reach a common goal. A computing grid can be thought of as a distributed system with non-interactive workloads that involve many files. Grid computing is distinguished from ...
* XtreemOS * BeeGFS


References


External links


XtreemFS website

XtreemFS project on GitHub.com
{{DEFAULTSORT:Xtreemfs Distributed file systems Distributed file systems supported by the Linux kernel Network file systems Userspace file systems Software using the BSD license