HOME

TheInfoList



OR:

XtreemFS is an
object-based The term object-based language may be used in a technical sense to describe ''any'' programming language that uses the idea of encapsulating state and operations inside ''objects''. Object-based languages need not support inheritance or subtyping, b ...
,
distributed file system A clustered file system is a file system which is shared by being simultaneously mounted on multiple servers. There are several approaches to clustering, most of which do not employ a clustered file system (only direct attached storage for ...
for wide area networks.F. Hupfeld, T. Cortes, B. Kolbeck, E. Focht, M. Hess, J. Malo, J. Marti, J. Stender, E. Cesario
"XtreemFS - a case for object-based storage in Grid data management"
VLDB Workshop on Data Management in Grids. In: Proceedings of 33rd International Conference on Very Large Data Bases (VLDB) Workshops, 2007.
XtreemFS' outstanding feature is full (all components) and real (all failure scenarios, including network partitions)
fault tolerance Fault tolerance is the property that enables a system to continue operating properly in the event of the failure of one or more faults within some of its components. If its operating quality decreases at all, the decrease is proportional to the ...
, while maintaining
POSIX The Portable Operating System Interface (POSIX) is a family of standards specified by the IEEE Computer Society for maintaining compatibility between operating systems. POSIX defines both the system- and user-level application programming interf ...
file system semantics. Fault-tolerance is achieved by using
Paxos Paxos ( gr, Παξός) is a Greek island in the Ionian Sea, lying just south of Corfu. As a group with the nearby island of Antipaxos and adjoining islets, it is also called by the plural form Paxi or Paxoi ( gr, Παξοί, pronounced in Engl ...
-based
lease A lease is a contractual arrangement calling for the user (referred to as the ''lessee'') to pay the owner (referred to as the ''lessor'') for the use of an asset. Property, buildings and vehicles are common assets that are leased. Industrial ...
negotiation algorithms and is used to replicate files and metadata. SSL and X.509 certificates support make XtreemFS usable over public networks. XtreemFS has been under development since early 2007. A first public release was made in August 2008. XtreemFS 1.0 was released in August 2009. The 1.0 release includes support for read-only replication with failover, data center replica maps, parallel reads and writes, and a native Windows client. The 1.1 added automatic on-close replication and POSIX advisory locks. In mid-2011, release 1.3 added read/write replication for files. Version 1.4 underwent extensive testing and is considered production-quality. An improved
Hadoop Apache Hadoop () is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage an ...
integration and support for SSDs was added in version 1.5. XtreemFS is funded by the European Commission's IST programme. The original XtreemFS team founde
Quobyte
Inc. in 2013. Quobyte offers a professional storage system as a commercial product.


Features

* Secure connections to Contrail (software)Alt URL
/ref> * Clients for Linux, Windows and OS X * Open source (New BSD License since release 1.3) * Cross-site file replication with auto-failover * Partial replicas, objects fetched on demand *
POSIX The Portable Operating System Interface (POSIX) is a family of standards specified by the IEEE Computer Society for maintaining compatibility between operating systems. POSIX defines both the system- and user-level application programming interf ...
compatibility * Plugins for authentication policies, replica selection * RAID0 (
striping In computer data storage, data striping is the technique of segmenting logically sequential data, such as a file, so that consecutive segments are stored on different physical storage devices. Striping is useful when a processing device request ...
) with parallel I/O over stripesJ. Stender, B. Kolbeck, F. Hupfeld, E. Cesario, E. Focht, M. Hess, J. Malo, J. Marti
"Striping without Sacrifices: Maintaining POSIX Semantics in a Parallel File System"
1st USENIX Workshop on Large-Scale Computing (LASCO '08), Boston, 2008
* Read-only replication * Security ( SSL, X.509 certificates) * Servers for Linux and Solaris Natively and Non-Native Windows Java & ANT based server. * experimental file system driver for
Hadoop Apache Hadoop () is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage an ...
(added in version 1.2)


Use cases

* as a filer replacement (home directories and group shares), * in HPC cluster, * in
Hadoop Apache Hadoop () is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage an ...
clusters, * for VM block storage * cross-branch data sharing * and many more use cases, all in a single system.


See also

* List of file systems, the distributed parallel fault-tolerant file system section *
Grid computing Grid computing is the use of widely distributed computer resources to reach a common goal. A computing grid can be thought of as a distributed system with non-interactive workloads that involve many files. Grid computing is distinguished from co ...
*
XtreemOS The Framework Programmes for Research and Technological Development, also called Framework Programmes or abbreviated FP1 to FP9, are funding programmes created by the European Union/European Commission to support and foster research in the Europea ...
* BeeGFS


References


External links


XtreemFS website

XtreemFS project on GitHub.com
{{DEFAULTSORT:Xtreemfs Distributed file systems Distributed file systems supported by the Linux kernel Network file systems Userspace file systems Software using the BSD license