ext3, or third extended filesystem, is a
journaled file system that is commonly used by the
Linux kernel
The Linux kernel is a free and open-source, monolithic, modular, multitasking, Unix-like operating system kernel. It was originally authored in 1991 by Linus Torvalds for his i386-based PC, and it was soon adopted as the kernel for the GNU ope ...
. It used to be the default
file system
In computing, file system or filesystem (often abbreviated to fs) is a method and data structure that the operating system uses to control how data is stored and retrieved. Without a file system, data placed in a storage medium would be one larg ...
for many popular
Linux distributions.
Stephen Tweedie first revealed that he was working on extending
ext2 in ''Journaling the Linux ext2fs Filesystem'' in a 1998 paper, and later in a February 1999 kernel mailing list posting. The filesystem was merged with the mainline Linux kernel in November 2001 from 2.4.15 onward.
Its main advantage over ext2 is
journaling, which improves reliability and eliminates the need to check the file system after an unclean shutdown. Its successor is
ext4.
Advantages
The performance (speed) of ext3 is less attractive than competing Linux filesystems, such as ext4,
JFS,
ReiserFS, and
XFS, but ext3 has a significant advantage in that it allows in-place upgrades from ext2 without having to
back up and restore data. Benchmarks suggest that ext3 also uses less CPU power than ReiserFS and XFS. It is also considered safer than the other Linux file systems, due to its relative simplicity and wider testing base.
ext3 adds the following features to ext2:
* A
journal
* Online file system growth
*
HTree indexing for larger directories
Without these features, any ext3 file system is also a valid ext2 file system. This situation has allowed well-tested and mature file system maintenance utilities for maintaining and repairing ext2 file systems to also be used with ext3 without major changes. The ext2 and ext3 file systems share the same standard set of utilities,
e2fsprogs, which includes an
fsck tool. The close relationship also makes conversion between the two file systems (both forward to ext3 and backward to ext2) straightforward.
ext3 lacks "modern" filesystem features, such as dynamic
inode
The inode (index node) is a data structure in a Unix-style file system that describes a file-system object such as a file or a directory. Each inode stores the attributes and disk block locations of the object's data. File-system object attribute ...
allocation and
extents. This situation might sometimes be a disadvantage, but for recoverability, it is a significant advantage. The file system metadata is all in fixed, well-known locations, and data structures have some redundancy. In significant data corruption, ext2 or ext3 may be recoverable, while a tree-based file system may not.
Size limits
The maximum number of
blocks for ext3 is 2
32. The size of a block can vary, affecting the maximum number of files and the maximum size of the file system:
Journaling levels
There are three levels of
journaling available in the Linux implementation of ext3:
; Journal (lowest risk): Both metadata and file contents are written to the journal before being committed to the main file system. Because the journal is relatively continuous on disk, this can improve performance, if the journal has enough space. In other cases, performance gets worse, because the data must be written twice—once to the journal, and once to the main part of the filesystem.
; Ordered (medium risk): Only metadata is journaled; file contents are not, but it's guaranteed that file contents are written to disk before associated metadata is marked as committed in the journal. This is the default on many Linux distributions. If there is a power outage or
kernel panic
A kernel panic (sometimes abbreviated as KP) is a safety measure taken by an operating system's kernel upon detecting an internal fatal error in which either it is unable to safely recover or continuing to run the system would have a higher ...
while a file is being written or appended to, the journal will indicate that the new file or appended data has not been "committed", so it will be purged by the cleanup process. (Thus appends and new files have the same level of integrity protection as the "journaled" level.) However, files being ''overwritten'' can be corrupted because the original version of the file is not stored. Thus it's possible to end up with a file in an intermediate state between new and old, without enough information to restore either one or the other (the new data never made it to disk completely, and the old data is not stored anywhere). Even worse, the intermediate state might intersperse old and new data, because the order of the write is left up to the disk's hardware.
; Writeback (highest risk): Only metadata is journaled; file contents are not. The contents might be written before or after the journal is updated. As a result, files modified right before a crash can become corrupted. For example, a file being appended to may be marked in the journal as being larger than it actually is, causing garbage at the end. Older versions of files could also appear unexpectedly after a journal recovery. The lack of synchronization between data and journal is faster in many cases. JFS uses this level of journaling, but ensures that any "garbage" due to unwritten data is zeroed out on reboot. XFS also uses this form of journaling.
In all three modes, the internal structure of file system is assured to be consistent even after a crash. In any case, only the data content of files or directories which were being modified when the system crashed will be affected; the rest will be intact after recovery.
Disadvantages
Functionality
Because ext3 aims to be
backward-compatible with the earlier ext2, many of the on-disk structures are similar to those of ext2. Consequently, ext3 lacks recent features, such as
extents, dynamic allocation of
inode
The inode (index node) is a data structure in a Unix-style file system that describes a file-system object such as a file or a directory. Each inode stores the attributes and disk block locations of the object's data. File-system object attribute ...
s, and
block sub-allocation
Block or blocked may refer to:
Arts, entertainment and media Broadcasting
* Block programming, the result of a programming strategy in broadcasting
* W242BX, a radio station licensed to Greenville, South Carolina, United States known as ''96.3 ...
. A directory can have at most 31998 ''subdirectories'', because an inode can have at most 32,000 links (each direct subdirectory increases their parent folder inode link counter in the ".." reference).
On ext3, like for most current Linux filesystems, the system tool "
fsck" should not be used while the filesystem is mounted for writing.
Attempting to check a filesystem that is already mounted in read/write mode will (very likely) detect inconsistencies in the filesystem metadata. Where filesystem metadata is changing, and fsck applies changes in an attempt to bring the "inconsistent" metadata into a "consistent" state, the attempt to "fix" the inconsistencies will corrupt the filesystem.
Defragmentation
There is no online ext3
defragmentation tool that works on the filesystem level. There is an offline ext2 defragmenter,
e2defrag
. However,
e2defrag
may destroy data, depending on the feature bits turned on in the filesystem; it does not know how to handle many of the newer ext3 features.
There are userspace defragmentation tools, like Shake and defrag. Shake works by allocating space for the whole file as one operation, which will generally cause the allocator to find contiguous disk space. If there are files which are used at the same time, Shake will try to write them next to one another. Defrag works by copying each file over itself. However, this strategy works only if the file system has enough free space. A true defragmentation tool does not exist for ext3.
However, as the Linux System Administrator Guide states, "Modern Linux filesystem(s) keep fragmentation at a minimum by keeping all blocks in a file close together, even if they can't be stored in consecutive sectors. Some filesystems, like ext3, effectively allocate the free block that is nearest to other blocks in a file. Therefore it is not necessary to worry about fragmentation in a Linux system."
While ext3 is resistant to file fragmentation, ext3 can get fragmented over time or for specific usage patterns, like slowly writing large files. Consequently, ext4 (the successor to ext3) has an online filesystem defragmentation utility e4defrag and currently supports
extents (contiguous file regions).
Undelete
ext3 does not support the recovery of deleted files. The ext3 driver actively deletes files by wiping file inodes for crash safety reasons.
There are still several techniques and some free and proprietary software for recovery of deleted or lost files using file system journal analysis; however, they do not guarantee any specific file recovery.
Compression
e3compr is an
unofficial patch for ext3 that does transparent
compression. It is a direct port of e2compr and still needs further development. It compiles and boots well with upstream kernels, but journaling is not implemented yet.
Lack of snapshots support
Unlike a number of modern file systems, ext3 does not have native support for
snapshots
Snapshot, snapshots or snap shot may refer to:
* Snapshot (photography), a photograph taken without preparation
Computing
* Snapshot (computer storage), the state of a system at a particular point in time
* Snapshot (file format) or SNP, a fil ...
, the ability to quickly capture the state of the filesystem at arbitrary times. Instead, it relies on less-space-efficient, volume-level snapshots provided by the Linux
LVM. The
Next3 file system is a modified version of ext3 which offers snapshots support, yet retains compatibility with the ext3 on-disk format.
No checksumming in journal
ext3 does not do
checksumming when writing to the journal. On a storage device with extra cache, if ''barrier=1'' is not enabled as a mount option (in
/etc/fstab
fstab (after ''file systems table'') is a system file commonly found in the directory /etc on Unix and Unix-like computer systems. In Linux, it is part of the util-linux package. The fstab file typically lists all available disk partitions and ot ...
), and if the hardware is doing out-of-order write caching, one runs the risk of severe filesystem corruption during a crash.
[Re: Frequent metadata corruption with ext3 + hard power-off](_blank)
Archives.free.net.ph. Retrieved on 2013-06-22. This is because storage devices with write caches report to the system that the data has been completely written, even if it was written to the (volatile) cache.
If hard disk writes are done out-of-order (due to modern hard disks caching writes in order to
amortize write speeds), it is likely that one will write a commit block of a transaction before the other relevant blocks are written. If a power failure or unrecoverable crash should occur before the other blocks get written, the system will have to be rebooted. Upon reboot, the file system will replay the log as normal, and replay the "winners" (transactions with a commit block, including the invalid transaction above, which happened to be tagged with a valid commit block). The unfinished disk write above will thus proceed, but using corrupt journal data. The file system will thus mistakenly overwrite normal data with corrupt data while replaying the journal. If checksums had been used, where the blocks of the "fake winner" transaction were tagged with a mutual checksum, the file system could have known better and not replayed the corrupt data onto the disk. Journal checksumming has been added to ext4.
Filesystems going through the device mapper interface (including software
RAID and LVM implementations) may not support barriers, and will issue a warning if that mount option is used. There are also some disks that do not properly implement the write cache flushing extension necessary for barriers to work, which causes a similar warning. In these situations, where barriers are not supported or practical, reliable write ordering is possible by turning off the disk's write cache and using the mount option.
Turning off the disk's write cache may be required even when barriers are available.
Applications like databases expect a call to
fsync() to flush pending writes to disk, and the barrier implementation doesn't always clear the drive's write cache in response to that call. There is also a potential issue with the barrier implementation related to error handling during events, such as a drive failure. It is also known that sometimes some
virtualization technologies do not properly forward fsync or flush commands to the underlying devices (files, volumes, disk) from a guest operating system. Similarly, some hard disks or controllers implement cache flushing incorrectly or not at all, but still advertise that it is supported, and do not return any error when it is used. There are so many ways to handle fsync and write cache handling incorrectly, it is safer to assume that cache flushing does not work unless it is explicitly tested, regardless of how reliable individual components are believed to be.
Near-time extinction due to date-stamp limitation
Ext3 stores dates as
Unix time using four bytes in the file header. 32 bits does not give enough scope to continue processing files beyond January 18, 2038 - the
Year 2038 problem.
ext4
On June 28, 2006,
Theodore Ts'o, the principal developer of ext3, announced an enhanced version, called ext4. On October 11, 2008, the patches that mark ext4 as stable code were merged in the Linux 2.6.28 source code repositories, marking the end of the development phase and recommending its adoption.
In 2008, Ts'o stated that although ext4 has improved features such as being much faster than ext3, it is not a major advance, it uses old technology, and is a stop-gap; Ts'o believes that
Btrfs is the better direction, because "it offers improvements in scalability, reliability, and ease of management". Btrfs also has "a number of the same design ideas that
reiser3/
4 had".
See also
*
List of file systems
*
Comparison of file systems
*
Extended file attributes
*
Ext2Fsd
*
Next3, modified version of ext3 which snapshots
References
External links
* as of 2004-10-14.
Introducing ext3 – IBM developerWorks Advanced filesystem implementor's guide, Part 7Free ext2/ext3 Windows driver
Ext2 File System For WindowsGPL ext2/ext3 file system driver for Windows 2000/XP/2003/VISTA/2008 (opensource, supports read & write, supports inode of 256 bytes at maximum to access larger disks)
Ext2 Installable File System For Windowsext2/ext3 file system driver for MS Windows NT4.0/2000/XP/Vista/7/8/8.1/Server 2003/2008/2008 R2/2012/2012 R2 (freeware, closed source, supports read & write, supports inodes of 256 bytes at maximum to access larger disks)
ext2/ext3 file system driver (read only) for MS Windows NT/2000/XP (opensource), latest version in the web archive
Explore2fsAn explorer-like GUI tool for accessing ext2/ext3 filesystems under MS Windows
"Ext2read"A windows application to read/copy ext2/ext3/ext4 files with extent and LVM2 support.
UFS Explorer Standard Recovery version 4Commercial data recovery and file undelete software for Ext2/Ext3 file systems.
ext2/ext3 resizing toolsby Dr. Stephen Tweedie at the Ottawa Linux Symposium, 20 July 2000
State of the Art: Where we are with the Ext3 filesystemby Mingming Cao, Theodore Y. Ts'o, Badari Pulavarty, Suparna Bhattacharya, IBM Linux Technology Center, 2005
Tutorial– Determining Your EXT3 Size Limits
fuse-ext2An open source ext2/ext3 file system driver for
FUSE
Fuse or FUSE may refer to:
Devices
* Fuse (electrical), a device used in electrical systems to protect against excessive current
** Fuse (automotive), a class of fuses for vehicles
* Fuse (hydraulic), a device used in hydraulic systems to protect ...
. (Supports
Mac OS X 10.4 and later (
Universal Binary), usin
MacFuse
*Windows port of Ext2/Ext4 and other FS i
CROSSMETA*Red Hat Enterprise Linux
''Chapter 22. Write Barriers''.
Linux clockpocalypse in 2038 is looming and there's no 'serious plan'
{{Filesystem
2001 software
Disk file systems
File systems supported by the Linux kernel