e2fsprogs/lib, branch master

libext2fs: display partial path if fs corrupted in ext2fs_get_pathname()

2012-01-17T20:38:31Z

The function ext2fs_get_pathname() used to return EXT2_ET_NO_DIRECTORY if one of the directories in an inode's pathname is not a directory. This is not very useful in an emergency, when the file system is corrupted. This commit will cause ext2fs_get_pathname() to return a partial pathname, which should help system administrators trying to use debugfs to investigate a corrupted file system. Signed-off-by: "Theodore Ts'o"

libext2fs: change getpagesize to sysconf

2012-01-10T02:19:48Z

Newer versions of glibc no longer export the getpagesize() prototype when using recent versions of POSIX (_XOPEN_SOURCE). So building tdb.c gives use implicit function declaration warnings. Fix the issue by using the portable sysconf() function which returns the same answer. Signed-off-by: Mike Frysinger Signed-off-by: Theodore Ts'o

libext2fs: add bitmap statistics

2011-12-18T06:12:44Z

This feature is especially useful for better understanding how e2fsprogs tools (mainly e2fsck) treats bitmaps and what bitmap backend can be most suitable for particular bitmap. Backend itself (if implemented) can provide statistics of its own as well. [ Changed to provide basic statistics when enabled with the E2FSPROGS_BITMAPS_STATS environment variable -- tytso] Signed-off-by: Lukas Czerner Signed-off-by: "Theodore Ts'o"

libext2fs: adjust the description when copying a bitmap

2011-12-18T06:12:44Z

Label the copy of a bitmap as "copy of ..." so that the bitmap's description is more descriptive. Signed-off-by: "Theodore Ts'o"

e2fsck: use different bitmap types as appropriate

2011-12-18T06:12:44Z

Now that we have multiple backend implementations of the bitmap code, this commit teaches e2fsck to use either the most appropriate backend for each use case. Since we don't know for sure if we will get it all right, the default choices can be overridden via e2fsck.conf. The various definitions are shown here, with the current defaults (which may change as we add more bitmap implementations and as learn what works better). ; EXT2FS_BAMP64_BITARRAY is 1 ; EXT2FS_BMAP64_RBTREE is 2 ; EXT2FS_BMAP64_AUTODIR is 3 [bitmaps] inode_used_map = 2 ; pass1 inode_dir_map = 3 ; pass1 inode_reg_map = 2 ; pass1 block_found_map = 2 ; pass1 inode_bad_map = 2 ; pass1 inode_imagic_map = 2 ; pass1 block_dup_map = 2 ; pass1 block_ea_map = 2 ; pass1 inode_link_info = 2 ; pass1 inode_dup_map = 2 ; pass1b inode_done_map = 3 ; pass3 inode_loop_detect = 3 ; pass3 fs_bitmaps = 2 Signed-off-by: "Theodore Ts'o"

libext2fs: use the rbtree bitmap by default when initializing a file system

2011-12-18T06:12:44Z

This change causes the max resident memory of mke2fs, as reported by /usr/bin/time, to drop from 9296k to 5328k when formatting a 25 gig volume. Signed-off-by: "Theodore Ts'o"

libext2fs: add pseudo bitmap backend type EXT2FS_BMAP64_AUTODIR

2011-12-18T06:12:43Z

This backend type will automatically switch between the bitarray and the rbtree backend based on the number of directories in the file system. Signed-off-by: "Theodore Ts'o"

libext2fs: add a bitmap implementation using rbtree's

2011-12-18T06:12:40Z

For a long time we had a bitarray backend for storing filesystem metadata bitmaps, however today this approach might hit its limits with todays huge data storage devices, because of its memory utilization. Bitarrays stores bitmaps as ..well, as bitmaps. But this is in most cases highly unefficient because we need to allocate memory even for the big parts of bitmaps we will never use, resulting in high memory utilization especially for huge filesystem, when bitmaps might occupy gigabytes of space. This commit adds another backend to store bitmaps. It is based on rbtrees and it stores just used extents of bitmaps. It means that it can be more memory efficient in most cases. I have done some limited benchmarking and it shows that rbtree backend consumes approx 65% less memory that bitarray on 312GB filesystem aged with Impression (default config). This number may grow significantly with the filesystem size, but also it may be a lot lower (even negative) if the inodes are very fragmented (need more benchmarking). This commit itself does not enable the use of rbtree backend. [ Simplified the code by avoiding unneeded memory allocation and deallocation of del_ext. In addition, fixed a bug discovered by the tst_bitmaps tests: rb_unamrk_bmap() must return true if the bit was previously set in bitmap, and zero otherwise -- tytso ] Signed-off-by: Lukas Czerner Signed-off-by: "Theodore Ts'o"

libext2fs: add rbtree library

2011-12-18T06:00:44Z

This commit adds rbtree library into e2fsprogs so it can be used for various internal data structures. The rbtree implementation is ripped of kernel rbtree implementation with small changes needed for it to work outside kernel. [ I prefixed the exported symbols and interface with ext2fs_ to keep avoid pulluting the namespace exported by the libext2fs shared library. -- tytso ] Signed-off-by: Lukas Czerner Signed-off-by: "Theodore Ts'o"

libext2fs: add tests for the bitmap functions

2011-12-18T06:00:38Z

These tests allow us to be sure that the new bitmap backends are correctly implemented. Signed-off-by: "Theodore Ts'o"