# fd [![Build Status](https://travis-ci.org/sharkdp/fd.svg?branch=master)](https://travis-ci.org/sharkdp/fd) [![Build status](https://ci.appveyor.com/api/projects/status/21c4p5fwggc5gy3j?svg=true)](https://ci.appveyor.com/project/sharkdp/fd) [![Version info](https://img.shields.io/crates/v/fd-find.svg)](https://crates.io/crates/fd-find) *fd* is a simple, fast and user-friendly alternative to [*find*](https://www.gnu.org/software/findutils/). While it does not seek to mirror all of *find*'s powerful functionality, it provides sensible (opinionated) defaults for [80%](https://en.wikipedia.org/wiki/Pareto_principle) of the use cases. ## Features * Convenient syntax: `fd PATTERN` instead of `find -iname '*PATTERN*'`. * Colorized terminal output (similar to *ls*). * It's *fast* (see [benchmarks](#benchmark) below). * Smart case: the search is case-insensitive by default. It switches to case-sensitive if the pattern contains an uppercase character[\*](http://vimdoc.sourceforge.net/htmldoc/options.html#'smartcase'). * Ignores hidden directories and files, by default. * Ignores patterns from your `.gitignore`, by default. * Regular expressions. * Unicode-awareness. * The command name is *50%* shorter[\*](https://github.com/ggreer/the_silver_searcher) than `find` :-). * Parallel command execution with a syntax similar to GNU Parallel. ## Demo ![Demo](http://i.imgur.com/kTMFSVU.gif) ## Benchmark Let's search my home folder for files that end in `[0-9].jpg`. It contains ~150.000 subdirectories and about a million files. For averaging and statistical analysis, I'm using [bench](https://github.com/Gabriel439/bench). All benchmarks are performed for a "warm cache". Results for a cold cache are similar. Let's start with `find`: ``` find ~ -iregex '.*[0-9]\.jpg$' time 6.265 s (6.127 s .. NaN s) 1.000 R² (1.000 R² .. 1.000 R²) mean 6.162 s (6.140 s .. 6.181 s) std dev 31.73 ms (0.0 s .. 33.48 ms) ``` `find` is much faster if it does not need to perform a regular-expression search: ``` find ~ -iname '*[0-9].jpg' time 2.866 s (2.754 s .. 2.964 s) 1.000 R² (0.999 R² .. 1.000 R²) mean 2.860 s (2.834 s .. 2.875 s) std dev 23.11 ms (0.0 s .. 25.09 ms) ``` Now let's try the same for `fd`. Note that `fd` *always* performs a regular expression search. The options `--hidden` and `--no-ignore` are needed for a fair comparison, otherwise `fd` does not have to traverse hidden folders and ignored paths (see below): ``` fd --hidden --no-ignore '.*[0-9]\.jpg$' ~ time 892.6 ms (839.0 ms .. 915.4 ms) 0.999 R² (0.997 R² .. 1.000 R²) mean 871.2 ms (857.9 ms .. 881.3 ms) std dev 15.50 ms (0.0 s .. 17.49 ms) ``` For this particular example, `fd` is approximately seven times faster than `find -iregex` and about three times faster than `find -iname`. By the way, both tools found the exact same 14030 files :smile:. Finally, let's run `fd` without `--hidden` and `--no-ignore` (this can lead to different search results, of course): ``` fd '[0-9]\.jpg$' ~ time 159.5 ms (155.8 ms .. 165.3 ms) 0.999 R² (0.996 R² .. 1.000 R²) mean 158.7 ms (156.5 ms .. 161.6 ms) std dev 3.263 ms (2.401 ms .. 4.298 ms) ``` **Note**: This is *one particular* benchmark on *one particular* machine. While I have performed quite a lot of different tests (and found consistent results), things might be different for you! I encourage everyone to try it out on their own. Concerning *fd*'s speed, the main credit goes to the `regex` and `ignore` crates that are also used in [ripgrep](https://github.com/BurntSushi/ripgrep) (check it out!). ## Colorized output `fd` can colorize files by extension, just like `ls`. In order for this to work, the environment variable [`LS_COLORS`](https://linux.die.net/man/5/dir_colors) has to be set. Typically, the value of this variable is set by the `dircolors` command which provides a convenient configuration format to define colors for different file formats. On most distributions, `LS_COLORS` should be set already. If you are looking for alternative, more complete (and more colorful) variants, see [here](https://github.com/seebi/dircolors-solarized) or [here](https://github.com/trapd00r/LS_COLORS). ## Parallel Command Execution If the `--exec` flag is specified alongside a command template, a job pool will be created for generating and executing commands in parallel with each discovered path as the inputs. The syntax for generating commands is similar to that of GNU Parallel: - **{}**: A placeholder token that will be replaced with the discovered path. - **{.}**: Removes the extension from the path. - **{/}**: Uses the basename of the discovered path. - **{//}**: Uses the parent of the discovered path. - **{/.}**: Uses the basename, with the extension removed. ```sh # Demonstration of parallel job execution fd -e flac --exec 'sleep 1; echo $\{SHELL}: {}' # This also works, because `SHELL` is not a valid token fd -e flac --exec 'sleep 1; echo ${SHELL}: {}' # The token is optional -- it gets added at the end by default. fd -e flac --exec 'echo' # Real world example of converting flac files into opus files. fd -e flac --type f --exec 'ffmpeg -i "{}" -c:a libopus "{.}.opus"' ``` ## Install With Rust's package manager [cargo](https://github.com/rust-lang/cargo), you can install *fd* via: ``` cargo install fd-find ``` Note that rust version *1.16.0* or later is required. The release page of this repository also includes precompiled binaries for Linux. On **macOS**, you can use [Homebrew](http://braumeister.org/formula/fd): ``` brew install fd ``` On **Arch Linux**, you can install the package from the official repos: ``` pacman -S fd-rs ``` On **NixOS**, or any Linux distro you can use [Nix](https://nixos.org/nix/): ``` nix-env -i fd ``` On **Windows**, you can download the pre-built binaries from the [Release page](https://github.com/sharkdp/fd/releases). ## Development ```bash git clone https://github.com/sharkdp/fd # Build cd fd cargo build # Run unit tests and integration tests cargo test # Install cargo install ``` ## Command-line options ``` USAGE: fd [FLAGS/OPTIONS] [] [] FLAGS: -H, --hidden Search hidden files and directories -I, --no-ignore Do not respect .(git)ignore files -s, --case-sensitive Case-sensitive search (default: smart case) -i, --ignore-case Case-insensitive search (default: smart case) -a, --absolute-path Show absolute instead of relative paths -L, --follow Follow symbolic links -p, --full-path Search full path (default: file-/dirname only) -0, --print0 Separate results by the null character -h, --help Prints help information -V, --version Prints version information OPTIONS: -d, --max-depth Set maximum search depth (default: none) -t, --type Filter by type: f(ile), d(irectory), (sym)l(ink) -e, --extension Filter by file extension -c, --color When to use colors: never, *auto*, always -j, --threads Set number of threads to use for searching & executing -x, --exec Execute the given command for each search result ARGS: the search pattern, a regular expression (optional) the root directory for the filesystem search (optional) ``` ## Tutorial First, to see all command line options, you can get `fd`'s help text by running: ``` fd --help ``` `fd` can be called with no arguments, it'll then show the content of the actual directory recursively (like `ls -R`): ``` > cd fd > fd appveyor.yml build.rs Cargo.lock Cargo.toml LICENSE README.md src src/app.rs src/fshelper src/fshelper/mod.rs src/lscolors src/lscolors/mod.rs src/main.rs tests tests/testenv tests/testenv/mod.rs tests/tests.rs ``` If we work in a directory that is a Git repository (or includes several Git repositories), `fd` does not search folders (and does not show files) that match the `.gitignore` pattern. For instance, see above example, and note that .gitignore is the following: ``` target/ **/*.rs.bk ``` To disable this behavior, we can use the `-I` (or `--ignore`) option: ``` > fd -I Cargo.lock Cargo.toml LICENSE README.md appveyor.yml build.rs src src\app.rs src\fshelper src\fshelper\mod.rs src\lscolors src\lscolors\mod.rs src\main.rs target target\debug target\debug\build target\debug\build\fd-find-11fb469ceafee9ce target\debug\build\fd-find-11fb469ceafee9ce\out target\debug\build\fd-find-11fb469ceafee9ce\out\_fd target\debug\build\fd-find-11fb469ceafee9ce\out\_fd.ps1 target\debug\build\fd-find-11fb469ceafee9ce\out\fd.bash-completion target\debug\build\fd-find-11fb469ceafee9ce\out\fd.fish target\debug\build\fd-find-11fb469ceafee9ce\output target\debug\build\fd-find-8682b98943903a5b target\debug\build\fd-find-8682b98943903a5b\build-script-build.exe target\debug\build\fd-find-8682b98943903a5b\build_script_build-8682b98943903a5b.exe target\debug\build\fd-find-8682b98943903a5b\build_script_build-8682b98943903a5b.pdb target\debug\build\kernel32-sys-7568a971f6718c45 target\debug\build\kernel32-sys-7568a971f6718c45\out target\debug\build\kernel32-sys-7568a971f6718c45\output target\debug\build\kernel32-sys-d715e52d58016295 target\debug\build\kernel32-sys-d715e52d58016295\build-script-build.exe target\debug\build\kernel32-sys-d715e52d58016295\build_script_build-d715e52d58016295.exe target\debug\build\kernel32-sys-d715e52d58016295\build_script_build-d715e52d58016295.pdb target\debug\deps (some content omitted...) target\debug\examples target\debug\fd.exe target\debug\incremental target\debug\native tests tests\testenv tests\testenv\mod.rs tests\tests.rs ``` If `fd` is called with a single argument (the search pattern), it will perform a recursive search through the current directory. To search for all files that include the string "access" in the /var/log directory, we can simply run: ``` > cd /var/log > fd access cups/access_log cups/access_log.1 cups/access_log.2 some_program/user_access ``` The search pattern is treated as a regular expression. To show only entries that start with "access", we can simply run: ``` > fd '^access' cups/access_log cups/access_log.1 cups/access_log.2 ``` Note that `fd` does not show hidden files (like `.access_control`) by default. To change this, we can use the `-H` (or `--hidden`) option: ``` > fd -H access cups/access_log cups/access_log.1 cups/access_log.2 some_program/user_access .access_control ``` If we are interested in showing the results from a particular directory, we can specify the root of the search as a second argument: ``` > cd /etc > fd firewall iptables simple_firewall.rules // TODO: review this with router content ``` If we work in a directory that is a Git repository (or includes several Git repositories), `fd` does not search folders (and does not show files) that match the `.gitignore` pattern. For example, imagine we had a `.gitignore` file with the following content: ``` *.sh ``` In this case, `fd` would not show any files that end in `.sh`. To disable this behavior, we can use the `-I` (or `--ignore`) option: ``` > fd -I me sub_dir/more_dir/even_further_down/not_me.sh ``` To really search *all* files and directories, we can combine the hidden and ignore features to show everything (`-HI`): ``` fd -HI 'not|here' not_file sub_dir/.here_be_tests sub_dir/more_dir/.not_here sub_dir/more_dir/even_further_down/not_me.sh sub_dir/more_dir/not_file ``` Searching for a file extension is easy too, using the `-e` (or `--file-extensions`) switch for file extensions: ``` > fd -e sh sub_dir/more_dir/even_further_down/not_me.sh ``` Next, we can even use a pattern in combination with `-e` to search for a regex pattern over the files that end in the specified extension. ``` > fd -e txt test fd_examples/desub_dir/old_test.txt fd_examples/sub_dir/new_test.txt ``` What if we wanted to run a command for each of the search results? We can use `xargs` to do that: `fd -0 'test' | xargs -0 -I {} cp {} {}.new` In this example there are a couple things to take note: - First we are telling `fd` we want a null character to seperate the files `-0`, this is important when passing to `xargs`. - Second, we are piping the output to `xargs` and telling this program to expect input null terminated with `-0` (the same syntax that `fd` was built with). - Then for fun we are using `-I` to replace a string `{}` and lauching `cp` to copy the file `{}` to a file ending in `{}.new`. `fd` can also show us the absolute path vs. the full path with `-a` (`--absolute-path`): ``` > fd -a new /Users/fd_user/fd_examples/sub_dir/more_dir/even_further_down/test_seven.new /Users/fd_user/fd_examples/sub_dir/more_dir/even_further_down/testing_eight.new /Users/fd_user/fd_examples/sub_dir/more_dir/test_file_six.new /Users/fd_user/fd_examples/sub_dir/test_file_five.new /Users/fd_user/fd_examples/sub_dir/test_file_four.new /Users/fd_user/fd_examples/sub_dir/test_file_three.new /Users/fd_user/fd_examples/test_file_one.new /Users/fd_user/fd_examples/test_file_two.new /Users/fd_user/fd_examples/test_one.new /Users/fd_user/fd_examples/this_is_a_test.new ```