croc/README.md

167 lines
9.6 KiB
Markdown
Raw Normal View History

2018-06-28 14:09:11 +02:00
2018-07-02 00:12:46 +02:00
<p align="center">
<img
2018-10-10 04:08:07 +02:00
src="https://user-images.githubusercontent.com/6550035/46709024-9b23ad00-cbf6-11e8-9fb2-ca8b20b7dbec.jpg"
width="408px" border="0" alt="croc">
2018-07-02 00:12:46 +02:00
<br>
2019-02-19 05:30:47 +01:00
<a href="https://github.com/schollz/croc/releases/latest"><img src="https://img.shields.io/badge/version-4.1.5-brightgreen.svg?style=flat-square" alt="Version"></a>
2018-10-12 06:34:56 +02:00
<img src="https://img.shields.io/badge/coverage-77%25-brightgreen.svg?style=flat-square" alt="Code coverage">
2018-10-11 16:33:35 +02:00
<a href="https://travis-ci.org/schollz/croc"><img
2019-02-02 05:14:27 +01:00
src="https://img.shields.io/travis/schollz/croc.svg?style=flat-square" alt="Build
2018-10-11 16:33:35 +02:00
Status"></a>
<a href="https://saythanks.io/to/schollz"><img src="https://img.shields.io/badge/Say%20Thanks-!-brightgreen.svg?style=flat-square" alt="Say thanks"></a>
2018-07-02 00:12:46 +02:00
</p>
2018-06-28 14:09:11 +02:00
2018-10-13 20:25:35 +02:00
<p align="center"><code>curl https://getcroc.schollz.com | bash</code></p>
2018-06-28 14:09:11 +02:00
2018-10-23 14:58:37 +02:00
*croc* is a tool that allows any two computers to simply and securely transfer files and folders. There are many tools that can do this but AFAIK *croc* is the only tool that is easily installed and used on any platform, *and* has secure peer-to-peer transferring, *and* has the capability to resume broken transfers.
2018-06-28 14:09:11 +02:00
2018-10-10 15:31:24 +02:00
## Overview
2018-06-28 14:09:11 +02:00
2018-10-21 20:34:31 +02:00
**Transmit encrypted data with a code phrase**
*croc* securely transfers data using *code phrases* - a combination of three random words (mnemonicoded 4 bytes). The code phrase is shared between the sender and the recipient for password authenticated key exchange ([PAKE](https://github.com/schollz/pake)), a cryptographic method to use a shared weak key (the "code phrase") to generate a strong key for secure end-to-end encryption. By default, a code phrase can only be used once between two parties so an attacker would have a chance of less than 1 in *4 billion* to guess the code phrase correctly to steal the data. An attacker with the wrong code phrase will fail the PAKE and the sender will be notified without any data transfering. Only two people with the right code phrase will be able to computers transfer encrypted data through a relay.
**Fast data transfer through TCP**
2018-06-28 14:09:11 +02:00
2018-10-10 15:31:24 +02:00
The actual data transfer is accomplished using a relay, either using raw TCP sockets or websockets. If both computers are on the LAN network then *croc* will use a local relay, otherwise a public relay is used. All the data going through the relay is encrypted using the PAKE-generated session key, so the relay can't spy on information passing through it. The data is transferred in blocks, where each block is compressed and encrypted, and the recipient keeps track of blocks received so that it can resume the transfer if interrupted.
2018-06-28 14:09:11 +02:00
2018-10-23 14:37:46 +02:00
**Relay allows any two computers to connect**
*croc* differs from a utility like *scp* because it doesn't require any two computers to have enabled port-forwarding. Instead, *croc* will uses a relay - a temporary server setup locally (if both computers are on lan) or publicly (default is at croc4.schollz.com). Any two computers can connect to the relay, and after securing their channel with PAKE, they can transfer encrypted metadata and data through the relay. The relay works by first having the computers communicate the PAKE protocol via websockets, and then exchanging encrypted metadata, and then stapling the TCP connections directly so that they can transfer directly.
2018-10-21 20:34:31 +02:00
**Why another data transfer utility?**
2018-10-23 14:59:11 +02:00
My motivation to write *croc*, as stupid as it sounds, is because I wanted to create a program that made it easy to send a 3GB+ PBS documentary to my friend in a different country. My friend has a Windows computer and is not comfortable using a terminal. So I wanted to write a program that, while secure, is simple to receive a file. *croc* accomplishes this, and now I find myself using it almost everyday at work. To receive a file you can just download the executable and double click on it. The name is inspired by the [fable of the frog and the crocodile](https://web.archive.org/web/20180926035731/http://allaboutfrogs.org/stories/crocodile.html).
2018-07-02 00:12:46 +02:00
2018-10-10 15:31:24 +02:00
## Examples
2018-07-02 00:12:46 +02:00
2018-10-10 15:31:24 +02:00
The first example shows the basic transfer of some file or folder from computer 1 to computer 2. _These two gifs should run in sync if you force-reload (Ctl+F5)_
2018-07-02 00:12:46 +02:00
2018-10-10 15:31:24 +02:00
![send](.github/1.gif)
2018-07-02 00:12:46 +02:00
2018-10-10 15:31:24 +02:00
![receive](.github/2.gif)
The second example shows how you can restart a broken transfer. Here, computer 2 presses Ctl+C during a transfer to abruptly break the connection, and then resumes by having computer 1 re-send the file. _These two gifs should run in sync if you force-reload (Ctl+F5)_
![send](.github/3.gif)
![receive](.github/4.gif)
2018-07-02 00:12:46 +02:00
2018-10-20 16:14:36 +02:00
In version 4, there is now a GUI available for [Windows](https://github.com/schollz/croc/releases/latest) and [Linux](https://github.com/schollz/croc/releases/latest):
<div style="text-align:center">
<img src="https://user-images.githubusercontent.com/6550035/47256575-8a193e00-d437-11e8-96fa-42c9d072a8f1.PNG">
</div>
2018-07-07 15:46:40 +02:00
## Install
2018-07-02 00:12:46 +02:00
2018-07-07 15:46:40 +02:00
[Download the latest release for your system](https://github.com/schollz/croc/releases/latest).
2018-10-29 13:43:17 +01:00
Or, you can [install Go](https://golang.org/dl/) and build from source with `go get github.com/schollz/croc`. Since *croc* uses [Go modules](https://golang.org/doc/go1.11#modules) it requires Go version 1.11+.
2018-07-02 00:12:46 +02:00
2018-10-13 19:50:29 +02:00
Or, you can quickly install a release from the command-line:
```
$ curl https://getcroc.schollz.com | bash
```
```
$ wget -qO- https://getcroc.schollz.com | bash
```
2018-07-02 00:12:46 +02:00
2018-07-07 15:46:40 +02:00
## Usage
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
The basic usage is to just do
2018-06-28 14:09:11 +02:00
2018-07-02 00:12:46 +02:00
```
2018-07-07 15:46:40 +02:00
$ croc send FILE
2018-07-02 00:12:46 +02:00
```
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
to send and then on the other computer you can just do
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
```
$ croc [code phrase]
```
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
to receive (you'll be prompted to enter the code phrase). Note, by default, you don't need any arguments for receiving, instead you will be prompted to enter the code phrase. This makes it possible for you to just double click the executable to run (nice for those of us that aren't computer wizards).
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
### Custom code phrase
You can send with your own code phrase (must be more than 4 characters).
2018-06-28 14:09:11 +02:00
2018-07-02 00:12:46 +02:00
```
2018-07-07 15:46:40 +02:00
$ croc send --code [code phrase] [filename]
2018-07-02 00:12:46 +02:00
```
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
### Use locally
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
*croc* automatically will attempt to start a local connection on your LAN to transfer the file much faster. It uses [peer discovery](https://github.com/schollz/peerdiscovery), basically broadcasting a message on the local subnet to see if another *croc* user wants to receive the file. *croc* will utilize the first incoming connection from either the local network or the public relay and follow through with PAKE.
You can change this behavior by forcing *croc* to use only local connections (`--local`) or force to use the public relay only (`--no-local`):
2018-06-28 14:09:11 +02:00
2018-07-02 00:12:46 +02:00
```
2018-07-07 15:46:40 +02:00
$ croc --local/--no-local send [filename]
2018-07-02 00:12:46 +02:00
```
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
### Using pipes - stdin and stdout
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
You can easily use *croc* in pipes when you need to send data through stdin or get data from stdout. To send you can just use pipes:
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
```
$ cat [filename] | croc send
```
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
In this case *croc* will automatically use the stdin data and send and assign a filename like "croc-stdin-123456789". To receive to stdout at you can always just use the `-yes` and `-stdout` flags which will automatically approve the transfer and pipe it out to stdout.
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
```
$ croc -yes -stdout [code phrase] > out
```
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
All of the other text printed to the console is going to `stderr` so it will not interfere with the message going to stdout.
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
### Self-host relay
2018-06-28 15:38:07 +02:00
The relay is needed to staple the parallel incoming and outgoing connections. The relay temporarily stores connection information and the encrypted meta information. The default uses a public relay at, `croc4.schollz.com`. You can also run your own relay, it is very easy, just run:
2018-06-28 14:09:11 +02:00
2018-07-07 15:46:40 +02:00
```
$ croc relay
```
2018-06-28 14:09:11 +02:00
2018-09-22 20:21:44 +02:00
Make sure to open up TCP ports (see `croc relay --help` for which ports to open). Relays can also be customized to which elliptic curve they will use (default is siec).
2018-06-28 14:09:11 +02:00
You can send files using your relay by entering `-addr` to change the relay that you are using if you want to custom host your own.
2018-06-28 14:09:11 +02:00
2018-07-02 00:12:46 +02:00
```
$ croc -addr "myrelay.example.com" send [filename]
2018-07-02 00:12:46 +02:00
```
2018-06-28 14:09:11 +02:00
2018-10-21 17:23:56 +02:00
### Configuration file
You can also make some paramters static by using a configuration file. To get started with the config file just do
```
$ croc config
```
which will generate the file that you can edit.
Any changes you make to the configuration file will be applied *before* the command-line flags, if any.
2017-10-17 17:21:47 +02:00
2018-07-07 15:46:40 +02:00
## License
2018-07-02 00:12:46 +02:00
MIT
2018-07-07 15:46:40 +02:00
## Acknowledgements
2018-10-10 15:31:24 +02:00
*croc* has been through many iterations, and I am awed by all the great contributions! If you feel like contributing, in any way, by all means you can send an Issue, a PR, ask a question, or tweet me ([@yakczar](http://ctt.ec/Rq054)).
2018-07-02 00:12:46 +02:00
Thanks...
- ...[@warner](https://github.com/warner) for the [idea](https://github.com/warner/magic-wormhole).
- ...[@tscholl2](https://github.com/tscholl2) for the [encryption gists](https://gist.github.com/tscholl2/dc7dc15dc132ea70a98e8542fefffa28).
- ...[@skorokithakis](https://github.com/skorokithakis) for [code on proxying two connections](https://www.stavros.io/posts/proxying-two-connections-go/).
2018-10-23 14:55:45 +02:00
- ...for making pull requests [@Girbons](https://github.com/Girbons), [@techtide](https://github.com/techtide), [@heymatthew](https://github.com/heymatthew), [@Lunsford94](https://github.com/Lunsford94), [@lummie](https://github.com/lummie), [@jesuiscamille](https://github.com/jesuiscamille), [@threefjord](https://github.com/threefjord), [@marcossegovia](https://github.com/marcossegovia), [@csleong98](https://github.com/csleong98), [@afotescu](https://github.com/afotescu), [@callmefever](https://github.com/callmefever), [@El-JojA](https://github.com/El-JojA), [@anatolyyyyyy](https://github.com/anatolyyyyyy), [@goggle](https://github.com/goggle), [@smileboywtu](https://github.com/smileboywtu), [@nicolashardy](https://github.com/nicolashardy)!