Mirror
/
monolith
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
357 Commits 1 Branch 19 Tags 4.2 MiB
Commit Graph

357 Commits

Author SHA1 Message Date
Sunshine 727a5a410c
add option for custom network request timeout 2020-02-10 20:08:06 -05:00
Sunshine 23af174822
Merge pull request #115 from snshn/remove-javascript-anchors 
Nullify JS within As' href attributes when needed
 2020-02-05 22:57:48 -05:00
Sunshine 5ef2b7c9dc
nullify JS within As' href attributes when needed 2020-02-03 01:47:35 -05:00
Sunshine 1e8348543a
Merge pull request #111 from snshn/adr 
Introduce ADRs
 2020-01-22 23:57:25 -05:00
Sunshine f9bafe092d
Introduce ADRs 2020-01-22 01:03:31 -05:00
Sunshine f876e9243c
Merge pull request #109 from snshn/version-bump 
version bump (2.1.1 → 2.1.2)
 2020-01-21 08:39:10 -05:00
Sunshine b6896febf1
version bump (2.1.1 → 2.1.2) 2020-01-21 02:32:29 -05:00
Sunshine 29d2ba5857
Merge pull request #107 from snshn/update-readme 
Update README.md
 2020-01-21 02:18:10 -05:00
Sunshine 8b1ebc7871
Update README.md 2020-01-21 02:16:36 -05:00
Sunshine d753c83c76
Merge pull request #108 from rhysd/revert-manual-proxy-support 
Revert #106 since reqwest supports system proxies by default
 2020-01-21 02:15:29 -05:00
rhysd 47a825f5ed add proxies instruction in README.md 2020-01-21 13:02:45 +09:00
rhysd 0e12cecd85 Revert "Merge pull request #106 from rhysd/proxy-support" 
This reverts commit d8def879b2, reversing
changes made to a9d114d04d.
 2020-01-21 13:01:22 +09:00
Sunshine d8def879b2
Merge pull request #106 from rhysd/proxy-support 
Support HTTP and HTTPS proxies
 2020-01-20 18:36:00 -05:00
Linda_pp 0420854ed6
remove '$' from environment variable names in README.md 2020-01-20 23:11:14 +09:00
rhysd d47482fcd9 fix crash at setting empty values to HTTP proxies 
with this patch `https_proxy=` and `http_proxy=` will work well.
 2020-01-20 17:17:24 +09:00
rhysd b68624f2f3 support HTTP and HTTPS proxies (fix #103) 2020-01-20 17:02:43 +09:00
Sunshine a9d114d04d
Merge pull request #105 from rhysd/refactor-main 
Refactoring for main.rs to address several issues
 2020-01-20 01:10:29 -05:00
rhysd 4e4ebe9c98 refactor main to address several issues 
Addressed issues:

- when specified URL is invalid, it exited successfully with doing
  nothing. There was no way why it does not work for users
- it exited successfully even if invalid User-Agent value is specified
- it created file twice on `--output` option specified. It may cause an
  issue when some file watcher (e.g. FsEvents on macOS) is watching

Improvements:
- handle errors with `Result::expect` consistently it correctly exits
  with non-zero status on error
- define `Output` enum for handling both stdout and file outputs
 2020-01-15 16:52:20 +09:00
Sunshine 429217d8f7
Merge pull request #104 from rhysd/complete-dom-event-handlers 
Use complete list of DOM event handlers for detecting JS attributes
 2020-01-15 01:34:01 -05:00
rhysd 1779f4a374 better comments for JS_DOM_EVENT_ATTRS constant 2020-01-15 14:33:27 +09:00
rhysd 26e89ae6d3 use complete list of DOM event handlers 2020-01-15 13:58:09 +09:00
Sunshine b333d19d04
Update README.md 2020-01-14 03:42:04 -05:00
Sunshine c1dc798ded
Merge pull request #101 from rhysd/ignore-preload 
Improve handling preload links and white spaces in attribute values
 2020-01-13 17:51:25 -05:00
rhysd 69d99b69e8 remove . in line comment 2020-01-13 23:47:07 +09:00
Sunshine aae53d20f0
Merge pull request #102 from popey/update-snap-config 
Update snapcraft configuration
 2020-01-13 08:39:15 -05:00
Alan Pope 14cf2ce8a6
Update snapcraft configuration 
This changes the build slightly. If snapcraft is triggered when there is a new tagged release in the project github release page, and it's newer than the version in the Snap Store beta channel, we build that stable release. If however, the latest stable release in github releases is already the same as the Snap Store beta channel, then we build the tip of master.

This gives a couple of advantages. 

  * One yaml can be used to build tip-of-git snaps, and stable releases alike
  * Closing the beta channel in the Snap Store will mean the next triggered build will re-build whatever the last stable release is. This is useful to force a rebuild of the stable version in case a dependency (not that there are many) has a security issue.

We also now set the version dynamically based on the git tags.
 2020-01-13 11:14:08 +00:00
Emi Simpson 05985583f0
Switch timestamps from rfc822 local time to iso8601 UTC 2020-01-10 14:30:35 -05:00
Emi Simpson 651fa716b4
Clean user, pass, and fragment from URL before writing 2020-01-10 14:18:15 -05:00
rhysd 67b79e92f9 simplify &x.into_iter() to x.iter() 2020-01-10 14:45:02 +09:00
rhysd b51f41fe34 trim attribute values 2020-01-10 14:41:05 +09:00
rhysd 6f158dc6db compare value of 'rel' properties in case-insensitive 2020-01-10 13:52:31 +09:00
rhysd 8d7052b39c ignore preload and prefetch sources 
since all resources are embedded as data URL.
 2020-01-09 18:18:21 +09:00
rhysd 660511b8a0 define link type of <link> element as enum and prefer match statement 
since match statement checks exhaustiveness
 2020-01-09 16:55:42 +09:00
Emi Simpson 9be3982dc6
Added --no-context flag to disable adding context comment 2020-01-08 19:00:53 -05:00
Emi Simpson 27c9fb4cd3
Added comment indicating the context under which the page was downloaded 2020-01-08 18:51:18 -05:00
Sunshine 929512f4f5
Merge pull request #97 from rhysd/reqwest-0.10.0 
Upgrade reqwest to v0.10.0 for better binary size and build time
 2020-01-08 01:43:55 -05:00
Sunshine a46d89cefc
Merge pull request #98 from rhysd/fix-ci 
Fix nighly and beta CI
 2020-01-07 18:14:30 -05:00
rhysd f93646e17a ignore beta channel again on AppVeyor 
since rustc command crashes on combination of
channel=beta & target=i686-pc-windows-gnu
 2020-01-07 17:31:36 +09:00
rhysd 9d14b6dfea rename appveyor.yml to .appveyor.yml 
align to .travis.yml
 2020-01-07 15:28:29 +09:00
rhysd 9783b96524 check beta channel on CI not to break this crate with next Rust version 2020-01-07 15:28:29 +09:00
rhysd 106efe58ce fix nighly and beta on CI are failing 
we always use stable rustfmt so checking with nighly/beta rustfmt is not
necessary.
 2020-01-07 15:28:29 +09:00
rhysd 6e99ad13e7 upgrade reqwest to v0.10.0 
This will improve build time and binary size as follows:

* Before

- **Compile targets**: 220
- **Build time**: `cargo build --release  1264.95s user 39.72s system 335% cpu 6:29.14 total`
- **Binary size**: 6578568 bytes

* After

- **Compile targets**: 170
- **Build time**: `cargo build --release  1130.64s user 32.15s system 359% cpu 5:23.69 total`
- **Binary size**: 6107088 bytes

* Differences

- **Compile targets**: 1.29x smaller
- **Build time**: 1.23x faster
- **Binary size**: 1.07x smaller
 2020-01-07 14:22:32 +09:00
Sunshine 413dd66886
Merge pull request #96 from rhysd/refactorings 
Refactorings
 2020-01-05 18:46:31 -05:00
rhysd dc7ec6e7a8 remove more redundant type annotations 2020-01-04 16:33:11 +09:00
rhysd ed879231af fix test code was broken by refactoring 2020-01-04 08:07:19 +09:00
rhysd ddf4b8ac13 prefer &str to String for reducing allocations 2020-01-04 08:05:02 +09:00
rhysd 84c13f0605 prefer unwrap_or_default to unwrap_or 2020-01-04 07:58:29 +09:00
rhysd ce03e0e487 reduce allocation on checking DOM attributes and do not hard-code number of elements of array constant 
`to_lower` allocates new string but the allocation is not necessary
here.
 2020-01-04 07:52:47 +09:00
rhysd 63e19998d0 reduce clones and fix some code styles and redundant code 2020-01-04 07:49:26 +09:00
Sunshine e3321bbb07
Merge pull request #95 from rhysd/rust2018 
Migrate to Rust2018 edition
 2020-01-03 02:00:47 -05:00