Commit Graph

56 Commits

Author SHA1 Message Date
Sunshine 89ce5029b9
add option to blacklist/whitelist domains 2022-09-01 13:35:52 -10:00
Sunshine 0df8613789
Rewrite part of function retrieve_asset, include support for brotli and deflate (#312)
do not crash the app if reqwest throws, add support for deflate & brotli
2022-08-06 19:07:39 -10:00
Sunshine 2cc1870033
get rid of macros, move tests out of src 2021-10-16 21:16:37 -10:00
Sunshine 4bc8043f0f
account for charset when creating data URLs 2021-06-08 12:54:16 -10:00
Sunshine b8aa545e8c
add support for wider range of charsets 2021-06-08 02:30:15 -10:00
Sunshine 2e86ee67a5
revamp codebase 2021-03-11 14:15:18 -10:00
Sunshine 4921a70dda
Merge branch 'master' into change-meta-charset-to-utf-8 2021-02-23 23:38:03 -10:00
Sunshine e0273c664a
forcefully set document's charset to UTF-8 2021-02-23 23:35:35 -10:00
Sunshine 9a27c6c5ee
add color to asset download log 2021-01-29 20:24:35 -10:00
Sunshine 15d98a7269
don't modify base url by default, add option for setting it 2020-12-24 18:38:44 -10:00
Sunshine 38a6f963ad
account for network errors, add option to ignore them 2020-11-22 16:49:26 -10:00
Sunshine bc98aca2a2
indent items in retrieval log to form a tree-like structure 2020-06-28 16:11:15 -04:00
Sunshine 5c229c51da
move functions related to URL manipulation into url.rs 2020-06-24 03:16:40 -04:00
Sunshine f6ea16b3ad
create a separate function for appending URL fragments 2020-06-24 02:26:05 -04:00
Sunshine a18df74946
refactor code and implement integrity validation 2020-05-12 02:51:37 -04:00
Sunshine edacd09dc8
store blobs instead of data URLs in cache 2020-04-19 13:26:14 -04:00
Sunshine 594ad55bd8
improve data URL media type detection 2020-04-10 05:50:33 -04:00
Sunshine c097733ae7
improve parsing of data URLs 2020-04-09 20:27:07 -04:00
Sunshine 4951fea730
implement full CSS parsing 2020-04-02 01:09:32 -04:00
Sunshine be25784297
improve SVG media type detection 2020-03-24 08:50:39 -04:00
Sunshine 479c42e1ce
improve test code structure 2020-03-22 22:08:41 -04:00
Sunshine 59a8be493d
add support for working with local assets 2020-03-22 15:48:23 -04:00
Sunshine 0d1e21e9ad
add black box tests 2020-02-23 22:48:14 -05:00
Sunshine 3d2d40e7cd
add support for data URL targets 2020-02-23 22:25:37 -05:00
Sunshine 928664dc88
correct is_valid_url to is_http_url 2020-02-23 22:24:33 -05:00
Sunshine 5c8d75539b
rename dataurl to data_url 2020-02-23 22:24:32 -05:00
rhysd 6e99ad13e7 upgrade reqwest to v0.10.0
This will improve build time and binary size as follows:

* Before

- **Compile targets**: 220
- **Build time**: `cargo build --release  1264.95s user 39.72s system 335% cpu 6:29.14 total`
- **Binary size**: 6578568 bytes

* After

- **Compile targets**: 170
- **Build time**: `cargo build --release  1130.64s user 32.15s system 359% cpu 5:23.69 total`
- **Binary size**: 6107088 bytes

* Differences

- **Compile targets**: 1.29x smaller
- **Build time**: 1.23x faster
- **Binary size**: 1.07x smaller
2020-01-07 14:22:32 +09:00
rhysd 75fb6961ed migrate to Rust 2018 2020-01-03 00:33:49 +09:00
Sunshine c7fc121c7c use clean URLs as hashmap keys 2019-12-18 11:49:38 -05:00
Emi Simpson 3d4a932ac1
Merge Y2Z/master, fix conflicts between shared-client & resolve-css 2019-12-12 19:29:21 -05:00
Emi Simpson 614af44c92
Gramatical and stylistic fixes 2019-12-09 13:58:12 -05:00
Emi Simpson 028beb821c
Rustfmt update for nightly formatter 2019-12-06 16:46:52 -05:00
Emi Simpson 76ccff80f9
Fixed failure of regex to match @imports 2019-12-06 16:15:34 -05:00
Emi Simpson a4743ca92f
Respect the --no-images flag while parsing CSS 2019-12-06 15:00:06 -05:00
Emi Simpson b96a777e8a
Merge commit '4decea7' into load-css-imports 2019-12-06 13:56:36 -05:00
Emi Simpson 4decea716c
Fixed css replacement with more than one linked asset 2019-12-06 13:55:43 -05:00
Emi Simpson 695a787206
Moved regex compilation to lazy_static 2019-12-06 13:53:44 -05:00
Emi Simpson 90e6cb1c45
Prevent crash on URLs delimited by single quotes 2019-12-06 11:52:31 -05:00
Emi Simpson 7412d663e0
Use a slightly more efficient .replace_range() instead of cloning the string twice 2019-12-06 11:37:05 -05:00
Emi Simpson de383c94b1
Applied rustfmt 2019-12-05 20:41:43 -05:00
Emi Simpson ab65b44f0d
Cleaned up some overcomplicated code 2019-12-05 20:22:39 -05:00
Emi Simpson 13bacb4320
EMPTY_STRING no longer used 2019-12-05 20:11:19 -05:00
Emi Simpson d574e9a5da
Added support for <style> tags 2019-12-05 20:05:52 -05:00
Emi Simpson d3956a7905
Made merge compatible with Y2Z/master 2019-12-05 19:01:03 -05:00
Emi Simpson ef7ddcd434
Added fallback to absolute URL on failure to resolve CSS stylesheet @imports 2019-12-05 18:37:37 -05:00
Emi Simpson 11bbfc0851
Added support for recursively nested css @imports 2019-12-05 18:15:06 -05:00
Emi Simpson a2bf7e3345
Fixed some errors detecting, parsing, and transforming urls in `resolve_css_imports` 2019-12-05 17:42:07 -05:00
knidarkness 550e4cc83f Fixed formatting 2019-10-12 14:05:07 +03:00
knidarkness 5443c0cc3f Added loading of the links given as url(...) in css files 2019-10-12 12:32:59 +03:00
robatipoor 55fe523a1c refactor utils functions 2019-10-10 16:53:00 +03:30