Commit Graph

396 Commits

Author SHA1 Message Date
n1073645 7386c145ef Comments for OLE2 extractor. 2019-11-21 11:23:28 +00:00
n1073645 25ca8d85a6 Added extractor for OLE2 and modified the PLIST one. 2019-11-21 11:14:56 +00:00
n1073645 7a4ebbf47e Tidied up ExtractTAR 2019-11-18 08:42:46 +00:00
n1073645 2e7ce477d7 Tidied up ExtractTAR 2019-11-18 08:40:57 +00:00
n1073645 c1a22ef639 Made TAR extractor and MACHO signature more robust 2019-11-15 16:01:33 +00:00
n1073645 0a7b78b7ee Made TAR extractor and MACHO signature more robust 2019-11-15 15:46:13 +00:00
n1073645 e1cb62848c Made TAR extractor and MACHO signature more robust 2019-11-15 15:35:37 +00:00
n1073645 acf5c733c2 Tidied up local and global variables for Mach-o 2019-11-15 09:26:49 +00:00
n1073645 7c25e29515 Rectified magic bytes for MACHO extractor 2019-11-15 09:21:46 +00:00
n1073645 7c72871c02 Added Tar and Mach-O extractors 2019-11-14 17:17:25 +00:00
n1474335 03f4740968 Tidied up consumeWhile and consumeUntil 2019-11-13 18:04:36 +00:00
n1073645 c1878ca28b Linting adjustments 2019-11-13 17:15:54 +00:00
n1073645 e9b7a43b9a Adjustment to consumeWhile 2019-11-13 17:11:04 +00:00
n1073645 3921b4f445 Small correction to continueWhile 2019-11-13 09:59:55 +00:00
n1073645 dfd4cca43f Corrections 2019-11-13 09:02:36 +00:00
n1073645 9eda670026 up-to-date 2019-11-12 11:06:10 +00:00
n1073645 d3c13b118d Improved continueUntil, added consumeWhile and made the EVTX extractor more complete 2019-11-12 11:00:43 +00:00
n1073645 8e2345cf9e Improved continueUntil, added consumeWhile and made the EVTX extractor more complete 2019-11-11 16:08:03 +00:00
n1073645 d240d65c5f Improved continueUntil, added consumeWhile and made the EVTX extractor more complete 2019-11-11 15:47:16 +00:00
n1474335 e61b7d598e Tidied up FileSignatures.mjs 2019-11-08 17:34:25 +00:00
n1073645 eb81b9217e SQLITE, EVT, EVTX and Signatures added 2019-11-08 17:08:14 +00:00
n1073645 4d9bfcad20 Comment the WAV extractor. 2019-11-08 15:00:20 +00:00
n1073645 2387452a56 Comment the WAV extractor. 2019-11-08 14:59:06 +00:00
n1073645 a4772941a7 Added WAV extractor. 2019-11-08 14:56:54 +00:00
n1474335 04f1fa06ad Tidied up GIF and BZIP2 extractors 2019-11-08 13:49:39 +00:00
n1073645 f3864b00fe Made GIF extractor more robust 2019-11-08 13:40:09 +00:00
n1073645 51cc94bf2a Made GIF extractor more robust 2019-11-08 13:38:17 +00:00
n1073645 80362cfa84 Bzip2 extractor completed 2019-11-08 11:39:50 +00:00
n1073645 447a6d7524 Comments for GIF. 2019-11-07 16:50:10 +00:00
n1073645 f022440b4a Tidied GIFextractor 2019-11-07 16:20:09 +00:00
n1073645 4f5e0c007d GIF extractor for GIF89a 2019-11-07 15:06:30 +00:00
n1073645 b83f6591bb XZ compression 2019-11-07 10:13:40 +00:00
n1073645 77a9481cf9 xz compression 2019-11-07 09:20:24 +00:00
n1474335 875c1019b2 Merge branch 'blowfish-fix' of https://github.com/cbeuw/CyberChef into cbeuw-blowfish-fix 2019-11-06 13:22:50 +00:00
n1474335 e1378860d6 Added support for 109 more character encodings 2019-11-01 14:56:18 +00:00
n1474335 05e65a74ce Improved Magic scoring slightly 2019-10-28 17:26:13 +00:00
n1474335 9d73127cae Fixed some typos 2019-10-16 15:38:20 +01:00
n1474335 834ff95702 Base64 operations now throw a meaningful error if the alphabet is the wrong length 2019-10-15 16:25:52 +01:00
n1474335 ba2a5b195c Improved PE extractor to also carve the overlay if possible 2019-10-09 16:12:41 +01:00
n1474335 da901e20d9 Added several more file signatures. The background magic button now highlights when a file type has been detected. 2019-10-04 17:52:09 +01:00
n1474335 087cc6b8fd Fixed webm signature 2019-10-01 17:11:31 +01:00
n1474335 22028b074a Added support for many more file types to file signature operations 2019-10-01 16:54:19 +01:00
Andy Wang 912d63067c Fix #578 by refactoring and implementing the modes 2019-09-26 23:02:03 +01:00
n1474335 b31f32a7e7 Tidied up Bacon Cipher operations 2019-09-04 17:13:05 +01:00
n1474335 f0b3bd0ede Merge branch 'bacon' of https://github.com/kassi/CyberChef 2019-09-04 16:30:05 +01:00
n1474335 eb769c7fb4 Tidied up Steganography operations. FileType and toBase64 functions now accept ArrayBuffers. 2019-09-04 13:54:59 +01:00
n1474335 5bc5c0df90 Merge branch 'steganography' of https://github.com/Ge0rg3/CyberChef into Ge0rg3-steganography 2019-09-04 11:31:58 +01:00
n1474335 32c0d6f253 Updated dependencies 2019-08-30 18:49:05 +01:00
Ge0rg3 48831225ac Extract RGBA Values Operation 2019-08-28 09:58:00 +01:00
n1474335 094d352e5f Added eslint space-before-blocks rule 2019-08-27 18:13:33 +01:00
n1474335 82abdb50b1 Fixed bug in Protobuf library causing issues with long keys 2019-08-20 15:20:43 +01:00
n1474335 0e95ad8ed6 Updated a range of operations to use ArrayBuffers instead of byteArrays to improve performance with large files. 2019-07-29 17:09:46 +01:00
n1474335 566517d20f Imports now specify the file extension to support Node v12 2019-07-09 12:23:59 +01:00
d98762625 0de89f3145 Merge branch 'v9' of github.com:gchq/CyberChef into node-lib 2019-07-05 13:10:44 +01:00
n1474335 5eb3979504 Updated dependencies and linter 2019-07-05 12:22:52 +01:00
d98762625 368f508b17 Merge branch 'v9' of github.com:gchq/CyberChef into node-lib 2019-07-05 11:07:31 +01:00
d98762625 1c24c05647 swap ENVIRONMENT_IS_* functions for Utils named exports 2019-07-05 10:17:52 +01:00
n1474335 080886a2d1 Added support for psb, hdr, arw, raf, mrw, bct, mdi, au, auf, aif, aifc, arj, ace, hqx, alz, kgb, and torrent file detection. 2019-07-04 18:43:38 +01:00
n1474335 99f4091c1a Tidied up Streebog operation, splitting out GOST hash into a separate op. 2019-07-03 17:23:45 +01:00
j433866 1135ca5fb4 Remove duplicate function.
Fix reading QR codes with transparent backgrounds
2019-07-02 16:31:26 +01:00
j433866 f473807459 Bring up to date with master 2019-07-02 14:23:17 +01:00
n1474335 525cb0689f Added 'Protobuf Decode', 'VarInt Decode' and 'VarInt Encode' operations 2019-04-02 17:27:14 +01:00
j433866 c97e77c765 Merge with qr-improvements.
Change QR code ops to use ArrayBuffer.
Add new function to Utils to convert a string to arraybuffer.
2019-04-01 14:11:37 +01:00
n1474335 1640859542 Tidied up charts operations 2019-03-31 21:40:54 +01:00
n1474335 3d80d66925 Merge branch 'module-charts' of https://github.com/artemisbot/CyberChef into artemisbot-module-charts 2019-03-27 23:17:30 +00:00
mshwed 8707287349 Added percent delimiter for "To Hex" operation 2019-03-21 20:10:45 -04:00
j433866 6a01e40394 Fix bug where GIF input would error on output.
Also minor corrections to jsdocs in ImageManipulation
2019-03-20 11:20:34 +00:00
j433866 2cd3e9cacd Add new implementation of gaussian blur.
Changed SharpenImage to use the new algorithm.
2019-03-19 13:54:26 +00:00
Matt 3ad5f889a0 Wrote some tests, fixed imports for node 2019-03-14 13:37:11 +00:00
j433866 4fafa39e54 Fix magic library to better handle operation error 2019-03-13 13:09:02 +00:00
j433866 308195279c Bring up to date with master 2019-03-13 09:17:43 +00:00
s2224834 1a707eab86 Merge branch 'feature/bombe' into feature/typex 2019-03-12 18:21:34 +00:00
s2224834 fa6d5e60ce Merge branch 'master' into feature/bombe 2019-03-12 18:07:39 +00:00
Matt 66c0425080
Merge branch 'master' into module-charts 2019-03-11 11:57:19 +00:00
Matt f8874fc586 Actually made operations work (and made the module 8MB)
Unfortunately they need jsdom
2019-03-10 11:44:02 +00:00
Matt 4ae875601a Ported final two chart operations 2019-03-10 10:33:47 +00:00
n1474335 84d31c1d59 Added 'Move to input' button to output file list. Improved zlib extraction efficiency. 2019-03-09 06:25:27 +00:00
j433866 21a8d03201 Move parsing and generation of QR codes to lib folder.
Also rewrote QR code parsing to be more readable and actually error out properly.
2019-03-07 13:21:26 +00:00
Karsten Silkenbäumer ad571e6019 Change author URL 2019-03-03 17:20:54 +01:00
Karsten Silkenbäumer d36cede0c7 Use better names for the alphabet selection 2019-03-02 17:55:03 +01:00
Karsten Silkenbäumer a262d70b88 Add Bacon cipher encoding 2019-03-02 17:33:17 +01:00
n1474335 9fa7edffbf Improved file extraction error handling 2019-03-02 16:12:21 +00:00
n1474335 24a47445f6 Merge branch 'master' into feature-extract-files 2019-03-02 15:40:32 +00:00
Karsten Silkenbäumer 77b098c5fe Add Bacon cipher decoding 2019-03-02 15:00:42 +01:00
s2224834 2be642e4c9 Merge branch 'feature/bombe' into feature/typex 2019-02-28 17:00:33 +00:00
s2224834 934356dea8 Tweaks for new rotor order 2019-02-28 16:56:28 +00:00
s2224834 a037bf6f9d Merge branch 'master' into feature/bombe 2019-02-28 16:29:21 +00:00
Matt da2d5674a5 Ported heatmap and hex density chart ops 2019-02-23 00:41:19 +00:00
s2224834 dd9cbbac77 Bombe: add note about rotor step in crib 2019-02-09 23:01:52 +00:00
s2224834 069d4956aa Bombe: Handle boxing stop correctly 2019-02-09 22:57:57 +00:00
s2224834 61fee3122a Bombe: add Rebuild Project to authors 2019-02-08 21:16:42 +00:00
s2224834 5a2a8b4c8e Typex: input wiring is reversed 2019-02-08 18:53:08 +00:00
s2224834 220053c044 Typex: add ring setting 2019-02-07 18:10:16 +00:00
j433866 3209c94622 Fix conversion breaking when compass directions are used as delimiters 2019-01-21 12:50:30 +00:00
n1474335 69837837b0 Tidied up co-ordinate operation 2019-01-18 17:14:25 +00:00
n1474335 03d8bf2836 Merge branch 'coordinates' of https://github.com/j433866/CyberChef into j433866-coordinates 2019-01-18 16:05:44 +00:00
j433866 4bd923dc06 Improved handling of negative numbers and weirder inputs.
Negative numbers shouldn't make it go weird any more.
Automatic detection of input formats should be more reliable.
2019-01-17 13:53:42 +00:00
j433866 d00b0f4c0e Basically rewrote the whole thing using the new geodesy module 2019-01-15 15:55:49 +00:00
j433866 5e68959c03 Catch when OS grid references aren't calculated 2019-01-15 10:25:49 +00:00
j433866 ad4451a757 Rewrite MGRS to use new Geodesy module.
Added Ordnance Survey grid reference support
2019-01-15 10:13:11 +00:00
n1474335 cd2c8078c8 Added ELF extractor. You can now specific which categories to search for in file type operations. 2019-01-14 18:55:10 +00:00
j433866 04b0b8c723 Tidy up code 2019-01-14 14:58:41 +00:00
j433866 b3ac8d0835 Removed some debug logging 2019-01-14 13:49:49 +00:00
j433866 1a88a0164c Fix delimiter breaking Geohash detection 2019-01-14 13:00:14 +00:00
j433866 68fbbb64db Add new Convert co-ordinate format module.
Also added autodetect of co-ordinate format / delimiter
2019-01-14 11:49:57 +00:00
s2224834 eee92aa1aa Bombe: fix some outdated docs 2019-01-12 12:56:21 +00:00
s2224834 74eb4cca86 Bombe: tweaks
Twiddle the default rotor sets a bit.
Add a time remaining estimate for the multibombe.
2019-01-12 01:35:24 +00:00
s2224834 49f5c94a75 Bombe: further optimisation 2019-01-12 01:10:47 +00:00
s2224834 d94e8c8187 Bombe: wording/docs tweaks 2019-01-11 18:24:16 +00:00
n1474335 2307325af8 Added Zlib extraction 2019-01-11 17:58:25 +00:00
n1474335 4e57b4be88 Completed GZIP extraction 2019-01-11 17:44:13 +00:00
s2224834 21335e7d05 Bombe: Add checking machine 2019-01-11 13:18:25 +00:00
j433866 abdd70c6fa Add ConvertCoordinates to lib folder 2019-01-11 11:59:13 +00:00
s2224834 78768e00d4 Bombe: Firefox optimisation
Switch a couple of for of loops in the critical path for classic fors.
This loses about 10% performance in Chrome, but it brings Firefox
performance in line with Chrome's, rather than 2.5 times slower.
2019-01-10 18:49:06 +00:00
s2224834 3eb44708e5 Add MultiBombe
Runs the Bombe multiple times with different rotor specs.
Edits the core BombeMachine a little to add the ability to switch rotors
without rewiring everything
2019-01-10 18:04:02 +00:00
n1474335 c077b22410 Stream.readBits() method implemented. Unfinished. 2019-01-10 17:30:52 +00:00
s2224834 8c757d1e03 Bombe: optimise
This cuts about 85% off the execution time.
2019-01-09 21:07:05 +00:00
n1474335 c49a770c59 Tidied up Lorem Ipsum op 2019-01-09 16:36:34 +00:00
s2224834 e74c86842b Bombe: add trial decryption preview 2019-01-08 19:37:34 +00:00
s2224834 ad6e30f3d4 Bombe: review, tests, validation 2019-01-08 18:25:42 +00:00
s2224834 b6eb4e84e4 Add Bombe operation
Still needs some work, but functional
2019-01-07 19:48:44 +00:00
n1474335 2a6db47aeb Began implementing GZIP/DEFLATE extraction. Unfinished. 2019-01-04 18:12:49 +00:00
n1474335 19b7957523 Added RTF extractor 2019-01-04 14:57:31 +00:00
s2224834 1b1a3c261d Typex: random rotors 2019-01-04 13:21:15 +00:00
n1474335 0d2cb02f97 Fixed FLV previous tag size error 2019-01-04 11:49:12 +00:00
n1474335 7d8d80ca2c Added extractor for MS Office 2007+ files 2019-01-03 19:01:12 +00:00
s2224834 53cc413eae Typex: move machine implementation to lib/ 2019-01-03 18:49:01 +00:00
n1474335 0449c46b38 Added FLV extractor. 2019-01-03 18:40:22 +00:00
s2224834 088864fd9c Add Enigma operation 2019-01-03 16:36:56 +00:00
n1474335 cd0c86e0d6 File scan now uses bytesMatch() instead of signatureMatches(), reducing call stack size 2019-01-03 13:03:41 +00:00
n1474335 a56f92cdee Significantly improved performance when scanning for embedded files by implementing a fastcheck algorithm. 2019-01-02 17:50:47 +00:00
n1474335 4c285bce57 Refactored scanning for file types to be more than twice as fast. 2019-01-01 15:12:01 +00:00
n1474335 ede75530d0 Added PNG and BMP extractors 2018-12-30 02:21:45 +00:00
Klaxon f2d115ee4d add lorem ipsum generator 2018-12-29 00:44:59 +10:00
n1474335 0198f05112 Added and improved file signatures. 2018-12-27 00:03:41 +00:00
n1474335 729307336e Converted all previous file signatures to the new format. 2018-12-26 23:19:46 +00:00
n1474335 f4f9b5c91c Added 'isImage' and 'isType' functions 2018-12-26 18:40:27 +00:00
n1474335 8d3836cb16 Added support for a number of further file types and file detection methods. 2018-12-21 12:48:08 +00:00
n1474335 9829491c4c Merge branch 'master' into feature-extract-files 2018-12-20 12:28:23 +00:00
n1474335 ed2c886359 Magic crib now only applies after all branches have been explored. 2018-12-19 17:24:38 +00:00
j433866 f600571c6d Fix to make the filter work when intensive mode was turned on. 2018-12-19 09:42:09 +00:00
n1474335 e6fb0be1d0 Refactored file type detection engine 2018-12-18 17:44:42 +00:00
j433866 c8eab5d218 Commenting 2018-12-18 14:06:39 +00:00
j433866 367d79e820 Fix filtering to work on all the data and not just the result snippet 2018-12-18 11:55:49 +00:00
j433866 283d7f2159 Add Output Filter option to Magic operation 2018-12-18 10:40:18 +00:00
n1474335 6aa9d2b492 Added 'Extract Files' operation and 'Forensics' category. 2018-12-14 16:43:03 +00:00
n1474335 4cf80e3ebb Added RFC numbers to relevant Base64 alphabets. Closes #410 2018-11-19 14:34:52 +00:00
n1474335 42b956e402 Fixed JSDoc comment 2018-11-09 15:28:47 +00:00
n1474335 42e881326f Added 'Binary' key option to all bitwise operations. Closes #398 2018-11-09 15:25:16 +00:00
n1474335 53c500eb1b Added various options to the 'Defang URL' operation. 2018-11-07 13:23:05 +00:00
n1474335 e6b89d571e Tidied up TLV operation and tests 2018-10-10 13:56:20 +00:00
n1474335 a15af602e0 Merge branch 'tlv' of https://github.com/GCHQ77703/CyberChef into GCHQ77703-tlv 2018-08-31 15:12:54 +00:00
n1474335 56946a66aa Merge branch 'feature/improve-parse-ip-range' of https://github.com/klaxon1/CyberChef into klaxon1-feature/improve-parse-ip-range 2018-08-29 18:48:29 +00:00
n1474335 7396117d89 Merge branch 'cascadexor-new' of https://github.com/PenguinGeorge/CyberChef into PenguinGeorge-cascadexor-new 2018-08-29 17:31:59 +00:00
Klaxon 2820660264 fix regex issues and ESlint errors and warnings
fix comment

fix ESlint errors and warnings

fix regex

add author
2018-08-28 23:07:53 +10:00
Klaxon ce494339ef add parse IPv6 list 2018-08-28 23:07:32 +10:00
Klaxon dd5af7eb10 add parse IPv4 list 2018-08-28 23:07:04 +10:00
GCHQ 77703 032b4bed7f Add Length Value Decoder Operatoin 2018-08-27 01:17:06 +01:00
George J 70d4e3394c Updated XOR to include Cascade scheme 2018-08-24 22:33:24 +01:00
n1474335 2a49af1ec3 'To Braille' and 'From Braille' operations added. Closes #255 2018-08-24 01:07:51 +01:00
n1474335 61f2f2d2e3 'Show Base64 offsets' operation show supports base64 input. Closes #276 2018-08-24 00:32:52 +01:00
n1474335 032f8808ef Fixed typo in Z85 alphabet 2018-08-23 22:56:18 +01:00
n1474335 8e9fece77d Tidied up Base85 ops 2018-08-23 22:05:31 +01:00
George J 2d9e8773f5 Updated Base85 operations for latest CyberChef version 2018-08-22 20:24:32 +01:00
n1474335 affe057cab Added 'Decimal' option for toggleStrings. Closes #337. 2018-08-19 22:50:49 +01:00
n1474335 9b7f4e824a Improvements and basic tests for Magic op and addition of deep cloning for dishes 2018-08-09 19:17:24 +01:00
n1474335 651ca6cf5d Fixed all HTML operations 2018-07-15 13:25:44 +01:00
n1474335 ab44100312 Changed table-condensed to table-sm 2018-07-13 13:03:13 +00:00
n1474335 40a1da10e3 Merge branch 'esm' of github.com:gchq/CyberChef into esm 2018-06-03 17:33:39 +01:00
n1474335 1ef4f71d8b ESM: Added BackgroundWorkerWaiter for running Magic on output in the background 2018-06-03 17:33:13 +01:00
n1474335 a0f034b843 ESM: Fixed magic errors 2018-06-01 12:43:36 +00:00
n1474335 6a4bc3c9df ESM: Fixed PGP ops and added tests 2018-05-29 16:00:24 +00:00
n1474335 7f9a2eeb6b ESM: Tidied up IP operations 2018-05-29 00:48:30 +01:00
n1474335 3f3a3e0016 ESM: Tidied up recently added operations 2018-05-28 15:42:43 -07:00
Matt C 049656ec6b ESM: Ported PublicKey operations 2018-05-27 23:53:43 +01:00
n1474335 6768038a2f ESM: Tidied up recently ported ops 2018-05-27 16:13:18 +01:00
Matt C 905bc6699e ESM: Ported case converters, generic beautifier and syntax highlighting 2018-05-26 18:04:53 +01:00
Matt C 95f81ad740 Ported Bitwise operations
also enabled bitshift tests
2018-05-23 18:59:57 +01:00
n1474335 0d1e5311dc ESM: Changed thrown errors to OperationErrors 2018-05-21 18:34:52 +00:00
n1474335 28b24b725f ESM: Tidied up FlowControl ops 2018-05-21 11:39:10 +00:00
d98762625 10556f528f update comments 2018-05-21 11:12:58 +01:00
d98762625 046e1ebad9 Merge branch 'esm' into port-flowcontrol 2018-05-21 09:02:58 +01:00
n1474335 ee519c7352 Merged esm branch into feature-magic. Ported FileType ops. 2018-05-20 16:49:42 +01:00
d98762625 ec0ecf5151 add comments 2018-05-18 12:52:16 +01:00
d98762625 bfb405c4a6 Add Jump 2018-05-18 12:50:23 +01:00
n1474335 3fd1f4e6d9 ESM: Ported all Hash and Checksum operations 2018-05-17 15:11:34 +00:00
Callum Fraser 3ba12ae9ac Made variables non-private, and followed convention for the references to the IP lib. 2018-05-16 22:32:46 +01:00
Callum Fraser ea36687205 Merge branch 'esm' of https://github.com/gchq/CyberChef into ip-convert 2018-05-16 21:52:40 +01:00
Callum Fraser 1920e9c7fb Added more content to the Ip.mjs file, required for other functions. 2018-05-16 21:37:48 +01:00
n1474335 f26d175cad ESM: Ported Base58, Base and BCD operations 2018-05-16 16:25:05 +00:00
n1474335 84df055888 ESM: Ported MS and Entropy operations 2018-05-16 11:39:30 +01:00
n1474335 b760c2f1a0 ESM: Fixed OperationError detection and tidied up ops. 2018-05-16 10:17:49 +01:00
n1474335 acb8a342a7 Merge branch 'esmconversion' of https://github.com/artemisbot/CyberChef into esm 2018-05-16 09:28:24 +01:00
Callum Fraser 8d2adfaae7 Updated the Ip core file with more required functions/variables 2018-05-15 23:48:18 +01:00
Callum Fraser 39ba83eefb Created a Ip for now which contains all the helper functions, they may be moved into their corrosponding files in the future 2018-05-15 23:30:35 +01:00
Matt C b3ee251ee3 ESM: Port Extract.js module 2018-05-15 16:30:17 +01:00
n1474335 e41eb3d8a2 Merge branch 'port-arithmetic' of https://github.com/d98762625/CyberChef into esm 2018-05-15 15:16:56 +00:00
Matt C 285e512483 Actually made these ops work 2018-05-15 16:04:57 +01:00
n1474335 b8d3b33963 ESM: Ported CharEnc operations 2018-05-15 15:03:41 +00:00
d98762625 3bbfc130d4 create arithmetic specific delimiter options 2018-05-15 14:59:28 +01:00