Commit graph

511 commits

Author SHA1 Message Date
Son NK
e48f19afb5 use info level for set message-id 2020-12-18 15:34:01 +01:00
Son NK
efc6b32ce0 black 2020-12-16 20:34:31 +01:00
Son NK
866ef1c139 increase the max_nb_alert 2020-12-16 20:30:27 +01:00
Son NK
2f803e4714 refactoring: move template to folder 2020-12-16 18:51:14 +01:00
Son NK
ae9abe8512 remove unused var 2020-12-16 18:50:09 +01:00
Son NK
30b2182694 use should_disable to decide whether an alias should be disabled 2020-12-16 18:50:09 +01:00
Son NK
8d72d66d08 keep References and In-Reply-To in reply phase for a correct email thread 2020-12-11 11:13:19 +01:00
Son NK
b2e1682704 do not override message-id in forward phase 2020-12-11 11:12:38 +01:00
Son NK
c1ad161db7 add email_log to get_spam_score 2020-12-11 11:05:01 +01:00
Son NK
93503d4cd3 Do not rely on revert to delete EmailLog object when pgp fails 2020-12-11 11:03:52 +01:00
Son NK
f03bde1d8d remove _MESSAGE_ID 2020-12-11 11:02:52 +01:00
Son Nguyen Kim
bf139f83b3
Merge pull request #342 from herrboyer/linting
Linting
2020-12-07 17:45:50 +01:00
Renaud Boyer
5d948faf56 black 2020-12-06 22:11:58 +01:00
Son NK
ce2d68a64d take into account include_sender_in_reverse_alias when creating reverse-alias 2020-12-06 19:37:20 +01:00
Renaud Boyer
b16bfaac35 liniting 2020-12-06 13:54:59 +01:00
Son NK
d150dfacdb rename contact_from_header -> from_header 2020-12-05 18:15:53 +01:00
Son NK
8c5f311367 prefer using Reply-To header when creating a new contact 2020-12-05 18:15:00 +01:00
Son NK
b7fdbe7721 log more 2020-12-02 12:40:29 +01:00
Son NK
4d89ac4158 replace replace_str_in_msg() by replace() 2020-11-30 15:15:44 +01:00
Son NK
22b082fd55 use warning for invalid contact email 2020-11-30 10:50:16 +01:00
Son NK
59745b68d0 use warning level when cannot encrypt using python-gnupg 2020-11-27 20:35:57 +01:00
Son NK
e7b83fadbc trigger build 2020-11-26 10:38:48 +01:00
Son NK
3efa96020b use warning level for invalid contact email 2020-11-26 10:06:16 +01:00
Son NK
e2f0a72ab7 log headers in case a contact email is skipped 2020-11-26 09:49:03 +01:00
Son NK
dcd116f11a use mail_from as fallback when contact_email is not valid 2020-11-25 17:50:25 +01:00
Son NK
ac1a6f5613 skip invalid contact in replace_header_when_forward() 2020-11-25 15:21:01 +01:00
Son NK
dfcb74dc87 do not create contact with invalid email in get_or_create_contact() 2020-11-25 15:20:42 +01:00
Son NK
609d59d23f improve logging 2020-11-25 15:20:00 +01:00
Son NK
2f882b81fe sleep before retry 2020-11-25 14:56:54 +01:00
Son NK
5e1a68cdee retry 1 more if SMTPServerDisconnected 2020-11-25 14:43:02 +01:00
Son NK
4f211bba61 fix subject not correctly decoded in spf-fail email 2020-11-25 09:53:27 +01:00
Son NK
272c5628bb fix 2020-11-24 17:02:09 +01:00
Son NK
297857a140 Remove _MAILBOX_ID_HEADER 2020-11-24 16:50:55 +01:00
Son NK
5231483026 add doc 2020-11-24 16:38:54 +01:00
Son NK
fb465ba03e use exception log for the case where mailbox is an alias 2020-11-24 16:38:49 +01:00
Son NK
54942cdf65 set EmailLog.mailbox_id in forward and reply phase. A EmailLog for each mailbox in forward phase. 2020-11-24 16:38:34 +01:00
Son NK
c28872288b black 2020-11-24 11:28:14 +01:00
Son NK
c707342695 Use pgp_enabled() instead of pgp_finger_print 2020-11-24 11:22:41 +01:00
Son NK
bcdf522174 create normalize_reply_email(): handle case where reply email contains space, quote, etc 2020-11-22 13:07:09 +01:00
Son NK
f069d2f083 use getaddresses to parse multiple address from To, CC header. Remove get_addrs_from_header() 2020-11-21 19:15:02 +01:00
Son NK
c53fe90484 fix email subject 2020-11-18 16:16:37 +01:00
Son NK
30185a2798 handle the case where reply_email is not ascii 2020-11-18 16:11:00 +01:00
Son NK
78cb49095a fix reply_email not set 2020-11-18 11:48:09 +01:00
Son NK
319078fceb use contact email when generating reply-email 2020-11-18 10:24:39 +01:00
Son NK
9154b4656d refactor: create is_reply_email() 2020-11-16 19:22:19 +01:00
Son NK
75ba1669e0 Create generate_reply_email() and refactor 2020-11-16 19:15:09 +01:00
Son NK
496be08639 handle case where contact address is empty/invalid 2020-11-14 15:55:53 +01:00
Son NK
b4d1b3950d log SA report 2020-11-12 12:11:39 +01:00
Son NK
c3f73b25b2 decode the subject 2020-11-09 21:16:50 +01:00
Son NK
21839d579c log more 2020-11-09 17:03:47 +01:00
Son NK
2cc7cb6a37 use to_bytes instead of .as_bytes() 2020-11-09 17:02:10 +01:00
Son NK
4d03d2fe04 Fix subject 2020-11-07 17:23:28 +01:00
Son NK
78f5f27d5d add more debugging 2020-11-07 16:12:28 +01:00
Son NK
6a68141d8d Use mailbox generic subject for forwarded emails 2020-11-07 13:00:45 +01:00
Son NK
5ef3ab4d74 disable handle_bounce_reply_phase 2020-11-05 10:26:19 +01:00
Son NK
d0ca773376 not forward email that has invalid from address 2020-11-05 10:26:09 +01:00
Son NK
352cd978bd add debug 2020-11-04 19:42:20 +01:00
Son NK
6585aef443 use warning level 2020-11-04 16:11:32 +01:00
Son NK
3dee121bec improve handle_bounce_reply_phase 2020-11-04 15:38:26 +01:00
Son NK
3a03dec077 simplify code 2020-11-04 14:55:54 +01:00
Son NK
009236e623 add debug code when bounce message cannot be parsed 2020-11-04 13:37:33 +01:00
Son NK
6c626520d3 handle_bounce_reply_phase 2020-11-04 12:32:15 +01:00
Son NK
5a7df14d58 use msg.as_bytes() to sign instead of as_string() 2020-11-03 13:30:37 +01:00
Son NK
8d0e243c83 sign PGP forwarded email if PGP_SENDER_PRIVATE_KEY 2020-11-02 19:09:57 +01:00
Son NK
63788125da save bounce email sent to an alias when 2020-11-02 15:10:03 +01:00
Son NK
c41c36acaa set "date" header in forward phase if needed 2020-11-02 14:53:22 +01:00
Son NK
38877598cf fix handle_reply: do not delete _MIME_HEADERS headers, add Date header 2020-11-02 14:51:37 +01:00
Son NK
756e8080ab handle case msg.get_payload(decode=True) is None 2020-11-01 18:38:21 +01:00
Son NK
1d0aa0f900 fix doc 2020-11-01 18:13:50 +01:00
Son NK
7337110110 Remove all headers in reply phase 2020-11-01 18:12:09 +01:00
Son NK
593e81705b Handle case Content-Type and Mime-Version are missing in prepare_pgp_message 2020-11-01 18:06:28 +01:00
Son NK
53e57eee42 clone orig message in prepare_pgp_message 2020-11-01 18:06:05 +01:00
Son NK
7ca74eaa6f replace-reverse-alias and pgp encryption before modifying message header in reply phase 2020-11-01 18:02:43 +01:00
Son NK
0307793666 use pgpy as fallback for gpg 2020-10-28 17:07:53 +01:00
Son NK
5a190ed840 use pgpy if python-gnupg fails 2020-10-28 12:21:24 +01:00
Son NK
9210459a72 add pgpy
- add pgpy to poetry
- add test PGP keys to local_data
- add encrypt_file_with_pgpy()
- use randomly pgpy
2020-10-28 11:50:14 +01:00
Son NK
aa1cac521b Set X-SimpleLogin-Envelope-From header in forward phase 2020-10-27 11:03:56 +01:00
Son NK
8f6550f992 update contact.mail_from and contact.from_header if needed 2020-10-27 10:40:54 +01:00
Son NK
4a7b73a218 use warning log for disabled account 2020-10-26 10:33:53 +01:00
Son NK
bdec727cd1 allow mailbox's authorized address to unsubscribe alias 2020-10-23 13:29:20 +02:00
Son NK
bfa59dcdd9 fix 2020-10-22 12:26:45 +02:00
Son NK
ea45ac119e Refactor: create Alias.unsubscribe_link 2020-10-22 10:37:02 +02:00
Son NK
f624085aa3 handle newsletter unsubscribe when the subject=user_id* 2020-10-22 10:34:52 +02:00
Son NK
1fcf166c00 small refactor: add should_add_dkim_signature 2020-10-15 16:24:04 +02:00
Son NK
e79522b638 take into account Premium domains 2020-10-15 16:21:31 +02:00
Son NK
805e78cad1 rename email_belongs_to_alias_domains -> email_belongs_to_default_domains 2020-10-14 18:46:05 +02:00
Son NK
8268568f08 add mailbox.disabled column. Disable a mailbox if it fails tests for 10 days consecutive. 2020-10-12 13:28:21 +02:00
Son NK
6993721ae2 disable email forwards/sending if user is disabled 2020-10-04 12:49:43 +02:00
Son NK
6253a4eb23 set SpamAssassin timeout to 300s 2020-09-30 14:03:19 +02:00
Son NK
abc42df0fb create get_spam_score() as a sync function, use a simpler version for running MailHandler. Remove async/await 2020-09-30 11:05:21 +02:00
Son NK
61e4455406 logging more for spamassassin 2020-09-29 16:00:53 +02:00
Son NK
d7ca639dc1 format 2020-09-29 13:11:04 +02:00
Son NK
65938d2fb7 improve email template 2020-09-29 13:03:15 +02:00
Son NK
e8ccbced59 refactor code: wrap smtp.sendmail into sl_sendmail() 2020-09-29 12:57:14 +02:00
Son NK
17ef292779 update reply-must-use-personal-email template 2020-09-29 11:00:50 +02:00
Son NK
0a7643b367 take into account mailbox authorized address when check for spoofing 2020-09-28 17:43:09 +02:00
Son NK
063885ccf7 Add get_mailbox_from_mail_from() 2020-09-28 17:41:16 +02:00
Son NK
740d31871d remove asyncio.shield 2020-09-17 17:03:20 +02:00
Son NK
5f8fff5af3 wrap shield around aiospamc.check to avoid the task being canceled 2020-09-16 19:47:12 +02:00
Son NK
25118dff9b use parseaddr_unicode instead of parseaddr 2020-09-16 17:28:15 +02:00
Son NK
5c8d31111c add contact to handle_unknown_mailbox logging 2020-09-16 17:24:42 +02:00
Son NK
b9b442294b remove unnecessary sanitize on mailbox email 2020-09-14 20:02:46 +02:00
Son NK
cb2033443c fill up contact mail_from, from_header if possible 2020-09-14 18:22:26 +02:00
Son NK
1ab36bd22b remove unnecessary email address sanitize 2020-09-14 17:38:48 +02:00
Son NK
ed2e748d1e sanitize envelope mail_from and rcpt_tos 2020-09-14 17:30:01 +02:00
Son NK
e6dd2f1717 do not forward to unverified mailbox 2020-09-10 09:38:30 +02:00
Son NK
0c9106717b handle case where contact is concurrently created 2020-09-09 17:00:07 +02:00
Son NK
15d7f6407e fix compatible with mailvelope add name=encrypted.asc 2020-09-08 11:10:22 +02:00
Son NK
e36768824f handle the case contact already added 2020-09-03 19:42:52 +02:00
Son NK
b83c513607 use warning level 2020-09-03 15:43:33 +02:00
Son NK
0dbc755790 use warning level when not able to parse email-log-id 2020-09-03 15:43:01 +02:00
Son NK
a25559dace able to choose port to listen on in email_handler. Default to 20381 2020-09-02 17:36:11 +02:00
Son NK
d97966a2e8 use warning level when cannot parse mailbox-id 2020-09-02 10:26:46 +02:00
Son NK
5ea3d1bd42 use warning level for when email_log cannot be parsed 2020-09-02 10:25:12 +02:00
Son NK
b7b4c07cd3 use warning level for SMTPRecipientsRefused error 2020-09-02 10:20:04 +02:00
Son NK
c03bb70755 handle SMTPRecipientsRefused in forward phase 2020-09-02 10:16:13 +02:00
Son NK
916e6a1a7f remove whitespace for rcpt in forward phase 2020-09-02 09:58:58 +02:00
Son NK
85b87bbacb improve send_email_with_rate_control to use on any day range 2020-08-31 17:32:46 +02:00
Son NK
8079746e47 handle case where alias mailbox is invalid 2020-08-30 19:22:21 +02:00
Son NK
171100eda7 return 421 in case mailbox is invalid 2020-08-30 19:08:53 +02:00
Son NK
e117726cd9 send alert email when a mailbox is an email alias 2020-08-30 19:06:50 +02:00
Son NK
e4271f725c update "reply must from mailbox" email wording 2020-08-27 11:12:48 +02:00
Son NK
a6df989a8f update cycle email subject 2020-08-27 11:10:16 +02:00
Son NK
4a90ea9aca send warning about email cycle at most once 2020-08-27 10:43:48 +02:00
Son NK
fdedc24358 black new version 2020-08-27 10:20:48 +02:00
Son NK
bb6e2a35ca send at max 1 email / day for the cycle email issue 2020-08-27 10:16:13 +02:00
Son NK
26ecf38760 use warning log level for cycle email issue 2020-08-27 10:15:40 +02:00
Son NK
828d9e4fe1 ignore spoof check if alias.disable_email_spoofing_check 2020-08-26 14:39:51 +02:00
Son NK
ab911fd55e do not forward cycle email: email sent to alias from its mailbox 2020-08-25 12:51:19 +02:00
Son NK
ce791567f1 delete header if empty when replacing header 2020-08-25 12:51:19 +02:00
Son NK
61fd81489f Set _EMAIL_LOG_ID_HEADER header for reply phase 2020-08-25 12:51:19 +02:00
Son NK
b53cc94310 set "X-SimpleLogin-Type" header for reply phase 2020-08-25 12:51:19 +02:00
Son NK
d410b34b50 set a custom Message-ID header 2020-08-25 12:51:19 +02:00
Son NK
0bb10d8fc3 add spam score processing time for forward phase 2020-08-24 18:39:16 +02:00
Son NK
ffa9304d00 log waiting time for get_spam_score 2020-08-24 17:47:56 +02:00
Son NK
9cf807f7bd special handling for case when alias can't be disabled 2020-08-24 10:48:54 +02:00
Son NK
29b6b52a62 try to get email log and mailbox from bounce report 2020-08-24 10:23:49 +02:00
Son NK
06c48244e4 black 2020-08-21 12:03:23 +02:00
Son NK
dc8c2f403e try to fix Message.as_bytes() by trying different policies 2020-08-21 12:01:11 +02:00
Son NK
01afb7557c small refactoring 2020-08-21 10:47:10 +02:00
Son NK
2b2512e775 no need to create a copy of message when there's only 1 mailbox 2020-08-21 10:41:50 +02:00
Son NK
5bb4c20fba fix nb_bounced computation 2020-08-21 10:32:10 +02:00
Son NK
90eae05e9e better logging 2020-08-21 10:20:08 +02:00
Son NK
386fcbdc3a refactoring 2020-08-21 10:18:58 +02:00
Son NK
a3e052cc7b black 2020-08-20 14:28:57 +02:00
Son NK
db0e197500 set the email log that has been bounced 2020-08-20 14:27:05 +02:00
Son NK
1de57119c4 add missing commit 2020-08-20 11:58:46 +02:00
Son NK
50683be4f8 increase spamassassin timeout to 300s 2020-08-17 11:42:46 +02:00
Son NK
38bf117f29 move the lock sync to _handle 2020-08-17 11:40:58 +02:00
Son NK
d8a415c00a do not use aiostmpd controller 2020-08-17 11:39:13 +02:00