[01:48] *** logchfoo starts logging #projectnewsletter at Thu Apr 23 01:48:24 2015 [01:48] *** logchfoo has joined #projectnewsletter [01:49] *** Start sets mode: +oo chfoo Start-mob [01:51] *** chfoo- has joined #projectnewsletter [03:12] *** Start-mob has quit IRC (Remote host closed the connection) [03:17] *** Start sets mode: +o chfoo- [08:53] achip: can you please implement the new script in mail3? https://github.com/ArchiveTeam/newsletter-python [08:53] they have very basic support for attachments [08:53] if that looks good, I'll get on the html mail-infrastructure of mail3 [09:29] added basic html interface [09:32] *** logchfoo_ starts logging #projectnewsletter at Thu Apr 23 09:32:52 2015 [09:32] *** logchfoo_ has joined #projectnewsletter [09:52] *** Start has quit IRC (ircd.shaw.ca irc.shaw.ca) [09:52] *** chfoo- has quit IRC (ircd.shaw.ca irc.shaw.ca) [09:52] *** wp494 has quit IRC (ircd.shaw.ca irc.shaw.ca) [09:52] *** Sanqui has quit IRC (ircd.shaw.ca irc.shaw.ca) [09:57] *** chfoo- has joined #projectnewsletter [09:57] *** Start has joined #projectnewsletter [09:57] *** wp494 has joined #projectnewsletter [09:57] *** Sanqui has joined #projectnewsletter [09:57] *** irc.shaw.ca sets mode: +oooo chfoo- Start wp494 Sanqui [13:57] *** Start has quit IRC (Disconnected.) [14:15] arkiver got the new code pulled, just need to fix a couple bugs real quick [14:50] *** Start has joined #projectnewsletter [14:57] *** Start has quit IRC (Disconnected.) [15:03] *** Start has joined #projectnewsletter [15:31] mail3 is updated with arkiver's code and some minor bug fixes (couldn't push to AT/newsletter-python so the changes are in my chip-dev branch) [15:41] achip: awesome, I'll test a bit [15:42] k in a bit im gonna add so it writes mailhtml to it's own html file for easier viewing [15:43] yeah, looks I forgot that in the script [15:43] you're going to add it or shall I implement it in the /archiveteam/ repo? [15:44] achip ^ [15:44] working on it now, just broke it :/ [15:44] :P, ok [15:44] *beta [15:45] html files will be in the folders of the mails? [15:45] correct in addition to .json will be -mailhtml.html [15:45] and I think redirect from /newspoc/index.html to /newspoc/mailtitle/mailtitle.html? [15:47] ok [15:47] http://paste.nerds.io/raw/okonizoqaf your attachment test [15:48] oh, I'll have a look and fix it [15:48] sorry [15:49] I think "attachment.append(mailpart)" should be "attachments.append(mailpart)"? (no worries) [15:49] yep [15:50] typo :P [15:50] will check other code also for typos [15:50] it's all good, I was just letting you know the result of your test email since I had the trace up :p [15:51] *** Start has quit IRC (Disconnected.) [15:51] that fix is made and updated on mail3 [15:52] let's test again [15:53] attachments almost working, looks like it's writing the item name as content for the attachment http://mail3.newsletter.nerds.io/newspoc/arkiver@hotmail.com-FW:%20test-1429804308/ [15:53] this small change https://github.com/ArchiveTeam/newsletter-python/commit/5e5339251fff1ed55d9d42e723e29772c8988427 [15:53] mmmm encoding http://paste.nerds.io/raw/degugijoqe [15:54] one line above that, the file name, do we want to change that to [1] as well? [15:55] i.e. https://github.com/chpwssn/newsletter-python/commit/65a80ab102172f0d386f6b4848963b62902d0560 [15:56] no, because[1] is the content of the attachment https://github.com/chpwssn/newsletter-python/blob/chip-dev/inbox.py#L63 [15:56] looks like it can't handle some decoded characters, will have a look at that [15:57] decoded characters in the content of the attachment ^ [15:57] k, reverted and updated [15:59] oh, I see it [15:59] it's not converted to utf8 [16:00] will add conversion of attachment content to utf8, error should be solved then [16:00] *** Start has joined #projectnewsletter [16:02] here's the md5 of the attachment as it sits on the server 6f26b3c021d5172aaece2239e2f885a7 attachment-wget-lua-warrior, I think the error is just with the .json stuff not writing the attachment file [16:02] from email test-1429804630 [16:03] yeah, but that was before the fix for writing the filename as content of attachment [16:03] I'll try again now, error should now be on line 51 [16:04] oh [16:04] http://paste.nerds.io/raw/oyenasalun [16:04] writes bytes to attachment fine [16:04] yes, error is only in the json [16:04] looks like 55 [16:05] yes [16:05] I think I'll pass the un-decoded attachment to the json [16:06] are your script on github the latest? [16:06] yes [16:06] mailhtml.html is added? [16:06] or are you still working on that [16:06] still working, I'll comment that out and push, one sec [16:07] I think I'll wait till you have added that -mailhtml.html [16:07] we shouldn't implement two things at the same time, will become messy [16:08] I had only added two lines to archive.py that are commented out now, it should be standard and I'll wait until you make your changes [16:08] ok [16:09] I added you to the chpwssn/newsletter-python repository too incase you ever need/want to push to that [16:14] I'll make my changes in the chpwssn repo [16:16] sounds good [16:19] added. [16:20] I remember image attachments can be displayed in the mail through the mailhtml [16:20] I'll have a look how to make our attachments work with that [16:20] k I'll pull [16:21] pulled and running again [16:21] no errors on that one [16:22] great [16:23] good job, pretty freakin sweet [16:23] :) [16:23] * arkiver is off for 45 minutes [16:45] *** Start has quit IRC (Disconnected.) [16:58] achip: so what ideas do we have next? [17:00] or what more needs to be implemented beside the redirect to mailhtml.html in the folder from the index.html? [17:10] not quite sure right now, I've got a couple other ideas but they're not necessarily directly mailserver related like the "registration" page thing [17:11] looks like Start gave me permissions to the AT/newsletter-python repo so if you'd rather work from there we can do that [17:14] ohhhh that multi attachment goodness [18:52] achip: updated the scripts, better support for attachments now [19:06] arkiver: updated [19:13] achip: [19:13] http://mail3.newsletter.nerds.io/newspoc/arkiver@hotmail.com-test%20with%20multiple%20attachments-1429806038/ [19:13] vs [19:13] http://mail3.newsletter.nerds.io/newspoc/arkiver@hotmail.com-FW:%20test%20with%20multiple%20attachments-1429815999/ [19:13] one attachment was missing [19:16] interesting, so maybe log files would be a good next step? [19:27] yeah, but this should work for all attachments [19:27] no attachments should be missed after that last update [19:28] how's the mailhtml.html update going? [20:22] haven't had much time to play with it, tonight I've got some beers with #projectnewsletter's name on them though haha [20:43] awesome :)