[00:45] *** godane has quit IRC (Read error: Operation timed out) [01:21] *** mistym_ has quit IRC (Remote host closed the connection) [01:29] *** primus104 has quit IRC (Leaving.) [01:30] *** schbirid2 has joined #archiveteam-bs [01:32] *** schbirid has quit IRC (Read error: Operation timed out) [02:10] *** godane has joined #archiveteam-bs [02:24] *** mistym has joined #archiveteam-bs [02:43] i'm starting to upload bbs romscene collection [02:56] *** mistym has quit IRC (Remote host closed the connection) [03:03] *** mistym has joined #archiveteam-bs [03:07] *** mistym has quit IRC (Remote host closed the connection) [03:07] *** mistym has joined #archiveteam-bs [04:30] *** aaaaaaaaa has quit IRC (Leaving) [04:46] *** username1 has joined #archiveteam-bs [04:48] *** schbirid2 has quit IRC (Read error: Operation timed out) [05:32] *** mistym has quit IRC (Remote host closed the connection) [05:56] *** mistym has joined #archiveteam-bs [06:50] *** primus104 has joined #archiveteam-bs [07:48] *** primus104 has quit IRC (Leaving.) [08:06] *** garyrh has quit IRC (Ping timeout: 506 seconds) [08:21] *** primus104 has joined #archiveteam-bs [08:57] *** mistym has quit IRC (Remote host closed the connection) [09:30] http://gamasutra.com/view/news/243598/MAME_is_going_open_source_to_be_a_learning_tool_for_developers.php [09:58] *** mistym has joined #archiveteam-bs [10:06] *** mistym has quit IRC (Read error: Operation timed out) [11:45] *** BlueMaxim has quit IRC (Quit: Leaving) [12:02] *** username1 is now known as schbirid [12:04] oh poop, i should not have used beautifulsoup...~100ms to parse a html file :( [12:12] optimize! [12:14] *** primus104 has quit IRC (Leaving.) [12:15] html = file.read() [12:15] soup = BeautifulSoup(html) [12:15] can't optimise that i guess [12:16] soup = BeautifulSoup(file.read()) [12:16] less initalising [12:16] not going to save much tho [12:18] nah, it's really just the BeautifulSoup step that's so slow [12:22] nod [12:22] and not like you can strip out some stuff before passing it, easily? [12:23] what you trying to match with BS? [12:26] warced some forum and now i am parsing all the comments into a sqlite db [12:27] is it warced or worc? [12:54] It's work, for sure [12:54] :D [13:14] if i just had 64gb ram, all would be eas [13:14] y [13:37] *** mistym has joined #archiveteam-bs [13:41] *** mistym has quit IRC (Ping timeout: 252 seconds) [14:11] *** primus104 has joined #archiveteam-bs [14:15] this is interesting [14:15] https://muut.com/manifesto/ [14:15] a Disqus "competitor" [14:15] "Muut is installed on a website with a HTML link. This anchor (A) tag points to a static version of the discussion. It’s an hourly HTML dump specifically designed for search engines. " [14:15] admittedly designed for search engines rather than archival, but that's going to be good for archival nevertheless [14:50] indeed [14:51] bizarre thing: https://youtu.be/_z2Fpwq-X-A?t=38s [14:53] *** primus104 has quit IRC (Leaving.) [14:54] http://arstechnica.com/gaming/2015/05/humanity-weeps-as-candy-crush-saga-comes-pre-installed-with-windows-10/ [14:54] WHAT [14:54] I JUST LEARNED THIS THROUGH ARCHIVEBOT [14:54] * Muad-Dib gets torches to burn down the local microsoft branch [14:57] it's called "just uninstall it" [14:57] that doesn't prevent King from getting money for it :( [15:02] *** Asparagir has joined #archiveteam-bs [15:10] raylee: [15:10] [00:44] RedType: 'cept their previous bundling wasn't from publishers that were known for putting out shitty intentionally exploitative games [15:10] [00:44] and looks like micropayments will be intact in this version, so fuck that [15:10] [00:50] it is amazing to me how many people still don't seem to understand the power of defaults [15:10] [00:50] "meh, who cares, you can delete it" [15:12] *** tsp_ has joined #archiveteam-bs [15:31] *** SimpBrain has joined #archiveteam-bs [15:33] i guess [15:38] *** mistym has joined #archiveteam-bs [15:44] *** mistym has quit IRC (Read error: Operation timed out) [15:54] *** Asparagir has quit IRC (Remote host closed the connection) [15:58] *** human39 has quit IRC (Read error: Operation timed out) [16:22] *** schbirid2 has joined #archiveteam-bs [16:25] *** schbirid has quit IRC (Read error: Operation timed out) [16:32] *** aaaaaaaaa has joined #archiveteam-bs [16:32] Muad-Dib: i learn a lot of things through archivebot [16:33] it's actually a big source of news for me [16:49] at least when I'm not spamming it with youtube videos [16:49] *** BlueMaxim has joined #archiveteam-bs [16:50] that said, that does qualify as news [16:54] *** SN4T14_ has quit IRC (Ping timeout: 369 seconds) [16:56] *** mistym has joined #archiveteam-bs [16:59] i use the twitterfeed from at bot as my newsfeed :p [17:03] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [17:10] *** Ravenloft has joined #archiveteam-bs [17:10] just watched Chappie [17:11] liked it very much [17:18] its like a drama Short Circuit [17:18] *** tsp_ has quit IRC (Read error: Connection reset by peer) [17:18] with a cybergangsta Johhny Five [17:19] or a sci-fi Tarantino's Ikea "Lamp" Commercial [17:19] *** tsp_ has joined #archiveteam-bs [17:22] its start over the top, and then go above and beyond [17:22] muut looks awesome, thanks [17:22] its like whatching a comic book [17:23] a brilliant one [17:23] i mean to see chappie but i am a bit wary of die antwoord sucking at acting [17:23] they seem to play themselves and that's kinda annoying imo [17:24] they neo-wave colors worked around the cyberpunk crime environment [17:24] wait, it's not selfhosted [17:24] its totally not credible [17:24] muut looks useless \o/ [17:25] but you need suspension of disbelief anyway [17:25] *their [17:33] *** tsp_ has quit IRC (Ping timeout: 483 seconds) [17:34] *** tsp_ has joined #archiveteam-bs [17:36] SimpBrain: is your codcademy rip done? [17:36] nah [17:36] ]might be good for a warrior job if you want the logs from what i scraped [17:36] schbirid2: playing their themselves or their personas actually works for them.. [17:37] SimpBrain: how much did you grab? [17:37] it was 185-190gb last time i checked the file [17:38] a lot of content is on amazon storage [17:39] how will the logs help with a warrior job? [17:41] SimpBrain: you have direct links then? [17:45] my logs seem incomplete :/ [17:46] on the topic of logs, i spotted some connection problems in a wpull mirror i did. is it possible to "smartly" make it re-run those using the same rules as before, so it will add them to the warc and follow newly discovered urls? (paging chfoo) [17:50] just checking the .db file [17:54] db shows over 500k urls [17:58] *** human39 has joined #archiveteam-bs [17:58] going to re-start the codecademy job soon, start a fresh [18:11] SimpBrain: ok [18:21] *** primus104 has joined #archiveteam-bs [18:45] *** primus104 has quit IRC (Leaving.) [18:47] *** SN4T14 has joined #archiveteam-bs [19:55] *** SN4T14_ has joined #archiveteam-bs [20:01] *** SN4T14 has quit IRC (Ping timeout: 369 seconds) [20:18] *** lysobit has quit IRC (Read error: Operation timed out) [20:19] *** primus104 has joined #archiveteam-bs [20:21] *** brayden has quit IRC (Read error: Operation timed out) [20:23] *** lysobit has joined #archiveteam-bs [21:31] *** mistym has quit IRC (Remote host closed the connection) [21:32] *** mistym has joined #archiveteam-bs [21:33] *** RichardG has quit IRC (Ping timeout: 240 seconds) [21:40] *** mistym has quit IRC (Read error: Operation timed out) [21:40] so i just found out i'm at 401k items uploaded [21:44] *** RichardG has joined #archiveteam-bs [22:34] *** mistym has joined #archiveteam-bs [22:44] *** mistym has quit IRC (Ping timeout: 606 seconds) [22:51] *** SimpBrain has quit IRC (Quit: Leaving) [23:53] *** aaaaaaaaa has quit IRC (Ping timeout: 370 seconds)