[00:16] *** Martle has quit IRC (Ping timeout: 252 seconds) [00:42] *** VerifiedJ has quit IRC (Quit: Leaving) [01:07] *** odemg has quit IRC (Ping timeout: 260 seconds) [01:19] *** odemg has joined #archiveteam-ot [02:05] *** dashcloud has quit IRC (Remote host closed the connection) [02:07] *** dashcloud has joined #archiveteam-ot [02:20] *** maxiPsych has joined #archiveteam-ot [02:36] *** Martle has joined #archiveteam-ot [03:10] *** NickN00b has joined #archiveteam-ot [03:13] *** odemg has quit IRC (Ping timeout: 260 seconds) [03:14] *** MrRadar2 has quit IRC (hub.efnet.us irc.efnet.nl) [03:14] *** BnAboyZ has quit IRC (hub.efnet.us irc.efnet.nl) [03:14] *** VoynichCr has quit IRC (hub.efnet.us irc.efnet.nl) [03:14] *** Tenebrae has quit IRC (hub.efnet.us irc.efnet.nl) [03:16] *** VoynichCr has joined #archiveteam-ot [03:16] *** MrRadar2 has joined #archiveteam-ot [03:16] *** BnAboyZ has joined #archiveteam-ot [03:16] *** Tenebrae has joined #archiveteam-ot [03:21] *** NickN00b has left [03:25] *** odemg has joined #archiveteam-ot [03:32] Anybody familiar with Twint and know why it doesn't download the same number of tweets as Twitter reports exist? [03:35] Because Twint is rubbish [03:35] *** VoynichCr has quit IRC (se.hub irc.efnet.nl) [03:35] *** MrRadar2 has quit IRC (se.hub irc.efnet.nl) [03:35] *** BnAboyZ has quit IRC (se.hub irc.efnet.nl) [03:35] *** Tenebrae has quit IRC (se.hub irc.efnet.nl) [03:35] *** MrRadar2 has joined #archiveteam-ot [03:35] *** BnAboyZ has joined #archiveteam-ot [03:35] *** Tenebrae has joined #archiveteam-ot [03:36] *** VoynichCr has joined #archiveteam-ot [03:36] Oh :( [03:36] Use SNScrape [03:37] https://github.com/JustAnotherArchivist/snscrape [03:37] Martle [03:38] Thanks [03:41] Flashfire: SNScrape found fewer? [03:43] SNScrape is an invention of JAA [03:44] Thanks [04:15] *** VoynichCr has quit IRC (hub.efnet.us irc.efnet.nl) [04:15] *** MrRadar2 has quit IRC (hub.efnet.us irc.efnet.nl) [04:15] *** BnAboyZ has quit IRC (hub.efnet.us irc.efnet.nl) [04:15] *** Tenebrae has quit IRC (hub.efnet.us irc.efnet.nl) [04:18] *** VoynichCr has joined #archiveteam-ot [04:18] *** MrRadar2 has joined #archiveteam-ot [04:18] *** BnAboyZ has joined #archiveteam-ot [04:18] *** Tenebrae has joined #archiveteam-ot [04:19] *** Martle has quit IRC (Quit: Leaving) [04:53] *** odemg has quit IRC (Ping timeout: 260 seconds) [05:05] *** odemg has joined #archiveteam-ot [05:08] *** dashcloud has quit IRC (Ping timeout: 260 seconds) [05:11] *** dashcloud has joined #archiveteam-ot [06:15] *** maxiPsych has quit IRC (Ping timeout: 260 seconds) [06:40] *** maxiPsych has joined #archiveteam-ot [07:13] *** kiska1 has quit IRC (Read error: Connection reset by peer) [07:13] *** wmvhater has quit IRC (Read error: Connection reset by peer) [07:17] *** wmvhater has joined #archiveteam-ot [07:17] *** kiska1 has joined #archiveteam-ot [07:45] *** godane has quit IRC (Ping timeout: 265 seconds) [07:59] *** godane has joined #archiveteam-ot [09:53] *** adinbied_ has joined #archiveteam-ot [09:56] *** adinbied has quit IRC (Read error: Operation timed out) [10:24] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [10:25] *** m007a83 has joined #archiveteam-ot [10:44] *** BlueMax has quit IRC (Quit: Leaving) [11:18] Martle (if you read logs): snscrape does not discover retweets, so that might be why it doesn't return as many tweets as the profile page claims there are. There are also some bugs on the Twitter server side which prevent it from scraping some accounts or from going through the entire history of some accounts. There's nothing snscrape can do about those. [11:40] *** Jens has quit IRC (Remote host closed the connection) [11:41] *** Jens has joined #archiveteam-ot [11:41] *** Jens has quit IRC (Remote host closed the connection) [11:41] *** Jens has joined #archiveteam-ot [12:52] *** Mateon1 has quit IRC (Ping timeout: 265 seconds) [12:52] *** Mateon1 has joined #archiveteam-ot [12:55] *** Ryz has quit IRC (Quit: ChatZilla 0.9.92-rdmsoft [XULRunner 35.0.1/20150122214805]) [13:04] *** uzerus has joined #archiveteam-ot [13:23] *** adinbied_ is now known as adinbied [13:47] *** icedice has joined #archiveteam-ot [14:15] *** wp494 has quit IRC (Read error: Operation timed out) [14:15] *** wp494 has joined #archiveteam-ot [14:43] *** icedice2 has joined #archiveteam-ot [14:47] *** icedice has quit IRC (Read error: Operation timed out) [15:03] *** jrwr has quit IRC (Quit: Updating details, brb) [15:03] *** jrwr has joined #archiveteam-ot [15:05] *** jrwr has quit IRC (Client Quit) [15:05] *** jrwr has joined #archiveteam-ot [15:49] *** icedice2 has quit IRC (Read error: Operation timed out) [16:04] *** schbirid has joined #archiveteam-ot [16:17] *** Stilett0 has joined #archiveteam-ot [16:18] *** Stiletto has quit IRC (Ping timeout: 252 seconds) [17:03] I need to get a homeserver (once again) and do my archival on it rather than on the desktop I shut down [17:50] *** uzerus has quit IRC (Remote host closed the connection) [18:37] *** Martle has joined #archiveteam-ot [19:15] *** Meroje has quit IRC (Quit: bye!) [19:20] 2018-11-13 11:18:19 UTC <@JAA> Martle (if you read logs): snscrape does not discover retweets, so that might be why it doesn't return as many tweets as the profile page claims there are. There are also some bugs on the Twitter server side which prevent it from scraping some accounts or from going through the entire history of some accounts. There's nothing snscrape can do about those. [19:21] I see, thanks! [19:23] *** Meroje has joined #archiveteam-ot [19:34] *** schbirid has quit IRC (Remote host closed the connection) [19:55] *** Ryz has joined #archiveteam-ot [20:03] *** Stiletto has joined #archiveteam-ot [20:06] *** Stilett0 has quit IRC (Read error: Operation timed out) [20:09] *** VerifiedJ has joined #archiveteam-ot [20:28] *** JAA has quit IRC (Read error: Operation timed out) [20:28] *** ivan has quit IRC (Read error: Operation timed out) [20:28] *** jspiros has quit IRC (Read error: Operation timed out) [20:28] *** ivan has joined #archiveteam-ot [20:29] *** svchfoo1 has quit IRC (Read error: Operation timed out) [20:29] *** svchfoo3 sets mode: +o ivan [20:54] *** uzerus has joined #archiveteam-ot [20:55] hey, can i get sponsor for archiving? :/ [20:55] just want to have private instance for archiving, in cash or in resources... [20:56] hey i want cash and resources too! :) [20:56] heh [20:57] i have FX-8350 8 core 4.2Ghz but 5Mbps down and 1Mbps up :/ [20:58] somebody know good vps provider with at least 7 day trial? [20:58] without credit card etc... [21:30] *** svchfoo1 has joined #archiveteam-ot [21:31] *** svchfoo3 sets mode: +o svchfoo1 [21:31] not that i'd trust, no [21:32] *** JAA has joined #archiveteam-ot [21:33] *** jspiros has joined #archiveteam-ot [21:33] *** svchfoo1 sets mode: +o JAA [21:33] *** bakJAA sets mode: +o JAA [21:36] uzerus: what are you archiving? [21:39] uzerus: I ran grab-site on a https://cloud.google.com/free/ and my API project got nuked after a few days [21:42] *** Martle has quit IRC (Quit: Leaving) [21:50] *** BlueMax has joined #archiveteam-ot [21:57] *** dashcloud has quit IRC (Read error: Connection reset by peer) [22:01] *** Martle has joined #archiveteam-ot [22:04] *** dashcloud has joined #archiveteam-ot [22:16] *** VerifiedJ has quit IRC (Read error: Connection reset by peer) [22:19] *** robogoat has quit IRC (Ping timeout: 265 seconds) [22:30] *** VerifiedJ has joined #archiveteam-ot [22:45] *** uzerus has quit IRC (Read error: Operation timed out) [23:13] *** Stiletto has quit IRC (Read error: Operation timed out) [23:13] *** Stiletto has joined #archiveteam-ot [23:18] *** robogoat has joined #archiveteam-ot [23:22] https://github.com/ludios/terastash [23:22] if anyone actually wants to use it, I can prioritize writing some setup instructions [23:23] it's mostly released because I'm hoping someone will take over my archiving operation soon, so I'm releasing the software