#archiveteam-bs 2019-01-30,Wed

↑back Search

Time Nickname Message
00:35 🔗 VADemon has quit IRC (Read error: Connection reset by peer)
01:17 🔗 newbie12 has joined #archiveteam-bs
01:18 🔗 newbie12 is now known as jianaran
01:33 🔗 VerfiedJ has quit IRC (Quit: Leaving)
02:17 🔗 Despatche has quit IRC (Read error: Connection reset by peer)
02:17 🔗 Despatche has joined #archiveteam-bs
02:34 🔗 wp494_ has joined #archiveteam-bs
02:38 🔗 wp494 has quit IRC (Read error: Operation timed out)
02:45 🔗 odemg has quit IRC (Ping timeout: 265 seconds)
02:45 🔗 Hani111 has joined #archiveteam-bs
02:46 🔗 odemgi_ has quit IRC (Ping timeout: 252 seconds)
02:52 🔗 Hani has quit IRC (Ping timeout: 615 seconds)
02:52 🔗 Hani111 is now known as Hani
03:01 🔗 Sk1d has quit IRC (Read error: Operation timed out)
03:03 🔗 Sk1d has joined #archiveteam-bs
03:09 🔗 jianaran has quit IRC (Read error: Operation timed out)
03:09 🔗 turnkit has quit IRC (Read error: Connection reset by peer)
03:10 🔗 turnkit has joined #archiveteam-bs
03:13 🔗 kyonko has joined #archiveteam-bs
03:16 🔗 systwi has quit IRC (Read error: Connection reset by peer)
03:17 🔗 systwi has joined #archiveteam-bs
03:20 🔗 Sk1d has quit IRC (Read error: Operation timed out)
03:24 🔗 Sk1d has joined #archiveteam-bs
03:55 🔗 Sk1d has quit IRC (Read error: Operation timed out)
03:58 🔗 Sk1d has joined #archiveteam-bs
04:04 🔗 Sk1d has quit IRC (Read error: Operation timed out)
04:08 🔗 Sk1d has joined #archiveteam-bs
04:28 🔗 odemgi has joined #archiveteam-bs
04:33 🔗 qw3rty118 has joined #archiveteam-bs
04:35 🔗 odemg has joined #archiveteam-bs
04:37 🔗 systwi has quit IRC (Read error: Connection reset by peer)
04:37 🔗 systwi_ has joined #archiveteam-bs
04:37 🔗 qw3rty117 has quit IRC (Ping timeout: 600 seconds)
04:37 🔗 ndiddy has quit IRC ()
04:39 🔗 systwi_ is now known as systwi
04:44 🔗 systwi has quit IRC (Read error: Connection reset by peer)
04:44 🔗 systwi_ has joined #archiveteam-bs
04:46 🔗 systwi_ is now known as systwi
04:59 🔗 systwi has quit IRC (Read error: Connection reset by peer)
05:00 🔗 systwi has joined #archiveteam-bs
05:13 🔗 systwi has quit IRC (Read error: Operation timed out)
05:13 🔗 HashbangI has quit IRC (Read error: Connection reset by peer)
05:14 🔗 systwi has joined #archiveteam-bs
05:19 🔗 icedice has quit IRC (Quit: Leaving)
05:58 🔗 Odd0002_ has joined #archiveteam-bs
05:58 🔗 Odd0002 has quit IRC (Ping timeout: 252 seconds)
05:59 🔗 Odd0002_ is now known as Odd0002
06:04 🔗 systwi_ has joined #archiveteam-bs
06:04 🔗 systwi has quit IRC (Read error: Connection reset by peer)
06:05 🔗 ats has quit IRC (Read error: Operation timed out)
06:06 🔗 ats has joined #archiveteam-bs
06:13 🔗 fuzy802 has joined #archiveteam-bs
06:14 🔗 fuzzy8021 has quit IRC (Read error: Operation timed out)
06:16 🔗 Sk1d has quit IRC (Read error: Operation timed out)
06:19 🔗 Sk1d has joined #archiveteam-bs
06:23 🔗 fuzy802 is now known as fuzzy8021
06:25 🔗 m007a83 has quit IRC (Read error: Connection reset by peer)
06:43 🔗 pawbs|alt has joined #archiveteam-bs
06:45 🔗 pawbs has quit IRC (Read error: Operation timed out)
06:46 🔗 m007a83 has joined #archiveteam-bs
06:57 🔗 Sk1d has quit IRC (Read error: Operation timed out)
07:00 🔗 Sk1d has joined #archiveteam-bs
07:03 🔗 newbie|2 has joined #archiveteam-bs
07:04 🔗 newbie|2 is now known as kyonko2
07:06 🔗 kyonko has quit IRC (Ping timeout: 252 seconds)
07:16 🔗 Sk1d has quit IRC (Read error: Operation timed out)
07:18 🔗 m007a83 has quit IRC (Ping timeout: 252 seconds)
07:20 🔗 Sk1d has joined #archiveteam-bs
07:21 🔗 m007a83 has joined #archiveteam-bs
07:36 🔗 Odd0002 has quit IRC (Read error: Operation timed out)
07:41 🔗 newbie12 has joined #archiveteam-bs
07:41 🔗 newbie12 is now known as jianaran
07:42 🔗 jianaran Is anyone here familiar with internetarchive's warc python package? I'm struggling to write a new record, and would really appreciate some help
07:44 🔗 Gfy has quit IRC (Read error: Connection reset by peer)
07:47 🔗 newbie|2 has joined #archiveteam-bs
07:48 🔗 newbie|2 has quit IRC (Read error: Connection reset by peer)
07:48 🔗 newbie|2 has joined #archiveteam-bs
07:48 🔗 kyonko2 has quit IRC (Ping timeout: 252 seconds)
07:50 🔗 newbie|2 is now known as kyonko2
07:58 🔗 Gfy has joined #archiveteam-bs
08:10 🔗 Exairnous has quit IRC (Read error: Operation timed out)
08:15 🔗 Despatche has quit IRC (Remote host closed the connection)
08:17 🔗 Despatche has joined #archiveteam-bs
08:25 🔗 brayden has quit IRC (Read error: Operation timed out)
08:26 🔗 jodizzle jianaran: I'm loosely familiar, what's the problem?
08:27 🔗 jodizzle Though I should probably mention before you dig too deep that the internetarchive package is quite old, and a lot of people prefer warcio: https://github.com/webrecorder/warcio
08:27 🔗 jianaran I think I've solved it now using warcio, but the IA warc package wouldn't write new .warc.gz files without throwing errors
08:27 🔗 jianaran Ha, there we go!
08:27 🔗 jodizzle Ah okay
08:28 🔗 jodizzle There are also python3 forks of the internetarchive package that are slightly better, but I don't think by much
08:31 🔗 jianaran Yeah, I spent a little while trying to make one work before giving up
08:31 🔗 jianaran But the good thing is, I now have deduplication working!
08:36 🔗 jianaran Is there a good way to extract media from within a WARC? eg, if I want to go through and pull out every jpg to a folder?
08:43 🔗 Sk1d has quit IRC (Read error: Operation timed out)
08:43 🔗 Despatche has quit IRC (Read error: Connection reset by peer)
08:46 🔗 Sk1d has joined #archiveteam-bs
08:49 🔗 Despatche has joined #archiveteam-bs
08:57 🔗 Despatche has quit IRC (Ping timeout: 360 seconds)
08:58 🔗 Despatche has joined #archiveteam-bs
09:03 🔗 brayden has joined #archiveteam-bs
09:03 🔗 Despatche has quit IRC (Ping timeout: 246 seconds)
09:09 🔗 jodizzle jianaran: Well, you could write a script to do it with warcio, or you could try using warcat: https://github.com/chfoo/warcat
09:26 🔗 BlueMax has quit IRC (Quit: Leaving)
09:40 🔗 Jens has quit IRC (Remote host closed the connection)
09:41 🔗 Jens has joined #archiveteam-bs
09:45 🔗 Despatche has joined #archiveteam-bs
09:57 🔗 Despatche has quit IRC (Ping timeout: 600 seconds)
09:58 🔗 jianaran has quit IRC (Ping timeout: 612 seconds)
10:01 🔗 LFlare has quit IRC (Read error: Operation timed out)
10:02 🔗 Despatche has joined #archiveteam-bs
10:04 🔗 LFlare has joined #archiveteam-bs
10:28 🔗 Despatche has quit IRC (Ping timeout: 612 seconds)
10:29 🔗 Despatche has joined #archiveteam-bs
10:40 🔗 systwi_ has quit IRC (Give me your HAND, and I'll help you across.)
10:45 🔗 Sk1d has quit IRC (Read error: Operation timed out)
10:48 🔗 Sk1d has joined #archiveteam-bs
11:02 🔗 Raccoon` has joined #archiveteam-bs
11:03 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
11:04 🔗 Mateon1 has joined #archiveteam-bs
11:22 🔗 RichardG_ has quit IRC (Read error: Connection reset by peer)
11:22 🔗 RichardG has joined #archiveteam-bs
11:35 🔗 wp494 has joined #archiveteam-bs
11:41 🔗 wp494_ has quit IRC (Read error: Operation timed out)
12:35 🔗 HashbangI has joined #archiveteam-bs
13:21 🔗 Sk1d has quit IRC (Read error: Operation timed out)
13:26 🔗 Sk1d has joined #archiveteam-bs
14:36 🔗 ubahn has joined #archiveteam-bs
14:56 🔗 VerfiedJ has joined #archiveteam-bs
15:51 🔗 ubahn has quit IRC (ubahn)
15:51 🔗 kbtoo_ has joined #archiveteam-bs
15:53 🔗 ubahn has joined #archiveteam-bs
15:59 🔗 kbtoo has quit IRC (Read error: Operation timed out)
16:24 🔗 fredgido_ has joined #archiveteam-bs
16:25 🔗 fredgido has quit IRC (Ping timeout: 252 seconds)
16:49 🔗 Sk1d has quit IRC (Read error: Operation timed out)
16:53 🔗 Sk1d has joined #archiveteam-bs
16:56 🔗 schbirid has joined #archiveteam-bs
16:57 🔗 Sk1d has quit IRC (Read error: Operation timed out)
17:00 🔗 Sk1d has joined #archiveteam-bs
17:06 🔗 Despatche has quit IRC (Read error: Operation timed out)
17:44 🔗 Despatche has joined #archiveteam-bs
18:03 🔗 zirnch has joined #archiveteam-bs
18:36 🔗 RichardG_ has joined #archiveteam-bs
18:37 🔗 RichardG has quit IRC (Read error: Connection reset by peer)
18:43 🔗 ubahn has quit IRC (Quit: ubahn)
19:09 🔗 m007a83_ has joined #archiveteam-bs
19:09 🔗 m007a83_ has quit IRC (Read error: Connection reset by peer)
19:12 🔗 m007a83 has quit IRC (Ping timeout: 252 seconds)
19:27 🔗 Exairnous has joined #archiveteam-bs
19:44 🔗 zirnch_ has joined #archiveteam-bs
19:45 🔗 zirnch has quit IRC (Read error: Connection reset by peer)
19:47 🔗 ubahn has joined #archiveteam-bs
20:20 🔗 Oddly has joined #archiveteam-bs
20:35 🔗 wp494_ has joined #archiveteam-bs
20:39 🔗 wp494 has quit IRC (Read error: Operation timed out)
20:46 🔗 Sk1d has quit IRC (Read error: Operation timed out)
20:49 🔗 ubahn has quit IRC (Quit: ubahn)
20:49 🔗 Sk1d has joined #archiveteam-bs
21:22 🔗 ivan_ has quit IRC (Leaving)
21:24 🔗 ivan_ has joined #archiveteam-bs
21:28 🔗 BlueMax has joined #archiveteam-bs
21:30 🔗 Oddly has quit IRC (Read error: Operation timed out)
21:38 🔗 X-Scale has joined #archiveteam-bs
21:57 🔗 schbirid has quit IRC (Remote host closed the connection)
22:14 🔗 TC01 has quit IRC (Read error: Operation timed out)
22:16 🔗 TC01 has joined #archiveteam-bs
22:27 🔗 godane i'm capturing a kiss 3d video tape i found at savers
22:35 🔗 jodizzle Would someone be willing to archive some more snscrapes of Venezuelan accounts? These are mostly either government accounts or accounts of government officials related to the United Socialist Party: https://transfer.sh/dkYfx/venezuela-psuv-twitter.txt https://transfer.sh/Dof8T/venezuela-psuv-facebook.txt https://transfer.sh/8IAdg/venezuela-psuv-instagram.txt
22:35 🔗 jodizzle Warning that the twitter list is pretty large, around 1.1 million tweets.
22:36 🔗 jodizzle If someone could also archivebot http://www.psuv.org.ve/, that'd be great
22:51 🔗 ndiddy has joined #archiveteam-bs
23:32 🔗 Stilett0 has joined #archiveteam-bs
23:34 🔗 Stiletto has quit IRC (Ping timeout: 268 seconds)
23:50 🔗 kode54 has quit IRC (Quit: ZNC 1.7.1 - https://znc.in)

irclogger-viewer