| Time |
Nickname |
Message |
|
00:12
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
00:13
🔗
|
|
pizzaiolo has left |
|
00:29
🔗
|
|
icedice has quit IRC (Ping timeout: 260 seconds) |
|
02:43
🔗
|
|
odemg has quit IRC (Read error: Operation timed out) |
|
03:11
🔗
|
|
bsmith093 has quit IRC (Read error: Operation timed out) |
|
03:28
🔗
|
|
bsmith093 has joined #archiveteam-bs |
|
03:35
🔗
|
|
nyaomi has quit IRC (Ping timeout: 245 seconds) |
|
03:54
🔗
|
|
nyaomi has joined #archiveteam-bs |
|
03:58
🔗
|
* |
jrwr breaks out the tape drives |
|
03:58
🔗
|
jrwr |
LTO-4 All the way |
|
04:16
🔗
|
godane |
i'm now at $43.50 on patreon |
|
04:19
🔗
|
|
synth has left |
|
04:34
🔗
|
|
Sk1d has quit IRC (Ping timeout: 250 seconds) |
|
04:41
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
05:18
🔗
|
godane |
SketchCow: https://drive.google.com/drive/folders/0BweO6Y13Cmc4TF9hNHVUN0I2NmM |
|
05:19
🔗
|
godane |
its from the guy that complained about losing his vhs archive on youtube |
|
05:22
🔗
|
godane |
i also put his wordpress blog in archivebot |
|
06:21
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
06:24
🔗
|
|
fie has joined #archiveteam-bs |
|
06:47
🔗
|
|
Jonison has joined #archiveteam-bs |
|
06:50
🔗
|
|
odemg has joined #archiveteam-bs |
|
07:06
🔗
|
|
Stilett0- has joined #archiveteam-bs |
|
07:21
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
07:37
🔗
|
|
Stilett0- is now known as Stiletto |
|
07:42
🔗
|
|
odemg has quit IRC (Read error: Operation timed out) |
|
08:10
🔗
|
|
godane has quit IRC (Read error: Operation timed out) |
|
08:16
🔗
|
|
godane has joined #archiveteam-bs |
|
08:54
🔗
|
|
kristian_ has quit IRC (Read error: Operation timed out) |
|
09:27
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
09:47
🔗
|
|
icedice has joined #archiveteam-bs |
|
10:11
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 260 seconds) |
|
10:15
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
10:52
🔗
|
JAA |
My Dead Format grab just passed 200k retrieved URLs in a little under 12 hours. Some collection pages are really, *really* slow, but other than that, it's pretty smooth. |
|
10:54
🔗
|
|
odemg has joined #archiveteam-bs |
|
11:05
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
11:58
🔗
|
|
icedice has quit IRC (Ping timeout: 260 seconds) |
|
12:36
🔗
|
SketchCow |
godane: Jeremy is my pal |
|
12:40
🔗
|
godane |
SketchCow: ok |
|
12:40
🔗
|
godane |
i don't remember who Jeremy is? |
|
12:49
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
12:56
🔗
|
|
BlueMaxim has quit IRC (Read error: Connection reset by peer) |
|
12:59
🔗
|
SketchCow |
He's a lovely Australian Apple II enthusiast. |
|
13:07
🔗
|
godane |
oh |
|
13:08
🔗
|
godane |
i forgot about me talking about the pdfs and stuff from that guy last night |
|
14:32
🔗
|
|
pizzaiolo has quit IRC (Ping timeout: 506 seconds) |
|
14:33
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
14:40
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
14:42
🔗
|
|
pizzaiolo has quit IRC (Ping timeout: 255 seconds) |
|
14:51
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
14:53
🔗
|
|
icedice has joined #archiveteam-bs |
|
14:53
🔗
|
|
Soni has quit IRC (Ping timeout: 272 seconds) |
|
15:10
🔗
|
|
Soni has joined #archiveteam-bs |
|
15:36
🔗
|
|
icedice has quit IRC (Ping timeout: 260 seconds) |
|
15:59
🔗
|
|
icedice has joined #archiveteam-bs |
|
16:27
🔗
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
16:32
🔗
|
|
powerKitt has joined #archiveteam-bs |
|
16:38
🔗
|
|
Jonison has quit IRC (Read error: Connection reset by peer) |
|
16:56
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
17:06
🔗
|
|
powerKitt has quit IRC (Quit: Page closed) |
|
17:27
🔗
|
|
dd0a13f37 has joined #archiveteam-bs |
|
17:39
🔗
|
|
trs80 has quit IRC (Ping timeout: 246 seconds) |
|
17:40
🔗
|
|
bluesoul has quit IRC (Read error: Operation timed out) |
|
17:46
🔗
|
|
bluesoul has joined #archiveteam-bs |
|
17:55
🔗
|
|
bluesoul has quit IRC (Read error: Operation timed out) |
|
17:56
🔗
|
xarph |
So I seem to recall that dolphin can actually buy packages from the wii shop. I wonder how much money would be needed to script an emulator to download and archive literally everything on wii shop channel |
|
17:56
🔗
|
|
bluesoul has joined #archiveteam-bs |
|
18:03
🔗
|
dd0a13f37 |
A lot, it would be a giant waste of money |
|
18:04
🔗
|
dd0a13f37 |
Isn't most of it on TPB already? |
|
18:07
🔗
|
dd0a13f37 |
Anyone know how to use the JS debugger in firefox? I've set breakpoints, but they're not triggering and everything is super slow |
|
18:13
🔗
|
|
icedice has joined #archiveteam-bs |
|
18:25
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
18:38
🔗
|
|
icedice has joined #archiveteam-bs |
|
18:44
🔗
|
|
dd0a13f37 has quit IRC (Ping timeout: 268 seconds) |
|
18:49
🔗
|
|
Smiley has joined #archiveteam-bs |
|
20:31
🔗
|
|
arkhive has joined #archiveteam-bs |
|
20:37
🔗
|
arkhive |
Who ever wants to help me using Video DownloadHelper or another extension of the like to download Seeso(owned by NBC) original series(I'm running into trouble) gets a Steam key of Rise of the Tomb Raider! :) |
|
20:38
🔗
|
arkhive |
I'm stil kinda learning how to do this stuff. I've been here on and off since the Starwars.com forum save and Google Video save. |
|
21:13
🔗
|
JAA |
Do you guys know of any EPG archives (or how to access EPG data from a computer to begin with)? |
|
21:38
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
22:10
🔗
|
Laverne |
as in the program guides? |
|
23:05
🔗
|
godane |
i'm starting to upload Canton Observer and Eccentric newspaper |
|
23:05
🔗
|
godane |
issues go back to 1974 |
|
23:07
🔗
|
odemg |
https://www.reddit.com/r/DataHoarder/comments/735541/years_of_howard_sterns_interviews_with_trump_now/dnp1qlx |
|
23:11
🔗
|
|
adinbied has joined #archiveteam-bs |
|
23:12
🔗
|
godane |
odemg: i'm grabbing that torrent |
|
23:12
🔗
|
godane |
also i'm going to grab the audio archives they have on myspleen |
|
23:13
🔗
|
odemg |
godane, I mirrored heynow if you want that? |
|
23:13
🔗
|
adinbied |
Hi all! I posted this over on the #archiveteam channel, not sure which is the correct channel so I'll post here as well |
|
23:13
🔗
|
adinbied |
Hi all. With the recent death of TC (private tracker), it reminded me of just how much I enjoy the community. I'm trying to figure out a way to archive a copy of the forums on Gazelle-based sites. I'm not interested in the actual torrents/data, as that would get out of hand size-wise very quickly. |
|
23:13
🔗
|
godane |
what is heynow? |
|
23:14
🔗
|
adinbied |
A quick bit of googling shows someone asked a similar question ~10 months ago on the AT subreddit: https://www.reddit.com/r/Archiveteam/comments/5cmvj0/gazelle_archive/ and one of the responses was to ask godane in the archive team irc channel. |
|
23:14
🔗
|
adinbied |
Thanks! |
|
23:14
🔗
|
odemg |
godane, a private tracker that has the largest collection of stern content |
|
23:14
🔗
|
odemg |
godane, https://www.reddit.com/r/OpenSignups/comments/72brgw/the_howard_stern_archive_streams_archives_htv/dnhbwul/ |
|
23:14
🔗
|
godane |
you can mirror it |
|
23:14
🔗
|
odemg |
^^ |
|
23:15
🔗
|
odemg |
adinbied, you may get an answer for this here but you should stop by the-eye on discord, there is an ex TC staffer there and our recent focus has been mirroring private trackers |
|
23:17
🔗
|
adinbied |
Ambitious project, I like it! IIRC Nuked over at PTP said the total file size of all of the torrents was somewhere around 2 PB |
|
23:17
🔗
|
adinbied |
Do you have a link? |
|
23:18
🔗
|
adinbied |
nvm |
|
23:18
🔗
|
|
godane has quit IRC (Quit: Leaving.) |
|
23:19
🔗
|
adinbied |
Thanks for the tip! |
|
23:21
🔗
|
arkiver |
odemg: do you think we can get heynow on IA? |
|
23:25
🔗
|
odemg |
arkiver, do I have permission to put it on ia? |
|
23:27
🔗
|
arkiver |
ah, it's a private tracker |
|
23:28
🔗
|
odemg |
the tracker doesn't come into it, I have the files which while coming from the tracker don't link back to the tracker in any meaningful way |
|
23:30
🔗
|
hook54321 |
https://nintendowire.com/news/2017/09/29/nintendo-wii-shop-channel-set-shut-january-31-2019/ |
|
23:30
🔗
|
odemg |
that's a good lead time |
|
23:34
🔗
|
|
godane has joined #archiveteam-bs |
|
23:38
🔗
|
|
TBO has joined #archiveteam-bs |
|
23:39
🔗
|
TBO |
There we go ! |
|
23:39
🔗
|
TBO |
it was irc.efnet.fr |
|
23:39
🔗
|
TBO |
Okay so I came here to ask a question, there's lot of talking about data storage and data hosting on r/datahoarders |
|
23:39
🔗
|
TBO |
But what about data gathering ? What are your tools ? |
|
23:39
🔗
|
TBO |
Woops I copy pasted too much |
|
23:41
🔗
|
zino |
TBO: For small things: wpull or wget saving to warcs. Then there is Archivebot for small-ish automated jobs and the warrior for larger jobs. |
|
23:41
🔗
|
TBO |
Cool, thanks |
|
23:42
🔗
|
zino |
Then there are some specialized things like youtube-dl for video, which can be combined with wpull. |
|
23:45
🔗
|
TBO |
I was using a self made script but obviously it only goes as far as I have time to lose |
|
23:47
🔗
|
odemg |
TBO, r/DataHoarder |
|
23:47
🔗
|
TBO |
Yep I went there. It doesn't talk much about tools |
|
23:47
🔗
|
TBO |
More about storage and stuff like that |
|
23:47
🔗
|
odemg |
I was correcting you, that's my sub. |
|
23:48
🔗
|
TBO |
Right because I added an S at the end |
|
23:48
🔗
|
TBO |
I noticed that later |
|
23:49
🔗
|
TBO |
So zino your tools seem to be centered about archiving stuff for your collective archive |
|
23:49
🔗
|
odemg |
zino, answered well, tools fit certain archival/download projects but mostly leverage tools available in a base install of linux, for very specific sites we write custom scripts |
|
23:49
🔗
|
TBO |
How about stuff that you probably wouldn't agree should go there |
|
23:49
🔗
|
TBO |
That i'd store locally |
|
23:50
🔗
|
zino |
TBO: I don't download much that don't go into the archive, but there are some things. I use youtube-sync to download youtube channels I want to keep an updated copy of for example. |
|
23:50
🔗
|
TBO |
Stuff like porn, niche personnal interests, obscure japanese websites, search engine results |
|
23:50
🔗
|
odemg |
the tools would be the same no matter where you intend to store the data, we tend to write things or use flags in existing tools that don't just get the video from youtube (for example) but also the metadata and everything in between |
|
23:50
🔗
|
TBO |
I doubt you'd want me to archive these |
|
23:51
🔗
|
TBO |
Okay it wasn't clear whether or not local storage was intended in the purpose of these particular softwares |
|
23:52
🔗
|
zino |
TBO: Well, we'd like to put all of those in IA, but unfortunately IA doesn't have the storage capacity for porn. Niche interests and japanese websites goes into IA though. |
|
23:54
🔗
|
TBO |
I'm surprised that there isn't a broader tool with an easy GUI for mass downloading stuff |
|
23:54
🔗
|
TBO |
It's typically the kind of thing that's a pain to work with in a terminal |
|
23:54
🔗
|
zino |
There probably is somewhere in Windows land. Most of us here live on the command line. :) |
|
23:55
🔗
|
zino |
As for local media, porn and other, I assume it comes down mostly to storage and organization more than how to download it. Can't help much there. |
|
23:55
🔗
|
TBO |
I'm in the command line too for that kind of things as I don't want to keep my computer on 24/7 |
|
23:55
🔗
|
TBO |
And my servers have the luxury of an ethernet cable |
|
23:55
🔗
|
TBO |
But still |
|
23:56
🔗
|
TBO |
You must rely on windows-land to make GUIs |
|
23:57
🔗
|
zino |
Time to get some sleep. |
|
23:57
🔗
|
TBO |
Good night |
|
23:58
🔗
|
|
Stiletto has quit IRC () |
|
23:58
🔗
|
|
BlueMaxim has joined #archiveteam-bs |