| Time |
Nickname |
Message |
|
01:01
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
01:42
🔗
|
|
dashcloud has joined #archiveteam-ot |
|
02:11
🔗
|
|
ivan` has joined #archiveteam-ot |
|
02:11
🔗
|
|
vectr0n_ has joined #archiveteam-ot |
|
02:11
🔗
|
|
djsundog has quit IRC (Ping timeout (120 seconds)) |
|
02:11
🔗
|
|
vectr0n has quit IRC (Excess Flood) |
|
02:11
🔗
|
|
dxrt_ has quit IRC (Ping timeout (120 seconds)) |
|
02:11
🔗
|
|
Albardin has quit IRC (Write error: Broken pipe) |
|
02:12
🔗
|
|
Odd0002 has quit IRC (ZNC - http://znc.in) |
|
02:12
🔗
|
|
ivan has quit IRC (Remote host closed the connection) |
|
02:12
🔗
|
|
faolingfa has quit IRC (Remote host closed the connection) |
|
02:13
🔗
|
|
vectr0n_ is now known as vectr0n |
|
02:16
🔗
|
|
nightpoo- has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
Polylith has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
moufu has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
chfoo has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
arkiver has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
jut_ has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
kiska1 has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
mal has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
tyzoid has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:16
🔗
|
|
sep332 has quit IRC (ircd.choopa.net irc.choopa.net) |
|
02:19
🔗
|
|
faolingfa has joined #archiveteam-ot |
|
02:22
🔗
|
|
moufu_ has joined #archiveteam-ot |
|
02:24
🔗
|
|
chfoo-_ has joined #archiveteam-ot |
|
02:26
🔗
|
|
Odd0002 has joined #archiveteam-ot |
|
02:26
🔗
|
|
nightpoo- has joined #archiveteam-ot |
|
02:26
🔗
|
|
Polylith has joined #archiveteam-ot |
|
02:26
🔗
|
|
arkiver has joined #archiveteam-ot |
|
02:26
🔗
|
|
jut_ has joined #archiveteam-ot |
|
02:26
🔗
|
|
kiska1 has joined #archiveteam-ot |
|
02:26
🔗
|
|
tyzoid has joined #archiveteam-ot |
|
02:26
🔗
|
|
sep332 has joined #archiveteam-ot |
|
02:26
🔗
|
|
djsundog has joined #archiveteam-ot |
|
02:28
🔗
|
|
kiska1 has quit IRC (Read error: Operation timed out) |
|
02:28
🔗
|
|
nightpoo- has quit IRC (Read error: Operation timed out) |
|
02:28
🔗
|
|
tyzoid has quit IRC (Write error: Broken pipe) |
|
02:28
🔗
|
|
nightpool has joined #archiveteam-ot |
|
02:28
🔗
|
|
arkiver has quit IRC (Read error: Operation timed out) |
|
02:29
🔗
|
|
jut_ has quit IRC (Read error: Operation timed out) |
|
02:29
🔗
|
|
jut_ has joined #archiveteam-ot |
|
02:29
🔗
|
|
sep332 has quit IRC (Read error: Operation timed out) |
|
02:30
🔗
|
|
Polylith has quit IRC (Read error: Operation timed out) |
|
02:30
🔗
|
|
djsundog has quit IRC (Read error: Operation timed out) |
|
02:30
🔗
|
|
Polylith has joined #archiveteam-ot |
|
02:32
🔗
|
|
arkiver has joined #archiveteam-ot |
|
02:41
🔗
|
|
mal has joined #archiveteam-ot |
|
02:42
🔗
|
|
kiska1 has joined #archiveteam-ot |
|
03:27
🔗
|
|
Albardin has joined #archiveteam-ot |
|
03:27
🔗
|
|
tyzoid has joined #archiveteam-ot |
|
03:27
🔗
|
|
dxrt_ has joined #archiveteam-ot |
|
03:27
🔗
|
|
dxrt sets mode: +o dxrt_ |
|
03:27
🔗
|
|
djsundog has joined #archiveteam-ot |
|
03:33
🔗
|
|
sep332 has joined #archiveteam-ot |
|
03:48
🔗
|
|
odemg has quit IRC (Read error: Operation timed out) |
|
04:00
🔗
|
|
odemg has joined #archiveteam-ot |
|
04:10
🔗
|
|
DrasticAc has joined #archiveteam-ot |
|
04:46
🔗
|
w0rmhole |
can't remember if i asked here before or not, but is there a preferred way to download entire mediawiki wikis? (entire meaning images, page edits, audio clips, files, etc.) |
|
04:47
🔗
|
w0rmhole |
for example, i'd like to get an offline copy of https://wiki.telefang.net/ |
|
04:47
🔗
|
w0rmhole |
btw i not only want to download it but be able to view it too |
|
04:55
🔗
|
Flashfire |
can anyone reccomend an iso burning software for macosx Kiska or w0rmhole ? |
|
04:55
🔗
|
w0rmhole |
finder can do that already |
|
04:56
🔗
|
w0rmhole |
pop in your disc, right click the disk image, and click burn disk image to disc" |
|
04:56
🔗
|
w0rmhole |
right click, or control+click, or two-finger click |
|
04:56
🔗
|
Flashfire |
I want to make it an ISO from a disk |
|
04:57
🔗
|
w0rmhole |
open disk utility |
|
04:57
🔗
|
w0rmhole |
highlight the disc in the list |
|
04:57
🔗
|
w0rmhole |
go to file>new image>image from <name> |
|
04:58
🔗
|
Flashfire |
Ok cause I have a game that is not the IA as far as I know |
|
04:58
🔗
|
w0rmhole |
be sure to select format as "dvd/cd master" |
|
04:58
🔗
|
w0rmhole |
what's the game? |
|
04:59
🔗
|
Flashfire |
https://www.ebay.com/itm/Mega-Bloks-Dragons-Metal-Ages-PC-Game-Program-Windows-Mint-/173527845467?oid=172724424844 |
|
04:59
🔗
|
Flashfire |
only mention I could find of it |
|
04:59
🔗
|
w0rmhole |
my assumption is that it has no copy protection so doing it the disk utility way should work |
|
05:00
🔗
|
Flashfire |
I come across a lot of obscure stuff |
|
05:01
🔗
|
w0rmhole |
then it will give you a .cdr file. just type `hdiutil convert /path/to/file.cdr -format UDTO -o /path/to/converted.iso' |
|
05:01
🔗
|
Flashfire |
https://archive.org/details/@flashfire42 |
|
05:01
🔗
|
w0rmhole |
cool :D |
|
05:01
🔗
|
Flashfire |
I just convert it to an ISO in the about this file thing is that bad? |
|
05:01
🔗
|
w0rmhole |
like rename .cdr to .iso? |
|
05:01
🔗
|
Flashfire |
yeah |
|
05:01
🔗
|
Flashfire |
its worked in the past |
|
05:02
🔗
|
Flashfire |
I think |
|
05:02
🔗
|
w0rmhole |
i though i read somewhere that that works, but i've looked and can't find that |
|
05:02
🔗
|
|
Albardin has quit IRC (Read error: Operation timed out) |
|
05:02
🔗
|
|
sep332 has quit IRC (Write error: Broken pipe) |
|
05:02
🔗
|
|
tyzoid has quit IRC (Write error: Broken pipe) |
|
05:02
🔗
|
|
kiska1 has quit IRC (Read error: Operation timed out) |
|
05:02
🔗
|
|
djsundog has quit IRC (Read error: Operation timed out) |
|
05:02
🔗
|
|
dxrt_ has quit IRC (Read error: Operation timed out) |
|
05:02
🔗
|
w0rmhole |
netshit |
|
05:02
🔗
|
Flashfire |
Well if you want to try some of my old games go ahead |
|
05:02
🔗
|
w0rmhole |
i mean netsplit |
|
05:02
🔗
|
w0rmhole |
:) |
|
05:02
🔗
|
Flashfire |
The ones I have uploaded to the archive already |
|
05:02
🔗
|
w0rmhole |
i'd love to |
|
05:03
🔗
|
Flashfire |
they are mostly going to need to be run through WINE or crossover if you dont have a windows device handy |
|
05:04
🔗
|
w0rmhole |
there is a proper way to create as-close-to-original-as-possible copies of discs, but it requires expensive and specific hardware |
|
05:04
🔗
|
Flashfire |
Yeah I dont have that kind of hardware though if someone does I would be happy to send them the disks |
|
05:05
🔗
|
Flashfire |
godane might he does a lot of digitisation and shit |
|
05:05
🔗
|
Flashfire |
but w0rmhole if you want to try out some of the old programs I have uploaded be my guest |
|
05:06
🔗
|
w0rmhole |
i have the hardware (a winxp box, ide plextor px-708a) but not enough time, and i need to reinstall xp on there anyway |
|
05:06
🔗
|
w0rmhole |
sure i'll check them out |
|
05:06
🔗
|
w0rmhole |
http://wiki.redump.org/index.php?title=CD_Dumping_Guide_(DIC_CLI) |
|
05:07
🔗
|
w0rmhole |
has a list of archive-grade drives |
|
05:08
🔗
|
w0rmhole |
my px-708a was about $165 AUD and i had to go through three to finally get a working one |
|
05:08
🔗
|
w0rmhole |
was a lot of money to dump just like that but, archiving is what i live for |
|
05:09
🔗
|
w0rmhole |
btw flashfire if you have a scanner i would really appreciate it if you could scan your discs too |
|
05:10
🔗
|
w0rmhole |
the disc itself or whatever the jewel case artwork is if you have it |
|
05:10
🔗
|
w0rmhole |
just to make as complete of a copy as possible |
|
05:10
🔗
|
Flashfire |
I dont have a scanner |
|
05:10
🔗
|
Flashfire |
Sadly |
|
05:11
🔗
|
w0rmhole |
could you take a photo of the discs? |
|
05:11
🔗
|
Flashfire |
Though if you have the equipment and would like me to keep an eye out for sales just let me know |
|
05:11
🔗
|
w0rmhole |
yeah |
|
05:11
🔗
|
Flashfire |
I can and upload that |
|
05:11
🔗
|
Flashfire |
I also need to have another look I want to buy some rom dumping equipment |
|
05:12
🔗
|
Flashfire |
I have some bootleg GBA games somewhere around |
|
05:12
🔗
|
w0rmhole |
for something like that one where its relatively inexpensive and in great condition i could buy that |
|
05:12
🔗
|
w0rmhole |
if you need suggestions on archival hardware feel free to ask me anytime |
|
05:13
🔗
|
|
m007a83 has quit IRC (Read error: Operation timed out) |
|
05:13
🔗
|
w0rmhole |
for dumping gba roms, you could always buy a nintendo ds flashcart (like an R4) and put a gba rom dumping utility on there. ive done that before |
|
05:13
🔗
|
w0rmhole |
with a ds lite |
|
05:13
🔗
|
w0rmhole |
cant remember the exact name of the tool though |
|
05:13
🔗
|
|
m007a83 has joined #archiveteam-ot |
|
05:14
🔗
|
w0rmhole |
but i did check the sha1s and md5s of the retail cartridges i dumped and they matched their no-scene counterparts |
|
05:15
🔗
|
Flashfire |
wait you do GBA rom dumping? |
|
05:15
🔗
|
Flashfire |
Do you have the files? |
|
05:15
🔗
|
w0rmhole |
when i have carts worth dumping, yes |
|
05:15
🔗
|
w0rmhole |
which files? |
|
05:15
🔗
|
Flashfire |
If you can get me the files I can upload the GBA rom files to the internet archive for you plus add them to my personal collection |
|
05:16
🔗
|
w0rmhole |
sure, but which files? the roms i dumped? the actual dumping software? the r4 firmware? |
|
05:17
🔗
|
w0rmhole |
i too have an IA account btw, but i haven't added that much stuff in a while |
|
05:17
🔗
|
w0rmhole |
and i don't upload my tubeup videos to it |
|
05:17
🔗
|
|
BlueMax has quit IRC (Read error: Connection reset by peer) |
|
05:17
🔗
|
Flashfire |
The roms you dumped |
|
05:17
🔗
|
Flashfire |
I would be very interested in them |
|
05:18
🔗
|
Flashfire |
also if you havent already check out http://hhug.me/ |
|
05:22
🔗
|
w0rmhole |
most of them were retail by the way, three of them were firered rom hacks. and yeah i've been there before, great site. |
|
05:22
🔗
|
w0rmhole |
it's been years since the last time i dumped those, i'd have to scour my hdds to find them |
|
05:22
🔗
|
Flashfire |
PLEASE DO SO |
|
05:22
🔗
|
Flashfire |
I dont mind whatever they were |
|
05:23
🔗
|
Flashfire |
Even a slightly different hash is good for me |
|
05:32
🔗
|
w0rmhole |
ok hold your horses while i go look |
|
05:35
🔗
|
w0rmhole |
i think that's the fastest i've ever found something |
|
05:36
🔗
|
Flashfire |
lol |
|
05:36
🔗
|
Flashfire |
where will you upload them? |
|
05:36
🔗
|
w0rmhole |
dmca.gripe |
|
05:36
🔗
|
w0rmhole |
dmca.gripe mangles the filename though, so i'll store it in a .7z |
|
05:36
🔗
|
w0rmhole |
*store them all in a .7z |
|
05:37
🔗
|
Flashfire |
alright upload them and dm them to me My laptop will go dead soon so Will have a look tommorow or later today probably |
|
05:37
🔗
|
w0rmhole |
and by mangles i mean, if you upload `horses.png' it will turn out as `a2dfscxCGcx.png' |
|
05:37
🔗
|
w0rmhole |
ok, should be just about five minutes or so |
|
05:39
🔗
|
w0rmhole |
archiving them rn |
|
05:39
🔗
|
|
kiska1 has joined #archiveteam-ot |
|
05:41
🔗
|
w0rmhole |
there will only be one POKEMON_FIRE_BPRE01.gba file. two of the three rom hacks had the same name, as well as my official firered cart |
|
05:42
🔗
|
w0rmhole |
so im not sure if the one in there is a hack or the retail |
|
05:53
🔗
|
|
chfoo-_ is now known as chfoo |
|
06:01
🔗
|
|
Albardin has joined #archiveteam-ot |
|
06:01
🔗
|
|
tyzoid has joined #archiveteam-ot |
|
06:01
🔗
|
|
dxrt_ has joined #archiveteam-ot |
|
06:01
🔗
|
|
dxrt sets mode: +o dxrt_ |
|
06:01
🔗
|
|
djsundog has joined #archiveteam-ot |
|
06:05
🔗
|
|
sep332 has joined #archiveteam-ot |
|
06:32
🔗
|
|
m007a83_ has joined #archiveteam-ot |
|
06:34
🔗
|
|
Meroje has joined #archiveteam-ot |
|
06:35
🔗
|
|
m007a83 has quit IRC (Ping timeout: 252 seconds) |
|
06:35
🔗
|
|
m007a83_ is now known as m007a83 |
|
06:59
🔗
|
|
BlueMax has joined #archiveteam-ot |
|
07:15
🔗
|
|
sep332 has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
djsundog has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
dxrt_ has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
tyzoid has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
Albardin has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
kiska1 has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
mal has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
jut_ has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
moufu_ has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
Sanky has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
svchfoo3 has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:15
🔗
|
|
rektide has quit IRC (hub.efnet.us ircd.choopa.net) |
|
07:16
🔗
|
|
jut_ has joined #archiveteam-ot |
|
07:16
🔗
|
|
moufu_ has joined #archiveteam-ot |
|
07:16
🔗
|
|
Sanky has joined #archiveteam-ot |
|
07:16
🔗
|
|
svchfoo3 has joined #archiveteam-ot |
|
07:16
🔗
|
|
rektide has joined #archiveteam-ot |
|
07:16
🔗
|
|
irc.mzima.net sets mode: +o svchfoo3 |
|
07:23
🔗
|
w0rmhole |
is there a preferred way to download entire mediawiki or fandom wikia wikis? (entire meaning images, page edits, audio clips, files, etc.) |
|
07:23
🔗
|
w0rmhole |
i believe that just throwing it into grab-site can run into stacking urIs |
|
07:24
🔗
|
w0rmhole |
or something with login page issues |
|
09:40
🔗
|
Flashfire |
So dxrt what brought you to the archiveteam |
|
09:42
🔗
|
Flashfire |
And you kiska what brought you here? |
|
09:42
🔗
|
dxrt |
Hmm probably reading about the geocities stuff and finding the wiki a good resource a good enough reason to join |
|
09:42
🔗
|
Flashfire |
Fair enough was curious is all |
|
09:42
🔗
|
dxrt |
You? |
|
09:43
🔗
|
Flashfire |
I honestly dont remember I was looking into datahoarding and the internet archive and found this place mentioned somewhere |
|
09:44
🔗
|
dxrt |
It is mentioned a lot on that subreddit lol |
|
09:45
🔗
|
kiska |
I had a habit of clicking on the "About this Capture" thing on WBM and that is how I found AT |
|
09:45
🔗
|
Flashfire |
How long have you been with the team kiska I seem to remember you joining after me |
|
09:46
🔗
|
kiska |
I joined IRC after you, I ran the warrior since version 2 |
|
09:46
🔗
|
Flashfire |
yeah |
|
10:34
🔗
|
|
wp494 has quit IRC (Ping timeout: 492 seconds) |
|
10:35
🔗
|
|
wp494 has joined #archiveteam-ot |
|
10:42
🔗
|
|
BlueMax has quit IRC (Read error: Connection reset by peer) |
|
11:26
🔗
|
JAA |
#archivebot: "<+w0rmhole> why does that say "dick" in it?" -- On a related note, the URL I got when I archived Trump's tweets a while ago was https://transfer.sh/GayO1/realDonaldTrump-tweets :-) |
|
11:30
🔗
|
kiska |
xD |
|
11:31
🔗
|
|
kiska1 has joined #archiveteam-ot |
|
12:02
🔗
|
Flashfire |
no flounce no fuss no drama just liek movin' on izzle |
|
12:02
🔗
|
Flashfire |
i dont really game tbh |
|
12:02
🔗
|
Flashfire |
dont reall has mich in uuuh... common with majority o' peeps here 'cpz of taht an' etcetc |
|
12:02
🔗
|
Flashfire |
i mena mah irl frienfs they game liek welp 0% so i feel iddi MUCH bettah than 'em! for abit |
|
12:02
🔗
|
Flashfire |
ima sho' you get it tho |
|
12:02
🔗
|
Flashfire |
tried to get snowy back failed too bad so sad much hashtag |
|
12:02
🔗
|
Flashfire |
Kiska JAA try and make sense of that |
|
12:02
🔗
|
kiska |
... |
|
12:02
🔗
|
kiska |
No thanks |
|
12:03
🔗
|
Flashfire |
That’s a message from a friend of mine. Her pseudonym is Fairfox no one ever knows what the duck she is saying |
|
12:07
🔗
|
JAA |
That's disgusting. |
|
12:09
🔗
|
Flashfire |
How I summed it up or how she types |
|
12:09
🔗
|
Flashfire |
? |
|
12:09
🔗
|
JAA |
The latter. |
|
12:10
🔗
|
|
dxrt_ has joined #archiveteam-ot |
|
12:10
🔗
|
|
dxrt sets mode: +o dxrt_ |
|
15:51
🔗
|
|
mgrytbak has joined #archiveteam-ot |
|
16:07
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 255 seconds) |
|
16:07
🔗
|
|
Mateon1 has joined #archiveteam-ot |
|
16:22
🔗
|
astrid |
00:23 <w0rmhole> is there a preferred way to download entire mediawiki or fandom wikia wikis? || wikiteam has tooling exactly for this |
|
17:06
🔗
|
|
godane has quit IRC (Ping timeout: 260 seconds) |
|
17:11
🔗
|
|
moufu_ is now known as moufu |
|
17:22
🔗
|
|
godane has joined #archiveteam-ot |
|
17:23
🔗
|
|
svchfoo3 sets mode: +o godane |
|
17:26
🔗
|
w0rmhole |
https://www.archiveteam.org/index.php?title=Deaths_in_2018 how does the bot on this page know when a website is saved? |
|
17:26
🔗
|
w0rmhole |
archivebot just finished www.joefrank.com |
|
17:29
🔗
|
astrid |
is there a bot? i thought it was manual |
|
17:34
🔗
|
jut_ |
I think it searches https://archive.fart.website/archivebot/viewer/ |
|
17:35
🔗
|
w0rmhole |
near the top of the page it says not to edit it, as it is "automatically updated by bot". |
|
17:35
🔗
|
astrid |
ah ok |
|
17:37
🔗
|
jrwr |
HadeanEon is the botname |
|
17:55
🔗
|
JAA |
VoynichCr is the author. |
|
17:55
🔗
|
w0rmhole |
on the github page it says that using `--xml' and `--images' downloads "complete XML histories and images". that means it downloads images, page edits, audio clips, files, etc., right? |
|
17:55
🔗
|
JAA |
w0rmhole: I think it checks against the ArchiveBot viewer periodically to update the saved/not saved thing. |
|
17:55
🔗
|
w0rmhole |
im just confused on the terminology |
|
17:56
🔗
|
|
vectr0n_ has joined #archiveteam-ot |
|
17:57
🔗
|
|
vectr0n has quit IRC (Ping timeout: 259 seconds) |
|
17:57
🔗
|
|
vectr0n_ is now known as vectr0n |
|
17:58
🔗
|
w0rmhole |
JAA: i see |
|
18:13
🔗
|
VoynichCr |
w0rmhole: bot updates page once a day |
|
18:13
🔗
|
VoynichCr |
a more frequent rate would flood page history and recent changes |
|
19:08
🔗
|
|
wp494 has quit IRC (Quit: LOUD UNNECESSARY QUIT MESSAGES) |
|
19:09
🔗
|
|
wp494 has joined #archiveteam-ot |
|
19:27
🔗
|
w0rmhole |
thanks voynichcr and jaa and everyone else |
|
19:39
🔗
|
w0rmhole |
kiska, flashfire: macOS Mojave comes out today!!! :D |
|
19:41
🔗
|
|
caff has joined #archiveteam-ot |
|
19:53
🔗
|
w0rmhole |
JAA: does snscrape grab the urls from retweets? |
|
19:54
🔗
|
|
SimpBrain has joined #archiveteam-ot |
|
19:57
🔗
|
JAA |
w0rmhole: Nope. |
|
19:57
🔗
|
w0rmhole |
do you have plans of it grabbing those urls in the future? |
|
19:58
🔗
|
JAA |
If you know a way to discover them, sure. |
|
19:58
🔗
|
w0rmhole |
i only know bash |
|
19:58
🔗
|
JAA |
Note that the profile page is limited to 3200 results. That's why snscrape uses the Twitter search, not the profile page. |
|
19:58
🔗
|
w0rmhole |
oh i didnt know that |
|
19:58
🔗
|
JAA |
And there doesn't seem to be a way to find all tweets retweeted by @user through the search. |
|
19:59
🔗
|
w0rmhole |
damn |
|
20:30
🔗
|
VoynichCr |
so how many tweets can find in Tw search? your best results JAA ? |
|
20:37
🔗
|
JAA |
VoynichCr: All of them, but only original tweets by the user. The largest accounts I've scraped so far had roughly 150k tweets. |
|
20:48
🔗
|
VoynichCr |
JAA: thats pretty cool, is snscrape going to be added to archivebot soon? |
|
20:52
🔗
|
|
S1mpbrain has joined #archiveteam-ot |
|
20:52
🔗
|
JAA |
VoynichCr: "Soon"? Not likely. |
|
20:53
🔗
|
|
S1mpbrain has quit IRC (Remote host closed the connection) |
|
20:54
🔗
|
VoynichCr |
:-( |
|
20:54
🔗
|
JAA |
ArchiveBot development is moving at glacial speeds. |
|
20:55
🔗
|
|
SimpBrain has quit IRC (Read error: Operation timed out) |
|
20:57
🔗
|
VoynichCr |
not bad, it could be slower |
|
20:57
🔗
|
JAA |
Heh |
|
20:57
🔗
|
JAA |
Yeah, it could be 0 commits per year instead of 1. |
|
21:03
🔗
|
VoynichCr |
one would think Commons and Wikipedia pages are well archived, but this file (and I have found many others) from year 2015 is yet to be archived https://web.archive.org/web/*/https://commons.wikimedia.org/wiki/File:Bulletin_of_the_Museum_of_Comparative_Zoology_at_Harvard_College_(1982-1985)_(20493697735).jpg |
|
21:03
🔗
|
VoynichCr |
(i know about the xml and image dumps, I mean the wayback) |
|
21:05
🔗
|
VoynichCr |
2011 https://web.archive.org/web/*/https://commons.wikimedia.org/wiki/File:West_Allen_Dale_-_Low_Hartleycleugh_and_High_Turney_Shield_-_geograph.org.uk_-_1703591.jpg |
|
21:06
🔗
|
VoynichCr |
the wayback coverage of Commons sucks |
|
21:15
🔗
|
JAA |
I'd guess that it's intentionally excluded from IA's crawls because there's no risk of it suddenly disappearing anytime soon. |
|
21:16
🔗
|
JAA |
And IA is directly collaborating with Wikimedia in other aspects (e.g. prevet linkrot among sources on Wikipedia articles), so if Wikipedia got in trouble, they'd likely be able to archive it then before anything is lost. |
|
21:20
🔗
|
VoynichCr |
there must be an explanation for sure, but it is a bit weird to me |
|
21:21
🔗
|
VoynichCr |
one of the most popular websites in the interwebs, the biggest encyclopedia, free licensed, is poorly archived in the wayback |
|
21:22
🔗
|
VoynichCr |
next year the Commons interface is gonna change, Structured Commons is comming soon |
|
23:14
🔗
|
|
Odd0002 has quit IRC (Quit: ZNC - http://znc.in) |
|
23:14
🔗
|
|
Odd0002 has joined #archiveteam-ot |
|
23:16
🔗
|
|
caff_ has joined #archiveteam-ot |
|
23:19
🔗
|
|
caff has quit IRC (Read error: Operation timed out) |