#archiveteam-bs 2020-07-28,Tue

↑back Search

Time Nickname Message
00:00 πŸ”— arkiver our code should pick those out and retry (or fail)
00:00 πŸ”— arkiver and with fail I mean, fail and give the item to someone else eventually so no data is lost
00:00 πŸ”— arkiver and no bad data is archived
00:00 πŸ”— korobkov glad to hear :)
00:01 πŸ”— korobkov BTW, do you have any container for FreeBSD (i.e. bastille)
00:01 πŸ”— korobkov as there is no docker under FreeBSD
00:01 πŸ”— arkiver so for now most project are manual with scripts, if you are familiar with that
00:01 πŸ”— arkiver not sure, maybe Fusl would know more about that
00:01 πŸ”— arkiver but Fusl is on hackint
00:01 πŸ”— arkiver same channels on hackint
00:02 πŸ”— korobkov thank you, I can ask him about it
00:02 πŸ”— arkiver her*
00:02 πŸ”— korobkov sorry :) :)
00:03 πŸ”— korobkov about scripts: where could I read about them?
00:04 πŸ”— korobkov are they just shell scripts? how much manual interaction do they require?
00:04 πŸ”— arkiver our wiki, github.com/archiveteam, tracker.archiveteam.org
00:04 πŸ”— korobkov https://www.archiveteam.org/index.php?title=Projects#Manual_projects_2 ?
00:05 πŸ”— korobkov these?
00:05 πŸ”— arkiver yep, but also see the READMEs on github
00:05 πŸ”— arkiver and you might want to join hackint
00:06 πŸ”— korobkov should I reconnect there now?
00:08 πŸ”— korobkov also, why do you recommend me to participate in script projects rather than warrior-based ones?
00:08 πŸ”— korobkov are they more important for saving sites?
00:08 πŸ”— korobkov or something else?
00:13 πŸ”— Terbium A lot of the new projects are discussions are on hackint, however the general chats (#archiveteam #archiveteam-bs #archiveteam-ot) are still on EFnet. I recommend using a client that allows you to connect to both to keep up
00:14 πŸ”— korobkov thanks, I will try
00:14 πŸ”— Terbium If you can run a OVA VM image then you can run the Warrior Appliance (VM + Docker + Warrior Container + Watchtower autoupdate).
00:15 πŸ”— Terbium A lot of the new projects are in rapid development so they arent pushed to Warriors immediately but as manual scripts
00:15 πŸ”— Terbium However, many of the scripts are automatically built into docker containers on updates
00:16 πŸ”— korobkov are new project of more value than old ones?
00:16 πŸ”— korobkov could I just run the latter?
00:17 πŸ”— korobkov (may be just need some time to have accustomed with new ones, if you advice me to do)
00:17 πŸ”— korobkov I for sure will read much more to be able to help
00:17 πŸ”— Terbium http://tracker.archiveteam.org/ shows some of the active (ish projects)
00:18 πŸ”— korobkov My first and main question here was about the whole ability to run the project from russian network
00:18 πŸ”— Terbium you can try URLteam for now if you want to get started on a warrior project (it's the default)
00:18 πŸ”— korobkov OK
00:19 πŸ”— korobkov I feel that I should help where there is more need in help, not where it would be more easy for me to run :)
00:20 πŸ”— korobkov just need some time to read a lot about all this :)
00:20 πŸ”— Terbium You can try reddit test project then as that's what we are working on
00:21 πŸ”— Terbium It shows up on warrior (you can manually select it from the warrior control panel)
00:21 πŸ”— Terbium Although im not sure if it auto updates the scripts (i'll check now)
00:22 πŸ”— korobkov btw, could it be run under FreeBSD's BHYVE?
00:23 πŸ”— Terbium I unfortunately do not have experience when FreeBSD OS or BHYVE virtualization
00:23 πŸ”— korobkov (either way FreeBSD do support Virtualbox, so I'm rather OK with it)
00:23 πŸ”— korobkov OK
00:23 πŸ”— Terbium if you can run docker you can do the following: sudo docker run --rm -d warcforceone/reddit-grab:latest --concurrent 20 ${NICKNAME}
00:23 πŸ”— Terbium change ${NICKNAME} to what you want to show up as
00:23 πŸ”— korobkov sorry, docker isn't available under FreeBSD…
00:24 πŸ”— korobkov but I could use it via warrior under Virtualbox?
00:25 πŸ”— Terbium Yeah, you can probably run a linux OS as a VM and then either run reddit-grab as a docker or as a script from here: https://github.com/ArchiveTeam/reddit-grab
00:25 πŸ”— Terbium The project readme states that FreeBSD support is currently unknown
00:25 πŸ”— korobkov yes, it's rare OS, especially now
00:26 πŸ”— korobkov what should I expect about bandwidth? and disk space ?
00:27 πŸ”— HP_Archiv has quit IRC (Quit: Leaving)
00:28 πŸ”— Terbium lemme check
00:29 πŸ”— korobkov (I have 100 Mbit/s FTTB and 640 Gb HDD with ZFS)
00:30 πŸ”— Terbium I'm averaging about 6MB/s with around <10GB disk usage
00:30 πŸ”— korobkov OK :)
00:30 πŸ”— Terbium this will probably vary per machine and internet connection
00:30 πŸ”— Terbium also because fusl is utterly annihilating the tracker and Reddit
00:33 πŸ”— Terbium korobkov: i forgot to mention, the project chat is at #shreddit over at hackint
00:34 πŸ”— korobkov thank you, so as you adviced me to start with, I will follow your advice :)
00:35 πŸ”— arkiver :)
00:35 πŸ”— korobkov just eed some sleep now (it's 04:35 UTC+04 here) and I still hadn't slept :)
00:35 πŸ”— arkiver good night!
00:36 πŸ”— korobkov thank you! see you later :)
00:36 πŸ”— * korobkov is going to sleep/offline mode…
00:36 πŸ”— korobkov has quit IRC (Quit: ERC (IRC client for Emacs 26.3))
00:46 πŸ”— bsmith093 has quit IRC (Ping timeout: 265 seconds)
01:01 πŸ”— bsmith093 has joined #archiveteam-bs
01:02 πŸ”— Ravenloft has quit IRC (Remote host closed the connection)
02:05 πŸ”— britmob has quit IRC (Ping timeout: 265 seconds)
02:12 πŸ”— HP_Archiv has joined #archiveteam-bs
02:13 πŸ”— britmob has joined #archiveteam-bs
02:43 πŸ”— HP_Archiv has quit IRC (Quit: Leaving)
03:23 πŸ”— HP_Archiv has joined #archiveteam-bs
03:38 πŸ”— HP_Archiv has quit IRC (Quit: Leaving)
03:45 πŸ”— qw3rty__ has joined #archiveteam-bs
03:53 πŸ”— qw3rty_ has quit IRC (Read error: Operation timed out)
05:10 πŸ”— Zandro has joined #archiveteam-bs
05:10 πŸ”— Zandro has left Leaving
07:06 πŸ”— K4k__ has quit IRC (Ping timeout: 260 seconds)
07:06 πŸ”— K4k__ has joined #archiveteam-bs
07:07 πŸ”— godane has quit IRC (hub.efnet.us irc.Prison.NET)
07:07 πŸ”— phirephly has quit IRC (hub.efnet.us irc.Prison.NET)
07:07 πŸ”— Pixi` has quit IRC (hub.efnet.us irc.Prison.NET)
07:07 πŸ”— superkuh has quit IRC (hub.efnet.us irc.Prison.NET)
07:07 πŸ”— maxfan8 has quit IRC (hub.efnet.us irc.Prison.NET)
07:07 πŸ”— scorche has quit IRC (hub.efnet.us irc.Prison.NET)
07:10 πŸ”— godane has joined #archiveteam-bs
07:10 πŸ”— phirephly has joined #archiveteam-bs
07:10 πŸ”— Pixi` has joined #archiveteam-bs
07:10 πŸ”— maxfan8 has joined #archiveteam-bs
07:10 πŸ”— scorche has joined #archiveteam-bs
07:10 πŸ”— jshoard has joined #archiveteam-bs
07:11 πŸ”— superkuh has joined #archiveteam-bs
07:21 πŸ”— bsmith093 has quit IRC (Read error: Operation timed out)
07:30 πŸ”— bsmith093 has joined #archiveteam-bs
07:36 πŸ”— HP_Archiv has joined #archiveteam-bs
08:01 πŸ”— lennier1 has quit IRC (Ping timeout: 857 seconds)
08:03 πŸ”— HP_Archiv has quit IRC (Quit: Leaving)
09:08 πŸ”— BlueMax has quit IRC (Read error: Connection reset by peer)
09:57 πŸ”— kiskaWee has joined #archiveteam-bs
10:34 πŸ”— kiska has quit IRC (Remote host closed the connection)
10:36 πŸ”— kiska has joined #archiveteam-bs
12:41 πŸ”— fredgido has joined #archiveteam-bs
12:48 πŸ”— fredgido_ has quit IRC (Read error: Operation timed out)
13:47 πŸ”— Terbium has quit IRC (Quit: http://quassel-irc.org - Chat comfortably. Anywhere.)
13:48 πŸ”— Terbium has joined #archiveteam-bs
15:25 πŸ”— Arcorann has quit IRC (Read error: Connection reset by peer)
15:43 πŸ”— systwi has quit IRC (Read error: Operation timed out)
16:03 πŸ”— Nikchemny has joined #archiveteam-bs
16:03 πŸ”— Nikchemny nico_32_ How I can recognize you have a progress? Check your IA account?
16:04 πŸ”— Nikchemny has quit IRC (Client Quit)
16:10 πŸ”— OrIdow6^2 Oh, that's "http://fileformats.archiveteam.org/ is down", not "http://fileformats.archiveteam.org/ is shutting down"
16:13 πŸ”— sembiance seems to be back up
16:14 πŸ”— arkiver :P
16:30 πŸ”— systwi has joined #archiveteam-bs
16:30 πŸ”— Maylay has quit IRC (Read error: Connection reset by peer)
16:34 πŸ”— Maylay has joined #archiveteam-bs
16:49 πŸ”— SketchCow WE THANK YOU ALL FOR OUR INCREDIBLE FILE FORMAT JOURNEY
16:52 πŸ”— VoynichCr all file formats will be .gif, problem solved
18:23 πŸ”— Nikchemny has joined #archiveteam-bs
18:26 πŸ”— Nikchemny JAA: Do you have Telegram? There is bot ( t.me/SaveYoutubeBot ) that can save YT videos. I asked them will they upload videos on IA, they said they don't have plans for this. I asked will they and they didn't answer. Maybe someone from AT or even IA contact with them ( t.me/SYmanagerBot )?
18:26 πŸ”— Nikchemny *will they create plans for this
18:31 πŸ”— Mateon1 has quit IRC (Ping timeout: 265 seconds)
18:31 πŸ”— Mateon1 has joined #archiveteam-bs
18:32 πŸ”— lennier1 has joined #archiveteam-bs
18:33 πŸ”— Kaz no.
18:33 πŸ”— Kaz this has caused issues in the past, because people save the most mundane shit and it's just a waste of space
18:34 πŸ”— Kaz IA doesn't want 500x copies of gangnam style or whatever people listen to these days
18:34 πŸ”— Nikchemny Kaz: Hm, I think tha IA can think before upload data
18:35 πŸ”— Kaz what
18:35 πŸ”— Nikchemny Btw, looks like https://youtube.com/watch?v=ddDpdfXlMxY was saved in 360p and 720p
18:35 πŸ”— Nikchemny And it is not pop-music
18:36 πŸ”— Kaz you've lost me
18:36 πŸ”— Nikchemny It is about capitalism, Putin, Russia
18:36 πŸ”— Kaz when did we move on to russia
18:37 πŸ”— Kaz is this like when you go on wikipedia and see how many clicks until you find hitler
18:37 πŸ”— Nikchemny I mean, IA (in my dream) won't upload all the videos by SaveYoutubeBot, only those that looks important
18:37 πŸ”— Nikchemny Kaz: https://youtube.com/watch?v=ddDpdfXlMxY is example of saved video
18:38 πŸ”— Kaz uh
18:38 πŸ”— Kaz whoever runs the bot would upload to IA
18:38 πŸ”— Kaz except, they shouldn't because it's a terrible idea
18:38 πŸ”— Nikchemny ΠŸΠ£Π’Π˜ΠΠ‘ΠšΠ˜Π™ ΠšΠΠŸΠ˜Π’ΠΠ›Π˜Π—Πœ. Как ΠŸΡƒΡ‚ΠΈΠ½ "спас" Россию ΠΎΡ‚ 90-Ρ… β†’ (https://youtube.com/watch?v=ddDpdfXlMxY) πŸ‘€ #ВСстник_Π‘ΡƒΡ€ΠΈ β†’ (http://www.youtube.com/channel/UCQ_LYRUJzBfh-mvU14xCNMw) πŸš€ 360p: 117MB πŸš€ 720p: 324MB βœ… 1080p: 658MB Π€ΠΎΡ€ΠΌΠ°Ρ‚Ρ‹ для скачивания ↓
18:38 πŸ”— Nikchemny πŸš€ means video was saved
18:38 πŸ”— Kaz ok(??)
18:39 πŸ”— Nikchemny βœ… means video can be saved, but not saved by someone before yet
18:39 πŸ”— JAA Yeah, no.
18:39 πŸ”— JAA sets mode: +o Kaz
18:39 πŸ”— Kaz as long as they save it somewhere that isn't IA, this all sounds fine
18:39 πŸ”— Nikchemny Why?
18:40 πŸ”— Kaz https://usercontent.irccloud-cdn.com/file/4ph8PMSB/image.png
18:40 πŸ”— kiska That and also IA pays $1500 per T of data saved to be accessed forever
18:41 πŸ”— kiska I'd rather my donation to be saving something more significant than youtube videos
18:41 πŸ”— Nikchemny Yes, I mean IA can choose what upload. The idae was to share this data with IA
18:41 πŸ”— Kaz that's not how uploading to IA works
18:41 πŸ”— Kaz it's user-submitted
18:42 πŸ”— Nikchemny https://usercontent.irccloud-cdn.com/file/4ph8PMSB/image.png Hm, interesting argument. But there are many community books, videos etc
18:42 πŸ”— Kaz yes
18:42 πŸ”— Kaz books small
18:42 πŸ”— Nikchemny Hm, ok. No is no
18:42 πŸ”— Kaz youtube videos of putin big
18:43 πŸ”— Nikchemny and bad
18:43 πŸ”— JAA sets mode: +o Kaz
18:43 πŸ”— JAA sets mode: +o kiska
18:45 πŸ”— JAA Also, uploading content that is still available on YouTube is bad. It wastes disk space that could be used for something more useful.
18:46 πŸ”— Nikchemny Mhm, I thought that the whole IA is for saving content in case of its death.
18:46 πŸ”— Nikchemny Except really old books and films
18:48 πŸ”— JAA Yeah, but IA doesn't have the resources (money) to archive YouTube. It's just too big.
18:49 πŸ”— Nikchemny Btw, does anyone moderate community collections? Looks like there are tons of useless pics (like Twitter and YT icons), sometimes porn etc
18:50 πŸ”— Kaz yes
18:50 πŸ”— Nikchemny Ok
18:58 πŸ”— VoynichCr yeah, there are many useless shit on IA collections
19:00 πŸ”— VoynichCr sometimes I explore those collections randomly, and half of it are religion content, and other stuff
19:00 πŸ”— Nikchemny Looks like content by Arabians
19:01 πŸ”— Nikchemny *arabs
19:01 πŸ”— VoynichCr well i have seen evangelists content too
19:02 πŸ”— Nikchemny Hm
19:02 πŸ”— Nikchemny Also, IA has collection with Bible on almost all languages
19:02 πŸ”— VoynichCr all them have uploaded hours and hours and hours of videos analysing their "holy" books
19:03 πŸ”— Nikchemny The books are holy for them. We must respect their religions
19:04 πŸ”— Nikchemny Even atheists must
19:05 πŸ”— Nikchemny has quit IRC (Quit: Page closed)
19:07 πŸ”— Nikchemny has joined #archiveteam-bs
19:08 πŸ”— Nikchemny Btw, it would be great if IA create collection for YT vids which links are on Wikipedia
19:15 πŸ”— godane has quit IRC (Read error: Connection reset by peer)
19:18 πŸ”— godane has joined #archiveteam-bs
19:22 πŸ”— sembiance FY, http://fileformats.archiveteam.org/ is down again. Same 'Unable to allocate memory for pool' errors as before.
19:23 πŸ”— SketchCow < Nikchemny> Btw, does anyone moderate community collections? Looks like there are tons of useless pics (like Twitter and YT icons), sometimes porn etc
19:23 πŸ”— SketchCow Why.... is this in #archiveteam-bs
19:24 πŸ”— Nikchemny Sorry, no more
19:25 πŸ”— SketchCow By the way, this is literally my job
19:25 πŸ”— SketchCow Literally. My. Job.
19:25 πŸ”— SketchCow Like, I'm that guy.
19:25 πŸ”— Nikchemny Ah, okay. I don't know it. Sorry
19:26 πŸ”— SketchCow What, you did it
19:26 πŸ”— SketchCow You got into the Tyrell Corporation. I'm the guy
19:29 πŸ”— Nikchemny Btw, thanks for uploading old journals. I have a small collection of journals about cars from 2013, but don't think you will be interested in.
19:36 πŸ”— balrog has quit IRC (Remote host closed the connection)
19:37 πŸ”— Nikchemny has quit IRC (Quit: Page closed)
19:39 πŸ”— balrog has joined #archiveteam-bs
20:19 πŸ”— lennier1 has quit IRC (Ping timeout: 260 seconds)
20:21 πŸ”— lennier1 has joined #archiveteam-bs
20:30 πŸ”— VoynichCr has left
20:31 πŸ”— DogsRNice has joined #archiveteam-bs
20:32 πŸ”— lennier2 has joined #archiveteam-bs
20:39 πŸ”— antomati_ is now known as antomatic
20:40 πŸ”— lennier1 has quit IRC (Read error: Operation timed out)
20:40 πŸ”— lennier2 is now known as lennier1
22:48 πŸ”— Arcorann has joined #archiveteam-bs
22:49 πŸ”— Arcorann has quit IRC (Remote host closed the connection)
22:50 πŸ”— Arcorann has joined #archiveteam-bs
22:54 πŸ”— Nikchemny has joined #archiveteam-bs
22:57 πŸ”— Nikchemny It would be nice to see here korobkov
22:58 πŸ”— Nikchemny has quit IRC (Client Quit)
23:07 πŸ”— jodizzle Peerlyst is basically all Javascript, which is really annoying
23:10 πŸ”— jshoard has quit IRC (Leaving)
23:30 πŸ”— JAA Not just "basically", entirely except for robots.txt and sitemap, as far as I can see. Eww
23:37 πŸ”— Terbium With the explosion of client side rendered sites, i am not surprised in the least
23:42 πŸ”— HP_Archiv has joined #archiveteam-bs
23:50 πŸ”— britmob has quit IRC (Read error: Connection reset by peer)
23:53 πŸ”— britmob has joined #archiveteam-bs
irclogger-viewer