Return to “Announcements”

Post

Re: The End

#527
Flatfingers wrote:
Thu Nov 19, 2020 4:03 pm
If any parts are to be archived for access later (if possible and acceptable), I'd hope at a minimum they include the REKT, Dev Logs, and Suggestions forums/sub-forums.

SO MUCH good stuff there over the years.
I have the majority if not all of the dev logs backed up on my google drive as both DOC and PDF files (found in my signature). I am hoping that many of the old conversations we have had about gameplay related things are backed up by someone. As the community here has hashed through some very deep topics on these forums which are well worth saving.

Edit: I have not backed up any of the dev logs after January 23, 2015 (The Road to Beta Chapter 2) Since this is the case, I can begin work on archiving the newer devlogs for you all since there seems to be interest in these logs as well.
Image
Post

Re: The End

#529
I guess she could? She doesn't copy anything down, though, so I'd have to add all that. She also doesn't have the ability to actually write anything anywhere.
Dinosawer wrote:
Thu Nov 19, 2020 9:01 am
Talvieno wrote:
Wed Nov 18, 2020 6:50 pm
If he kills the forums, I lose five years of the REKT RPG I've been working on. I find that to be a terrifying thought. Fortunately I don't think he's going to... not yet at least. The payment date is somewhere around September, if I remember correctly, and that's come and gone for this year without a hiccup.
I'm wondering if it wouldn't be safer to move over to somewhere else at this point.
Thinking you might be right... just to be safe. That's a big undertaking though. We've put a lot of stuff in the REKT subforum over the years.
CSE wrote:
Thu Nov 19, 2020 2:02 pm
I am not wondering.
Make a copy of the forum database (at least REKT).
Weekly or so. Hopefully you have the rights, otherwise you may need to make a bot and « read/store » the threads.
Nope, don't have the rights. I'm not sure I actually have the ability to change anything on the site at all, much less database access.
Have a question? Send me a PM! || I have a Patreon page up for REKT now! || People talking in IRC over the past two hours: Image
Image
Image
Post

Re: The End

#530
Talvieno wrote:
Fri Nov 20, 2020 5:17 pm
I guess she could? She doesn't copy anything down, though, so I'd have to add all that. She also doesn't have the ability to actually write anything anywhere.
Dinosawer wrote:
Thu Nov 19, 2020 9:01 am
Talvieno wrote:
Wed Nov 18, 2020 6:50 pm
If he kills the forums, I lose five years of the REKT RPG I've been working on. I find that to be a terrifying thought. Fortunately I don't think he's going to... not yet at least. The payment date is somewhere around September, if I remember correctly, and that's come and gone for this year without a hiccup.
I'm wondering if it wouldn't be safer to move over to somewhere else at this point.
Thinking you might be right... just to be safe. That's a big undertaking though. We've put a lot of stuff in the REKT subforum over the years.
CSE wrote:
Thu Nov 19, 2020 2:02 pm
I am not wondering.
Make a copy of the forum database (at least REKT).
Weekly or so. Hopefully you have the rights, otherwise you may need to make a bot and « read/store » the threads.
Nope, don't have the rights. I'm not sure I actually have the ability to change anything on the site at all, much less database access.
Could it be automated with a bot scraping the forum?
LT Wiki | IRC | REKT Wiki
Image
Idiots. Idiots everywhere. ~Dr. Cha0zz
Post

Re: The End

#531
Talvieno wrote:
Fri Nov 20, 2020 5:17 pm
I guess she could? She doesn't copy anything down, though, so I'd have to add all that. She also doesn't have the ability to actually write anything anywhere.
Dinosawer wrote:
Thu Nov 19, 2020 9:01 am
Talvieno wrote:
Wed Nov 18, 2020 6:50 pm
If he kills the forums, I lose five years of the REKT RPG I've been working on. I find that to be a terrifying thought. Fortunately I don't think he's going to... not yet at least. The payment date is somewhere around September, if I remember correctly, and that's come and gone for this year without a hiccup.
I'm wondering if it wouldn't be safer to move over to somewhere else at this point.
Thinking you might be right... just to be safe. That's a big undertaking though. We've put a lot of stuff in the REKT subforum over the years.
Aye, but the undertaking is only going to increase the more we postpone it...
Didn't Silver have a Thing to scrape the forums as backup or something?
Warning: do not ask about physics unless you really want to know about physics.
The LT IRC / Alternate link || The REKT Wiki || PUDDING
Image
Post

Re: The End

#532
I suppose anyone could create a backup using wget (see https://en.wikipedia.org/wiki/Wget) - at least of all publicly visible threads; I'm not sure if there's more, apart from obviously private direct messages, or how large a part of the whole those deeper sections might be. I don't want to post something directly working, for fear of too many people putting too large a load on the server, but such example commands are just a search away. Someone who does this might consider using the -w parameter to add a time delay between requests (examples: https://stackoverflow.com/questions/357 ... ts-in-wget).

I'd compile the archive myself, though somehow it seems better for that kind of thing to come from someone not so no-name - from someone who is actually recognisable as a member of the community. That, and I'm unsure about the copyright problems one might technically get into if sharing so many contributions from others.

(As a side-note, I once used wget to "save" the remains of a dying forum (for the overhyped game StarForge), starting the process just too late to get much before it was shut down. That was only for silly sentimental reasons - the Limit Theory forum seems vastly more valuable and informative. For me, this feels almost like the beginnings of a pattern; I'm wondering if I'll take a liking to a third and yet more interesting forum-potentially-at-risk...)
Post

Re: The End

#534
Someone may or may not have been giving the backup-via-wget method a go. During this hypothetical process, the (practically speaking) simulated scraping experience suggests that one might reasonably end up with unreasonably many redundant downloads unless one takes care to exclude a few common URL patterns, such as by adding another parameter to the wget invocation:

Code: Select all

--reject-regex 'posting|search|print|ucp|feed|viewprofile|\?p='
This precaution could (in theory) avoid the following:
  • attempts to quote/reply to every single post
  • searches (such as listings of each user's posts)
  • print views
  • attempts to access direct messaging
  • the Atom feed
  • attempts to view user profiles (which show nothing to a web scraper that isn't logged in as a forum user)
  • stupendously superfluous per-post (rather than per-topic or per-page) views
Silverware wrote:
Mon Nov 23, 2020 7:09 pm
I had built a scraping bot to do this, but there were innumerable errors with the bloody thing.
So... you're saying the Silverware software needs polishing? Ahem. :ghost:
(My bad sense of humour isn't liable to apologise for itself, so I do so in its stead. I'll see myself out.)

Online Now

Users browsing this forum: No registered users and 0 guests

cron