How To Archive Full Threads

While archive.is and archive.org are good for storing thread content with thumbnails, if you want to archive a full thread, with all the posted .webms, .mp4s and full-sized images, no online service for doing that is available, especially after the demise of 8archive.moe.

That's why you'll need to save entire threads onto your hard drive, should you want to keep other people's progress updates for future study and good memories.
While expanding all the images and just saving the page with your browser does work for images, all video content will be unavailable for viewing.

This is where WinHTTrack website mirrorer comes into play. It allows you to save virtually any website to your hard drive, allowing you to save any piece of digital history to be preserved.
This is how you use it for archiving /agdg/ threads:

  1. Create a new project
    You create a new project by clicking NEXT, just as the program suggests.
    1.png
  2. Type in project name
    The preferable name for the project would be the thread number
    2.png
  3. Basic setup
    The optimal way of downloading a website would be to choose the action "Download web site(s)" when it's on page 13 and/or when there is a new thread created.
    3.png
  4. Advanced setup
    4.png
    Going into "Set options" menu is the most important part of the setup process. Should you screw it up, the program might decide to download the entirety of 8chan and all the websites linked from the thread, bloating the download to gigabytes.
    Scan rules:
    Copy this into the program to make sure you'll download all the content
+*.css +*.js -ad.doubleclick.net/* -mime:application/foobar
+*.gif +*.jpg +*.jpeg +*.png +*.tif +*.bmp
+*.zip +*.tar +*.tgz +*.gz +*.rar +*.z +*.exe
+*.mov +*.mpg +*.mpeg +*.avi +*.asf +*.mp3 +*.mp2 +*.rm +*.wav +*.vob +*.qt +*.vid +*.ac3 +*.wma +*.wmv
+*.webm +*.mp4 +*.pdf +*.swf
+*media.8ch.net*


Limits:
Putting 0 into external mirroring and leaving mirroring depth as empty is crucial. Max connections and max transfer rates are for you to tweak but it seems that with more simultaneous connections, the faster the download will be completed.
5.png

Flow control:
The number of connections should be equal to the max connections value from the Limits, or at least this seems to be the logical thing to do.
6.png

You might want to play with other options but they shouldn't be required.

5. Begin downloading!
Upon saving the options, pressing NEXT and then FINISH, the download will begin.
7.png
A typical /agdg/ thread should weigh around 200 MB. When the download is complete, you'll be given an option to view the mirrored website and check if everyting went alright and if all the content has been saved.
8.png
Unless otherwise stated, the content of this page is licensed under Creative Commons Attribution-ShareAlike 3.0 License