The Data Behind /g/'s Good Sites
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
gg1234 3b75df474a Add site coolors.co 4 months ago
issue_template Simplify issue_template for new link request 5 months ago
templates Add dynamic last update to build-site.js 5 months ago
www Fix checkbox state saving to localstorage 5 months ago
.gitignore Rebuild static site from JSON files 5 months ago
00.alternative-search-engines.json Lowercase filenames of JSON data files 5 months ago
01.miscellaneous-interesting-sites.json Lowercase filenames of JSON data files 5 months ago
02.useful-sites.json Add site coolors.co 4 months ago
03.science-math-sites.json Lowercase filenames of JSON data files 5 months ago
04.tech-sites.json Lowercase filenames of JSON data files 5 months ago
05.privacy-security-related-sites.json Lowercase filenames of JSON data files 5 months ago
06.learning-sites.json Add site simply-how.com/userscripts 5 months ago
07.image-editors-generators-etc-sites.json Lowercase filenames of JSON data files 5 months ago
08.aesthetic-cool-sites.json Lowercase filenames of JSON data files 5 months ago
09.book-sites.json Lowercase filenames of JSON data files 5 months ago
10.humour-fun-random-sites.json Lowercase filenames of JSON data files 5 months ago
11.audio-music-sound-sites.json Fix sites with leading '.' in name 5 months ago
12.coomer-stuff.json Lowercase filenames of JSON data files 5 months ago
13.image-boards-and-related-sites.json Note that desuarchive *does* archive /g/ 5 months ago
14.data-compression-sites.json Lowercase filenames of JSON data files 5 months ago
15.text-tools-and-related-sites.json Lowercase filenames of JSON data files 5 months ago
16.video-tv-movie-anime-sites.json Fix sites with leading '.' in name 5 months ago
17.gaymen-related-sites.json Lowercase filenames of JSON data files 5 months ago
18.alternative-paranormal-conspiracy-bizarre-sites.json Add site encypte.de/Daemonen 5 months ago
19.niche-interest-sites.json Add site based.cooking 5 months ago
20.file-conversion-sites.json Lowercase filenames of JSON data files 5 months ago
21.conversational-chatbots.json Lowercase filenames of JSON data files 5 months ago
22.sms-verification-sites.json Lowercase filenames of JSON data files 5 months ago
23.torrenting-sites.json Lowercase filenames of JSON data files 5 months ago
24.uncategorized-sites-will-sort-soon.json Add appreciationofbootednewswomen.blogspot.com 5 months ago
25.mirrors.json Add git repo to Mirrors section 4 months ago
LICENSE Initial commit 5 months ago
README.md Remove link to matrix 4 months ago
build-md.js Add last update to markdown too 5 months ago
build-site.js Add dynamic last update to build-site.js 5 months ago
original.json Add the original scrape of the data 5 months ago
package-lock.json Add jsonlint 5 months ago
package.json Add jsonlint 5 months ago
scrape.js Update comment w/ some history 5 months ago
utils.js Add dynamic last update to build-site.js 5 months ago

README.md

good-sites

The Data Behind /g/'s Good Sites

Context

The Plan

  • Split the sections in original.json into their own files for easier editing.
  • Remember the order of the sections in original.json for later.
  • Salvage the HTML/CSS/JS/Image assets from webarchive.
  • Write script to rebuild the site as a function of our data.
  • Figure out how to get this to people willing to publish the site.

Building Content From Data

First install the dependencies.

npm i

Web Site

node build-site.js

The results will be in ./www.

Markdown

node build-md.js > index.md

Deployment

TODO - Figure out how to get sites to automatically update when our data is updated. Should we use webhooks?

At the very least, we'd like mirrors to setup a daily cron job to pull the latest changes from git and rebuild the site if necessary.

Mirrors

With Waifus

Markdown

Maintenance

If you want to request that a link be added, please create a [New Link] issue.