• Usenet-Rewind: search engine for Usenet messages back to 1981

    From Craig Stadler@cstadler18@hotmail.com to alt.folklore.computers on Sun Sep 6 06:12:18 2026
    From Newsgroup: alt.folklore.computers

    I spent the last year gathering and normalizing as many resources for
    Usenet messages and built a search engine over public Usenet
    discussions going back to 1981. Posting here because this seemed like
    the one group that would actually care.

    https://www.usenet-rewind.com/

    Since Google Groups stopped indexing new Usenet content a
    while back, and search over its historical archive has always been
    rough- I wanted something that treats this as a real research
    archive -- full-text search, date-range/filtering,etc and most
    importantly as much Usenet data as possible going back as far as I could
    find.

    The index currently holds (to date) roughly 980 million messages and is
    still growing. Sources are archival backups, data donations, and ongoing
    crawls of several thousand still-active public NNTP servers. Binary and yEnc-encoded content is stripped where possible to keep the index
    focused on text.

    The index was built using Apache Solr 10, MariaDB 12 (rocksdb), Ubuntu
    22.04.5 LTS & custom Python scripts, all on nvme disk.

    This is public archival content, same legal basis as DejaNews and
    Google Groups before it. There's a removal process for anyone who
    wants their own posts taken down, and author contact info is masked
    by default.
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From ram@ram@zedat.fu-berlin.de (Stefan Ram) to alt.folklore.computers on Sun Sep 6 07:18:56 2026
    From Newsgroup: alt.folklore.computers

    Craig Stadler <cstadler18@hotmail.com> wrote or quoted:
    There's a removal process for anyone who
    wants their own posts taken down, and author contact info is masked
    by default.

    What about some automatic removals for posts exhibiting header
    lines such as:

    X-No-Archive: Yes
    Archive: no
    X-No-Html: yes

    ?


    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Nuno Silva@nunojsilva@invalid.invalid to alt.folklore.computers on Sun Sep 6 10:01:27 2026
    From Newsgroup: alt.folklore.computers

    On 2026-09-06, Craig Stadler wrote:

    I spent the last year gathering and normalizing as many resources for
    Usenet messages and built a search engine over public Usenet
    discussions going back to 1981. Posting here because this seemed like
    the one group that would actually care.

    https://www.usenet-rewind.com/

    Since Google Groups stopped indexing new Usenet content a
    while back, and search over its historical archive has always been
    rough- I wanted something that treats this as a real research
    archive -- full-text search, date-range/filtering,etc and most
    importantly as much Usenet data as possible going back as far as I could find.

    The index currently holds (to date) roughly 980 million messages and is
    still growing. Sources are archival backups, data donations, and ongoing crawls of several thousand still-active public NNTP servers. Binary and yEnc-encoded content is stripped where possible to keep the index
    focused on text.

    The index was built using Apache Solr 10, MariaDB 12 (rocksdb), Ubuntu 22.04.5 LTS & custom Python scripts, all on nvme disk.

    This is public archival content, same legal basis as DejaNews and
    Google Groups before it. There's a removal process for anyone who
    wants their own posts taken down, and author contact info is masked
    by default.

    Can you consider setting a width and/or height for SVG icons for better compatibility? Or perhaps not use SVG icons at all?

    I can get a paginated list of newsgroups, but they're not linkified, how
    is this supposed to be used?
    --
    Nuno Silva
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Andy Burns@usenet@andyburns.uk to alt.folklore.computers on Sun Sep 6 10:31:35 2026
    From Newsgroup: alt.folklore.computers


    Craig Stadler wrote:

    this seemed like the one group that would actually care. https://www.usenet-rewind.com/
    Thanks for your efforts on this, I've only had a quick poke at it which
    gave me results, I'll try it later ...

    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Peter Flass@Peter@Iron-Spring.com to alt.folklore.computers on Sun Sep 6 08:02:37 2026
    From Newsgroup: alt.folklore.computers

    Thank you! This is definitely a worthwhile service. I'll have to try it out.

    On 9/5/26 23:12, Craig Stadler wrote:
    I spent the last year gathering and normalizing as many resources for
    Usenet messages and built a search engine over public Usenet
    discussions going back to 1981. Posting here because this seemed like
    the one group that would actually care.

    https://www.usenet-rewind.com/

    Since Google Groups stopped indexing new Usenet content a
    while back, and search over its historical archive has always been
    rough- I wanted something that treats this as a real research
    archive -- full-text search, date-range/filtering,etc and most
    importantly as much Usenet data as possible going back as far as I could find.

    The index currently holds (to date) roughly 980 million messages and is
    still growing. Sources are archival backups, data donations, and ongoing crawls of several thousand still-active public NNTP servers. Binary and yEnc-encoded content is stripped where possible to keep the index
    focused on text.

    The index was built using Apache Solr 10, MariaDB 12 (rocksdb), Ubuntu 22.04.5 LTS & custom Python scripts, all on nvme disk.

    This is public archival content, same legal basis as DejaNews and
    Google Groups before it. There's a removal process for anyone who
    wants their own posts taken down, and author contact info is masked
    by default.

    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Peter Flass@Peter@Iron-Spring.com to alt.folklore.computers on Sun Sep 6 08:12:25 2026
    From Newsgroup: alt.folklore.computers

    On 9/5/26 23:12, Craig Stadler wrote:
    I spent the last year gathering and normalizing as many resources for
    Usenet messages and built a search engine over public Usenet
    discussions going back to 1981. Posting here because this seemed like
    the one group that would actually care.

    https://www.usenet-rewind.com/

    Since Google Groups stopped indexing new Usenet content a
    while back, and search over its historical archive has always been
    rough- I wanted something that treats this as a real research
    archive -- full-text search, date-range/filtering,etc and most
    importantly as much Usenet data as possible going back as far as I could find.

    The index currently holds (to date) roughly 980 million messages and is
    still growing. Sources are archival backups, data donations, and ongoing crawls of several thousand still-active public NNTP servers. Binary and yEnc-encoded content is stripped where possible to keep the index
    focused on text.

    The index was built using Apache Solr 10, MariaDB 12 (rocksdb), Ubuntu 22.04.5 LTS & custom Python scripts, all on nvme disk.

    This is public archival content, same legal basis as DejaNews and
    Google Groups before it. There's a removal process for anyone who
    wants their own posts taken down, and author contact info is masked
    by default.

    Too bad there isn't some way to get rid of the porn. Search for "cp-v"
    (with the quotes) retrieves the following as the first hit:
    VEB ** Submissive Daddy's Girl Whitney Does It All ** CP@V+
    or else we need to know the rules for searches.
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Craig Stadler@cstadler18@hotmail.com to alt.folklore.computers on Sun Sep 6 16:55:47 2026
    From Newsgroup: alt.folklore.computers

    Nuno Silva <nunojsilva@invalid.invalid> wrote in news:117ja57$26mtg$1@dont- email.me:

    Can you consider setting a width and/or height for SVG icons for better compatibility? Or perhaps not use SVG icons at all?

    I can get a paginated list of newsgroups, but they're not linkified, how
    is this supposed to be used?


    I fixed the SVG size issue (I think!) and also newsgroups are now clickable but it shows ALL messages inthat group sorted by oldest first. Let me know
    if you had something else in mind, thanks for the feedback.

    -Craig
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Nuno Silva@nunojsilva@invalid.invalid to alt.folklore.computers on Mon Sep 7 10:51:55 2026
    From Newsgroup: alt.folklore.computers

    On 2026-09-06, Craig Stadler wrote:

    Nuno Silva <nunojsilva@invalid.invalid> wrote in news:117ja57$26mtg$1@dont- email.me:

    Can you consider setting a width and/or height for SVG icons for better
    compatibility? Or perhaps not use SVG icons at all?

    I can get a paginated list of newsgroups, but they're not linkified, how
    is this supposed to be used?


    I fixed the SVG size issue (I think!) and also newsgroups are now clickable but it shows ALL messages inthat group sorted by oldest first. Let me know if you had something else in mind, thanks for the feedback.

    Thanks, a (very) quick glance showed it is already much better than it
    was on browsers which have the SVG size issue, and groups can be clicked
    on! :-)

    I'll try to have a longer glance at it when time allows.
    --
    Nuno Silva
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Mark Shaw@mshaw@panix.com to alt.folklore.computers on Thu Sep 10 00:52:58 2026
    From Newsgroup: alt.folklore.computers

    Craig Stadler <cstadler18@hotmail.com> wrote:

    I spent the last year gathering and normalizing as many resources for
    Usenet messages and built a search engine over public Usenet
    discussions going back to 1981. Posting here because this seemed like
    the one group that would actually care.

    https://www.usenet-rewind.com/

    Thank you for this. I had a look at my old stomping grounds at rec.pets.dogs.behavior, and the first thing that came up in my
    search was a response to someone who got taken in by the resident
    newsgroup whackjob.

    Good times, good times.
    --
    Mark Shaw moc TOD liamg TA wahsnm ======================================================================== "Ironic that the two O's in 'cooperate' insisted on
    having their own separate sounds...." -Nathan W. Pyle
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Daniel@me@fuhgitabutit.com to alt.folklore.computers on Sun Sep 13 11:06:56 2026
    From Newsgroup: alt.folklore.computers

    Craig Stadler <cstadler18@hotmail.com> writes:

    I spent the last year gathering and normalizing as many resources for
    Usenet messages and built a search engine over public Usenet
    discussions going back to 1981. Posting here because this seemed like
    the one group that would actually care.

    https://www.usenet-rewind.com/

    Since Google Groups stopped indexing new Usenet content a
    while back, and search over its historical archive has always been
    rough- I wanted something that treats this as a real research
    archive -- full-text search, date-range/filtering,etc and most
    importantly as much Usenet data as possible going back as far as I could find.

    The index currently holds (to date) roughly 980 million messages and is
    still growing. Sources are archival backups, data donations, and ongoing crawls of several thousand still-active public NNTP servers. Binary and yEnc-encoded content is stripped where possible to keep the index
    focused on text.

    The index was built using Apache Solr 10, MariaDB 12 (rocksdb), Ubuntu 22.04.5 LTS & custom Python scripts, all on nvme disk.

    This is public archival content, same legal basis as DejaNews and
    Google Groups before it. There's a removal process for anyone who
    wants their own posts taken down, and author contact info is masked
    by default.

    Is there any way you can create a gopher equivalent to your site?

    Any chance that you'll adopt a public API? I would consider writing a
    feature to my finger service + a door on my bbs to interface with it.

    --
    Daniel
    sysop | air & wave bbs
    finger | info@bbs.airandwave.net
    --- Synchronet 3.22a-Linux NewsLink 1.2