• Moderation system update

    From Mark Goodge@usenet@listmail.good-stuff.co.uk to uk.religion.christian on Mon Sep 7 10:03:18 2026
    From Newsgroup: uk.religion.christian

    As most of you probably know, the ukrc moderation system has been running on one of my servers since, well, ages ago. It's been running on the current server since 2009, when I had to hurriedly move it to a new one when the previous server failed. I cobbled together some simple PHP scripts to do the job, and that's how it's been ever since.

    In the meantime, every other system that was running on that server has migrated to a new one. It's got to the point now where the ukrc moderation system is the only live use of that server. In particular, every revenue-generating site on that server has long since migrated elsewhere, meaning that I'm now paying u100 a month for a server which has only one
    active function and which generates no corresponding revenue. That's clearly not sustainable.

    So, I'm in the process of migrating the moderation system to a different server, where it can piggyback on revenue-generating uses rather than
    requiring me to spend money on keeping a server running for ukrc alone. Once it's all up and running I can then shut down the old one.

    I've also taken the opportunity to rewrite the moderation software entirely from scratch. The old software was, frankly, awful, it was thrown together
    very rapidly as part of an emergency move and I've never revisited it since. The new code is, hopefully, better.

    That has a few practical consequences. One is that posts may possibly be a little erratic for the next few days while I make sure that the new server
    is working OK. So if you post something, but don't see it straight away,
    please be patient.

    The second consequence is that the database of post author statuses is completely new. Rather than import the old status database, everyone starts life on the new database as a new contributor. So your first post which goes through the new system will be held for manual moderation. Once I've seen
    that, and approved it, you'll be back to the status you had under the old system. But it won't be automatic. So, again, there will be lengthier
    posting delays for first-time posts on the new system, although once you've
    had one approved it should be OK after that.

    There are some other changes. Unlike the old system, the new system doesn't support embedded Content-Type: application/news-transmission headers. This
    was only ever an experimental concept, I only added it because I was
    pestered to do so by Charles Lindsey (who invented it), and no other Usenet moderation system supports it. The logs show that nobody has used it to post
    to ukrc, ever. So the new system doesn't support it.

    Equally, the facility originally added by Patrick to allow posters on the whitelist to post via email, rather than using a news client, hasn't been recreated in the new system. I don't think anyone was using that, either.
    And removing it makes it much easier to filter out spam, since anything
    without a Newsgroups: header can simply be discarded without ever needing to
    be processed.

    A third change - and the reason why the post author database is new rather
    than just a copy of the old one - is that the author status is now keyed
    solely to the email address rather than the full From: line. Part of the
    issue we had previously is that some people were posting to the group with different news clients on different machines that used different formats for the From: line. For example, you might get one which looks like:

    "Firstname Lastname" <firstname.lastname@example.com>

    and another, from the same author, with

    Firstname Lastname <firstname.lastname@example.com>

    or

    firstname.lastname@example.com "Firstname Lastname"

    which resulted in three different entries in the database. Using the email address alone as the key makes it much simpler.

    Finally, the new system does not send acknowledgement emails to people who
    have posts held for manual moderation or rejection notices to authors of rejected posts. In the past, a lot of these simply resulted in bounces
    anyway, given that it's still fairly common to post to Usenet using an obfuscated email address in order to minimise it being harvest by spammers.
    And these days, that information is available via the web, so it doesn't
    need an emailed response.

    Also, for the next few days, I've asked Ken not to do any manual moderation. While the transition is in progress, I'll handle all the manual moderation
    so that if something does go wrong, I can see it and fix it. Again, this may delay posts a bit as anything which does need manual moderation will have to wait until I'm at my desk.

    If everything goes well I expect to have the transition complete by the end
    of this week.

    Mark

    --- Synchronet 3.22a-Linux NewsLink 1.2