• fetch from pkg.freebsd.org fails: Not Implemented

    From Ronald Klop@ronald-lists@klop.ws to muc.lists.freebsd.ports on Fri Jan 9 15:28:13 2026
    From Newsgroup: muc.lists.freebsd.ports

    ------=_Part_1270_779735029.1767968893864
    Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit

    Hi,

    For a little tool (https://www.klop.ws/pkgstats/pkg-age.html) I regularly fetch some data from the pkg servers.
    Since a day or two I get spurious errors. I added -vv to my fetch command and got this output.

    Apparently the server sends HTTP 501 status code. And fetch exits with "Not Implemented".


    scheme: "https"
    +user: ""
    +password: ""
    +host: "pkg.freebsd.org"
    +port: "0"
    +document: "/FreeBSD:13:amd64/quarterly/data.pkg"
    +---> pkg.freebsd.org:443
    +resolving server address: pkg.freebsd.org:443
    +SSL options: 82004850
    +Peer verification enabled
    +Using OpenSSL default CA cert file and path
    +Verify hostname
    +TLSv1.3 connection established using TLS_AES_128_GCM_SHA256
    +Certificate subject: /CN=pkg.freebsd.org
    +Certificate issuer: /C=US/O=Certainly/CN=Certainly Intermediate R1
    +requesting https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg
    GET /FreeBSD:13:amd64/quarterly/data.pkg HTTP/1.1
    +If-Modified-Since: Tue, 06 Jan 2026 15:22:51 GMT
    If-Modified-Since: Tue, 06 Jan 2026 15:22:51 GMT
    Host: pkg.freebsd.org
    Accept: */*
    User-Agent: fetch libfetch/2.0
    Connection: close

    +<<< HTTP/1.1 501 First fragment: unexpected status code

    +<<< Connection: close

    +<<< Content-Length: 0

    +<<< Via: 1.1 varnish, 1.1 varnish

    +content length: [0]
    +<<< ETag: "695d28cb-a3e396"

    +<<< Age: 0

    +<<< Accept-Ranges: bytes

    +<<< Date: Fri, 09 Jan 2026 14:04:04 GMT

    +<<< X-Served-By: cache-rtm-ehrd2290047-RTM

    +<<< X-Cache: MISS

    +<<< X-Cache-Hits: 0

    +<<< X-Timer: S1767967444.984756,VS0,VE111

    +<<< Cache-Control: no-cache,no-store,max-age=0

    +<<<

    +offset 0, length -1, size -1, clength 0
    +fetch: https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg: Not Implemented



    The fetch in the script worked fine for about a year.
    Does this ring a bell to anybody?

    Regards,
    Ronald.

    ------=_Part_1270_779735029.1767968893864
    Content-Type: text/html; charset=us-ascii
    Content-Transfer-Encoding: 7bit

    <html><head></head><body>Hi,<br>

    For a little tool (<a href="https://www.klop.ws/pkgstats/pkg-age.html">https://www.klop.ws/pkgstats/pkg-age.html)</a>&nbsp;I regularly fetch some data from the pkg servers.<br>
    Since a day or two I get spurious errors. I added -vv to my fetch command and got this output.<br>

    Apparently the server sends HTTP 501 status code. And fetch exits with "Not Implemented".<br>


    scheme: &nbsp;&nbsp;"https"<br>
    +user: &nbsp;&nbsp;&nbsp;&nbsp;""<br>
    +password: ""<br>
    +host: &nbsp;&nbsp;&nbsp;&nbsp;"pkg.freebsd.org"<br>
    +port: &nbsp;&nbsp;&nbsp;&nbsp;"0"<br>
    +document: "/FreeBSD:13:amd64/quarterly/data.pkg"<br>
    +---&gt; pkg.freebsd.org:443<br>
    +resolving server address: pkg.freebsd.org:443<br>
    +SSL options: 82004850<br>
    +Peer verification enabled<br>
    +Using OpenSSL default CA cert file and path<br>
    +Verify hostname<br>
    +TLSv1.3 connection established using TLS_AES_128_GCM_SHA256<br>
    +Certificate subject: /CN=pkg.freebsd.org<br>
    +Certificate issuer: /C=US/O=Certainly/CN=Certainly Intermediate R1<br> +requesting <a href="https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg" target="_blank">https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg</a><br>
    +&gt;&gt;&gt; GET /FreeBSD:13:amd64/quarterly/data.pkg HTTP/1.1<br> +If-Modified-Since: Tue, 06 Jan 2026 15:22:51 GMT<br>
    +&gt;&gt;&gt; If-Modified-Since: Tue, 06 Jan 2026 15:22:51 GMT<br> +&gt;&gt;&gt; Host: pkg.freebsd.org<br>
    +&gt;&gt;&gt; Accept: */*<br>
    +&gt;&gt;&gt; User-Agent: fetch libfetch/2.0<br>
    +&gt;&gt;&gt; Connection: close<br>
    +&gt;&gt;&gt;<br>
    +&lt;&lt;&lt; HTTP/1.1 501 First fragment: unexpected status code<br>

    +&lt;&lt;&lt; Connection: close<br>

    +&lt;&lt;&lt; Content-Length: 0<br>

    +&lt;&lt;&lt; Via: 1.1 varnish, 1.1 varnish<br>

    +content length: [0]<br>
    +&lt;&lt;&lt; ETag: "695d28cb-a3e396"<br>

    +&lt;&lt;&lt; Age: 0<br>

    +&lt;&lt;&lt; Accept-Ranges: bytes<br>

    +&lt;&lt;&lt; Date: Fri, 09 Jan 2026 14:04:04 GMT<br>

    +&lt;&lt;&lt; X-Served-By: cache-rtm-ehrd2290047-RTM<br>

    +&lt;&lt;&lt; X-Cache: MISS<br>

    +&lt;&lt;&lt; X-Cache-Hits: 0<br>

    +&lt;&lt;&lt; X-Timer: S1767967444.984756,VS0,VE111<br>

    +&lt;&lt;&lt; Cache-Control: no-cache,no-store,max-age=0<br>

    +&lt;&lt;&lt;<br>

    +offset 0, length -1, size -1, clength 0<br>
    +fetch: <a href="https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg" target="_blank">https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg</a>: Not Implemented<br>



    The fetch in the script worked fine for about a year.<br>
    Does this ring a bell to anybody?<br>

    Regards,<br>
    Ronald.<br>
    &nbsp;</body></html>
    ------=_Part_1270_779735029.1767968893864--


    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2
  • From Ronald Klop@ronald-lists@klop.ws to muc.lists.freebsd.ports on Sat Jan 10 14:56:43 2026
    From Newsgroup: muc.lists.freebsd.ports

    ------=_Part_1465_1505202812.1768053403557
    Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit

    Hi Ryan,

    Thanks for the quick response.
    I monitored and don't see the "501 Not Implemented" happening anymore. I will keep an eye on this.

    Can you share what you did to fix it?

    NB: I see another issue with the server, but I will open a new mail thread for it.

    Regards,
    Ronald.


    Van: Ryan Steinmetz <zi@freebsd.org>
    Datum: vrijdag, 9 januari 2026 17:58
    Aan: Ronald Klop <ronald-lists@klop.ws>
    Onderwerp: Re: fetch from pkg.freebsd.org fails: Not Implemented

    On (01/09/26 17:53), Ronald Klop wrote:
    Hi,

    I run my script every 3 hours and it fetches multiple data.pkg files. Most of them are successful, only a few give an error.

    The one below happened on: >+<<< Date: Fri, 09 Jan 2026 14:04:04 GMT

    The fetch command is:
    fetch -vv -o /data/FreeBSD:13:amd64_quarterly_data.pkg --if-modified-since=/data/FreeBSD:13:amd64_quarterly_data.pkg "https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg"



    Got it, thanks. Can you monitor and let me know if you see it again?

    -r


    I have output of a similar request for "https://pkg.freebsd.org/FreeBSD:14:amd64/quarterly/data.pkg" at +<<< Date: Fri, 09 Jan 2026 14:04:10 GMT.

    Oh, I can look back in my script runs. The first time this happened was in the run of "Thu, 08 Jan 2026 21:09:01 +0100".

    Regards,
    Ronald



    Van: Ryan Steinmetz <zi@freebsd.org>
    Datum: vrijdag, 9 januari 2026 16:24
    Aan: Ronald Klop <ronald-lists@klop.ws>
    Onderwerp: Re: fetch from pkg.freebsd.org fails: Not Implemented

    If possible, can you share:
    - Specific timestamps of when it was happy and when you experienced a 501?
    - The exact fetch command you're using

    Thanks,
    -r


    On (01/09/26 15:28), Ronald Klop wrote:
    Hi,

    For a little tool (https://www.klop.ws/pkgstats/pkg-age.html) I regularly fetch some data from the pkg servers.
    Since a day or two I get spurious errors. I added -vv to my fetch command and got this output.

    Apparently the server sends HTTP 501 status code. And fetch exits with "Not Implemented".


    scheme: "https"
    +user: ""
    +password: ""
    +host: "pkg.freebsd.org"
    +port: "0"
    +document: "/FreeBSD:13:amd64/quarterly/data.pkg"
    +---> pkg.freebsd.org:443
    +resolving server address: pkg.freebsd.org:443
    +SSL options: 82004850
    +Peer verification enabled
    +Using OpenSSL default CA cert file and path
    +Verify hostname
    +TLSv1.3 connection established using TLS_AES_128_GCM_SHA256 >>>+Certificate subject: /CN=pkg.freebsd.org
    +Certificate issuer: /C=US/O=Certainly/CN=Certainly Intermediate R1 >>>+requesting https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg >>>+>>> GET /FreeBSD:13:amd64/quarterly/data.pkg HTTP/1.1 >>>+If-Modified-Since: Tue, 06 Jan 2026 15:22:51 GMT
    If-Modified-Since: Tue, 06 Jan 2026 15:22:51 GMT
    Host: pkg.freebsd.org
    Accept: */*
    User-Agent: fetch libfetch/2.0
    Connection: close

    +<<< HTTP/1.1 501 First fragment: unexpected status code

    +<<< Connection: close

    +<<< Content-Length: 0

    +<<< Via: 1.1 varnish, 1.1 varnish

    +content length: [0]
    +<<< ETag: "695d28cb-a3e396"

    +<<< Age: 0

    +<<< Accept-Ranges: bytes

    +<<< Date: Fri, 09 Jan 2026 14:04:04 GMT

    +<<< X-Served-By: cache-rtm-ehrd2290047-RTM

    +<<< X-Cache: MISS

    +<<< X-Cache-Hits: 0

    +<<< X-Timer: S1767967444.984756,VS0,VE111

    +<<< Cache-Control: no-cache,no-store,max-age=0

    +<<<

    +offset 0, length -1, size -1, clength 0
    +fetch: https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg: Not Implemented



    The fetch in the script worked fine for about a year.
    Does this ring a bell to anybody?

    Regards,
    Ronald.


    -- >>Ryan Steinmetz
    PGP: 4143 0BDC 21B0 B3D9 6D47 F0DA 504D C825 7FAD 8C58






    --
    Ryan Steinmetz
    PGP: 4143 0BDC 21B0 B3D9 6D47 F0DA 504D C825 7FAD 8C58





    ------=_Part_1465_1505202812.1768053403557
    Content-Type: text/html; charset=us-ascii
    Content-Transfer-Encoding: 7bit

    <html><head></head><body>Hi Ryan,<br>

    Thanks for the quick response.<br>
    I monitored and don't see the "501&nbsp;Not Implemented" happening anymore. I will keep an eye on this.<br>

    Can you share what you did to fix it?<br>

    NB: I see another issue with the server, but I will open a new mail thread for it.<br>

    Regards,<br>
    Ronald.<br>

    &nbsp;
    <p><strong>Van:</strong> Ryan Steinmetz &lt;zi@freebsd.org&gt;<br> <strong>Datum:</strong> vrijdag, 9 januari 2026 17:58<br>
    <strong>Aan:</strong> Ronald Klop &lt;ronald-lists@klop.ws&gt;<br> <strong>Onderwerp:</strong> Re: fetch from pkg.freebsd.org fails: Not Implemented</p>

    <blockquote style="padding-right: 0px; padding-left: 5px; margin-left: 5px; border-left: #000000 2px solid; margin-right: 0px">
    <div class="MessageRFC822Viewer" id="P">
    <div class="TextPlainViewer" id="P.P"><br>
    On (01/09/26 17:53), Ronald Klop wrote:<br>
    &gt;Hi,<br>
    &gt;<br>
    &gt;I run my script every 3 hours and it fetches multiple data.pkg files. Most of them are successful, only a few give an error.<br>
    &gt;<br>
    &gt;The one below happened on: &gt;+&lt;&lt;&lt; Date: Fri, 09 Jan 2026 14:04:04 GMT<br>
    &gt;<br>
    &gt;The fetch command is:<br>
    &gt;fetch -vv -o /data/FreeBSD:13:amd64_quarterly_data.pkg --if-modified-since=/data/FreeBSD:13:amd64_quarterly_data.pkg "<a href="https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg">https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg</a>"<br>
    &gt;<br>


    Got it, thanks. &nbsp;Can you monitor and let me know if you see it again?<br>

    -r<br>


    &gt;I have output of a similar request for "<a href="https://pkg.freebsd.org/FreeBSD:14:amd64/quarterly/data.pkg">https://pkg.freebsd.org/FreeBSD:14:amd64/quarterly/data.pkg</a>" at +&lt;&lt;&lt; Date: Fri, 09 Jan 2026 14:04:10 GMT.<br>
    &gt;<br>
    &gt;Oh, I can look back in my script runs. The first time this happened was in the run of "Thu, 08 Jan 2026 21:09:01 +0100".<br>
    &gt;<br>
    &gt;Regards,<br>
    &gt;Ronald<br>
    &gt;<br>
    &gt;<br>
    &gt;<br>
    &gt;Van: Ryan Steinmetz &lt;zi@freebsd.org&gt;<br>
    &gt;Datum: vrijdag, 9 januari 2026 16:24<br>
    &gt;Aan: Ronald Klop &lt;ronald-lists@klop.ws&gt;<br>
    &gt;Onderwerp: Re: fetch from pkg.freebsd.org fails: Not Implemented<br> &gt;&gt;<br>
    &gt;&gt;If possible, can you share:<br>
    &gt;&gt;- Specific timestamps of when it was happy and when you experienced a &nbsp;&nbsp;&nbsp;501?<br>
    &gt;&gt;- The exact fetch command you're using<br>
    &gt;&gt;<br>
    &gt;&gt;Thanks,<br>
    &gt;&gt;-r<br>
    &gt;&gt;<br>
    &gt;&gt;<br>
    &gt;&gt;On (01/09/26 15:28), Ronald Klop wrote:<br>
    &gt;&gt;&gt;Hi,<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;For a little tool (<a href="https://www.klop.ws/pkgstats/pkg-age.html">https://www.klop.ws/pkgstats/pkg-age.html</a>) I regularly fetch some data from the pkg servers.<br>
    &gt;&gt;&gt;Since a day or two I get spurious errors. I added -vv to my fetch command and got this output.<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;Apparently the server sends HTTP 501 status code. And fetch exits with "Not Implemented".<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;scheme: &nbsp;&nbsp;"https"<br>
    &gt;&gt;&gt;+user: &nbsp;&nbsp;&nbsp;&nbsp;""<br>
    &gt;&gt;&gt;+password: ""<br>
    &gt;&gt;&gt;+host: &nbsp;&nbsp;&nbsp;&nbsp;"pkg.freebsd.org"<br> &gt;&gt;&gt;+port: &nbsp;&nbsp;&nbsp;&nbsp;"0"<br>
    &gt;&gt;&gt;+document: "/FreeBSD:13:amd64/quarterly/data.pkg"<br> &gt;&gt;&gt;+---&gt; pkg.freebsd.org:443<br>
    &gt;&gt;&gt;+resolving server address: pkg.freebsd.org:443<br>
    &gt;&gt;&gt;+SSL options: 82004850<br>
    &gt;&gt;&gt;+Peer verification enabled<br>
    &gt;&gt;&gt;+Using OpenSSL default CA cert file and path<br> &gt;&gt;&gt;+Verify hostname<br>
    &gt;&gt;&gt;+TLSv1.3 connection established using TLS_AES_128_GCM_SHA256<br> &gt;&gt;&gt;+Certificate subject: /CN=pkg.freebsd.org<br> &gt;&gt;&gt;+Certificate issuer: /C=US/O=Certainly/CN=Certainly Intermediate R1<br>
    &gt;&gt;&gt;+requesting <a href="https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg">https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg</a><br>
    &gt;&gt;&gt;+&gt;&gt;&gt; GET /FreeBSD:13:amd64/quarterly/data.pkg HTTP/1.1<br> &gt;&gt;&gt;+If-Modified-Since: Tue, 06 Jan 2026 15:22:51 GMT<br> &gt;&gt;&gt;+&gt;&gt;&gt; If-Modified-Since: Tue, 06 Jan 2026 15:22:51 GMT<br> &gt;&gt;&gt;+&gt;&gt;&gt; Host: pkg.freebsd.org<br>
    &gt;&gt;&gt;+&gt;&gt;&gt; Accept: */*<br>
    &gt;&gt;&gt;+&gt;&gt;&gt; User-Agent: fetch libfetch/2.0<br> &gt;&gt;&gt;+&gt;&gt;&gt; Connection: close<br>
    &gt;&gt;&gt;+&gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; HTTP/1.1 501 First fragment: unexpected status code<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; Connection: close<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; Content-Length: 0<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; Via: 1.1 varnish, 1.1 varnish<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+content length: [0]<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; ETag: "695d28cb-a3e396"<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; Age: 0<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; Accept-Ranges: bytes<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; Date: Fri, 09 Jan 2026 14:04:04 GMT<br> &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; X-Served-By: cache-rtm-ehrd2290047-RTM<br> &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; X-Cache: MISS<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; X-Cache-Hits: 0<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; X-Timer: S1767967444.984756,VS0,VE111<br> &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt; Cache-Control: no-cache,no-store,max-age=0<br> &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+&lt;&lt;&lt;<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;+offset 0, length -1, size -1, clength 0<br>
    &gt;&gt;&gt;+fetch: <a href="https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg">https://pkg.freebsd.org/FreeBSD:13:amd64/quarterly/data.pkg</a>: Not Implemented<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;The fetch in the script worked fine for about a year.<br> &gt;&gt;&gt;Does this ring a bell to anybody?<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;&gt;Regards,<br>
    &gt;&gt;&gt;Ronald.<br>
    &gt;&gt;&gt;<br>
    &gt;&gt;<br>
    &gt;&gt;-- &gt;&gt;Ryan Steinmetz<br>
    &gt;&gt;PGP: 4143 0BDC 21B0 B3D9 6D47 &nbsp;F0DA 504D C825 7FAD 8C58<br> &gt;&gt;<br>
    &gt;&gt;<br>
    &gt;&gt;<br>
    &gt;<br>
    &gt;<br>

    --&nbsp;<br>
    Ryan Steinmetz<br>
    PGP: 4143 0BDC 21B0 B3D9 6D47 &nbsp;F0DA 504D C825 7FAD 8C58</div>

    <hr></div>
    </blockquote>

    &nbsp;</body></html>
    ------=_Part_1465_1505202812.1768053403557--


    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2