1. Forum
  2. USENET
  3. comp.os.vms

  • librdkafka

    From =?UTF-8?Q?Arne_Vajh=C3=B8j?=@arne@vajhoej.dk to comp.os.vms on Wed Mar 4 20:15:35 2026
    From Newsgroup: comp.os.vms

    VSI recently released a port of librdkafka for VMS Itanium and VMS x86-64.

    First version for VMS x86-64. Not first version for VMS Itanium.

    The librdkafka library is a C/C++ client library that talk to Apache Kafka

    Kafka is a well known event streaming platform. If you have never heard of Kafka before then just think:
    event streaming platform = message queue (like ActiveMQ and RabbitMQ)

    If you are an expert in Kafka and message queues, then you know what
    the differences are. :-)

    Kafka is pretty popular today. Lots of companies use it. So definitely
    relevant for VMS to be able to integrate with it.

    And librdkafka is the client library for native code.

    The fact that 80-90% of those companies using Kafka would be better off
    using a traditional message queue doesn't change it relevance in the real world.

    So:

    C/C++ application on VMS->librdkafka----->Kafka on Linux

    Besides the standard librdkafka API, then the VSI port also comes
    with a VMS librdkafka API (using descriptors etc.).

    It comes with examples:

    producer consumer
    Fortran + +
    Cobol +

    I have done a nice Pascal wrapper for producer if anyone is interested!

    Arne
    --- Synchronet 3.21d-Linux NewsLink 1.2
  • From =?UTF-8?Q?Arne_Vajh=C3=B8j?=@arne@vajhoej.dk to comp.os.vms on Thu Mar 5 20:20:13 2026
    From Newsgroup: comp.os.vms

    On 3/4/2026 8:15 PM, Arne Vajh|+j wrote:
    I have done a nice Pascal wrapper for producer if anyone is interested!

    Nobody said they were interested.

    But anyway:
    https://www.vajhoej.dk/arne/opensource/vms/vmspkafka-src-v1_0-upd5.zip

    It is not much - less than 100 lines providing the external
    declarations and some convenience functions.

    Arne

    --- Synchronet 3.21d-Linux NewsLink 1.2
  • From =?UTF-8?Q?Arne_Vajh=C3=B8j?=@arne@vajhoej.dk to comp.os.vms on Thu Mar 5 20:31:42 2026
    From Newsgroup: comp.os.vms

    On 3/4/2026 8:15 PM, Arne Vajh|+j wrote:
    Kafka is a well known event streaming platform. If you have never heard of Kafka before then just think:
    -a-a-a event streaming platform = message queue (like ActiveMQ and RabbitMQ)

    If you are an expert in Kafka and message queues, then you know what
    the differences are.-a-a :-)

    Kafka is pretty popular today. Lots of companies use it. So definitely relevant for VMS to be able to integrate with it.

    And librdkafka is the client library for native code.
    I added examples to:
    https://www.vajhoej.dk/arne/articles/vmsipc.html#k

    Producer in Java, Groovy, Python, C, Fortran and Pascal.

    Consumer in Java, Groovy, Python and C.

    Honestly I don't think:
    producer on VMS->Kafka->consumer on VMS
    is a common scenario.

    producer on VMS-----|
    producer on Linux---|->Kafka->consumer data pipeline on Linux->Data Lake producer on Windows-|

    and:

    |->consumer processing tx on Linux
    producer web app on Linux-|
    |->consumer processing tx on VMS

    will be more common.

    (the first is better design than the latter!)

    But code example wise it doesn't matter.

    Arne



    --- Synchronet 3.21d-Linux NewsLink 1.2