From Newsgroup: comp.lang.prolog
Hi,
Ok, Tensorization on the Deskop seems
to be older than 2025, already featured
by Apple M1 Max hardware in 2021.
BTW, here is a nice piece of linear
algebra meets artificial intelligence,
ChatGPT-2 written in FORTRAN:
User: When did the Mexican-American war start?
fastGPT: 1846.
User: When did it end?
fastGPT: 1848.
File GPT-2 ca. 10 Pages of FORTRAN code
https://github.com/certik/fastGPT/blob/main/gpt2.f90
Bye
P.S.: The tensorization acceleration happens here.
Basically a float 32-bit general matrix multiplication,
already specified as THE LEVEL 3 BLAS in 1990:
#include <Accelerate/Accelerate.h>
void acc_sgemm(int m, int n, int k, float *A, float *B, float *C) {
https://github.com/certik/fastGPT/blob/main/linalg_accelerate.c
Vectorization would use SIMD (Single Instruction,
Multiple Data) instructions. I guess tensorization uses
typically MAC (multiply-accumulate operations).
The deployment on a Apple M1 Max is especially easy,
since it has UMA, unified memory, so you can pass
arrays just by memory pointers.
P.S.: Some of the top timings, inference of the
input file (20 tokens):
1 core + hardware GEMM:
fastGPT (Accelerate, fast_tanh) 0.288s
8 cores:
PyTorch (OpenBLAS) 0.392s
So the hardware GEMM accelerator easily
compensates for 8 cores? This was on a 2021 machine,
might be even better now?
Mild Shock schrieb:
Hi,
The paper outlines, how the AI Boom, changes
some dynamics, in hardware design. Which explains
the NVIDIA and Synopsys Strategic Partnership.
But the paper only shows a 2024 CPU, not yet a NPU.
Neural Model Checking
https://arxiv.org/abs/2410.23790
I suspect with End of 2025 CPU of the Copilot+ kind,
we can get a further speed-up of a factor 10x-100x.
But how difficult can it be to build such a prototype,
just a GNU Prolog with an ANN backend instead of a WAM?
Bye
Mild Shock schrieb:
Hi,
What do you prefer, the Blue Pill or the Red Pill?
a) Some LinkedIn Pseudo Science nonsense:
My Gripes with Prolog - January 14, 2026
https://buttondown.com/hillelwayne/archive/my-gripes-with-prolog/
b) Some real brain food for CLP(FD) Prologers:
Common constraint programming problems
https://www.hakank.org/common_cp_models/
Tell me your choice!
Bye
Mild Shock schrieb:
"Als der franz||sische K||nig, den man wegen
der unerm|+dlichen Regelm|n|figkeit, mit der er,
gleich einer Sonne, deren Lauf niemand
aufzuhalten vermochte, t|nglich zur selben
Stunde, von dem leisen Rascheln der seidnen
Vorh|nnge angek|+ndigt, aus den Gem|nchern
von Versailles hervortrat, um, von einer Schar
Hofleute umgeben, die weniger aus freiem
Willen als aus der wohlbegr|+ndeten Furcht,
in dem Schatten, den sein Glanz warf, unsichtbar
zu werden, ihm folgten, den Gang durch die
Spiegelgalerie anzutreten pflegte, sich an
eben diesem Morgen, an welchem ein
unbedeutender Wolkenzug den Himmel
tr|+bte, die Frage erhob, ob auch die Sonne,
wenn sie denn einmal z||gerte, noch Sonne
genannt werden d|+rfe, da bemerkte er, indem
er den Absatz seines Schuhs auf den Marmorboden
setzte, dass nicht der Himmel, sondern allein
sein Strumpf ein Loch hatte."
-- Menhire von Finist|?re, ca. 1708
--- Synchronet 3.21b-Linux NewsLink 1.2