This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
For you young folks, delay lines memories were common in the 1940s and
1950s before core memory replaced them, but they didn't use fiber.
Abstract
The rising pressure on DRAM availability and contract pricing reflects >generative AI's massive high-performance memory requirements. This
pressure is heavily compounded by hyperscale data center expansion,
which now consumes a significant portion of global DRAM output. In
this work, we propose a new architecture: Fiber Memory, which
reimagines the role of optical fiber in a hyperscale data center,
deploying it as an active, recirculating delay-line memory for
immutable data, such as large language model (LLM) weights. We present
a data-parallel optical broadcast delay-line memory architecture that >accounts for fiber's physical realities. By incorporating
space-division multiplexed multi-core fibers (MCFs), passive optical >tap-and-amplify interfaces, co-packaged optics (CPO), and regional >all-optical regeneration, our case study evaluation demonstrates that
Fiber Memory can eliminate redundant weight storage across 10,000 AI >accelerators and reduce weight-delivery energy by over 70% compared to >traditional HBM3e configurations.
https://arxiv.org/abs/2607.08407
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
For you young folks, delay lines memories were common in the 1940s and
1950s before core memory replaced them, but they didn't use fiber.
Abstract
The rising pressure on DRAM availability and contract pricing reflects generative AI's massive high-performance memory requirements. This
pressure is heavily compounded by hyperscale data center expansion,
which now consumes a significant portion of global DRAM output.
In--- Synchronet 3.22a-Linux NewsLink 1.2
this work, we propose a new architecture: Fiber Memory, which
reimagines the role of optical fiber in a hyperscale data center,
deploying it as an active, recirculating delay-line memory for
immutable data, such as large language model (LLM) weights. We present
a data-parallel optical broadcast delay-line memory architecture that accounts for fiber's physical realities. By incorporating
space-division multiplexed multi-core fibers (MCFs), passive optical tap-and-amplify interfaces, co-packaged optics (CPO), and regional all-optical regeneration, our case study evaluation demonstrates that
Fiber Memory can eliminate redundant weight storage across 10,000 AI accelerators and reduce weight-delivery energy by over 70% compared to traditional HBM3e configurations.
https://arxiv.org/abs/2607.08407
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
For you young folks, delay lines memories were common in the 1940s and
1950s before core memory replaced them, but they didn't use fiber.
I don't like the direction this is going since it seems to imply
that running such LLMs would be inherently limited to large
data-centers, thereby taking control out of the end-users hands.
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
For you young folks, delay lines memories were common in the 1940s and
1950s before core memory replaced them, but they didn't use fiber.
Right, but this is specially designed for the case where "every"
processor in your large system needs repeatedly the same sequence
of data. That seems potentially applicable to today's LLMs, but it's >*highly* specialized.
I don't like the direction this is going since it seems to imply that
running such LLMs would be inherently limited to large data-centers,
thereby taking control out of the end-users hands.
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
For you young folks, delay lines memories were common in the 1940s and
1950s before core memory replaced them, but they didn't use fiber.
That seems entirely consistent with the agendas of the companies
running most of the world's LLMs.
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
John Levine [2026-07-10 02:42:59] wrote:
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
BTW, I think the core of the idea is to recognize that some of the
workload in large AI datacenters is not just "SIMT" but that some part
of the data is exactly the same for some of those threads (e.g. say most
of the threads are performing a "vector x matrix" multiply with
a different vector each but all with the same matrix), so you might be
able to get similar benefits with some kind of "broadcast"
DRAM/SSD reads.
=== Stefan--- Synchronet 3.22a-Linux NewsLink 1.2
On Fri, 10 Jul 2026 02:42:59 -0000 (UTC), John Levine
<johnl@taugh.com> wrote:
[ ... ]
For you young folks, delay lines memories were common in the 1940s and >1950s before core memory replaced them, but they didn't use fiber.
In the 70's and 80's there was considerable interest in magnetic
bubble memory which essentially is a delay line technology. It was expensive, and bit density was a problem, but since it was
non-volatile, it often was used in machines designed for harsh
environments.
Nitpick: bubble memories were built on shift registers, but they
were not delay lines. If you stopped the rotating magnetic field,
the bits stopped circulating. Delay line memories have no
equivalent.
On Fri, 10 Jul 2026 02:42:59 -0000 (UTC), John Levine
<johnl@taugh.com> wrote:
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
For you young folks, delay lines memories were common in the 1940s and
1950s before core memory replaced them, but they didn't use fiber.
In the 70's and 80's there was considerable interest in magnetic
bubble memory which essentially is a delay line technology. It was expensive, and bit density was a problem, but since it was
non-volatile, it often was used in machines designed for harsh
environments.
George Neuner <gneuner2@comcast.net> wrote:
On Fri, 10 Jul 2026 02:42:59 -0000 (UTC), John Levine
<johnl@taugh.com> wrote:
[ ... ]
For you young folks, delay lines memories were common in the 1940s and
1950s before core memory replaced them, but they didn't use fiber.
In the 70's and 80's there was considerable interest in magnetic
bubble memory which essentially is a delay line technology. It was
expensive, and bit density was a problem, but since it was
non-volatile, it often was used in machines designed for harsh
environments.
Nitpick: bubble memories were built on shift registers, but they
were not delay lines. If you stopped the rotating magnetic field,
the bits stopped circulating. Delay line memories have no equivalent.
On 7/11/2026 5:19 PM, George Neuner wrote:
On Fri, 10 Jul 2026 02:42:59 -0000 (UTC), John Levine
<johnl@taugh.com> wrote:
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious.
For you young folks, delay lines memories were common in the 1940s and
1950s before core memory replaced them, but they didn't use fiber.
In the 70's and 80's there was considerable interest in magnetic
bubble memory which essentially is a delay line technology. It was
expensive, and bit density was a problem, but since it was
non-volatile, it often was used in machines designed for harsh
environments.
Yes.
And in the mid to late 1970s, a company I later worked for sold an SSD (Solid State *Drum* - a PCM replacement for a *real* drum peripheral
memory. Not a head per track disk that a certain vendor called a "drum"
- sorry my pet peeve.) It originally used CCD chips, similar to bubble memory but faster, though totally different technology. However, CCD
memory was volatile, which they overcame by having a UPS. Soon the economies of DRAM overtook the CCD chips and replaced them. The UPS was still there to compensate for the volatility. IIRC the replacement
DRAMS were 4K chips.
Stephen Fuld <sfuld@alumni.cmu.edu.invalid> wrote:
On 7/11/2026 5:19 PM, George Neuner wrote:
On Fri, 10 Jul 2026 02:42:59 -0000 (UTC), John Levine
<johnl@taugh.com> wrote:
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious. >>>>
For you young folks, delay lines memories were common in the 1940s and >>>> 1950s before core memory replaced them, but they didn't use fiber.
In the 70's and 80's there was considerable interest in magnetic
bubble memory which essentially is a delay line technology. It was
expensive, and bit density was a problem, but since it was
non-volatile, it often was used in machines designed for harsh
environments.
Yes.
And in the mid to late 1970s, a company I later worked for sold an SSD
(Solid State *Drum* - a PCM replacement for a *real* drum peripheral
memory. Not a head per track disk that a certain vendor called a "drum"
- sorry my pet peeve.) It originally used CCD chips, similar to bubble
memory but faster, though totally different technology. However, CCD
memory was volatile, which they overcame by having a UPS. Soon the
economies of DRAM overtook the CCD chips and replaced them. The UPS was
still there to compensate for the volatility. IIRC the replacement
DRAMS were 4K chips.
Not 64k bits? IIUC in earlier period CCD had density advantage, but
that vanished when 64k bits DRAM became available.
On 7/13/2026 1:13 PM, Waldek Hebisch wrote:
Stephen Fuld <sfuld@alumni.cmu.edu.invalid> wrote:
On 7/11/2026 5:19 PM, George Neuner wrote:
On Fri, 10 Jul 2026 02:42:59 -0000 (UTC), John Levine
<johnl@taugh.com> wrote:
This paper proposes using an optical fiber ring as a delay line to
store and distribute data in AI data centers. I think they're serious. >>>>
For you young folks, delay lines memories were common in the 1940s and >>>> 1950s before core memory replaced them, but they didn't use fiber.
In the 70's and 80's there was considerable interest in magnetic
bubble memory which essentially is a delay line technology. It was
expensive, and bit density was a problem, but since it was
non-volatile, it often was used in machines designed for harsh
environments.
Yes.
And in the mid to late 1970s, a company I later worked for sold an SSD
(Solid State *Drum* - a PCM replacement for a *real* drum peripheral
memory. Not a head per track disk that a certain vendor called a "drum" >> - sorry my pet peeve.) It originally used CCD chips, similar to bubble
memory but faster, though totally different technology. However, CCD
memory was volatile, which they overcame by having a UPS. Soon the
economies of DRAM overtook the CCD chips and replaced them. The UPS was >> still there to compensate for the volatility. IIRC the replacement
DRAMS were 4K chips.
Not 64k bits? IIUC in earlier period CCD had density advantage, but
that vanished when 64k bits DRAM became available.
You may very well be right. As I said, it was before I joined the
company, and it was nearly 50 years ago. :-(
Rotating magnetic media have the same basic property as delay lines:
that a particular storage location can be accessed only when it is
passing by the read/write apparatus, and the time between such moments
is constant, and can be inconveniently long for the programmer's purposes.
In the 70's and 80's there was considerable interest in magnetic
bubble memory which essentially is a delay line technology. It was expensive, and bit density was a problem, but since it was
non-volatile, it often was used in machines designed for harsh
environments.
In the 80's Olivetti sold as a (IBM)PC expansion board a solid state
drive that used bubble memory.
In the 2K's IBM's "racetrack" memory was a form of bubble memory.
A friend of mine had a stereo delay line which we used to alter the
"size" of the room with the speakers at the back being delayed by
20-50 ms (depending on the kind of music.) The effect was
interesting but only partially successful.
Niklas Holsti <niklas.holsti@tidorum.invalid> wrote:
Rotating magnetic media have the same basic property as delay lines:
that a particular storage location can be accessed only when it is
passing by the read/write apparatus, and the time between such moments
is constant, and can be inconveniently long for the programmer's purposes.
Rotating magnetic media (and magnetic bubbles) are nonvolatile storage.
Delay lines are volatile: if you don't detect, re-shape and
re-broadcast the signal after its round trip, the information is lost.
On 2026-07-14 3:56, Pierre Asselin wrote:
Niklas Holsti <niklas.holsti@tidorum.invalid> wrote:
Rotating magnetic media have the same basic property as delay lines:
that a particular storage location can be accessed only when it is
passing by the read/write apparatus, and the time between such moments
is constant, and can be inconveniently long for the programmer's
purposes.
Rotating magnetic media (and magnetic bubbles) are nonvolatile storage.
Delay lines are volatile: if you don't detect, re-shape and
re-broadcast the signal after its round trip, the information is lost.
Certainly, but that is a detail of the HW implementation. Dynamic RAM is still Random Access memory, as was magnetic-core memory which had to be rewritten after every read, because reads were destructive.
On Tue, 14 Jul 2026 00:39:25 GMT, MitchAlsup wrote:
A friend of mine had a stereo delay line which we used to alter the
"size" of the room with the speakers at the back being delayed by
20-50 ms (depending on the kind of music.) The effect was
interesting but only partially successful.
Was the room acoustically rCLdeadrCY? (Soft padding, curtains etc.)
Otherwise its own reverb would likely be confusing the issue.
On 2026-07-14 3:56, Pierre Asselin wrote:
Niklas Holsti <niklas.holsti@tidorum.invalid> wrote:
Rotating magnetic media have the same basic property as delay lines:
that a particular storage location can be accessed only when it is
passing by the read/write apparatus, and the time between such moments
is constant, and can be inconveniently long for the programmer's purposes.
Rotating magnetic media (and magnetic bubbles) are nonvolatile storage. Delay lines are volatile: if you don't detect, re-shape and
re-broadcast the signal after its round trip, the information is lost.
Certainly, but that is a detail of the HW implementation. Dynamic RAM is still Random Access memory, as was magnetic-core memory which had to be rewritten after every read, because reads were destructive.
The Intel 1Mb bubble memories were build using
X-ray lithography from a synchrotron.
Might account for the cost.
EricP <ThatWouldBeTelling@thevillage.com> wrote:
The Intel 1Mb bubble memories were build using
X-ray lithography from a synchrotron.
Might account for the cost.
I find that hard to believe. The minimum feature wasn't that small.
| Sysop: | Amessyroom |
|---|---|
| Location: | Fayetteville, NC |
| Users: | 74 |
| Nodes: | 6 (0 / 6) |
| Uptime: | 45:27:35 |
| Calls: | 1,100 |
| Files: | 1,339 |
| Messages: | 275,372 |