Engineering ·
CERN slides introduce LLM training
A post dated August 31, 2026, says slides from a CERN talk on LLM training are available as a PDF and that an online recording is available.
Daily bookmarks: relevant news, facts and discoveries.
Articles 1219
Engineering ·
A post dated August 31, 2026, says slides from a CERN talk on LLM training are available as a PDF and that an online recording is available.
Engineering ·
An article on reinforcement learning foundations derives the policy gradient algorithm and discusses variants, providing review material for engineers.
Engineering ·
A post dated August 30, 2026 distinguishes the one-time use of queries from the retention of keys and values in the KV cache during inference.
Engineering ·
A post reports reducing the Hy4 preview from 1.5 TB to 200 GB with per-layer precision settings, and compares results on two benchmarks.
Engineering ·
Published on August 29, 2026, the article explains using SSLKEYLOGFILE and Wireshark to inspect HTTP requests in captured HTTPS traffic.
Engineering ·
The Colibri project says it can run seven families of open MoE models, from 744 billion to 2.8 trillion parameters, by streaming experts from disk on user hardware.
Engineering ·
A post dated August 28, 2026, describes Phonon-1, a speech recognition model with 782 million parameters, a 415 MB download, and an Apache 2.0 license.
Engineering ·
In a post dated August 28, 2026, an engineer reports dynamically quantizing GLM-5.3 to 1 bit: 217 GB versus 1.5 TB in BF16, with about 76% top-1 accuracy.
Engineering ·
Published on August 28, 2026, TurnBench includes 30 hours of dyadic speech annotated by three people, a scoring protocol based on conversation analysis, and results for 14 systems.
Engineering ·
The approach separates execution traces, a persistent knowledge wiki, and executable skills. Experiences consolidated in the wiki guide later skill updates.
Engineering ·
Published on August 27, 2026, the post opens a series on alternatives to reinforcement learning for optimizing evaluable objectives. Part I introduces sampling methods.
Engineering ·
A post dated August 27, 2026 reports a graphics-driver change enabling peer-to-peer transfers over PCIe on GeForce cards while optimizing SlimServe. The author has not tested the proposed use on the RTX Pro 6000.
Engineering ·
An article published August 27, 2026 describes JIT-Agent, which synthesizes agent harnesses on demand and can repair and evolve them.
Engineering ·
A record published on August 27, 2026 describes an audio model combining speech recognition, audio understanding, speech synthesis, and editing.
Engineering ·
A publication dated August 26, 2026 identifies Ox Alpha as GLM-5.3-Flash and outlines components of its hybrid architecture.
Engineering ·
Published on August 26, 2026, the post claims GLM-5.3 alternates linear and sparse attention, and compares this design with other hybrid approaches.
Engineering ·
A post dated August 26, 2026, says Breeze TTS 2 weights are open and claims the model leads a ranking of TTS provider voices.
Engineering ·
A publication dated August 26, 2026 shares two resources on post-training with reinforcement learning beyond SFT: one on scaling vanilla GRPO and another on OPD.
Engineering ·
A publication dated August 26, 2026, reports that the 100-million-parameter Pocket TTS model, with six included voices, runs on-device with LiteRT on current Android devices.
Engineering ·
In a publication dated August 26, 2026, Recuris describes two loops for long-horizon agents: working and experiential memories guide tasks, while a fixed meta-agent analyzes execution traces and proposes targeted repairs.
Looking for something else?DocumentationContact