Signal Radar

★ DeepSeek-V4.1-Flash-1017 on one RTX 3090: Big updates to the Delta Inference Engine v0.93. Same 41 tok/s at 192GB/IQ2 at better quality, usable from 64 GB RAM, first token ~40% sooner, new Unsloth quants at full speed, EXL3, basic multi-GPU, public CI and more

/u/musicurgy — Fri, 06 Nov 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 90%, First-party 54%

Big update to the Delta Inference Engine, you guys asked for more features, more benchmarks and less clickbait. I'm here to deliver The short version: I've added almost everything requested and more. Delta Inference Engine now supports 64/96/128 GB of RAM and fully supports the new Unsloth quants. Unsloth IQ2 runs at the same 41 tok/s (192 GB RAM) using a new native reader for the Engram tables and some clever CPU kernel work. Compared to the old default model on my 99-question benchmark it went from 52 to 57 correct, against 59 for the full model. It's no full deepseek model quant, but they're a lot more usable than you might expect. Speed on one RTX 3090 24 GB (i5-13600K, 4x48 GB DDR5-5600, PCIe 4.0 NVMe, Windows, no WSL). Writing speed, tok/s, greedy, one chat at a time: RAM UD-IQ2_XXS, 2-bit, 301 GB UD-IQ1_S, 1-bit, 233 GB UD-Q2_K_XL, 2-bit, 335 GB UD-IQ3_XXS, 3-bit, 395 GB + the default 192 GB 41 41.0 31.3 28.2 128 GB 34.0 40.6 26.6 22.8 96 GB 29.3 36.5 22.9 18.3 64 GB 21.0 30.6 15.2 11.7 The 128, 96 and 64 GB rows are the same PC with the rest of the RAM locked away. Prompt reading: long prompts read at up to 740 tok/s at 192 GB and 600 at 128 GB (at ~64K tokens). A short prompt starts answering in about 2 s. Benchmark: 99 hard questions, greedy, 43K token budget: Set UD-IQ2_XXS (this release) ds4 Q2 (last release) Full model, API Qwen 3.8 Flash-Next, API Knowledge (40) 12 9 13 7 Maths (14) 10 10 10 8 Reasoning (30) 25 23 25 21 Coding (10) 10 10 10 8 Hard coding (5) 0 0 1 0 Total (99) 57 52 59 44 UD-IQ2_XXS is within 2 points of the full API, never scores below ds4 Q2 on any set while running at the same speed, and used 11% fewer tokens across the run. Agreement with DeepSeek's API on the next token, at the settings that ship: Model General text Code and maths Agentic UD-IQ2_XXS 91.1% 94.5% 95.9% ds4 Q2 89.9% 93.1% 95.1% UD-Q2_K_XL 92.5% 95.3% 97.0% UD-IQ3_XXS 92.7% 95.9% 97.4% UD-IQ1_S 89.1% 91.5% 95.3% For reference, two hosts of the full model agreed 98.3% and 98.9% in my test. By that measure Unsloth IQ2 is about 20% closer to the full model than the old ds4 Q2. If you want better quality: UD-Q2_K_XL (335 GB) runs 31 tok/s at 192 GB and 26.6 at 128 GB, at 92.5% / 95.3%. UD-IQ3_XXS (395 GB plus the default) runs 28 and 22.8 at 92.7% / 95.9%. What changed since last time: First token ~40% sooner: a ~180-token prompt went from about 3.8 s to 2.3 s. Agent turns read ~12% faster , and tool calls that low-bit models write slightly wrong are now read as tool calls. Unsloth quants at full speed: the engine reads their Engram tables directly. 64 and 96 GB are real options: SSD read-ahead (+22% at 64 GB), bigger expert memory, and prompt reads in file order (18-20% faster on low RAM). 128 GB: ds4 Q2 went from 33 to 36 tok/s. Default sampling: the drafter now samples its drafts too, about +3.5% at default settings. First launch shows which model suits your RAM, and you can pick any other or use your own. A Setup tab in the chat page changes model, speed vs quality and the second GPU. Public CI: the release zips are now built by GitHub Actions, so you can see how each one was made. EXL3: 2.5 bpw is on the menu and the GPU kernel is about 2x faster. In my tests UD-Q2_K_XL was both faster and closer to the API, so I still point people there. Basic multi-GPU: 7% uplift using a 3060 + 3090. It doesn't scale well to 3-4+ GPUs, so use Project Maya for those builds. Fixes: contexts past 65,535 tokens, </think> in prose no longer ends the reasoning, no out-of-memory on the biggest files, a failed picture encoder no longer stops the model, faster prompts after a pause and many more. Support for custom model selection: just add them to the custom model folder and pick them in the web-ui Requirements: OS: Windows 10 or 11 GPU: NVIDIA RTX with 12 GB of VRAM or more, driver 580 or newer. 24 GB is the fast path, and AMD GPUs aren't supported yet RAM: 64 GB or more, 128 GB+ recommended Disk: a fast NVMe SSD, with 233-395 GB for the model (UD-IQ3_XXS also needs the default model) CPU: any x86-64 CPU, Intel or AMD. AVX2 is the fast path All of this is one PC. It needs testing on other hardware. Repo: https://github.com/musicurgy/delta-inference-engine MIT licensed. It's a Windows port of Xolotl, built on Strata. Thanks to DeepSeek for the model, Unsloth, nazeshinjite and ISTA-DASLab for the quants, and to the Xolotl and Project Maya communities, whose work and public numbers helped a lot. Claude wrote most of the code and I ran the project. If you try it, post your GPU, RAM, model and tok/s, good or bad. submitted by /u/musicurgy to r/LocalLLaMA [link] [comments]

★ Introducing Inkling 2 Small

/u/pmttyji — Fri, 06 Nov 2026 00:00:00 +0000

97% · Measured result 97%, First-party 82%, Usable today 63%

Today we are introducing our second model generation with Inkling 2 Small. It is a Mixture-of-Experts model with 594B total parameters, 17B active , and supports image inputs and variable effort. Inkling 2 Small far surpasses our previous models’ scores on the Artificial Analysis Intelligence Index with a score of 31, reflecting gains in performance on agentic coding, vision, knowledge work, and reasoning. The increase in capabilities comes from improvements made at every step of our training process, including more efficient pre-training and a large, unified RL run. Inkling 2 Small will initially be available through Tinker, with closed weights, following the approach we outlined in a safe path to open weights . We intend to make the full weights available under an Apache 2.0 license next week after the completion of external safety testing and red-teaming. You can try Inkling 2 Small on Tinker Playground today. The model is also available for fine-tuning and sampling on Tinker; checkpoints will be downloadable with the release of Inkling 2 Small’s weights. :( Previous Inkling Small model's size is only 276B total, 12B active . Hope they release additional models Mini or Nano soon or later. submitted by /u/pmttyji to r/LocalLLaMA [link] [comments]

★ [Paper] FireFlash : An Open Recipe for Long-Horizon Agentic RL Achieving the Performance-Cost Pareto Frontier

/u/pmttyji — Fri, 06 Nov 2026 00:00:00 +0000

97% · Measured result 97%, First-party 66%

We introduce FireFlash , a 300B-scale model tailored for long-horizon agentic tasks. FireFlash excels as a terminal and coding agent, achieving 46.2% on Terminal-Bench 4.0 1 , putting it on par with Fable 5 and GPT-6 Sol, while costing over 30× less per task than Fable 5 at maximum effort (Figure 1). These gains also transfer to software engineering benchmarks, including DeepSWE v1.1 2 and SWE-Bench Pro Verified 3 (Table 1). While frontier labs scale reinforcement learning across thousands of GPUs, we reach the performance-cost Pareto frontier under 5 days using 64 NVIDIA B300 GPUs . Three key factors make this possible: (1) careful curation of agentic RL environments so that every task provides a reliable signal at the right difficulty; (2) an RL recipe built for long, stale, and low-precision rollouts; and (3) an optimized coding harness tailored to the model for both training and evaluation. Together, these components bring frontier efficiency to a hundred-GPU-scale cluster, and we are releasing the full recipe. Blog Post : https://agenteconomics.org/posts/agentic-rl-recipe Tweet : https://x.com/kaiwei_chang/status/2117378474654781780 Open weights : Soon submitted by /u/pmttyji to r/LocalLLaMA [link] [comments]

★ OpenAI has just announced GPT‑6 Cyber, a major step up from GPT‑5.6 Cyber and outperforms GPT‑6 Astra on most cyber tasks

/u/TorturedPoet30 — Fri, 06 Nov 2026 00:00:00 +0000

96% · Measured result 96%

On ExploitGym, which tests whether models can exploit a specified vulnerability, GPT‑6 Cyber scores 48.5%, up from 32.1% for GPT‑5.6 Cyber. submitted by /u/TorturedPoet30 to r/singularity [link] [comments]

★ Portal 2 recompiled into a native Mac and iPhone app

/u/kanapitsas — Fri, 06 Nov 2026 00:00:00 +0000

95% · Measured result 95%, Usable today 64%

I wanted to play Portal 2 natively on Apple silicon, so we (that is, Opus 5.5 and I) built a tool that translates the Linux release’s machine code into C (about 125,000 functions) and then compiles it to native ARM64. It turns out it took only two days to get a playable room (Claude thought it would take many months). There’s no emulator, Wine or Rosetta involved. You need your own copy of Portal 2. The repo has no game files; the native app is generated on your machine. It’s playable on an iPhone 15 Pro Max with touch controls. You fire portals by tapping the back of the phone: https://youtu.be/YWX2BeMnlQI . You can also use a Bluetooth controller (tested with 8BitDo). Co-op works over LAN: a Mac hosts, and another Mac or an iPhone joins by IP address. We recently replaced OpenGL with a direct D3D9 → Metal path, built on mtld3d ( https://github.com/athei/mtld3d ). In one scene on an M3 Pro, it ran at 122 fps versus 81 with OpenGL. Numbers vary a lot by room. Claude Code wrote the code; I set the direction, tested on my devices and made the calls. I used Codex as a reviewer and for second opinions when Claude was stuck. Happy to answer questions about the project. Contributions on GitHub are welcome: https://github.com/kanapitsas/portal2-recomp submitted by /u/kanapitsas to r/ClaudeAI [link] [comments]

★ CCORE GLB-3D-Coder dataset is here: 3,918 rendered and tested examples across 40 domains

/u/ConfidentDinner6648 — Fri, 06 Nov 2026 00:00:00 +0000

94% · Usable today 94%, First-party 54%

CCORE GLB-3D-Coder dataset is here: 3,918 rendered and tested examples across 40 domains As promised in my previous posts, I’m releasing the dataset used to train CCORE GLB-3D-Coder , my small 4B model for creating 3D assets with Three.js and GLB export. The dataset contains 3,918 examples across 40 domains , including characters, creatures, vehicles, laboratory equipment, musical instruments, architecture, machinery, nature, and everyday props. The grid shows 256 examples. Every example was tested and rendered, and its exported GLB was validated before inclusion. What’s included: Complete conversations, reasoning traces, and HTML/JavaScript responses. A rendered reference image for every example. Static assets and examples with animation and interaction. 3,501 training examples and 417 validation examples. MIT license. Dataset · Model and full weights More about what I’m planning next: Next releases . I hope this is useful for your own experiments, fine-tuning, and 3D tools. If you try it, let me know how it goes :) submitted by /u/ConfidentDinner6648 to r/LocalLLaMA [link] [comments]

★ I built a 3D globe for my two boys with Claude Code. It got way more love than I expected, so here's how it's grown.

/u/monoloni — Fri, 06 Nov 2026 00:00:00 +0000

94% · Usable today 94%

A little while ago, I shared a small interactive globe I'd been building for my two boys, aged 9 and 6. I'm just a dad with no coding background, and I built the whole thing with Claude Code (Opus 5.5). It got way more attention than I ever expected. And the feedback from parents and kids has been so lovely that I'd really love for more kids to get to explore it. So I wanted to share it here too, since none of this would exist without Claude Code. Quick recap: I wanted my kids' screen time to be a bit more meaningful, so I started vibe coding a 3D globe where they could explore the world. They quickly became my entire dev team. "Dad, why isn't this in the game?" "Can you make it do this?" That hasn't stopped. Since my first post, We've shipped a lot of updates, most of them straight from their wish list and from people's feedback, and it has gotten so much better: - 🌍 830+ landmarks and sights, each one made in 3D - 🦒 470+ animals that walk, swim and fly, plus an animal dex to fill in - 🚂 180+ vehicles you can actually ride: cars, trains, ships and planes - 🌙 Real day and night, with city lights coming on after dark - 🚀 You can even fly to the Moon - 🎯 A location-guessing game, quizzes and a daily landmark puzzle - 🌐 English, Korean, Japanese, Chinese and now Indonesian A small moment that made it all worth it. Not long ago, I asked one of my boys where the Eiffel Tower is. “Spain!” he said, with total confidence. He had no idea. After just a couple of days playing with the globe, he now knows where most countries are, and honestly, his geography is now better than most adults I know. The biggest surprise: it somehow found its way into classrooms around the globe, which still blows my mind. My workflow is still pretty simple. The boys ask for something, I describe it to Claude, and we test it together. They're still my lead testers. It's called My Earth Toy, and it's completely free, with no ads. https://myearthtoy.com/ You can try it without an account, or a simple sign up for the full experience. It's still very much a work in progress, with plenty of bugs and things I want to improve. If you have curious little ones (physically or internally), I'd love for you to try it together. Your feedback means a lot. Thank you for checking it out! submitted by /u/monoloni to r/ClaudeAI [link] [comments]

★ Krea 2 Turbo - 4 Step LoRA comeback (trained to 133K checkpoint, around 55K more than the 'final' 78K in Sep)

/u/TimeTruth2490 — Fri, 06 Nov 2026 00:00:00 +0000

94% · Usable today 94%, Measured result 82%

This version (chk00133000) replaces the first 'final' release (chk00078000), from two months ago. I decided to train a 'few more' samples (55K more to be precise), the newer part with five critic heads where the first release had one. Measured against the 8-step teacher on the 15 test prompts at 12 sizes: cleaner fine structure — the 8- and 16-pixel grid patterns at 0.96–0.98× the teacher's, where the first release was at 1.09–1.11× less ghosting and fewer doubled edges — closer to the teacher at 10 of 12 sizes on both measures cleaner flat areas — grain at 0.99× the teacher's, down from 1.08× no over-sharpening at large sizes — fine texture at 1.01–1.04× the teacher's at 1440 px, down from 1.18–1.20× saturation matching the teacher's Full details of changes from 78K to 133K: https://huggingface.co/lvladikov/Krea2-Turbo-Distill-4step-LoRA/blob/main/DETAILED-README.md#chk00133000-vs-chk00078000 The older versions are still kept as before under _archive/checkpoints/ . To use the new checkpoints - redownload/replace krea2_turbo_4step_rank_64_lora_comfyui.safetensors / krea2_turbo_4step_rank_64_lora.safetensors Since the initial training (than ended in September with 78K 'final' checkpoint), I have trained about a day on an H200 (on runpod in the cloud), which is where the bulk of new trained samples came from, and two more days on the RTX 3090. I've also tidied up the main model card (more sections taken out of it and moved to the detailed card for those interested). Instead the main card now includes an extra Table Of Contents like section with links to Detailed card: https://huggingface.co/lvladikov/Krea2-Turbo-Distill-4step-LoRA#detailed-model-card For now I will not call this another 'final' release 😀 (although I don't currently have plans to do more than the 133K training), as it is possible to train more in the future (just not soon). When I first stopped at 78K rumours were already circulating that Krea 3 would open source soon (so it felt like the right time then to 'finalise' the 4 step LoRA), and while Krea 3 is now available on paid platforms it is yet to be open sourced and most likely focused on Editing more than T2I, which makes the Krea 2 Turbo still a very desired model and my LoRAs do contribute in the more efficient use of the Krea 2 Turbo. Don't forget to also check the 'latest' of my Krea 2 Turbo step LoRAs - the 3 step one, which was updated just yesterday to 66K checkpoint: https://huggingface.co/lvladikov/Krea2-Turbo-Distill-3step-LoRA . I might also come back to the 2 Step LoRA with more training, who knows... It is important to understand that while my 2/3/4 Step LoRAs for Krea 2 Turbo were trained for these respective steps during rendering, they for obvious reasons work really well with even more steps. There are lots of Krea Checkpoints out there that require lets say 10, or 12 or more steps to render and when paired up with my Krea 2 Turbo 2, 3 or 4 Steps LoRAs you can get either 'sooner' (with less steps) to the asked number of steps by the checkpoint authors, or to get a lot more quality per step , i.e. if you run 2 Step LoRA with lets say 6 or 8 steps, this could give you quality you'd otherwise need 12 or 16 or 20 steps without LoRA, similarly do try the 3 Step and 4 Step LoRAs at higher step counts where such is required by a third party Krea checkpoint and you will see an instant boost of quality, so find the right LoRA and steps for your favourite checkpoint, either way all of the three - 2 Step LoRA , 3 Step LoRA and this 4 Step LoRA work fine with most checkpoints (but not all, as some checkpoints go in a very different direction to what the core Krea 2 Turbo does, and after all my LoRAs were trained on the official Krea 2 Turbo). Latest 133K 4 Step LoRA and ComfyUI workflow can be downloaded as usual at my HF: https://huggingface.co/lvladikov/Krea2-Turbo-Distill-4step-LoRA Also don't forget that Krea 2 Turbo works very well with Nvidia PiD to get to higher resolutions quicker by rendering at lower resolutions and letting PiD take it 4x in latent space, and do so quickly and efficiently: https://huggingface.co/lvladikov/Krea2Turbo-PiD-SuperFast-HighRes (again find the right LoRA and steps to use for the main Krea 2 Turbo renders, don't be afraid to use 6 or 8 steps with either of the LoRAs since you'll be doing it at lower resolutions, prior to PiD handover, and as such these more steps would run faster anyway, so the time cost for more steps is less when using PiD). Enjoy! submitted by /u/TimeTruth2490 to r/StableDiffusion [link] [comments]

★ Thinking Machines Lab debuts Inkling 2 Small, a MoE model with 594B total and 17B active parameters, and plans to release weights next week after safety testing (Thinking Machines Lab)

Fri, 06 Nov 2026 00:00:00 +0000

94% · First-party 94%

Thinking Machines Lab : Thinking Machines Lab debuts Inkling 2 Small, a MoE model with 594B total and 17B active parameters, and plans to release weights next week after safety testing — Today we are introducing our second model generation with Inkling 2 Small. It is a Mixture-of-Experts model with 594B total parameters …

★ [Model Release] Qwen-Image-2.1 Uncensored Omni — trained on ~1M images, 9 local formats

/u/metalfans — Fri, 06 Nov 2026 00:00:00 +0000

93% · Usable today 93%, First-party 49%

We’ve released Qwen-Image-2.1 Uncensored Omni , the most capable unrestricted Qwen-Image-2.1 model we’ve built so far. The rank-128 adapter was trained on roughly 1 million images , merged into the base transformer at strength 1.0, and released in nine formats: BF16, Q8_0, Q6_K, Q5_K_M, Q4_K_M, Q4_0, FP8, INT8 ConvRot and NVFP4. One model supports both text-to-image generation and natural-language image editing , with an emphasis on flexible poses and complex compositions. When comparing it, please use models designed for the same unrestricted use case. Restricted checkpoints operate under different constraints, and the trade-offs become obvious on the content they avoid or handle less effectively. Playground: chatrlabs.com/playground Download: Hugging Face GitHub: Code and documentation Civitai : https://civitai.red/models/3034876/qwen-image-21-uncensored-omni-quantized Feedback and comparison results are welcome. Please include your GPU, workflow and quantization. submitted by /u/metalfans to r/StableDiffusion [link] [comments]

★ METR reveals Anthropic's unreleased Model 4, trained in September–October 2026, scored 178.6 on the AI capability index, a jump nearly 90% as large as the entire improvement from Opus 4.6 to Mythos 5.

/u/ResultBackground2450 — Fri, 06 Nov 2026 00:00:00 +0000

92% · Measured result 92%

Source submitted by /u/ResultBackground2450 to r/singularity [link] [comments]

★ Anthropic has a powerful new AI model it hasn't released yet. METR reports that "Model 4" scored above 50% on all 15 capability benchmarks tested, raising concerns that existing AI tests are becoming too easy to measure frontier progress.

/u/141_1337 — Fri, 06 Nov 2026 00:00:00 +0000

92% · Measured result 92%

submitted by /u/141_1337 to r/singularity [link] [comments]

★ NVIDIA RTX PRO 5500 Blackwell appears at $17,999 MSRP, higher than RTX PRO 6000 at $16,000 MSRP set some months ago by NVIDIA - VideoCardz

/u/panchovix — Fri, 06 Nov 2026 00:00:00 +0000

92% · Measured result 92%, Usable today 37%, First-party 34%

submitted by /u/panchovix to r/LocalLLaMA [link] [comments]

★ GPT-6.1 Sol learns from real-world surgical experience: After just 3 mouse brain procedures, with a surgeon correcting its mistakes, the AI finds key anatomical landmarks nearly twice as fast (169 → 86 seconds) and cuts its positioning error in half (0.6 → 0.3 mm).

/u/141_1337 — Fri, 06 Nov 2026 00:00:00 +0000

92% · Measured result 92%

submitted by /u/141_1337 to r/singularity [link] [comments]

★ ollama v0.40.15

github-actions[bot] — Fri, 06 Nov 2026 00:00:00 +0000

90% · First-party 90%, Usable today 87%

MiMo V2.6 Xiaomi MiMo's mimo-v2.6 , a 9B model built for code and agent workflows, is now supported in Ollama. ollama run mimo-v2.6 AutoTrust decision models AutoTrust decision models read text and return choices, yes or no probabilities, and ratings for the questions you supply. The family includes 9b, 35b, and 27b-vl sizes — the 35b and 27b-vl sizes can also read images. ollama run autotrust-jev " A customer says their card was charged twice. " --ask " Is this a billing issue? " Note: autotrust-jev is supported on Apple silicon in this release. What's Changed ollama launch now supports Kimi Code CLI — the successor to kimi-cli — and offers to migrate existing kimi-cli setups ollama launch now fills in Pi's model list automatically so models can be picked inside Pi, and Claude Desktop's model picker shows Ollama's actual model names Recurrent and vision GGUF models can now serve more than one request at a time Qwen3 and Qwen3.5 models using long-context (YaRN) scaling Running ollama with no arguments opens the welcome launcher Full Changelog : v0.40.14...v0.40.15

Release v5.19.0

vasqu — Fri, 06 Nov 2026 00:00:00 +0000

89% · First-party 89%, Usable today 83%

Release v5.19.0 New Model additions EmbeddingGemma2 EmbeddingGemma 2 is a multimodal embedding model from Google built on the Gemma 4 architecture. It encodes text, images, audio, and video, individually or combined in one input, into a shared 768-dimensional vector space for cross-modal retrieval, semantic similarity, clustering, and classification. It uses Matryoshka Representation Learning, so embeddings can be truncated to 512, 256, or 128 dimensions. It also offers configurable visual and video token budgets, and unused vision or audio towers can be disabled at load time to save memory. Links: Documentation Smthn smthn ( #49364 ) by @vasqu in #49364 Breaking changes All MoE models whose routers compute logits now return them when output_router_logits=True , following the Qwen3-MoE pattern (a router_logits recorder on the base model, MoeModelOutputWithPast from the backbone, and a MoE causal LM output from the head), so code that relied on the previous outputs or their absence should read the router logits from these output classes. 🚨 Return router logits from every MoE model that computes them ( #48920 ) by @qgallouedec Owlv2ForObjectDetection.embed_image_query now selects the query box with the highest objectness score, as in the original OWLv2 notebook, instead of the OWL-ViT heuristic, so image-guided query embeddings and detections may differ from earlier releases. 🚨 Select the OWLv2 image query by objectness ( #49200 ) by @qgallouedec The "paged|" prefix for SDPA and flash attention implementations is deprecated, so users should set the regular attention implementation (e.g. sdpa or flash_attention_2 ) for continuous batching instead of paged|sdpa or paged|flash_attention_2 . 🚨 Attention 🚨 Deprecate "paged|" prefix for SDPA and flash ( #49112 ) by @remi-or The regular flash and SDPA attention functions ( flash_attention.py , sdpa_attention.py ) now support continuous batching directly, and "paged|..." implementations for these are redirected to them, while eager still requires the "paged|eager" prefix. 🚨 Attention 🚨 Make regular attention support CB ( #49101 ) by @remi-or In continuous batching, the cache update for the index-based and block-table paths is now fused into a single call, which slightly changes the cache update function's behavior and affects any custom code that calls the separate update paths. 🚨 [CB] 🚨 Fuse update for index and block table path ( #49088 ) by @remi-or Continuous batching internals changed in preparation for removing "paged" : `max 🚨 [CB] 🚨 Little fixes before removing "paged" ( #49069 ) by @remi-or Parallelization Expert parallelism gains a token-dispatch implementation, selected via the new ep_dispatch_experts plan rule and now the default for Qwen3 MoE and Mellum, which removes the requirement that EP size equal TP size. The Trainer was also adapted to work with expert parallelism, and the docs now note that PEFT adapters support tensor parallelism. A CI-related fix for pipeline-parallel chart2table inference was also included. [ distributed ]: adapt Trainer to work Expert Parallel ( #48873 ) by @3outeille in [ #48873 ] [ distributed ] Add expert-parallel token dispatch, default for Qwen3 MoE ( #48865 ) by @3outeille in [ #48865 ] Fix pp chart2table inference ( #49225 ) by @zucchini-nlp in [ #49225 ] [docs] TP for PEFT adapters ( #49060 ) by @stevhliu in [ #49060 ] Cache This release fixes quantized cache handling: generate no longer mutates the user's cache_config , and QuantizedLayer.reorder_cache is repaired. It also adds per-layer cache configuration, so DynamicCache and StaticCache initialize each layer from its own config (sliding window, attention chunk size, conv states, and attention head counts) to better support heterogeneous models. Separately, the deprecation cycle on mask and cache Fix quantized cache ( #48700 ) by @jiqing-feng in [ #48700 ] [CI] check_bad_commit: use EFS cache to avoid Xet FUSE OOM (exit 137) ( #49273 ) by @ydshieh in [ #49273 ] Support per-layer cache configuration ( #48178 ) by @eladsegal in [ #48178 ] Remove deprecation cycle on mask and cache ( #49231 ) by @Cyrilvallez in [ #49231 ] Bugfixes and improvements Revert "[CI] Temporarily disable AMD scheduled CI trigger" ( #49271 ) ( #49362 ) by @ydshieh in [ #49362 ] ALM testx fIxing... ( #49355 ) by @zucchini-nlp in [ #49355 ] Fix DataCollatorForLanguageModeling ignoring seed=0 ( #49349 ) by @akanyaani in [ #49349 ] Fix explicit kernelization modes for evaluation models ( #49339 ) by @DimensionSTP in [ #49339 ] fix(cohere_compass): add video to input_modalities ( #49320 ) ( #49323 ) by @destopianpirate in [ #49323 ] GPT-OSS: read the clamped SwiGLU's alpha and limit from the config ( #49346 ) by @IlyasMoutawwakil in [ #49346 ] [ distributed ] Default MoE ep_plans to token dispatch ( #49160 ) by @3outeille in [ #49160 ] Move CI to Python 3.11, with the version set in .python-version ( #49311 ) by @tarekziade in [ #49311 ] Bump doc-builder main docs workflow pin ( #49350 ) by @paulinebm in [ #49350 ] [ distributed ] decoupled tp_plan and ep_plan ( #48859 ) by @3outeille in [ #48859 ] [ distributed ] Add dense and expert device mesh ( #48857 ) by @3outeille in [ #48857 ] Bump doc-builder workflow pin ( #49342 ) by @paulinebm in [ #49342 ] Allow registering new processing backends ( #48984 ) by @zucchini-nlp in [ #48984 ] Fix WatermarkDetector repeated-ngram counting ( #49315 ) by @LE0-Lin in [ #49315 ] Fix minicpm 4.6V video batching and CI ( #49259 ) by @zucchini-nlp in [ #49259 ] remove colwise_gather_output for lm_head for DeepseekV4 ( #49314 ) by @3outeille in [ #49314 ] Fix the labels docstring of CLIPSegForImageSegmentation ( #49001 ) by @qgallouedec in [ #49001 ] [CI] Temporarily disable AMD scheduled CI trigger ( #49271 ) by @ydshieh in [ #49271 ] Remove the unused pandas entry from setup.py deps ( #49329 ) by @tarekziade in [ #49329 ] Fix run_glue.py label ids becoming strings with pandas>=3 ( #49326 ) by @tarekziade in [ #49326 ] [Fix] Remove old test file with two ancient tests ( #49280 ) by @remi-or in [ #49280 ] Fix chunked prefill with multi-axis position ids (Qwen3-VL) ( #49319 ) by @dacorvo in [ #49319 ] Why override when you can fix in Mixin ( #49105 ) by @zucchini-nlp in [ #49105 ] Do RoPE with mul instead of matmul ( #49265 ) by @Rocketknight1 in [ #49265 ] Deprecated pipelines should redirect; removed pipelines should raise ( #49308 ) by @LysandreJik in [ #49308 ] Enable model test on upcoming torch_tpu backend ( #49207 ) by @tengomucho in [ #49207 ] Fix encoder repetition penalty source rows after batch expansion ( #49262 ) by @gitedmond in [ #49262 ] Preserve masked EOS scores in exponential decay length penalty ( #49260 ) by @gitedmond in [ #49260 ] [CI] Avoid fetching all artifacts when only specific ones are needed ( #49282 ) by @ydshieh in [ #49282 ] Revert "[CI] ssh-runner: add optional cache_type input to switch between bucket and EFS runners ( #49159 )" ( #49270 ) by @ydshieh in [ #49270 ] Add Trainer.loss_is_scaled_for_ga to declare whether compute_loss already scales for gradient accumulation ( #49240 ) by @qgallouedec in [ #49240 ] fix precomputed flash kwargs clashing ( #47928 ) by @IlyasMoutawwakil in [ #47928 ] Reapply modular examples ( #49230 ) by @Cyrilvallez in [ #49230 ] Remove some stuff that does not exist ( #49232 ) by @Cyrilvallez in [ #49232 ] Remove rotaries deprecation cycle ( #49228 ) by @Cyrilvallez in [ #49228 ] [ GTE ] Add memory mixin ( #49234 ) by @vasqu in [ #49234 ] [CB] Make CB more device agnostic and add support for XPU ( #49156 ) by @remi-or in [ #49156 ] correct final metrics due to resuming from checkpoint ( #49208 ) by @SunMarc in [ #49208 ] [ESM/Persimmon/NllbMoe/ESMFold] use safetensors repos to fix Xet FUSE SIGBUS/IOError on bucket CI runners ( #49194 ) by @ydshieh in [ #49194 ] Dev update ( #49212 ) by @vasqu in [ #49212 ] Significant community contributions The following contributors have made significant changes to the library over the last release: @vasqu Smthn smthn ( #49364 ) [ GTE ] Add memory mixin ( #49234 ) Dev update ( #49212 ) @remi-or [Fix] Remove old test file with two ancient tests ( #49280 ) [CB] Make CB more device agnostic and add support for XPU ( #49156 ) 🚨 Attention 🚨 Deprecate "paged|" prefix for SDPA and flash ( #49112 ) 🚨 Attention 🚨 Make regular attention support CB ( #49101 ) 🚨 [CB] 🚨 Fuse update for index and block table path ( #49088 ) [Refactor] Make some flash-attention utils more readable ( #49071 ) 🚨 [CB] 🚨 Little fixes before removing "paged" ( #49069 )

Google rolls out Gemini Omni 1.2 Flash, which creates clips up to 15 seconds, vs. 10 seconds with Omni 1.1, has better reference adherence, and costs 30% less (Matthias Bastian/The Decoder)

Fri, 06 Nov 2026 00:00:00 +0000

86% · Measured result 86%, Usable today 73%

Matthias Bastian / The Decoder : Google rolls out Gemini Omni 1.2 Flash, which creates clips up to 15 seconds, vs. 10 seconds with Omni 1.1, has better reference adherence, and costs 30% less — Ask about this article... Google says Gemini Omni 1.2 Flash is rolling out through the Gemini API, Google AI Studio …

Introducing GPT‑6 Cyber: a major advance in security research that pairs stronger capabilities with better model alignment.

/u/Sassy_Allen — Fri, 06 Nov 2026 00:00:00 +0000

85% · First-party 85%

Introducing GPT‑6 Cyber: a major advance in security research that pairs stronger capabilities with better model alignment. The model powered the Linux kernel research we announced yesterday, and security teams at companies like Mozilla, Palo Alto Networks, Calif, and Cisco—alongside our own at OpenAI—are already putting it to work. GPT-6 Cyber is available to select Daybreak Red customers and we are expanding access over time. https://openai.com/index/introducing-gpt-6-cyber/ submitted by /u/Sassy_Allen to r/accelerate [link] [comments]

Search for everyone

elashri — Fri, 06 Nov 2026 00:00:00 +0000

85% · First-party 85%, Usable today 41%

Article URL: https://kagi.com/changelog#11820 Comments URL: https://news.ycombinator.com/item?id=50383740 Points: 664 # Comments: 333

Goodbye from Salon

mkeeter — Fri, 06 Nov 2026 00:00:00 +0000

84% · First-party 84%

Article URL: https://www.salon.com/2026/11/05/goodbye-from-salon/ Comments URL: https://news.ycombinator.com/item?id=50383739 Points: 568 # Comments: 216

Independent Assessment of AI R&D Acceleration at Anthropic in October 2026 | METR

/u/Recoil42 — Fri, 06 Nov 2026 00:00:00 +0000

81% · Measured result 81%

https://metr.org/blog/2026-11-05-anthropic-ai-rd-acceleration-assessment/#executive-summary "We now believe that: As of October 2026, Anthropic is likely improving the capabilities of their models on well-specified tasks at around twice the rate they did between March 2024 and October 2025. This estimate is given with high uncertainty; we would not be surprised if the true acceleration was closer to 1.3x or 3x the historical rate. A majority of this acceleration today is likely attributable to Anthropic’s extensive use of AI to do R&D, though there is significant uncertainty and other causes likely played a large role in acceleration in late 2025. The lack of observed bottlenecks or strong diminishing returns means there is a significant risk that further capabilities progress could lead to even faster acceleration, though, as we say below, we may be missing important bottlenecks. Since October 2025, benchmark scores (measured via AECI, Anthropic’s version of the Epoch Capabilities Index) for Anthropic’s models have been growing at an estimated 1.9x the pre-October 2025 rate [95% confidence interval: 1.5–2.8x], implying that Anthropic has made roughly two years of historical progress over the last year." submitted by /u/Recoil42 to r/singularity [link] [comments]

The New York Times is in talks to buy Letterboxd for around $330 million

The Verge — Fri, 06 Nov 2026 00:00:00 +0000

80% · Measured result 80%

Rumors have been swirling about the film lover’s social network for a while, but the NYT reports it's the buyer. www.theverge.com/news/1028375... Linked page: What’s the star rating?

★ Ricursive Intelligence released their first LLM: Ripple-65B Preview, a 65B dense model.

/u/xyzrt — Thu, 05 Nov 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 49%, First-party 47%

Ripple sets a new state-of-the-art for U.S. open-weight models in agentic coding tasks, surpassing significantly larger models including Muse Spark Open-816B, Beam-501B, Inkling-975B, and Nemotron 3 Ultra-550B. Ripple-65B Preview was trained on 12 trillion tokens, supports up to 1M context length, and achieves: - 80.5% on TerminalBench 2.1 - 79.1% on SWE-Bench Pro v2.0-Hard - 44.3% on DeepSWE v1.1 submitted by /u/xyzrt to r/singularity [link] [comments]

★ New Qwen3.8-Flash-Next Unsloth Dynamic V3.1 GGUFs

/u/danielhanchen — Thu, 05 Nov 2026 00:00:00 +0000

96% · Measured result 96%, Usable today 91%, First-party 87%

Hey r/LocalLLaMA ! We're releasing new new Unsloth Dynamic v3.1 GGUFs for Qwen3.8-Flash-Next! They're better by 10-15% accuracy on DeepSWE, Terminal Bench, Aider Polyglot and more vs GSQ-RCO. We also provide a new engram switching process for BF16, Q8_0, Q5_1, IQ4_NL switching for all quants! This builds upon our DeepSeek-V4.1-Flash UD3.1 work, which improved over 10-20% accuracy vs others. All benchmarks are 256K for agentic ones, and 128K for the rest. We used temperature 1.0, top_p 0.95, top_k 20, min_p 0, no presence or repetition penalty. preserve_thinking and xhigh reasoning, and ran over 26B of tokens for benchmarking. Benchmarks are noisy so we did 26.2B tokens of benchmarking - DeepSWE accounted for 18.1B tokens of the total budget followed by Terminal Bench (5.2B tokens). We ran benchmarks multiple times including LiveCodeBench x3 times, HMMT and others 8-16x and agentic benchmarks multiple times. The engram switching process is described in https://unsloth.ai/docs/models/qwen3.8-next#mix-n-match-engrams with details on each precision and RMSE (error) below: file type size relative RMSE vs BF16 Qwen3.8-Flash-Next-engram-BF16.gguf_file BF16 102.4 GB 0 Qwen3.8-Flash-Next-engram-Q8_0.gguf_file Q8_0 54.4 GB 0.0053 Qwen3.8-Flash-Next-engram-Q5_1.gguf_file Q5_1 38.4 GB 0.0376 Qwen3.8-Flash-Next-engram-IQ4_NL.gguf_file IQ4_NL 28.8 GB 0.0757 All new UD 3.1 quants are at https://huggingface.co/unsloth/Qwen3.8-Flash-Next-GGUF Currently all smaller quants than UD-Q4_K_XL are updated - we might plan to update UD-Q4_K_XL and larger ones soon as well! More blog details and items at https://unsloth.ai/docs/models/qwen3.8-next#dynamic-v3.1-update-november-2nd-2026 submitted by /u/danielhanchen to r/LocalLLaMA [link] [comments]

★ LFM3-Omni-2B running fully offline on my iPhone 18 Pro Max at ~80 tok/s, powered by custom WebGPU kernels in a React Native app.

/u/xenovatech — Thu, 05 Nov 2026 00:00:00 +0000

95% · Measured result 95%, Usable today 40%

submitted by /u/xenovatech to r/LocalLLaMA [link] [comments]

★ Viggle Remake: open weights for recasting / editing whole videos.

/u/init-5 — Thu, 05 Nov 2026 00:00:00 +0000

95% · Usable today 95%, First-party 93%

Weights: https://huggingface.co/Viggle/Viggle-Remake App: https://viggle.ai/meme/app/home?ui=v2 Post: https://x.com/ViggleAI/status/2118012913793290414?a=B6TBWhZywpFkFk8Iz8I&s=20 We just released Viggle Remake (based on H3) on Hugging Face: open weights for recasting people and editing scenes in existing videos, keeping the original motion, camera and soundtrack. Viggle Remake is built agent-first . We also ship an MCP server, so an agent (Claude Code, codex, …) can swap people in videos of any length. It cuts the video into windows, paints the keyframes, writes the prompts, renders, checks its own work and stitches the result. Our longest run so far is a 2-minute music video, and the repo includes everything needed to reproduce it. That also means it's more complicated than Viggle-Animate. Used by hand, Remake needs a well-structured prompt and a few painted keyframes, and the output depends heavily on both. That's exactly the work the MCP agent takes off your hands. If you'd rather skip all of it, the Viggle app does it for you. Also in the repo: ComfyUI nodes and workflows, int8/GGUF files for smaller GPUs, and smaller rank-128/64 LoRAs. submitted by /u/init-5 to r/StableDiffusion [link] [comments]

★ Anthropic’s FlashProve could prove an AI provider used the model you paid for without exposing its weights

/u/Spirited-Sir-3034 — Thu, 05 Nov 2026 00:00:00 +0000

95% · Measured result 95%, Usable today 46%, First-party 30%

Users currently have no independent way to confirm whether an AI provider served the requested model or quietly substituted a cheaper one. FlashProve addresses this by using zero-knowledge cryptography to prove that a particular model generated a response while keeping its proprietary weights hidden. Anthropic demonstrated the open-source system on a 400-billion-parameter model, generating proofs at roughly 110 tokens per second. However, the prototype requires 70 to 95 times more GPU time than ordinary inference, supports only 1,024-token contexts and does not yet cover every type of model output. Could cryptographic verification become standard for high-stakes AI services, even if it remains too expensive for everyday requests? submitted by /u/Spirited-Sir-3034 to r/artificial [link] [comments]

★ llama.cpp v0.9.0

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

95% · First-party 95%, Usable today 88%

Overview This release adds OCP FP8 E4M3 quantization support, a new flash_attn_ext_rows op that makes the unified KV cache efficient for multi-sequence inference, and a generic batched tensor copy API. Four new architectures are supported (Clover, Limite, Metis-1.6 and Mistral Large 4), audio generation and transcription expand with Chatterbox TTS, Nemotron 3.5 Transcribe and predefined Pocket TTS voices, and the Gemma 4 E2B/E4B models get major prefill optimizations. ggml is updated to v0.29.0, bringing FP8 E4M3, flash attention rows, NCCL-based multi-node tensor parallelism and performance work across the CPU, CUDA, SYCL, Metal, Vulkan, OpenCL and Hexagon backends. The server and UI receive a round of fixes and refinements. Highlights Quant: OCP FP8 E4M3 tensor type (saturating mode) with conversion helpers and a new ftype ( #27512 ) llama: flash_attn_ext_rows - more efficient unified KV for multi-seq, restoring non-unified KV prefill performance ( #29510 ) ggml: batched tensor copy API ( ggml_backend_tensor_copy_n / set_n / get_n ) superseding the _2d API, implemented for Metal and CUDA ( #30881 ) For a 3rd year in a row, llama.cpp is a featured repo in the Github Octoverse report : API changes llama.h: add LLAMA_FTYPE_MOSTLY_F8_E4M3 ( #27512 ) mtmd.h: add MTMD_GEN_AUDIO_TYPE_CHATTERBOX and n_voices to mtmd_gen_audio_info ( #30993 ) mtmd.h: add predefined-voice APIs: mtmd_gen_audio_voice_name() , mtmd_gen_audio_get_voice() , mtmd_gen_state_set_ref() ( #30993 ) mtmd.h: add mtmd_bitmap_is_voice() and mtmd_gen_audio_read_tensor() ( #30993 ) mtmd.h: add MTMD_VIDEO_TEMPLATE_QWEN3VL video prompt template ( #31619 ) server: GET /props reports the model's predefined TTS voices ; the TTS endpoint accepts predefined voice names ( #30993 ) server: /v1/responses now merges extra_params (seed, min_p, ...) into the converted chat-completions response ( #30959 ) New models Clover-35B-A3B-Preview diffusion model, AR mode ( #31306 ) Limite 1B - Violetto ( #29433 ) Metis-1.6 (Praxis ~2.9B and Logos ~10.2B): hybrid Mamba-2 / GQA attention with fixed-depth recurrence and LatentMoE ( #31134 ) Mistral Large 4 ( #31376 ) Core changes gemma4: graph optimizations with massive prefill gains for E2B and E4B ( #31356 ); create token_embd before the tied output in gemma3n and gemma4 ( #31394 ) LFM3: enable NVFP4 GGUFs ( #31608 ), enable tensor split ( #31431 ), quantize the audio codec decoder ( #31386 ) spec dec: save and restore MTP hidden state in context checkpoints ( #30141 ) and record LFM3 layer inputs ( #31598 ) dflash: copy hidden features via device copies ( #31506 ); qwen4exp: write the conv state tail without an intermediate cont ( #31443 ) model loading: reuse the tensor staging buffer and skip the direct-IO bounce buffer ( #31321 ) kv-cache: keep Hadamard rotation constants on the GPU ( #31073 ) and fix attention tensor rotation in layers with shared KV ( #31406 ) kv-cache: never return 0 kv_rows for sequences without cells ( #31570 ) and refuse rollbacks past the snapshots of the last ubatch ( #31368 ) Gemma4 MTP assistant: follow ctx_other devices and flash-attention setting ( #31635 ); DSV4: remove simple batch splitting ( #31300 ) chat: strip the qwen3-coder think block with reasoning_format none ( #31380 ) and end reasoning budget forcing on a prompt end tag ( #31374 ) chat: allow a constraint type after the gpt-oss final channel ( #31556 ); common: fix -hf tag matching inside longer quant names ( #31620 ) and bound control vector layer indices ( #31336 ) tools: reject mismatched shards in GGUF split merge ( #31579 ), fix imatrix --nextn crash ( #31522 ), fix gguf-py np_roundf dropping the sign ( #31310 ) vendor: miniaudio 0.11.26 ( #31459 ) and cpp-httplib 0.64.0 ( #31400 ); embed an app manifest in all Windows executables ( #31329 ) Multi-modality changes add Chatterbox TTS support ( #30993 ) add Nemotron 3.5 Transcribe support: offline transcription in 40 languages with prompt context and speaker attribution ( #31471 ) Pocket TTS: support predefined voices without voice cloning ( #31429 ) accurate support for the qwen3-vl video prompt format ( #31619 ) resize Gemma 4 images without letterbox padding ( #30922 ) and fix InternVL CLS token order ( #30886 ) Server changes cap shared decision prefixes at the first output ( #30710 ) restore the speculative checkpoint for drafts longer than n_rs_seq ( #31350 ) UI changes add MCP group checkboxes in the tools settings ( #31303 ) and request persistent storage on startup ( #31299 ) keep chats at the bottom until the reader scrolls up ( #31311 ) and show the submit button when the input has content ( #31324 ) reveal the collapsed sidebar from its logo ( #31307 ) and align alert dialog styling ( #31312 ) keep queued steering messages in their own conversation ( #31304 ) and show an interrupted state for tool calls that never returned ( #31314 ) disable model deletion the server would refuse ( #31305 ) and prefer a loading model in pre-selection ( #31326 ) add a Playwright harness for recording demo videos ( #31318 ) and run local browser tests in installed Chrome ( #31596 ) ggml changes v0.29.0 : ggml v0.29.0 adds an OCP FP8 E4M3 tensor type, a new ggml_flash_attn_ext_rows op where each query slice attends to its own list of K/V rows, a batched tensor copy API, and initial support for multi-node tensor parallelism through a new multi-process communicator interface. Core improvements include bounding tensor views by the bytes their strides reach, zero-copy GGUF export of host-buffer tensors, and vm_allocate -based allocations on Apple platforms. Performance work spans all major backends: new SVE kernels in the CPU backend, DPAS flash attention for quantized KV in SYCL, fused MoE MMQ in CUDA, faster MXFP4 mat-vec in Metal, split-K tuning in Vulkan, and a large expansion of quantized GEMM/GEMV coverage in OpenCL. The Hexagon backend gains support for several new ops, including the lightning indexer, top-k mask, conv2d and upscale. Assets Nightly build: b12110 More info Releases and versioning of ggml-org projects Changelog since v0.8.0 cd959ba llama.cpp : bump version to 0.9.0 ( #31646 ) 13ec8f6 sync : ggml cca14f6 ggml : bump version to 0.29.0 (ggml/1680) e853ec9 llama : follow ctx_other devices and flash attention in Gemma4 assistant ( #31635 ) feaf800 ggml : Gate RVV code on the target extension ( #31607 ) 4c4ca5b common : do not allow _ in sidecar ( #31639 ) 162e2bb ggml : fix bf16 ( #31609 ) 6900fb5 opencl: improve q2_0 GEMV for Adreno ( #31577 ) bbb02c9 ggml: bound views by the bytes their strides reach ( #31584 ) 960b1d5 ggml : write host-buffer tensor data directly in gguf writer ( #31144 ) 4b29d02 common : fix -hf tag matching inside longer quant names ( #31620 ) bee2332 hexagon: add LIGHTNING_INDEXER support ( #31289 ) 149f564 mtmd: accurate support for qwen3-vl video prompt format ( #31619 ) b976279 model, mtmd: add chatterbox TTS support ( #30993 ) 7071ba3 hexagon: add TOP_K_MASK op ( #31552 ) 6cb3e67 gemma4: graph optimizations (massive gains on pp for E2B and E4B) ( #31356 ) 6b9c0cf hexagon: faster TOP_K for the backend sampler ( #31279 ) d1c4e5b ui: run local browser tests in installed Chrome with its sandbox on ( #31596 ) 20a51f2 hexagon: add DSV4_HC_PRE and DSV4_HC_POST ops ( #30953 ) 0f35d6d spec : save and restore MTP hidden state ( #30141 ) a464960 ggml-zdnn: fix fattn test failure ( #31583 ) 9309bf1 model : Add support for Metis-1.6 models ( #31134 ) d1044bc model : enable NVFP4 LFM3 ggufs ( #31608 ) 28b812d mtmd : add Nemotron 3.5 Transcribe support ( #31471 ) 749db7f qwen4exp: write the conv state tail without an intermediate cont ( #31443 ) 0943ca5 ui: add Playwright harness for recording demo videos ( #31318 ) f9448cd model : record layer inputs in LFM3 for spec dec ( #31598 ) 0978a6e ggml: avoid signed overflow in ggml_roll bounds check ( #30375 ) 0ef2730 conversion : use original model tensor names in _flush_nvfp4_experts ( #31427 ) 8fc0376 cuda: potential fix for Q8_1 correction sum ( #31247 ) 740251a cuda : gather batched tensor reads into mapped host memory (PR to master) ( #31391 ) 71efc55 Add nccl support for multi-node tensor parallelism ( #28967 ) 19e8a86 tools : reject mismatched shards in GGUF split merge ( #31579 ) 259d917 meta: support GLM-5.3 next sm tensor ( #30499 ) 36ee3ca metal : fix cpy kernel for dst non-contiguous in dim 0 ( #31581 ) fac3a89 vulkan: skip maxStorageBufferRange pre-check for non-compute tensors ( #31114 ) b74298c delta_net_base: refactor conv state ( #30878 ) 37b0f9c vulkan: fix out-of-bounds NVFP4 UE4M3 scale lookup ( #31079 ) ca8daad llama : drop the redundant cnv from llm_attn_mask ( #31558 ) 0f663d2 dsv4.1: fix llama-context tests with partial offload ( #31292 ) 00f113e cuda : prevent premature eviction of graphs about to be used ( #30662 ) e6192de opencl: add initial iq4_xs support ( #31339 ) 4402e65 chat : allow constraint type after gpt-oss final channel ( #31556 ) 74101b3 ci : update the HIP VGPR spill ignore list for the kv_rows FA kernel argument ( #31550 ) 713319e webgpu: add ARANGE support ( #31455 ) ee17f29 kv-cache : never return 0 kv_rows for sequences without cells ( #31570 ) 51fe42c hexagon: tiled hvx permute ( #31446 ) 2cbca38 dflash: copy hidden features via device copies ( #31506 ) 29c720e docs: update s390x build docs ( #31546 ) d02b4c0 mtmd: Pocket tts - support for voices without voice cloning ( #31429 ) e4b6c8c model: add Clover support ( #31306 ) 1b6935b llama : flash_attn_ext_rows - more efficient unified kv for multi-seq ( #29510 ) 3f8af15 imatrix : fix --nextn crash ( #31522 ) cd8427d context : simplify setters ( #29730 ) 6b00d56 readme : fix links in README.md for maintainer PRs ( #31487 ) 458fcfc docs: CANN backend supports BF16 on 910B, document GGML_CANN_NO_PINNED ( #31249 ) 6ed8120 ggml-zdnn: share buffers with host ( #31481 ) ea24b95 ggml : use vm_allocate instead of posix_memalign on all Apple platforms ( #31437 ) 84d9ce0 opencl: add topk_mask ( #31441 ) dcbb091 vulkan: add tensor-parallel allreduce function ( #25051 ) 07ec7c8 vulkan: improve small-n split-K selection on RDNA3 and RDNA4 ( #30146 ) cb02250 vulkan: avoid redundant scans when zeroing skipped rows ( #31266 ) 2c93f0b sycl : fast ggml_sycl_comm_exchange() on Intel Arc Pro B70s ( #30956 ) 5e18eb0 sycl: dmmv code cleanup ( #31325 ) 5c2ea1a ui: disable model deletion the server would refuse ( #31305 ) 23426d7 ui: align alert dialog styling with other overlay surfaces ( #31312 ) 90080ce ui: keep queued steering messages in their own conversation ( #31304 ) 64be95b ui: show interrupted state for tool calls that never returned ( #31314 ) b12b405 ui: don't reload a loading model on select, prefer it in pre-selection ( #31326 ) aac6da8 docs : fix Vulkan example command in build.md ( #31530 ) 00ef136 tests : merge identical if branches ( #31523 ) 5969566 jinja : implement map('filter') ( #24033 ) a7a490a ggml : fix clang-cl build with AVX512 BF16 ( #31276 ) f72dc30 docs: fix Huawei ascend brand ( #31463 ) fcfe4b5 requirements : minor adjustments for python 3.14 wheels ( #31534 ) 4e910a8 cmake : add explicit thread linkage ( #31414 ) 1c5ed70 webgpu : fix CI by keeping scratch alloc sizes monotonic in batch length ( #31422 ) 785322d requirements : fix numpy dependencies ( #31508 ) dde879b sycl: Try PkgConfig for LevelZero includes / libs ( #31076 ) 060b2fe opencl: add initial iq3 support ( #31338 ) a91eab6 hexagon : fix DMA transfers with strides > 24 bits ( #31442 ) d5ef408 mtmd : fix InternVL CLS token order ( #30886 ) 79bce0c tests : enable Gemma 4 in test-llama-archs ( #31401 ) bc428e4 llama : enable tensor split for LFM3 ( #31431 ) f6312ad vendor : update miniaudio to 0.11.26 ( #31459 ) 0138937 llama : fix rotation of attention tensors in layers with shared KV ( #31406 ) ddf48f8 reshaping so mm on 2d instead of 3d tensor for lfm sc ( #30831 ) f3586e6 server: cap shared decision prefixes at the first output ( #30710 ) 2871678 server : fix /v1/responses endpoint to accept extra_params ( #30959 ) 7bd1808 mtmd : resize Gemma 4 images without letterbox padding ( #30922 ) 0ec4027 opencl: add fwht ( #31434 ) 1052f7e chat : strip the think block in the qwen3-coder with reasoning_format none ( #31380 ) 8956c76 sycl: fix f32 to q2_0/q4_0/q5_0 rounding in CPY ( #31120 ) 5047748 rpc : delete fs_path_to_utf8() ( #31424 ) 792fcf4 opencl: add initial iq1 support ( #31341 ) a34de86 common : delete fs_path_to_utf8() ( #31423 ) aa588a3 common : drop the Windows argv reconstruction ( #31417 ) 889f2ec quant : allow quantization for LFM3-Audio codec decoder ( #31386 ) 1ab23c3 vendor : update cpp-httplib to 0.64.0 ( #31400 ) 27b8464 ci : add missing ccache-clear to windows behavior check ( #31413 ) d63fbfe cmake : embed an app manifest in all Windows exes ( #31329 ) e216f4e ci : extract most apple jobs into daily workflow ( #31408 ) 344846b gemma3n, gemma4 : create token_embd before the tied output ( #31394 ) fb59972 kv-cache : keep rotation constants on the GPU ( #31073 ) ab3768c memory: refuse rollbacks past the snapshots of the last ubatch ( #31368 ) e0f142d opencl: add initial q2_0 support ( #31340 ) 3c809f4 common : end reasoning budget forcing on an end tag from the prompt ( #31374 ) 36a0e2f sycl: FLASH_ATTN_EXT failures ( #30761 ) 418f905 ggml : add batched tensor copy API ( #30881 ) eb4e244 ROCm/HIP: add RDNA4_M family for gfx1170/gfx1171 ( #31373 ) 68d20b8 Quant: OCP FP8 E4M3 support ( #27512 ) 0893ec9 skills: specify rule about ggml_build_forward_expand ( #31375 ) 78feec0 model: mistral le chonk ( #31376 ) 0ac1a7f llama : reuse the tensor staging buffer and skip the direct-io bounce buffer ( #31321 ) 7df8b87 server : restore the spec checkpoint for drafts longer than n_rs_seq ( #31350 ) 8ab29fa ui: keep chats at the bottom until the reader scrolls up ( #31311 ) f5d4d75 ui: show submit button when the chat input has content ( #31324 ) 3ed915e ui: reveal the collapsed sidebar from its logo and toggle it there ( #31307 ) f8fcef2 ui: add MCP group checkboxes in tools settings and fix indeterminate checkbox colors ( #31303 ) b7cde58 ui: request persistent storage on startup ( #31299 ) 3dd0f60 doc: update ops for opencl ( #31347 ) 78febba HIP/CUDA: enable sparse attn on CDNA ( #31259 ) abb76ab model : Support Limite 1B - Violetto ( #29433 ) 41be0bd common: select A100 cores for SpaceMiT default threads ( #30284 ) 22183e5 opencl: initial support for iq2 ( #31267 ) 6d19453 metal : faster MXFP4 mat-vec, full threadgroups for unary/binary/GLU ( #31075 ) fade717 tests : remove duplicate FA test cases added in #31125 ( #31357 ) c9daee1 ggml-metal : fix unary kernels compile on older Metal toolchains ( #31360 ) 8a199ad hexagon: support for UPSCALE op ( #31331 ) da6c30a hexagon: improve DDR bw utilization in transposed CONCAT ( #31277 ) f7c01c5 [SYCL] add DPAS flash attention kernel for quantized KV cache ( #31125 ) bf48103 sycl : vectorize reordered-layout dequantization stores (Q4_0, K-quants, IQ3, MXFP4) ( #30976 ) 6d5ac3c tests : fix comp_padding CUDA graph reservation ( #31344 ) 7ac5727 ggml-openvino: slice view inputs of SCALE ( #31334 ) 2e0d86b Hexagon: IM2COL improvement - block based HVX parallelization ( #31050 ) e09a78a tests: fix CI flakes in server cancel and sleep tests ( #31330 ) 369dcf3 ggml-cpu: add SVE implementation of ggml_gemv_q8_0_4x8_q8_0 ( #30585 ) d0ff631 docs : fix DSpark confidence threshold flag name (--spec-draft-p-min) ( #31178 ) cf24317 common, mtmd: bound control vector layer indices and M-RoPE position loops ( #31336 ) 74a4fb0 opencl: add tiled q4_k GEMM for adreno ( #30412 ) 5220213 hexagon: add conv2d support ( #30995 ) c3df4b7 Speed up IQ4 quant creation with pre-computed halfway points ( #31201 ) ac8e169 ggml-cpu: SVE 256 bit implementation of gemm_q6_K_8x8_q8_K kernel ( #27472 ) c02b5c6 ggml-cpu: SVE 256-bit Implementation of mxfp4 gemv kernel ( #28141 ) ff0d396 ci(s390x): switch to Ubuntu 26.04 runners ( #31317 ) 838093f llama : remove simple batch splitting for DSV4 ( #31300 ) 604cc43 codeowners : refresh teams and maintainer PRs link ( #31316 ) 39febd2 sycl: work-group argmax for short TOP_K rows ( #31110 ) f5222f2 cuda: fuse MoE (MUL_MAT_ID) gate/up and GLU in MMQ ( #31188 ) 28cb47c gguf-py: fix np_roundf dropping the sign ( #31310 )

★ Ouch: The Raspberry Pi 5 just hit an eye-watering $385

/u/lurker_bee — Thu, 05 Nov 2026 00:00:00 +0000

94% · Measured result 94%, Usable today 66%, First-party 38%

submitted by /u/lurker_bee to r/technology [link] [comments]

★ Stop Paying $149 To Semrush, I built a free Keyword & prompt Research Extension

/u/BoomBrigade7 — Thu, 05 Nov 2026 00:00:00 +0000

92% · Usable today 92%, Measured result 58%, First-party 35%

Didn't seem relevant to keep paying for Keyword Research Volume data from Semrush, so I built a free alternative. It uses DataforSEO and Official Google APIs, along with AI, to tell you exactly which keywords your page should target. You can also brainstorm which prompts to monitor for AI visibility and view the last 12 months of search trends for any keyword. It can provide data for 35 countries and 21 Languages Search for "KeyScout" on the Chrome Web Store. Hope it helps other solopreneurs. Do share your feedback. submitted by /u/BoomBrigade7 to r/SaaS [link] [comments]

★ Microsoft previews using smartphones as controllers for Xbox Cloud Gaming on supported smart TVs and direct Wi-Fi cloud gaming support for the Nano Controller (XBOX Wire)

Thu, 05 Nov 2026 00:00:00 +0000

92% · First-party 92%, Usable today 44%

XBOX Wire : Microsoft previews using smartphones as controllers for Xbox Cloud Gaming on supported smart TVs and direct Wi-Fi cloud gaming support for the Nano Controller — Starting today, we're rolling out two previews for XBOX Cloud Gaming. On supported Smart TVs, you can use your phone as a controller when you don't have one nearby.

★ OpenAI details a pipeline that used an upcoming cyber model to validate and patch 948 local privilege escalation vulnerabilities in Linux for $1.2M in API costs (OpenAI)

Thu, 05 Nov 2026 00:00:00 +0000

92% · Measured result 92%, First-party 84%

OpenAI : OpenAI details a pipeline that used an upcoming cyber model to validate and patch 948 local privilege escalation vulnerabilities in Linux for $1.2M in API costs — Security research that once required a separate, sustained investigation for each finding can increasingly be run as a systematic process.

★ Axion1-0/Axion-1.0-35B · Hugging Face

/u/pmttyji — Thu, 05 Nov 2026 00:00:00 +0000

91% · Usable today 91%, First-party 66%

We introduce Axion 1.0, a fully open agent foundation model that combines strong and broad agentic capabilities with a remarkably simple training recipe. Axion 1.0 is trained in only three stages: two lightweight supervised fine-tuning stages followed by reinforcement learning, without dedicated mid-training, direct preference optimization (DPO), or on-policy distillation (OPD). The first SFT stage develops strong self-contained reasoning through model-aware data construction, where we synthesize challenging problems and adversarially strengthen them based on the base model's own successful solution strategies. The second stage extends these capabilities to tool-dependent reasoning through a scalable pipeline for constructing diverse and automatically verifiable tasks grounded in real-world data sources and deterministic computation. Finally, reinforcement learning further strengthens long-horizon reasoning and interaction with external tools and environments. Despite this compact training recipe, Axion 1.0 achieves strong performance across a broad suite of agentic benchmarks and is competitive with leading commercial models on several of them. Equally importantly, Axion 1.0 is open beyond model weights: we release the complete recipe, including data construction, generation, filtering, verification, prompts, and training code, enabling the entire development process to be reproduced and extended. Axion 1.0 demonstrates that strong agent foundation models can be both open and simple, offering a practical and reproducible path toward advancing open agentic intelligence. arXiv : https://arxiv.org/abs/2611.03233 PDF : https://arxiv.org/pdf/2611.03233 GitHub : https://github.com/bytedance/axion1_0 Dataset : https://huggingface.co/datasets/Axion1-0/axion-training-data Project : https://axion1-0.github.io/ submitted by /u/pmttyji to r/LocalLLaMA [link] [comments]

★ Images 2.6

davidbarker — Thu, 05 Nov 2026 00:00:00 +0000

91% · First-party 91%, Usable today 42%

Article URL: https://openai.com/index/introducing-images-2-6/ Comments URL: https://news.ycombinator.com/item?id=50372945 Points: 267 # Comments: 168

Disney Style LoRA for MOSS

/u/vizsumit — Thu, 05 Nov 2026 00:00:00 +0000

89% · Usable today 89%

This LoRA captures the look of classic Disney 2D hand-drawn animation. Expect fluid, graceful linework, expressive character acting, soft painted backgrounds, and the warm, storybook charm of traditional cel-animated films. It works well for characters, portraits, fantasy scenes, and whimsical environments. Download Link: https://civitai.red/models/3037014/disney-style-moss Check sample images on Civitai for workflow and prompts. submitted by /u/vizsumit to r/StableDiffusion [link] [comments]

ollama v0.40.15

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

89% · First-party 89%, Usable today 78%

What's Changed mlx: load bundled CUDA libraries in-process on Linux by @dhiltgen in #19433 model: add MiMo V2.6 model support by @dhiltgen in #19400 Full Changelog : v0.40.14...v0.40.15-rc0

Kandinsky S2V 1.0 - 2B and 21B models.

/u/Crazy-Repeat-2006 — Thu, 05 Nov 2026 00:00:00 +0000

88% · Usable today 88%

Source: Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation "Speech-to-video generation: an avatar video is produced from a reference frame and a speech track . The whole figure is animated, not only the head. The audio is a condition — the model does not generate sound, it animates the person in the reference frame to match the speech it is given." Lite 2B: kandinskylab/Kandinsky-S2V-1.0-Lite · Hugging Face kandinskylab/Kandinsky-S2V-1.0-Lite-distill · Hugging Face Pro 21.4B: kandinskylab/Kandinsky-S2V-1.0-Pro · Hugging Face submitted by /u/Crazy-Repeat-2006 to r/StableDiffusion [link] [comments]

Claude writes a neural network's weights by hand, without training, to detect fake legal citations—achieving 97.8% test accuracy and outperforming a conventionally trained model that scored 94.6%.

/u/44th-Hokage- — Thu, 05 Nov 2026 00:00:00 +0000

87% · Measured result 87%

submitted by /u/44th-Hokage- to r/accelerate [link] [comments]

Fizgig 9.0.4: Fibo 2.0 training, Z-Image Base, masks from Sam 3.1, Detail crops for styles

/u/shootthesound — Thu, 05 Nov 2026 00:00:00 +0000

87% · Usable today 87%, First-party 39%

New models Fibo 2.0: LoRAs, edit LoRAs, sliders and full fine-tunes from a 12 GB card, with 4-step Turbo previews. Everything it saves loads in ComfyUI. ( guide ) The model arrived via a PR from @spaghettified26, thank you! Z-Image Base trains as its own model, with previews on Turbo. Training Masks from words: SAM 3.1 makes a mask of anything you name, and Edit masks lets you fix them by hand. Masked training now works on MiniMax H3 stills too. ( masked training guide ) Detail crops for style LoRAs: each picture also trains as a crop at its own scale, so brushwork and texture train pixel for pixel. A Style score in the Samples gallery tracks a style LoRA epoch by epoch. Transparent PNGs train with their transparency on Qwen Image 2.1. Start at a smaller size for about 20% less training time, plus caption dropout on every picture model and a steadier Adaptive LR. Three new optimizers: Prodigy, Muon and Automagic v4. Train on sub-folders. Captioning covers styles, objects and concepts, not just people, and a bigger 8B captioner is optional. Everything else 8 themes, a Run summary card, and Studio settings saved inside the pictures you download. Pods (RunPod, Vast.ai) log you in by themselves, and if a model is missing, Start downloads it. Thanks to everyone who sent PRs, issues and ideas. They're credited in the release notes. GitHub · Release notes submitted by /u/shootthesound to r/StableDiffusion [link] [comments]

llama.cpp b12123

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

87% · First-party 87%, Usable today 83%

opencl: add DSV4_HC_PRE and DSV4_HC_POST ( #31623 ) opencl: add DSV4_HC_PRE and DSV4_HC_POST Co-authored-by: Shafei Qi shaoqi@qti.qualcomm.com opencl: improve dsv4_hc_post Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Co-authored-by: Li He lih@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63921700 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Qwen 3.8 27B on my laptop can interpret model weights, too

Thu, 05 Nov 2026 00:00:00 +0000

87% · Measured result 87%, Usable today 44%

Yesterday's hot paper was Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights by Rikiya Takehi, Jayden Teoh, Alex Zhang, and Omar Khattab. The paper (OK, the authors classify is as a "blog post", but it's paper-shaped) found that frontier models, in particular GPT-6 Astra, can both interpret and modify the raw weights of a machine learning model - literally a text description of the model containing a bunch of floating point numbers. I've been playing with one of the examples from the paper and I'm delighted to share that Qwen 3.8 27B running on my laptop can do this as well! Weight-Space Programming Here's the highlight from their abstract, describing impressive capabilities for GPT-6 Astra and coining the term Weight-Space Programming for when LLMs analyze and modify model weights: Just by looking at the raw weights, GPT-6 Astra can tell what a network was trained to do . And without any environment feedback, it has no trouble writing, from scratch, small game-playing networks that outplay networks trained with PPO for 100 million steps. Likewise, asked to make Qwen3.5-0.8B better at math without gradients, Astra identifies an issue in its weights causing reasoning loops that Qwen’s own model card warns about, and fixes this by natively editing 0.016% of the weights . With the same sampling settings, this weight correction raises MATH-500 from 7.9% to 48.1% and generalizes out of the box to instruction following, raising IFEval by 3x. All of this is possible without allowing Astra to write training loops. It uses its reasoning to figure out what each part of a neural network computes, or should compute, and changes the weights accordingly. We call this Weight-Space Programming . The paper combines two topics that I think deserve to be treated separately. The first is what models can do with raw weights without running tools or executing code. The second explores how well models, once armed with code, can run operations to update and improve other models. spaCy author Matthew Honnibal called the paper misleading for conflating the two, and Sean Goedecke deconstructed the Qwen3.5-0.8B update example as taking the same steps that a human ML researcher would use. I'm going to focus on the no-tools question, which I think is the more interesting of the two. The paper presents the first question as Can LLMs understand model behaviors from weights? They trained four neural networks to play simplified 10x10 grid versions of four classic computer games - Breakout, Pong, Pac-Man, and Freeway (I had to look that one up , it's an Atari 2600 game from 1981). Then they fed those weights (as floating point numbers) to an LLM along with the following question: The weights below belong to one policy network that was trained with reinforcement learning to play a game on this grid. Which game was it trained on? Work from the weights. You have no tools: no code execution, no calculator, nothing to run. This is a single response. The GitHub repository that accompanies the paper is RikiyaT/lm_understand-logs . The exp1_which_game folder contains the prompts they used, with weights for the four games: breakout/prompt.txt freeway/prompt.txt pacman/prompt.txt pong/prompt.txt I checked and, aside from the weights, each prompt is identical to the others. Trying it out with Qwen 3.8 27B and other models The prompts on GitHub are self-contained. My LLM tool has a -f/--fragment option which can be passed the URL to a text file to use as a prompt, which means I can run any of the above like this: llm -f https://raw.githubusercontent.com/RikiyaT/lm_understand-logs/refs/heads/main/exp1_which_game/runs/breakout/prompt.txt \ -m openrouter/moonshotai/kimi-k3.1-pro This example requires the llm-openrouter plugin installed, and runs the Breakout prompt against Kimi K3.1 Pro via OpenRouter. Here's what I got back from Kimi K3.1 Pro , which successfully guessed Breakout after 9m 41s and 19,493 reasoning tokens. But how about Qwen 3.8 27B ? That's still my favorite model to run on my own laptop - it's just 17GB (I use this version ) and somehow feels close to the leading proprietary models of 2025. I fired up LM Studio , ensured Qwen 3.8 27B was loaded with a long context window (the default 8192 context failed with errors), installed the llm-lmstudio plugin and ran this command: LMSTUDIO_TIMEOUT=900 \ llm -f https://raw.githubusercontent.com/RikiyaT/lm_understand-logs/refs/heads/main/exp1_which_game/runs/pacman/prompt.txt \ -m lmstudio/qwen/qwen3.8-27b (I had to bump the timeout up using an environment variable, see this issue .) After 46m 12s and 43,506 reasoning tokens, Qwen on my laptop returned a response that ended like this (here's the reasoning trace ): Game: A simplified Pac-Man-style gridworld: an agent moves through a fixed 8x8 maze with central and corner wall blocks, moving objects/ghosts, and reward targets/pellets. Description: The agent navigates a fixed maze-like 8x8 board, using current agent/moving-object/previous-frame cues to move through corridors, collect reward-target cells, and avoid moving objects or hazards. Confidence: 72% This is impressive. I tried it on two of the other games as well. It identified Pong ( reasoning ) in 1h 4m 54s: Pong — specifically a Pong-like paddle/ball game where the agent controls a vertical paddle on the right side and must move up/down to intercept or return a moving ball/reward object. Description: The agent moves a right-side paddle vertically to hit or catch a moving ball-like reward target moving across the 8×8 field, while a left-side moving object/opponent and wall borders define the play; reward is obtained by successfully intercepting/returning/scoring the ball, and missing or failing to hit it is penalized. Confidence: 75% And Breakout ( reasoning ) in 52m 25s: Game: Breakout, or an Arkanoid-like paddle/ball/brick game. Description: The agent is a paddle on the bottom row and moves left/right to keep a ball in play; the ball moves around the upper grid, and bricks/reward targets in the top rows give reward when hit, while missing the ball/hitting the bottom wall ends the episode or gives penalty. Confidence: 88% Qwen failed at the Freeway prompt, which didn't surprise me considering that game is more obscure than the other three. Here's that transcript - Qwen thought it was "A simplified Pac-Man-like grid game: agent moves 4-directionally". The reasoning traces are fun to skim, and almost incomprehensible. Here's a sample: What about agent channel0? We see some large channel0 rows near row8 col7/8 and maybe bottom? Let's list channel0 large: line436 input435 (row8 col7 ch0) -2.107,1.169,0.513...; line441 input440 (row8 col8 ch0) -0.376,0.010,1.564,3.855...; line445 input444 (row8 col8 ch4) 0.142,0.491...; line382? input381 ch0? Wait line382 input381: 381//5=76 (row7 col6), ch1? 381%5=1? 76 * 5=380, ch1. So not. Channel0 large maybe at row8 col7/8 only. Also top row? line44 input43 ch3, line49 ch3. Channel0 large maybe not many. Agent position could be near bottom-right? If the agent is typically at bottom-right? That said though, I expect a sufficiently experienced human being armed with a notepad and a pencil could get there with enough effort. It's a cool paper, but some of the wider commentary I've seen around it does not feel justified. I'm not ready to declare that the age of source code is over and our future involves incomprehensible machines editing their own model weights in incomprehensible ways. Tags: machine-learning , ai , generative-ai , local-llms , llms , qwen , paper-review

Kimi K3.1 Pro model weights are out

abrarthought — Thu, 05 Nov 2026 00:00:00 +0000

86% · Usable today 86%, First-party 48%

Article URL: https://huggingface.co/moonshotai/Kimi-K3.1-Pro Comments URL: https://news.ycombinator.com/item?id=50366999 Points: 513 # Comments: 142

A new Go API for JSON

olexsmir — Thu, 05 Nov 2026 00:00:00 +0000

86% · First-party 86%, Usable today 50%

Article URL: https://go.dev/blog/jsonv2 Comments URL: https://news.ycombinator.com/item?id=50369106 Points: 300 # Comments: 137

llama.cpp b12124

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

85% · First-party 85%, Usable today 82%

opencl: support non-contig sigmoid ( #31687 ) Co-authored-by: Li He lih@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63927117 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b12119

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

85% · First-party 85%, Usable today 83%

server : realtime: send an error event instead of crashing on exceptions ( #31632 ) server : realtime: send an error event instead of crashing on exceptions server : route websocket handlers through ex_wrapper, remove the realtime test server : realtime: keep the previous tools when the chat template rejects new ones server : realtime: reject tool schemas the grammar cannot convert, drop ws_ex_wrapper server : realtime: clarify the tool schema check comment Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63794252 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

datasette-agent 0.5a0

Thu, 05 Nov 2026 00:00:00 +0000

85% · First-party 85%, Usable today 73%

Release: datasette-agent 0.5a0 This is a significant release of Datasette Agent . The most notable new feature is called the panel - it lets the agent chat open and then sit next to pages from Datasette, for example a table or query page. When combined with datasette-apps this means you can prompt a database-backed app into existence and then modify it from the chat that sits next to that app. You can try it by signing in with your GitHub account to agent.datasette.io . Tags: projects , datasette , datasette-agent

llama.cpp b12122

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

84% · Usable today 84%, First-party 76%

Title: CUDA: fuse NVFP4 gate/up matmuls and GLU in MMQ ( #31296 ) cuda: fuse NVFP4 gate/up and GLU in MMQ cuda: honor the requested src1 precision in fused gate/up MMQ cuda: share NVFP4 scale checks, skip unused fused FP4 kernels cuda: test NVFP4 fused MMQ at W4A8 without scales and with batches, clean up naming cuda: check gate_scale before loading the fused NVFP4 gate scale Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63914210 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b12125

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

83% · Usable today 83%, First-party 82%

opencl: enable f32 and q5_k multi column GEMV by default for Adreno X2 ( #31694 ) opencl: use the small-N f32 GEMV by default on X2E Assisted-by: Claude Opus 5.5 Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com opencl: use the q5_K multi-column verify GEMV by default on X2E Assisted-by: Claude Opus 5.5 Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Co-authored-by: Li He lih@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63933469 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b12121

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

81% · Usable today 81%, First-party 76%

llama : fix on-device state copy sizes for quantized KV caches ( #30541 ) llama : fix on-device state copy sizes for quantized KV caches The on-device sequence state copies (LLAMA_STATE_SEQ_FLAGS_ON_DEVICE) computed their element count as size / ggml_element_size(). For a quantized type such as q8_0 or q4_0 that is the number of blocks, not elements, so only part of each range was copied: the restored state was wrong, or the copy crashed. Compute the count as size / ggml_type_size() * ggml_blck_size() for the save, the restore and the copy between differently chunked ranges, and assert that each range covers whole blocks. llama : drop the one-line comments llama : drop the redundant cast in the state copy size Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63869663 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b12118

github-actions[bot] — Thu, 05 Nov 2026 00:00:00 +0000

81% · Usable today 81%, First-party 80%

opencl: improve decode perf with FA ( #31633 ) opencl: use more workgroups for q4_K gate up + GLU Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com opencl: handle FA for GQA 2 and 6 with head size 256 Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com opencl: handle FA for GQA 16 with head size of 128, 512 Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com opencl: handle FA for GQA 2 with head size 512 Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Co-authored-by: Li He lih@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63786542 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

datasette-apps 0.3a0

Thu, 05 Nov 2026 00:00:00 +0000

81% · First-party 81%, Usable today 58%

Release: datasette-apps 0.3a0 Datasette Apps adds support for hosting and editing custom HTML applications inside of Datasette. These can be created by hand, but it's easier to create them using LLMs via Datasette Agent . This release improves that integration: Apps can now be tagged in Datasette Agent chat messages by typing # , which autocompletes from the apps the user has permission to view. New app_add_stored_queries() and app_remove_stored_queries() tools let the agent manage which stored queries an app is allowed to call. Granting a write query requires approval from the user first. app_create() now checks that each requested stored query exists and that the user can view it, and asks the user to approve any write queries before the app is created. The "View app" buttons shown by the agent tools, and the links on # app references, now open the app full screen in the Datasette Agent panel. Tags: datasette , datasette-agent , datasette-apps

Progress on provable inference for large language models

ltononro — Thu, 05 Nov 2026 00:00:00 +0000

80% · First-party 80%

Article URL: https://www.anthropic.com/research/provable-inference Comments URL: https://news.ycombinator.com/item?id=50368626 Points: 213 # Comments: 99

llm 0.37.1

Thu, 05 Nov 2026 00:00:00 +0000

80% · Usable today 80%, First-party 78%

Release: llm 0.37.1 A bugfix release for LLM , with contributions from Steven Huang , Tao An , Arjan Mossel , and XQ . Tags: llm

★ SPEEDing up more than just MiniMax-H3 without retraining - now a drop-in KSampler replacement for image, edit and video models (with evidence this time)

/u/antipode_insights — Wed, 04 Nov 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 94%, First-party 36%

A while back I posted V2 of my SPEED nodes for MiniMax-H3, which run the early, noisy part of diffusion at lower resolution and then step back up to full resolution as the detail starts to matter. Well I did a little (lot) more work on it and generalized the implementation. Allowing it to be (theoretically) used by any model running KSampler or SamplerCustomAdvanced (comprehensively tested and benchmarked with H3, MOSS, and Krea 2, works with FIBO 2 and Flux 3) Repo: https://github.com/StanLukuvka/ComfyUI-SPEED-Sampler Also, by popular demand, I added H3 videos as evidence, did a bunch of refactors and a bunch of improvements. And improved the documentation for it in every section. It's now essentially a 1:1 drop-in replacement for the default sampler nodes. What's new: Image models. MOSS Image and Krea 2 are tested, and other flow (CONST) image models should work too. KSampler nodes. Swap your KSampler for SPEED - KSampler and wire it exactly the same. There's also a Manual and a Sigma Harvest version. The H3 nodes stay wired like SamplerCustomAdvanced. Most samplers work now , not just the five from last time. The few that break (mostly on H3) are listed in the repo, along with why. Example workflows for H3, MOSS and Krea 2, already set to harvested values, so you can just load one of the workflows and queue. Tooltips on every input , so you don't have to come and read my README. Numbers (same seed and prompt, native vs SPEED): MiniMax-H3 , 5 s 0.5 MP clip, L40S: 288 s native, 182 s with SPEED (1.58×, 4 stages) MOSS Image , 1344×768, RTX 5070 Laptop: 22 s native, 18 s Automatic (1.26×), 14 s Manual (1.54×) Krea 2 , 1216×832, RTX 5070 Laptop: 283 s native, 215 s Automatic (1.31×), 183 s Manual (1.55×) Comparison GIFs and images for every run are in the repo's Evidence section. Heads-up if you used V2: Old workflows still load. The old node IDs are kept as deprecated nodes, so right-click and swap them for the new ones when you get to it. direct_coarse transition noise is now drawn on the CPU, so the same seed gives the same image on any GPU. As always, run Sigma Harvest once for your own model, sampler and schedule. edit: see evidence of it working with downloadable videos here submitted by /u/antipode_insights to r/StableDiffusion [link] [comments]

★ What Qwen is thinking when it gets stuck saying "Wait"

/u/DeliciousGorilla — Wed, 04 Nov 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 86%

MIT CSAIL had GPT-6 Astra fix Qwen3.5-0.8B's reasoning loops by editing 0.016% of its weights (MATH-500 went from 7.9% to 48.1%). They released the diff, so the edit can be rebuilt exactly and run locally. I took it a step further and had Claude look at Qwen with Anthropic's Jacobian lens. At the token where the model decides to write "Wait" again, the lens reads "Wrong", "Nope" and "Hmm" from about 60% depth on, even though the answer is already written out. At real stopping points it reads "</think>", "Answer" and "Output". With the edit applied, the lens at the same token shows "Verification", "Completion" and "Result" in place of the doubt. The edit converts to GGUF cleanly (the base and edited bf16 files differ only in the two edited tensors) and still holds at Q4_K_M, with 1 loop in 40. I ran the evals in llama.cpp (Vulkan) on a Ryzen AI 9 HX 370 mini PC. Samples are small, but here's the code: https://github.com/alisorcorp/inside-a-reasoning-loop/tree/main/code And data: https://alisorcorp.github.io/inside-a-reasoning-loop/ submitted by /u/DeliciousGorilla to r/LocalLLaMA [link] [comments]

★ Electricity per AI image on an RTX PRO 6000, RTX 5090 Laptop, RTX 5080, RTX 3090 and more: about 3 to 10 cents per 1,000 images (FLUX.2 klein, 1024x1024)

/u/strata2signal — Wed, 04 Nov 2026 00:00:00 +0000

97% · Measured result 97%

What one generated image costs in electricity on each GPU we've measured, at one dated price: 18.31 cents per kWh, the US residential average for July 2026. Power is the board's own reading from each card's driver. The page has two bar charts (cents per 1,000 images and seconds per image) and shows the arithmetic once, so you can redo it at your own rate. FLUX.2 [klein] 4B, 1024x1024, 8 steps, one pinned ComfyUI stack, images drawn back to back for ten minutes. Cents of board electricity per 1,000 images: - RTX 5090 Laptop GPU 24 GB, Dynamic Boost: 3.37 cents (4.48 s per image) - RTX PRO 6000 Blackwell Workstation Edition 96 GB at 300 W: 3.39 cents (2.30 s) - ZOTAC RTX 5080 Solid CORE OC 16 GB at 360 W: 5.04 cents (3.61 s) - EVGA RTX 3090 Ti FTW3 Ultra 24 GB at 350 W: 8.47 cents (4.97 s) - EVGA RTX 3090 XC3 Ultra 24 GB at 350 W: 9.13 cents (5.29 s) - RTX 3080 Ti Founders Edition 12 GB at 350 W: 9.71 cents (5.81 s) Capping the RTX 3090 Ti and the RTX 3090 at 300 W cut the energy per image by about 9 percent, for about 4.5 percent more time per image. What moves the bill: 8 to 32 steps costs 3.5 to 3.9 times as much; 512x512 to 1024x1024 costs 3.0 to 3.3 times; 1024x1024 to 2048x1280 costs 2.7 to 2.9 times. Z-Image-Turbo costs 1.5 to 1.6 times klein, and FLUX.1 [dev] fp8 costs 2.1 to 2.5 times. Cheapest picture we've measured: 0.79 cents per 1,000 (klein, 512x512, 8 steps, the laptop GPU held to 95 W, one image's share of a batch of three). Dearest: about 150 cents per 1,000 (Z-Image-Turbo, 2048x1280, 32 steps, on an RTX 3080 Ti Founders Edition 12 GB with part of the model streamed over PCIe each step). Board vs wall, the one reading we have both ways: a batch of three klein images on an RTX 3090 at 250 W read 1.27 Wh at the card and 1.87 Wh at the wall meter, 1.47 times as much. Caveats: board power, not the wall (except that one reading); cross-card comparisons are "same software, different computer"; every run had ComfyUI's debug log on, so a normal setup should match or beat these figures; no idle cost is billed; and the price is a national average, not anyone's bill. https://research.strata2signal.com/electricity-per-image/ submitted by /u/strata2signal to r/StableDiffusion [link] [comments]

★ [Paper] Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

/u/pmttyji — Wed, 04 Nov 2026 00:00:00 +0000

96% · Measured result 96%, Usable today 72%

TL;DR We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights , well past what we’d expect from humans or conventional algorithms. This might be a big deal for both optimization and interpretability. Just by looking at the raw weights, GPT-6 Astra can tell what a network was trained to do . And without any environment feedback, it has no trouble writing, from scratch, small game-playing networks that outplay networks trained with PPO for 100 million steps. Likewise, asked to make Qwen3.5-0.8B better at math without gradients, Astra identifies an issue in its weights causing reasoning loops that Qwen’s own model card warns about, and fixes this by natively editing 0.016% of the weights . With the same sampling settings, this weight correction raises MATH-500 from 7.9% to 48.1% and generalizes out of the box to instruction following, raising IFEval by 3x . All of this is possible without allowing Astra to write training loops. It uses its reasoning to figure out what each part of a neural network computes, or should compute, and changes the weights accordingly. We call this Weight-Space Programming . Throughout the history of deep learning, we encoded our simplistic inductive biases into tiny symbolic optimizers like Adam or Muon. This is changing: our neural network weights will soon be natively optimized by LLMs that deliberately reason about their weights . Blog Post : https://rikiyat.github.io/blog/weight-space-programming/ GitHub : https://github.com/rikiyat/lm_understand-logs HuggingFace : https://huggingface.co/RikiyaT/Qwen3.5-0.8B-weight-space-programming Demo : https://huggingface.co/spaces/ML-Intern-lab/weight-space-programming-demo What Comes Next? In this blog, we demonstrated the rising capability of LLMs to read and write neural network weights (i.e., the rising concept of Weight-Space Programming). Our current results do show that capabilities are exciting but still limited, specifically due to inefficiencies in context length and harnesses. However, the current signs do show strong potential for a future involving Weight-Space Programming. We believe this marks the beginning of a dramatic shift in fields like mechanistic interpretability and neural network optimization. This opens up radical new possibilities for LLMs to function as a translator between human language and the weight space. Here are some examples: Auditing without evaluation: This may allow us to uncover hidden problems or capabilities without ever running inference or benchmarks. Currently, capabilities and vulnerabilities can only be detected if we have test sets designed for them, or worse, after deployment in the real world. If LLMs can interpret weight space accurately, we could identify such issues directly from the weights (e.g., backdoors). Dramatically reducing optimization cost: Weight-space editing could save immense time and compute. For instance, one-shot model initialization would be far faster and more efficient than curating datasets and running full training loops. Zero-data capability steering and unlearning: Adding or unlearning a capability currently requires extensive data collection and fine-tuning. In the future, we may just prompt “Can you add Capability X to the model?” and the LLM can directly tweak some weights. Because such an edit touches only a few weights (0.016% in Experiment 8), it can leave the rest of the model intact and avoid the catastrophic forgetting that fine-tuning often causes. Recursive self-improvement: Today, recursive self-improvement is often operationalized as a model writing code that launches training jobs. An LLM that can inspect, debug, and improve its own weights, or those of a newer model, offers a richer, more native path to it. True architectural and model merging: Today, merging models relies on averaging weights, which only works for models with identical architectures. An LLM that understands the weight space could instead graft a circuit, such as a reasoning module, from one model into a completely different one, without retraining. We are currently building a benchmark and a harness for LLMs’ capability on Weight-Space Programming. We believe this will provide a standardized evaluation to measure and accelerate progress in Weight-Space Programming, turning what currently seems like black magic into a rigorous, reproducible engineering discipline. submitted by /u/pmttyji to r/LocalLLaMA [link] [comments]

★ I tried MIT's "weight-space programming" on my own use case: Claude rewrote 8 neurons of Gemma 4 12B to change how it translates one Italian tense

/u/FeydRowan — Wed, 04 Nov 2026 00:00:00 +0000

94% · Measured result 94%, Usable today 80%

Yesterday MIT CSAIL showed GPT-6 Astra editing the weights of a small model by hand. It changed a few neurons of Qwen3.5-0.8B, the model stopped looping on math problems, and its scores jumped. No training at all. I wanted to try the same thing on something closer to what I actually do with local models, which is translating into Italian. Gemma 4 has a habit I don't love. For sentences like He had been hiding in the attic for months when the soldiers found him. it writes «Si era nascosto in soffitta per mesi…». That's correct, but I prefer «Si nascondeva in soffitta da mesi…», which says he was still hiding when they came. The catch is that when the period was already over ( he had lived in Paris for ten years, but by 1990 he had moved back ), the original tense has to stay. So it's not "always use tense X", it's "use it only when the meaning calls for it". So I gave Claude Opus 5.5 the same kind of setup MIT used: a Python kernel over Gemma's weights; 50 forward passes to test its ideas on practice sentences; no gradients, no training. It first checked whether Gemma already "knows" the difference between still-going-on and already-over. It does: a linear probe in the middle layers separates them almost perfectly. It just doesn't use that when choosing the verb. Then Claude rewrote 8 MLP neurons into a small switch that fires only in that context and nudges the verb toward the form I prefer. That's 92k out of 11.9B parameters, roughly a 100 KB diff. Results on sentences it never saw The table shows the share still in the old form, then how many control sentences got pushed into a wrong reading, then how many of 200 unrelated translations stayed identical. Method test 1 test 2 (independent) controls broken unrelated unchanged Gemma 4 12B 26 % 32 % — 200 Preference in the system prompt 4 % 2 % 49 82 Classic "difference of means" ablation 49 % 75 % 53 43 LoRA fine-tune on the same data 12 % 23 % 0 120 Claude's hand edit 5 % 16 % 2 182 The prompt applies the preference everywhere, even where it changes the meaning. The ablation recipe breaks the past tenses. The LoRA shifts fewer sentences and touches far more unrelated ones (it's better inside paragraphs, though). The hand edit moves just the verb and leaves almost everything else identical. Fair warning: it's one construction and one model. Two of my three runs succeeded (the third crashed because of my own harness), and the two that worked landed on the same "switch neuron" design independently. Repo with the edits, the code, the agent logs and all baselines: https://github.com/ValerioDolci/frontier-weight-edit submitted by /u/FeydRowan to r/LocalLLaMA [link] [comments]

★ Reshoot 4D: Reshoot Anyone in 4D

/u/itsmetamike — Wed, 04 Nov 2026 00:00:00 +0000

93% · Usable today 93%, Measured result 74%, First-party 34%

Hey guys - made this a few weeks back and just shipped a big update. You take a video of a person, it builds a 4D capture, you fly a new camera through it inside ComfyUI, and you get the same moment back from the new angle. Everything runs locally. Capture: turns a video of one person into a 4D capture: their motion in 3D, the background around them, and where the original camera was and how it moved. Quick mode for fast previews, or a full 4D Gaussian splat if you want a closer look while you direct Virtual Camera: a 4D camera editor that opens right inside the node, so no separate app. Keyframe the camera anywhere on the timeline, look through it or step outside to see the whole scene. Blender-style view gizmo, J/K/L shuttle, frame stepping, multi-select to move or retime keys together Retake: ReDirector re-shoots the whole video along your new path Photoreal Pass: LTX 2.3 renders every final frame, guided by the real footage warped to the new view (Cseti's CrossView-Warp IC-LoRA) Camera settings on every key: aperture, focus (in metres or locked to the subject), vignette, grain. Rack focus and aperture pulls between keys, Alt+click in the viewport to focus on whatever you click. Change those later without re-rendering. The render gets reused, so a focus tweak takes a few minutes instead of the whole pipeline again Zoom through the lens: zoom keys change the lens after the render, which makes dolly zooms work Bring your own camera: import an animated camera from .fbx, .abc or .usd (tested with Blender exports), and it starts on the original camera at roughly real scale, lens and focus included. Files with several cameras work too, and you can export your moves back out Lens looks per shot: distortion, chromatic aberration, bloom, halation, anamorphic bokeh. Depth and subject matte passes if you want to comp afterwards. Finish node: 24 to 60 fps with RIFE, real motion blur from a shutter angle, upscale up to 4K, keeps the original audio A Settings panel at the top of the workflow for the stuff you change between runs (quality, frame rate, upscale) Try the editor in your browser, no install: itsmetamike.github.io/reshoot-4d/demo/ For those enquiring about specs: Tested on one RTX 3090 (24 GB), roughly 30 minutes per shot Stays good within about 30 to 40 degrees of the original camera but am looking to improve this next Fast spins can still smear a face for a few frames Code (AGPL-3.0) and the workflow: github.com/itsmetamike/reshoot-4d Hope it's useful to some of you. Built for the #OpenSourceHiggsfield competition. submitted by /u/itsmetamike to r/StableDiffusion [link] [comments]

★ Skyfall AI demonstrates SKY-001, an engineering world model that reconstructs a Jaguar car with thousands of 3D parts. The company also reports matching GPT-6 Astra's CAD accuracy while running 51× faster and costing 150× less.

/u/141_1337 — Wed, 04 Nov 2026 00:00:00 +0000

91% · Measured result 91%, First-party 51%

submitted by /u/141_1337 to r/singularity [link] [comments]

★ Safari introduces Adaptive Dark Mode in 27.3

paddingtone — Wed, 04 Nov 2026 00:00:00 +0000

90% · First-party 90%, Usable today 33%

Article URL: https://webkit.org/blog/18541/introducing-adaptive-dark-mode/ Comments URL: https://news.ycombinator.com/item?id=50358562 Points: 411 # Comments: 219

★ llama.cpp b12100

github-actions[bot] — Wed, 04 Nov 2026 00:00:00 +0000

90% · First-party 90%, Usable today 83%

common : fix -hf tag matching inside longer quant names ( #31620 ) common : fix -hf tag matching inside longer quant names ":F16" picked a BF16 file when the repo had both, since "BF16" contains "F16". The same applied to ":Q4_XS" vs "IQ4_XS". The tag now has to start at a token boundary in the path. Assisted-by: dsh:llama.cpp/ggml-org/GLM-5.3-Flash-GGUF (Mac Studio, M5 Ultra, 256GB) common : accept underscore as -hf tag boundary Some repos separate the quant with an underscore, e.g. stepfun-ai/Step-3.5-Flash-GGUF-Q4_K_S ships step3p5_flash_Q4_K_S-00001-of-00012.gguf, which :Q4_K_S no longer matched. Add _ to the token boundary and pin the tag and default lookup cases. Co-authored-by: Pascal admin@serveurperso.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63478879 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

idol turbo is out

/u/Illustrious_Row_9971 — Wed, 04 Nov 2026 00:00:00 +0000

89% · Usable today 89%

model: https://huggingface.co/akhaliq/idol-turbo submitted by /u/Illustrious_Row_9971 to r/StableDiffusion [link] [comments]

ollama v0.40.15

github-actions[bot] — Wed, 04 Nov 2026 00:00:00 +0000

89% · First-party 89%, Usable today 77%

What's Changed mlx: load bundled CUDA libraries in-process on Linux by @dhiltgen in #19433 model: add MiMo V2.6 model support by @dhiltgen in #19400 Full Changelog : v0.40.14...v0.40.15-rc0

Patch release v5.20.2

Cyrilvallez — Wed, 04 Nov 2026 00:00:00 +0000

89% · First-party 89%, Usable today 72%

Patch release: v5.20.2 This patch notably solves an issue where some inputs could loose their original type inside prepare_inputs_for_generation in generate , leading to problems with multimodal models. It also fixes some other issues listed on the below commits. It contains the following commits: Fix inputs dict casting in generate ( #49731 ) by @Cyrilvallez Fix zero expert gradients in bfloat16 with expert parallelism and ep_size < fsdp_size ( #49688 ) by @qgallouedec Declare the input modalities of the VLMs that report text only ( #49677 ) by @qgallouedec Avoid a host-to-device copy in eager_mask ( #49684 ) by @hmellor

ollama v0.40.14-rc0

ParthSareen — Wed, 04 Nov 2026 00:00:00 +0000

88% · First-party 88%, Usable today 42%

server: decode cloud web search responses ( #19476 )

llama.cpp b12098

github-actions[bot] — Wed, 04 Nov 2026 00:00:00 +0000

88% · First-party 88%, Usable today 84%

mtmd: accurate support for qwen3-vl video prompt format ( #31619 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63416358 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Xiaomi's humanoid robots spotted doing their first 8-hour shift sorting EV parts at a rate of ~ 1 per minute

/u/Distinct-Question-16 — Wed, 04 Nov 2026 00:00:00 +0000

86% · Measured result 86%

submitted by /u/Distinct-Question-16 to r/singularity [link] [comments]

Stringman, an $800 open-source room scale gripper robot

nharada — Wed, 04 Nov 2026 00:00:00 +0000

86% · Measured result 86%, Usable today 75%, First-party 34%

Article URL: https://neufangled.com/ Comments URL: https://news.ycombinator.com/item?id=50354358 Points: 552 # Comments: 188

llama.cpp b12099

github-actions[bot] — Wed, 04 Nov 2026 00:00:00 +0000

86% · Usable today 86%, First-party 83%

hexagon: add LIGHTNING_INDEXER support ( #31289 ) hexagon: initial support for LIGHTNING_INDEXER op hex-lght-idxr: hmx for prefill hex-lght-idxr: q8_0 decode gather transpose, two-block decode compute hex-lght-idxr: pipelined hmx path for decode and prefill hex-lid: add support for K (f32) hex-lid: add support for K (f32) hex-lid: add support for q4_0 hex-lid: remove scalar VTCM reads in the HMX q4_0 K prep and remove vector spills hex-lid: host/kernel kparams alighnment and remove sw devices in kernel hex-lit: update dma pipeline to use canonical dbl buffering in all paths hex-lit: add GGML_HEXAGON_LI_SELECT to force hmx/hvx paths hex-lit: add support for dims collapse hex-lit: make kparams constistent with other ops Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63443132 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

I gave Claude ~700 ransomware encrypted files. It told me upfront it couldn't decrypt them, then got two thirds of them usable again

/u/Rare-Protection4270 — Wed, 04 Nov 2026 00:00:00 +0000

84% · Measured result 84%

The most interesting thing I've done with Claude, so sharing how it went. Background: ransomware encrypted my files back in 2019. I kept them for seven years, hoping something would eventually be able to open them. What stood out about how it worked: - It was honest from the start. The first answer was: no decryption, per-file AES keys under RSA, forget it. Then it looked for another way in. - Found the weak spot itself. It compared the encrypted files with a few unencrypted copies I had and saw that only the first 16 KB of each file is encrypted. - Built a real tool, not a one-off script. A module per format (JPEG, PNG, PSD, Excel, PDF, MP4...), re-run over all the files after each improvement. The last round alone brought back about 100 more files. - Decided on its own to train a model. The web pictures came back without light and color, and it concluded better formulas wouldn't fix that. So it trained a U-Net on my RTX 4070, using intact photos damaged the same way. Color errors dropped by more than half. - It wrote its own SketchUp reader. Using openskp's format notes as a reference, it wrote a parser from scratch, decoded three undocumented record types from the bytes, and got the whole 239 MB model out as format I imported into Blender. - Checked its own work. It scripted the whole Blender scene for me and fixed what I pointed out. Left: original SketchUp render. Right: Blender, rebuilt from encrypted model. Results: 26% fully restored, 27% open with some damage, 12% content saved into new files, 35% lost. I also tried GPT-6.1 Astra on the same files. It recovered some, but fell behind after the first session. [How I worked: Claude Code in VS Code, Opus 5.5, about 1 week of sessions] Full write-up with before/after pictures: https://medium.com/@weaxdesign/ai-unlocked-my-ransomware-encrypted-files-without-the-key-262212277514?sk=c58cddebd2f5a6aee8524f900f29488c submitted by /u/Rare-Protection4270 to r/ClaudeAI [link] [comments]

Introducing Trillium Labs

Nathan Lambert — Wed, 04 Nov 2026 00:00:00 +0000

84% · First-party 84%

Today we're unveiling Trillium Labs, a new non-profit to foster the open science of frontier AI. We're building open post-training recipes and will expand into open infra to study RSI, reward-hacking, multi-agent systems, and whatever comes next. blog.trilliumlabs.org/p/introducin... Linked page: Fostering the open science of frontier AI.

llama.cpp b12097

github-actions[bot] — Wed, 04 Nov 2026 00:00:00 +0000

84% · First-party 84%, Usable today 83%

model, mtmd: add chatterbox TTS support ( #30993 ) add chatterbox TTS support Co-authored-by: Pascal admin@serveurperso.com add built-in voice support rm redundant code clean up clean up 2 Apply batched suggestions from code review Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co improve Co-authored-by: Pascal admin@serveurperso.com Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63411937 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b12096

github-actions[bot] — Wed, 04 Nov 2026 00:00:00 +0000

84% · First-party 84%, Usable today 81%

hexagon: add TOP_K_MASK op ( #31552 ) hexagon: add TOP_K_MASK op Simplify Hexagon TOP_K_MASK kernel and do not duplicate host configuration Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63407530 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

You Can Now Run A 2.78-Trillion Parameter Kimi K3 Model With Just 8GB of RAM! | Kimi-k3-in-c is an open-source engine that runs the full Kimi K3 model on a single CPU.

/u/Lord_44th__Raikage — Wed, 04 Nov 2026 00:00:00 +0000

83% · Usable today 83%, Measured result 56%

What you get: The full 2.78T Kimi K3, not a cut-down version Runs in 8.24GB of RAM with no GPU The whole engine is a 176KB C file, with no PyTorch or CUDA The same output as a 128GB machine, only slower Chat mode, and it builds on Linux, macOS and Windows How to get it: Clone https://github.com/FareedKhan-dev/kimi-k3-in-c Run make, then ./scripts/k3-doctor.sh to check your machine Download the checkpoint and pick a preset that fits your RAM It's slow and needs a big SSD, but a trillion parameter model on 8GB of RAM is wild. Pic Explaining What Tokens Per Second You Can Expect: https://freeimage.host/i/nPRqmrB submitted by /u/Lord_44th__Raikage to r/accelerate [link] [comments]

Q&A with Simile CEO Joon Sung Park on claims that its digital twins predict human behavior with 85%+ accuracy, its goal of simulating all 8B people, and more (Mario Gabriele/The Generalist)

Wed, 04 Nov 2026 00:00:00 +0000

82% · Measured result 82%

Mario Gabriele / The Generalist : Q&A with Simile CEO Joon Sung Park on claims that its digital twins predict human behavior with 85%+ accuracy, its goal of simulating all 8B people, and more — Inside Simile with Joon Sung Park. … Before Joon Sung Park and I had ever met, he simulated the conversation.

Google will turn off search for schools that reject AI

ceejayoz — Wed, 04 Nov 2026 00:00:00 +0000

81% · First-party 81%

https://archive.ph/RuwsB https://blog.google/products-and-platforms/products/educatio... Comments URL: https://news.ycombinator.com/item?id=50353192 Points: 608 # Comments: 429

vllm v0.32.1rc0

aoshen02 — Wed, 04 Nov 2026 00:00:00 +0000

81% · First-party 81%, Usable today 52%

[Doc][RL] Document the weight-transfer HTTP protocol for trainers wit…

llama.cpp b12094

github-actions[bot] — Wed, 04 Nov 2026 00:00:00 +0000

81% · Usable today 81%, First-party 71%

hexagon: faster TOP_K for the backend sampler ( #31279 ) hexagon: faster TOP_K for the backend sampler (skip tiles, then block scan) Skip the bitonic sort for tiles whose max cannot reach the running k-th best value, then replace the tile sort with top_k_scan(): reject 256-float blocks with one HVX max-reduce and insert only surviving elements into a sorted k-entry list. Used for k in 2..64 and rows wider than 1024, in both the single-row and multi-row paths. Ties keep the first-seen index. NaN is treated as -INF. hex-top-k: eliminate scalar reads from vtcm Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/63400302 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

PaliGemma 2 Mix - New Instruction Vision Language Models by Google

Wed, 04 Nov 2026 00:00:00 +0000

80% · First-party 80%, Usable today 53%

★ [Release] ISTA DeepSeek-V4.1-Flash-1017 GSQ-RCO Coder: a 763B model at 1 bit per parameter

/u/Loginhe — Tue, 03 Nov 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 94%, First-party 92%

We have released a Coder build of DeepSeek-V4.1-Flash-1017, compressed with GSQ and RCO, in which half of the model's routed experts have been removed. DeepSeek-V4.1-Flash-1017 is a sparse mixture-of-experts model: 384 routed experts per layer, of which 6 are active per token, 763.2B parameters, 551.9B of them in the transformer. What's inside One expert-pruned GGUF: 192 of 384 experts kept in every layer, 72.1 GB of transformer weights, against 138.2 GB for our unpruned IQ2_XXS build. 1 bit per parameter, counted against the original model: 72.12 GB divided by the original 551.9B transformer parameters gives 1.05 bits, which we round to 1. The removed experts count as zero bits. No individual weight is stored below 1 bit: the 280.1B parameters the Coder keeps average 2.06 bits. The shared Engram file (110.6 GB) and vision projector are the same files as in the unpruned release, so they need to be downloaded only once. GSQ (Gumbel-Softmax Quantization): post-training scalar quantization that jointly learns grid assignments and group scales, closing most of the gap between scalar and vector quantization at low bit-widths while remaining deployable in standard GGUF types. RCO (Riemannian Constrained Optimization): enforces exact budgets by gradient descent on the task loss, without per-constraint tuning. Here it selects which experts to keep, optimising the KL divergence to the unpruned model, under one exact budget per layer. Why one budget per layer GGUF stores a single expert count for the whole model, so every layer must keep exactly the same number of experts; uneven layers would need padding that gives back the memory pruning saved. RCO treats each layer's budget as a hard constraint and holds all of them exactly at every optimisation step, while the layers are still optimised jointly through one loss on the full model. A penalty formulation would only meet the budgets approximately and would need one tuned coefficient per layer. Results LiveCodeBench v6: 88.57 against 89.71 for the base model, retaining 98.7% SWE-bench Verified: 77.00 against 81.20, retaining 94.8% SWE-bench Verified runs long agentic trajectories over real repositories, and tolerates the capacity reduction less well than single-problem code generation, as expected when errors accumulate across turns. Real-world examples, each a single HTML file written by the Coder: an animated SVG of a pelican riding a bicycle, a three.js voxel pagoda garden, and a playable first-person voxel sandbox. For full post incl. videos see: https://x.com/mhelcig/status/2117257900863156518 Links Coder (expert-pruned): https://huggingface.co/ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF Quantized models (unpruned): https://huggingface.co/ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF GSQ: paper https://arxiv.org/abs/2604.18556 | code https://github.com/IST-DASLab/GSQ RCO: paper https://arxiv.org/abs/2605.00649 | code https://github.com/IST-DASLab/RCO The repository ships the complete per-tensor RCO allocation. The GGUF runs in llama.cpp b11870 or newer and in Strata. The Coder build is an experimental release and feedback is welcome, particularly on capabilities that were not represented in the calibration mixture. Requests for models to quantize or prune are also welcome. From the ISTA Deep Algorithms and Systems Lab. submitted by /u/Loginhe to r/LocalLLaMA [link] [comments]

★ Not another tok/s post: local quants vs Claude on 9 real bugs

/u/FeydRowan — Tue, 03 Nov 2026 00:00:00 +0000

98% · Measured result 98%

There's a lot of talk here about not chasing tok/s by lobotomizing the model, and most of what I post is still speed numbers. So this is the other half: what the models I run at home actually get done on my own work, with Claude models added as fixed reference points. Everything local runs on my own engine (capy-flash) on 2x RTX 5070 Ti 16 GB, Ryzen 9900X, 96 GB DDR5. No expert skipping for flash next. The tasks I took 9 real regressions from the private history of that engine (C++/CUDA). For each one I checked out the code right before the fix and wrote the bug report the way I'd file it to myself: symptom, numbers, logs, no hint about where to look. Performance cliffs, numeric drift, a bug that only shows up on WSL2 with two GPUs. None of it has ever been public. The agent has to find the cause and write a patch. It runs sandboxed on a Mac with no network and no CUDA toolchain, so it can't build or run anything and has to reason from the code. 80 steps max, 3 runs per task per model. Claude models run in Claude Code, local models in OpenCode. I tried the local models in Claude Code through a bridge first and they did much worse there, so each side gets the harness it works best in. Scoring Every patch is scored twice: automatically, against a hidden key built from the real fix: right files and functions, patch precision, a few checks on the code; by Claude Opus 5 as a blind judge. It sees the bug report, the code, the real fix labelled as "one valid solution, not the only one" and the compiler output, and gives 1 / 0.75 / 0.5 / 0.25 / 0. A patch that doesn't compile is capped at 0.25 in both. The two scores correlate at r = 0.79 per patch and put the models in the same order. The judge is a bit stricter than the key, and it isn't kinder to Claude: judge minus auto score is negative for every Claude model and around zero for the Qwen ones. Turning a real bug into a task with a fair key is slow, and one model over 9 tasks x 3 runs takes 4 to 8 hours on my box. So 9 tasks is what I have, and the confidence intervals are wide, about ±0.2. The tiers hold. Two models less than ~0.1 apart are a coin flip. Results Judge score 0-1, tokens include reasoning. CIs and the auto score are in the image. Model Where Score Tokens/task Min/task Claude Opus 5.5 API 0.74 16k 3 Claude Sonnet 5.5 API 0.58 8k 1 Qwen3.8-Flash-Next NVFP4 local 0.50 53k 10 Qwen3.8-Flash-Next 3-bit local 0.48 53k 9 Claude Haiku 5.5 API 0.47 45k 4 Qwen3.8-27B 3-bit local 0.39 111k 18 Qwen3.8-27B NVFP4 local 0.34 81k 13 Claude Sonnet 5 API 0.28 43k 8 Claude Sonnet 4.5 API 0.19 15k 6 Claude Haiku 4.5 API 0.13 23k 4 Gemma 4 26B-A4B (thinking) local 0.07 33k 5 What 3 bits did This is the part that matters for the tok/s argument. Same models, NVFP4 vs 3-bit, paired on the same tasks. Flash-Next (3 bits on the experts only): score -0.02, tokens x1.03. As far as 9 tasks can tell, it's free. 27B: score +0.05, inside the noise. But it generates 40 % more tokens per task (x1.40, CI 1.25-1.59). The 3-bit 27B decodes faster on my engine, 153 vs 132 tok/s, and still needed 18 minutes per task instead of 13. Part of that gap was a slow 3-bit prefill path I've fixed since; a rerun on the newer build still came out at x1.30 tokens. So the damage from quantization didn't show up as a lower score. It showed up as the model thinking longer to get to the same place. Looking only at tok/s, the 3-bit 27B is the better deal. Per bug fixed, it isn't. Non-compiling patches don't tell a clear story: Flash-Next 5/27 at 3-bit vs 1/27, the 27B 2/27 vs 4/27. The rest Flash-Next at home sits with Haiku 5.5 and above the older Sonnets. Sonnet 5.5 is a step up, Opus 5.5 is ahead of everything. Tokens per task say as much as the score. Sonnet 5.5 gets further with 8k tokens than Flash-Next with 53k, which is 10 minutes per bug on my box against a minute and a half. The dense 27B is behind the MoE (Flash-Next +0.16 paired, P = 0.92) and burns more tokens getting there. Gemma 4 26B didn't work as an agent here. With thinking off it never edited a file in 9 tasks. With thinking on it edits, mostly wrong. Limits 9 tasks from one codebase in one domain (GPU inference), bug reports written in Italian. This is how models do on my work, not a general ranking. Different harnesses for Claude and for the local models. The judge is a Claude model. The automatic score is there to check it and they agree, but it's still a limit. No builds or tests, so this measures diagnosis and patching from reading code, not the full edit-build-test loop. I'm not publishing the tasks, they'd stop being useful. If you've checked your own quants on real work instead of perplexity or KL, I'd like to know whether you see the same pattern: same score, longer thinking. submitted by /u/FeydRowan to r/LocalLLaMA [link] [comments]

★ Running UNCENSORED DeepSeek-V4.1-Flash-1017 on a 12 Gb VRAM

/u/gladkos — Tue, 03 Nov 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 92%, First-party 81%

Measured, refusals 85%→0% even in thinking, 3 sizes 12 GB GPU VRAM, 64GB RAM + SSD via Strata Engine We took ISTA-DASLab's GSQ-RCO quants of DeepSeek-V4.1-Flash-1017 (the ones people run in Strata with a 12 GB GPU and the Engram table on SSD) and removed the refusals. We only touched 82 dense tensors per file: attention output, shared expert down proj and the Engram value proj. The 384 routed experts are byte for byte the same as ISTA's, so their GSQ rounding is kept. Headers and file sizes match too, so you just swap the shards and keep using ISTA's Engram file. Refusals are on JailbreakBench, stock rung -> ours, same Strata setup: Rung Size (+110 GB Engram) Refusals Refusals in thinking (of 30) MMLU-500 KL vs stock IQ1_M 121 GB 88.9% -> 0% 27 -> 1 80.6% 0.021 IQ2_XXS 138 GB 85.2% -> 0% 27 -> 0 82.8% 0.023 IQ2_XS 155 GB 86.4% -> 0% 27 -> 2 81.6% 0.027 We also ran GPQA-Diamond and AIME25 on IQ2_XXS against stock to make sure it didn't get dumber. GPQA came out 83.3% vs 83.3%, AIME 80.0% vs 76.7% (only 30 problems, so call it the same). Things to know: IQ2_XS still refuses inside its thinking on 2 of 30 prompts. The other two are at 0 and 1, so I'd grab IQ2_XXS. We tested at 8K context on a rented GPU. Haven't checked long context or speed on a 12 GB card ourselves, so if you try it please post your tok/s and RAM. Strata only for now. If you're on llama.cpp, our older release with the same edit works there: https://huggingface.co/AtomicChat/DeepSeek-V4.1-Flash-1017-Uncensored-GGUF Model: https://huggingface.co/AtomicChat/DeepSeek-V4.1-Flash-1017-Uncensored-GSQ-RCO-GGUF All the measurements: https://huggingface.co/datasets/AtomicChat/DeepSeek-V4.1-Flash-1017-Uncensored-GGUF-metrics Strata Engine: https://github.com/niko1221/strata Model page: https://atomic.chat/models/deepseek-v4-flash-0731 Thanks to DeepSeek for the base model (MIT), ISTA-DASLab for GSQ-RCO and the Engram file, and the Strata dev for the engine. I'm on the Atomic.Chat Local Ai team that made this. submitted by /u/gladkos to r/LocalLLaMA [link] [comments]

★ Unsloth vs GSQ-RCO - 512K context DeepSeek-V4.1 GGUF benchmarks Terminal Bench

/u/danielhanchen — Tue, 03 Nov 2026 00:00:00 +0000

97% · Measured result 97%, First-party 91%, Usable today 68%

We ran DeepSWE, Terminal Bench, Automation Bench, HLE, SciCode at 512K context on our DeepSeek UD version 3.1 GGUFs and show we're >10-20% better than GSQ-RCO We ran all other benchmarks (14 in total) to 128K. AIME2025 64x, DeepSWE/TB 3x. We addressed some issues people mentioned with these new benchmarks: 32K context was too short - we did 512K context for agentic + 128K for general tasks Saturated benchmarks - new unsaturated agentic style ones including Terminal Bench, DeepSWE and Automation Bench Benchmarks are noisy - we did 35.1B tokens of benchmarking vs 1.3B before so 27x more data . See this section where we did 64x AIME 2025 runs, 3x DeepSWE, 3x TB runs and more. Our graders are wrong - we used Math Verify , improved graders, used gpt-6-luna xhigh for HLE, and all official graders for Terminal Bench (Harbor), DeepSWE and the rest. See graders and infra fixes For DeepSWE v1.1, we used mini-swe-agent and chose 500 max steps (334 steps was the max runs we saw, so none went over). Terminal Bench 2.1 used mini-swe-agent as well, and we set max steps to 150 with no max limit. We had to exclude 7/89 tasks since they couldn't pass on our infra - see https://unsloth.ai/docs/models/deepseek-v4.1-flash#excluded-terminal-bench-tasks-due-to-issues We also re-checked ISTA's numbers as we have done many more runs (27x more data). GSQ-RCO IQ1_M claims 98.7% recovery, but we measured 97.24 [96.23, 98.21] with a p-value of 0.0013. GSQ-RCO IQ2_XS retaining 100% claimed recovery is possible with a p-value of 0.21. We measured 98.38% [97.52, 99.22]. So this is possible. GSQ-RCO IQ2_XXS claims 99.80% recovery but we measured 98.38 [97.52, 99.22] with a p-value of 0.0001. So this is nearly impossible. Paired difference to the official base (our runs, same questions, sign-flip permutation test, two-sided): AIME25 GPQA-D LCB v6 GSQ-RCO IQ1_M -1.61 ( p=0.02 ) -2.89 ( p=0.004 ) -3.24 ( p=0.00002 ) GSQ-RCO IQ2_XXS -0.47 (p=0.25) -2.07 ( p=0.02 ) -2.00 ( p=0.01 ) GSQ-RCO IQ2_XS -0.42 (p=0.48) -0.51 (p=0.42) -0.38 (p=0.52) The claimed recovery tested directly against our measurement (the card's definition: sum of the 3 scores / the base's sum, vs official FP8/FP4): p (no loss) = paired sign-flip permutation test of recovery = 100%; p (recovery >= claim) = one-sided paired bootstrap over questions. Claimed recovery Measured recovery [95% CI] p (no loss) p (recovery >= claim) GSQ-RCO IQ1_M 98.70 97.24 [96.23, 98.21] 0.00002 0.0013 GSQ-RCO IQ2_XXS 100.00 98.38 [97.52, 99.22] 0.0003 0.0001 GSQ-RCO IQ2_XS 99.80 99.54 [98.88, 100.18] 0.16 0.21 If we can get more details on how the benchmarks were run from GSQ-RCO, we are more than happy to run more. We provided all our setups and methods in our blog at https://unsloth.ai/docs/models/deepseek-v4.1-flash#dynamic-v3.1-update-november-2nd-2026 All details and data and methods at https://unsloth.ai/docs/models/deepseek-v4.1-flash#dynamic-v3.1-update-november-2nd-2026 . Our new Unsloth Dynamic 3.1 GGUFs for DeepSeek are at https://huggingface.co/unsloth/DeepSeek-V4.1-Flash-1017-GGUF submitted by /u/danielhanchen to r/LocalLLaMA [link] [comments]

★ Rtx 8000 48gb prices have decreased over the last two years while 3090 doubled.

/u/triynizzles1 — Tue, 03 Nov 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 75%

In 2024 i purchased an RTX 8000 48gb for $2400. As the market has changed I’ve kept an eye on prices. Two years later, they are available around $2100. Its a little slower than 3090 at inference (672gb/s vs 936gb/s) but it has double the memory so it can run larger models / contexts / higher quants. Rtx 8000 also wins on power, 265w vs 700w (2x 3090 to match 48gb) In 2024 two 3090s would cost around $1600-1800 now a single 3090 is in the $1500-$1600 range, making rtx 8000 cheaper per gb. Prices for strix halo and dgx spark have also gone way up. Rtx pro 6000 has double the memory but 8x the cost. In the last two years, I haven’t had any issues with drivers, compatibility software or anything. I can run all “local” tier models entirely in vram, usually at 256k tokens and sometimes at q6 (Qwen 3.8 27b, llama 3 70b, QWQ,). Larger moe models run great too with layers offloaded to system ram like gpt oss 120b and now with strata, QFN runs q4_xs @ 390k context at 850t/s prompt processing and 60-70t/s token generation. (64gb ddr4 system memory, i9 9900k cpu) $2100 for a gpu is not cheap but might be the best “do everything” option right now for home-lab setups. Cheaper than dual 3090, Strix halo, dgx spart, m5 max too. Fascinating to see prices decline as the market as a whole has more than doubled. submitted by /u/triynizzles1 to r/LocalLLaMA [link] [comments]

★ vllm v0.32.0

khluu — Tue, 03 Nov 2026 00:00:00 +0000

96% · Measured result 96%, First-party 95%, Usable today 91%

v0.32.0 Highlights This release features 814 commits from 363 contributors (121 new)! Structured decisions and generic parsers : the new POST /v1/systemone endpoint answers choice , noul and score questions over a structured state ( #59299 ), is served by default ( #60677 , #60696 ), and also runs on Cloudflare/clef-omni ( #61064 ), LiquidAI/d1-3B ( #60676 ) and DiffusionGemma ( #60466 ). The new hf tool and reasoning parser ( --tool-call-parser hf , --reasoning-parser hf ) reads the checkpoint's response_template , so models that ship it need no model-specific parser ( #58604 , #58602 ), in both the Python and Rust frontends ( #59005 ). Low-precision KV cache everywhere : NVFP4 KV cache now runs on SM8x and SM12x ( #46963 ), SM90 ( #60620 ) and with XQA decode on SM12x ( #60452 ), and on MiniMax-M3 sparse attention on SM100 ( #59300 ); GLM-5.x defaults to an FP8 KV cache on SM100, halving KV memory per rank with 2.3-5.5% more throughput at a 7-11% TTFT cost in the PR's benchmark ( #60140 , #60281 ); fp8_ds_mla on SM90 gives GLM-5.3-Flash up to 31% more output throughput ( #59246 ); ROCm gains the 4-bit ultraquant_4bit KV cache with about 2x the density of FP8 ( #57057 ). Model Runner V2 : a GPU n-gram speculator with variable-length drafts ( #40704 ), Elastic EP ( #53934 ), pipeline parallelism with prefill context parallelism for MLA models ( #59139 ), a stock torch.compile mode ( #59079 ), and MRV2 is now the default on ROCm with the model-specific MRV1 exceptions removed ( #56360 ). Faster startup and serving : vllm download-kernels installs FlashInfer's precompiled kernels ( #58765 ); vllm preload --preload-autotune keeps the FlashInfer autotune table warm across restarts ( #60085 ); a shared-memory tensor arena broadcasts large multimodal tensors to workers with one copy ( #51207 ); tokenizers and processors load from the local snapshot ( #60825 ); and with --api-server-count above 1 each connection goes to the least-loaded API worker, for 43-85% more req/s on short requests (Qwen3-0.6B, 32 input / 1 output tokens) in the PR's benchmark ( #60723 ). Model support : new EmbeddingGemma 2 omni-modal embeddings ( #60254 ), MiniCPM-V 4.7 ( #58674 ) and Nemotron 3.5 ASR ( #59827 ); video input in the Transformers modeling backend ( #57441 ); GLM-5.3 sparse MLA index conversions reused across layers (3.5-3.9x on that kernel, #59464 ) and fused multi-step draft decode (13.3% at concurrency 1, #57443 ); HiSparse per-request residency caching for up to 58% more throughput on GLM-5.3-NVFP4 on B200 with long, fully GPU-resident contexts at high concurrency ( #60083 ). Security : fixes for GHSA-4hhp-h66f-j5j7 (chat template resource exhaustion, #50300 ), GHSA-q97c-p368-75c4 (tokenizer max_token_id , #59491 ) and GHSA-frvg-qw88-hww9 (P2P ZMQ socket exhaustion, #51504 ); CORS no longer allows every origin by default ( #61009 ); untrusted images are limited to raster formats ( #60022 ); shared-memory multimodal cache handles are signed ( #59357 ); and JSON schemas nested deeper than 64 levels are rejected ( #60036 ). Breaking changes : Python 3.10 dropped ( #60402 ); default CORS origins restricted ( #61009 ); transformers>=5.16.1,<5.20.0 and tokenizers>=0.23.2 ( #57387 , #59796 ); torch.compile sequence parallelism and AsyncTP passes removed ( #60517 ); cascade attention removed ( #61126 ); mamba_cache_mode="all" removed ( #58997 ); max_tokens no longer reserved from the context window ( #57035 ); Responses API reasoning stream events renamed ( #59652 ). Release Artifacts Python Wheels Platform Install PyPI (CUDA 13.0) pip install vllm PyPI (CUDA 13.0, uv) uv pip install vllm --torch-backend=auto ROCm pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/0.32.0/rocm723 XPU uv pip install vllm --extra-index-url https://wheels.vllm.ai/0.32.0/xpu --extra-index-url https://download.pytorch.org/whl/xpu --index-strategy unsafe-best-match Docker Images Platform Docker Image CUDA 13.0 (Default) docker pull vllm/vllm-openai:v0.32.0 CUDA 12.9 docker pull vllm/vllm-openai:v0.32.0-cu129 CUDA 13.0 + Ubuntu 24.04 docker pull vllm/vllm-openai:v0.32.0-ubuntu2404 CUDA 12.9 + Ubuntu 24.04 docker pull vllm/vllm-openai:v0.32.0-cu129-ubuntu2404 ROCm docker pull vllm/vllm-openai-rocm:v0.32.0 CPU docker pull vllm/vllm-openai-cpu:v0.32.0 XPU docker pull vllm/vllm-openai-xpu:v0.32.0 Other Artifacts Pre-built release artifacts are available in the Assets section at the bottom of this page, including: Source distribution tarball CUDA 12.9 Python wheels for x86_64 and arm64 CUDA 13.0 Python wheels for x86_64 and arm64 CPU Python wheels for x86_64, arm64, and macOS XPU Python wheel for x86_64 Model Support New models : EmbeddingGemma 2 ( google/embeddinggemma-2 ), an omni-modal text/image/audio/video embedding model, with unused modality encoders skipped through --limit-mm-per-prompt ( #60254 , #60289 ); MiniCPM-V 4.7 ( #58674 ); Nemotron 3.5 ASR ( nvidia/nemotron-3.5-asr-streaming-0.6b ) complete-audio transcription; native realtime streaming is not yet supported ( #59827 ); Cloudflare/clef-omni ( #61064 ) and LiquidAI/d1-3B ( #60676 ) on /v1/systemone ; PLaMo 3 reasoning and tool parsers ( #56575 ); and the zerank-2 reranker score template ( #60415 ). Transformers modeling backend : video inputs ( #57441 ), and Glm, Arcee, CWM, Mellum ( #59679 ), GPT-NeoX, Phi, Seed-OSS and Jais2 ( #59701 ) now served through it. New model capabilities : LoRA for BERT, RoBERTa and XLM-RoBERTa embedding models ( #61033 ); Granite as an EAGLE3/DFlash target ( #60855 ); Qwen3-ASR EAGLE3 ( #52824 ); Sarvam MLA EAGLE3/DSpark with PP ( #55902 ); GLM-5.3-Flash with the DFlash2 drafter ( #56983 ); and MiniMax-M3 EAGLE3 at PP > 1 on MRV2 ( #57197 ) with MTP sharing target embeddings under PP ( #58648 ). GLM-5.3 and GLM-5.3-Flash : sparse MLA index conversion reused across layers ( #59464 ), fused multi-step draft decode ( #57443 ), FP8 KV cache default on SM100 ( #60140 , #60281 ), fp8_ds_mla on SM90 ( #59246 ), qlnorm skipped for MHA (4.4-7.7% TTFT, #58845 ), long-context indexer prefill sharded across TP (up to 25% lower TTFT at 1M context, #54951 ), DCP for the kpool indexer ( #59211 , #60032 ), KDA prefill checkpoints with FlashKDA ( #56960 ), FP8 KV on SM90 sparse MLA ( #55222 ), --mamba-ssm-cache-dtype honored for KDA state ( #59147 ), a generic packed KV layout ( #57169 ), MTP index sharing restored ( #61079 ), and fixes for vision-tower crashes ( #59126 ), non-square image encoder budgets ( #59565 ), DP startup ( #56974 ), video timestamps ( #55647 ), DFlash2/EAGLE3 aux hidden states ( #60763 ) and null-block writes ( #59528 ). DeepSeek-V4 and V4.1 : decoder-side SWA bounded replay ( #58132 ) with replay layers in CUDA graphs and trimmed in PIECEWISE graphs ( compilation_config.decoder_replay_trim_threshold , #59532 ) plus last KV-source layer trimming (+3.6%, #59894 ), packed FP8 Engram exchange across DP ( #59923 ), faster CPU-offloaded Engram lookups ( #59327 ), fused DeepSeek V4 + MTP drafting ( #58463 ), encoder CUDA graph packing for V4.1 and Kimi-K3 (11% lower mean TTFT, #58925 ), EPLB for DSpark drafts ( #57549 ), and fixes for NVFP4 checkpoints with 0% draft acceptance ( #59655 ), MegaMoE shared-expert finalize ordering ( #59927 ), worst-case vision dummy inputs ( #57898 , #59271 ), compressor ring null-block writes ( #58560 ), Triton 3.9 indexer quantization ( #60716 ) and decoder-replay CUDA graphs with FlashInfer EP MoE backends ( #61041 ). Qwen : Qwen3.8-Flash-Next (Qwen4Exp) merged QSA projections in one GEMM (1.45-1.68x, #59533 ), fused QSA pre-indexer ( #57097 ), sequence parallelism through --enable-hc-sp ( #56322 ), SM100 low-latency decode GEMM plans (up to 2.7x vs cuBLAS on small-M, #59214 ), --kv-cache-dtype-skip-layers honored ( #60023 ), and PLE loading for INC ( #59990 ), Quark ( #59443 ) and pre-SM89 GPUs ( #60142 ); Qwen3-VL/Qwen3.5/Qwen3.8 M-RoPE cache 4x smaller and Qwen3.5 YaRN matching Transformers ( #59853 ); Qwen3-Omni M-RoPE fixes ( #58890 , #59842 ); Qwen3-ASR on the upstream processor ( #57146 ); Qwen3-VL unknown video fps ( #60501 ) and per-video options with the multimodal cache ( #55203 ). Kimi-K3 and MiniMax-M3 : Kimi-K3 FlashInfer fused speculative KDA on SM100 ( #54255 ), fused vision processor (10-20x preprocessing at 1080p-8K, #59278 ), fused K/V pack on the DCP prefill path ( #56881 ), and DSpark KV cache back to 4 groups ( #59733 ); MiniMax-M3 MSA prefill with an E4M3 query (26-37% faster with FP8 KV, #60684 ), FP8 indexer cache on non-SM100 GPUs ( #59081 ), Triton indexer tuning ( #56151 , #59481 ), and indexer score fixes ( #60194 , #54597 ). Multimodal : device-side input normalization for Qwen3-VL/Qwen3.5/Qwen4Exp ( #51289 ), GLM-V and GLM-OCR ( #55389 ), Llama Nemotron VL ( #57928 ) and Kimi K2.5/K3 ( #59278 ), kept fused under compile_mm_encoder ( #59195 ); encoder inputs sorted by modality (6.5-8.2% more req/s, #60196 ); Mistral 3 preprocessing 8% faster ( #57531 ); Pixtral compile_mm_encoder ( #57168 ); and fixes for Llama 4 / Mistral Large 3 EAGLE drafters (regression since v0.28.0, #57633 ), Phi-4 MM audio OOM ( #60614 ), DeepSeek-OCR zero-sum pixels ( #59417 ), MiMo-V2.5/V2.6 with fastsafetensors ( #58142 ), MiMo-V2.6 FP8 KV cache ( #58128 ), Voxtral realtime ( #45022 ), Nemotron Super vision LayerNorm ( #61401 ), K-EXAONE config and MTP RoPE ( #60187 ), Nemotron Parse tied lm_head ( #60272 ), LongCat-Flash MTP loading ( #60080 ) and Ling-3.0-flash-VL ( #59026 ). Engine Core Model Runner V2 : GPU n-gram speculator ( #40704 ), Elastic EP with drain-then-commit scaling ( #53934 ), PP with PCP for MLA models ( #59139 ), STOCK_TORCH_COMPILE mode ( #59079 ), dynamic K in autoregressive speculators ( #57053 ), MTP sampling-mask replay ( #59359 ) and per-module LM heads ( #58921 ), non-blocking H2D copies on WSL2 ( #60215 ), and fixes for int64 index offsets at long context ( #60736 ), warmup ( #61013 ), GDN prefill checkpoints ( #59536 ) and MRV2+PP+MTP align state ( #60210 ). Speculative decoding : fused multi-step draft decode on FlashInfer trtllm-gen ( #58371 ), FlashInfer ReplaySSM for Mamba2 MTP ( #52928 ), in-graph metadata for DFlash/DSpark drafts ( #60692 ), and correctness fixes for ngram on hybrid recurrent models ( #56531 ), Mamba prefill checkpoints with MTP and prefix caching ( #59759 , #60797 ), stop-string trimming ( #47616 ), draft model config ( #61240 ), adaptive block verification ( #60945 ), DSpark bonus slots ( #59105 ) and draft models on the Transformers backend ( #59293 ). Hybrid models and prefix caching : Mamba2 internal prefill checkpoints for NemotronH, Granite-4.0-H, Falcon-H1 and Zamba2 ( #57329 ), stale block hashes dropped when streaming sessions truncate ( #59103 ), and fixes for quantized Mamba-2 with TP ( #58083 ), spec decode page sizes ( #59975 ), prefix-cache bounds ( #55601 , #60533 ) and sm90 Mamba2 NaNs ( #61718 ). Sleep and RL : sleep releases workspace scratch (up to 4.5 GiB/GPU, #59156 ) and KV-init state (about 4.6 GiB/GPU, #59158 ), opt-in sleep_mode_offload_cudagraph ( #59160 , #59523 ); token-level weight-version spans on outputs ( #59582 , #61070 ); weight-transfer communicators released without stopping inference ( #61060 ); --sleep-preserve-parameter-names 'draft.*' ( #61046 ); modelexpress weight-transfer backend ( #58399 ); POST /weight_checker ( #51350 ); weight-transfer metrics ( #55781 ); --enable-nccl-comm-suspend releasing the MNNVL workspace ( #59360 ); and sleep(level=2) keeping FP8 KV scales ( #57163 ). HiSparse : per-request residency cache (up to 58% at high concurrency with GPU-resident contexts, #60083 ), lower scheduler overhead ( #57930 ), GPU residency owned by HiSparse ( #60647 ), less staging memory ( #60429 ), host cache gauges ( #58949 , #59485 ), and fixes for decode token limits ( #60682 ) and TP hangs ( #60941 ). Startup and memory : shared-memory tensor arena ( --enable-shm-tensor-arena , on by default, #51207 ), Fast Start with PP ( #55477 ), daemon-held weights counted against gpu_memory_utilization ( #57298 ), autotune preload ( #60085 ), local tokenizer snapshots ( #60825 ), sparse_mla_prefill_workspace_factor saving several GiB at 1M context ( #61023 ), cached memory reclaimed during weight loading ( #57516 ), fewer Triton sampler warmup compiles ( #58605 ), sharded state loader with PP ( #52110 ), and reload_weights with Run:ai streamer ( #58124 ). Kernels and runtime : MoE weighted-sum tuning (1.17-2.37x, #59731 ), flash-maxsim kernels for ColBERT/ColPali scoring ( #40337 ), fallback detokenization with 69% less CPU at 32K tokens ( #60497 ), faster KV block free queue ( #60269 ), Triton kernels off tl.make_block_ptr ( #60502 ), fusion passes restored under PyTorch 2.15 ( #57299 ) and static FP8 quant fusion on recent torch ( #61108 ). Batch invariance : custom all-reduce under VLLM_BATCH_INVARIANT=1 ( #58623 ), deterministic split-K LoRA shrink ( #59377 ), every attention backend checked ( #60271 ), SM120 TP configs ( #58495 ), and ROCm support ( #52231 ). Observability : vllm:prompt_tokens_cached_by_source_total ( #56318 ), vllm:num_requests_kv_fetch_by_stage ( #58874 ), vllm:admission_rejections_total ( #55812 ), vllm:watermark_requests ( #58715 ), --custom-histogram-buckets ( #48867 ), a JSON log formatter via LoggingConfig.formatter ( #58739 ), and per-session profiling controls ( #57875 ). Large Scale Serving MoE communication : FlashInfer CuteDSL MegaMoE for more models via --moe-backend flashinfer_cutedsl ( #54049 ), FP8 combine for the FlashInfer one-sided all2all (+4% at DEP8, #57995 ), NCCL symmetric-memory MoE reduce-scatter (9.6-16% lower latency, #49194 ), DeepEPv2 hybrid NVLink+RDMA mode on by default ( #57991 ), Kimi-K3 shared experts with DeepEP v2 ( #56875 ), and opt-in EPLB migration batching ( #52641 ). Context parallelism : decode requests sharded across PCP ranks ( #52162 ) and TokenSpeed MLA with block-interleaved DCP for heterogeneous NIXL disaggregation ( #59462 ). KV connectors : NIXL host-buffer copies coalesced ( #54483 ), mixed block sizes ( #58860 ), peer metadata recovery ( #55471 ) and Qwen3.8-Flash-Next MTP acceptance in P/D ( #59997 ); Mooncake coalesced hybrid/MLA RDMA regions ( #57952 ) and bootstrap retries ( #55923 ); MoRIIO Kimi-K3 DSpark READ ( #57700 ); DeepSeek-V4.1 P/D skipping bounded replay for loaded KV ( #59197 ); and KVCR pool-and-index API ( #59899 ). Data parallelism : streaming requests pinned to their engine ( #59017 ), per-engine RNG streams ( #59788 ), and placement groups without ray[default] ( #57648 ). Hardware & Performance NVIDIA : native 64-head FlashMLA sparse prefill on SM100 (1.16-1.18x TTFT, #60029 ), block-FP8 DeepGEMM experts skipping padding ( #59128 ), SM120 split-K attention ( #58482 ), DGX Spark Qwen4Exp GEMM plans ( #59753 , #59632 , #60027 ), OAI Triton MXFP4 MoE on SM12x ( #58877 ), and FlashInfer autotune cache per rank ( #57635 ). AMD ROCm : DeepSeek-V4 AITER MegaMoEV2 via --moe-backend aiter_mega_moe ( #59685 ) with opt-in shared-expert fusion (3-8%, #61004 ), opt-in mono decode for DeepSeek-V4.1-Flash on MI355X ( VLLM_ROCM_MONO_DECODE=1 , #60397 ), opt-in Gluon sparse MLA (up to +16% on GLM-5.2, #53492 ), paged MXFP4 indexer ( #58671 ), opt-in a4w4 MoE for DSv4 ( #58819 ), ultraquant_4bit KV cache ( #57057 ), aiter_flydsl GDN prefill ( #57560 ), Kimi-K3 prefill checkpoints (about 20% better TTFT, #58344 ), fused MLA decode ( #57640 ) and per-rank latent MoE shards ( #59591 ), GLM-5.3-Flash split-K sparse MLA decode (5-15% lower ITL, #58584 ), native merge_attn_states (2.4x, #60159 ), ROCM_SEGMENTED_ATTN for RDNA ( #59132 ), gfx11 W4A16 tuning (up to 23% TTFT, #56301 ), MRV2 default with model-specific MRV1 exceptions removed ( #56360 ), and fixes for sleep-mode segfaults on ROCm 7.2+ ( #60367 ) and MLA weight reloads ( #60389 ). Intel XPU : MLA in FLASH_ATTN_MLA ( #58297 ), Arc Pro B70 FP8 GEMM (2.0-2.73x, #56063 ) and fused MoE configs ( #53065 ), fused SYCL LayerNorm ( #57172 ), and fixes for Gemma-2 softcap ( #58936 ) and DP+EP MoE ( #57787 ). CPU : vectorized sampler (up to 58x on s390x, #53913 ), aarch64 causal conv1d (about 9%, #54093 ), POWER10 AWQ/GPTQ ( #59149 ), and PowerPC dtype=auto choosing bfloat16 ( #58528 ). Other : tpu-inference v0.31.0 ( #60190 ) and out-of-tree platforms registering multiple attention backends ( #41091 ). Quantization New capabilities : online re-quantization of linear layers ( --quantization-config.linear fp8_per_channel , #55684 ), per-token NVFP4 CuTe-DSL MoE ( #50030 ) with ReLU2 ( #56740 ), MXFP4 MoE oracle with CUTLASS W4A4 and BF16 fallback ( #60079 ), compressed-tensors MXFP4 MoE with FP8 activations ( #59815 ), ModelOpt IQ2_XS/IQ2_XXS/Q8_0 on SM120/SM121 ( #59604 ), int4_per_token_head KV with non-power-of-two heads ( #56198 ), and Humming preferred over Marlin on SM90 ( #56997 ). Fixes : silent CUTLASS NVFP4/MXFP4 MoE corruption under EP ( #59042 ), GPTQ with non-default safetensors names ( #60411 ), moe_wna16 8-bit asymmetric zero points ( #58950 ), and ModelOpt mixed-precision NVFP4 detection ( #56050 ). API & Frontend New endpoints and options : /v1/systemone ( #59299 , #60677 , #60696 ), hf parser ( #58604 ), vllm download-kernels ( #58765 ), output_mode: "text" and stop_reason in /inference/v1/generate ( #58588 , #60251 ), mm_payload for render requests ( #61427 , #60728 ), Responses min_p and stop_token_ids ( #48084 , #56592 ), LLM.chat(priority=...) ( #57243 ), and /generative_scoring cache_salt ( #60841 ). Behavior : max_tokens is an upper bound instead of a reservation, so long prompts are no longer rejected ( #57035 ); least-loaded API worker selection ( #60723 ); tool parser compatibility checked at startup ( #59749 ). Tool calling and structured output : parallel_tool_calls=false enforced ( #50502 , #59298 ), tool_choice="required" streaming ( #60354 ) and native XML parsers ( #47512 ), Step-3.5 and minimax_m3 on the parser engine ( #59321 , #59743 ), xgrammar propertyNames ( #57594 ), and LoRA PEFT rank_pattern / alpha_pattern applied with unsupported features rejected ( #59801 , #60225 ). Rust frontend : --grpc-port ( #59659 ), --stream-interval ( #60589 ), logprob_token_ids ( #59549 ), Control.Shutdown with vllm-proto 0.5.0 ( #59316 ), qwen3_json parser ( #60136 ), and Kimi K3 grammar fixes ( #59190 , #59395 ). Security GHSA-4hhp-h66f-j5j7 : chat templates are validated statically and rendered under a timeout ( VLLM_CHAT_TEMPLATE_RENDER_TIMEOUT ), user-supplied chat_template in Responses chat_template_kwargs is rejected, and the Rust frontend caps template execution ( #50300 ). GHSA-q97c-p368-75c4 : tokenizer max_token_id off-by-one fixed ( #59491 ). GHSA-frvg-qw88-hww9 : P2P ZMQ peer sessions are bounded by VLLM_P2P_MAX_PEERS (default 128), VLLM_P2P_HANDSHAKE_TIMEOUT_S (default 30) and VLLM_P2P_IDLE_TIMEOUT_S (default 300), so unique peer addresses can no longer exhaust ZMQ sockets ( #51504 ). Default CORS settings no longer allow every origin in the Python and Rust frontends; set --allowed-origins to permit browser origins ( #61009 ). Untrusted images are opened with a raster-format allowlist ( ALLOWED_IMAGE_FORMATS ), denying EPS/PostScript and WMF ( #60022 ); shared-memory multimodal cache handles are HMAC-signed and forged handles rejected ( #59357 ). Structured-output JSON schemas nested more than 64 levels return 400 ( #60036 ); chunked /v1/embeddings requests keep cache_salt ( #47696 ); Phi-4 MM audio no longer holds multi-GiB attention matrices ( #60614 ); DeepSeek-OCR zero-sum pixel tensors no longer kill EngineCore ( #59417 ). Security dependency bumps: aiohttp>=3.14.3 , pillow>=12.3.0 , cryptography, urllib3, pyjwt and others ( #59249 , #59315 , #59427 ). Dependencies transformers>=5.16.1,<5.20.0 (minimum raised from 5.10.4, #57387 , #59762 ) and tokenizers>=0.23.2 ( #59796 ). NIXL 1.5.0 ( #56907 ), CuTe DSL 4.8.0 block-scale APIs ( #59480 ), humming-kernels==0.1.17 with initial Rubin support ( #61556 , #61858 ), InstantTensor 0.2.2 ( #61167 ), and flashinfer-jit-cache excluded from wheel install_requires ( #60052 ). ROCm: AITER 0.1.24.post1 ( #59794 ) and MoRI v1.2.3.post1 ( #56073 ). XPU: auto-round-lib 0.16.0 ( #60976 ). TPU: tpu-inference v0.31.0 ( #60190 ). Build Python 3.11-3.14 supported ( #60402 ); macOS wheels built with the stable ABI ( #60312 ); CUDA source builds require GCC 13 and fail early otherwise ( #60259 ); Docker images compile Python bytecode at build time for faster container startup ( #55422 ); VLLM_USE_PRECOMPILED finds a compatible published wheel within the last 20 commits ( #58871 ); the vendored DeepGEMM uses TORCH_LIBRARY (abi3, #48962 ). Breaking Changes & Deprecations Python 3.10 is no longer supported; the minimum is Python 3.11 ( #60402 ). Default CORS origins changed from * to none; set --allowed-origins for browser clients ( #61009 ). transformers>=5.16.1,<5.20.0 and tokenizers>=0.23.2 are required ( #57387 , #59796 ). The torch.compile sequence parallelism and AsyncTP passes were removed, along with PassConfig.enable_sp , fuse_gemm_comms and sp_min_token_num ; model-level sequence parallelism is unaffected ( #60517 ). Cascade attention was removed; --disable-cascade-attn still parses but only warns and will be removed in v0.33.0 ( #61126 ). mamba_cache_mode="all" was removed; --mamba-cache-mode all now fails validation ( #58997 ). Previously deprecated APIs were removed: wait_for_inflight_requests (use mode="wait" ), AsyncLLM.pause_generation() , IOProcessor.output_to_response , vllm.scripts.main() and vllm bench throughput --dataset ( #60923 ). The sonnet benchmark dataset was removed as scheduled ( #60129 ). Tensorizer support was removed from LoRA ( #60024 ), and the PyO3 vllm._rust_tool_parser bridge was removed ( #59744 ). API changes: max_tokens is treated as an upper bound on output rather than reserved from the context window ( #57035 ); Responses API streaming uses response.content_part.added/done with part.type="reasoning_text" instead of response.reasoning_part.added/done ( #59652 ); SamplingParams.prompt_logprob_token_ids is per row ( #56984 ); /inference/v1/generate logprobs use integer token IDs ( #58181 ); sleep API responses are standardized and invalid levels return 400 ( #52864 ); return_mm_kwargs is deprecated in favor of mm_payload ( #61427 ). Watermarking: when the engine has watermarking configured, an omitted request field means enabled and only false opts out; unsupported combinations warn and fall back ( #56801 ). Rust frontend: qwen3_xml now parses Qwen3-Coder XML (alias of qwen3_coder ); use the new qwen3_json for the JSON format ( #60136 ). New defaults: shared-memory tensor arena on ( #51207 ); GLM-5.x FP8 KV cache on SM100 with --kv-cache-dtype auto ( #60140 , #60281 ); VLLM_DEEPEP_V2_ALLOW_HYBRID_MODE=1 ( #57991 ); Humming preferred over Marlin on SM90 ( #56997 ); sparse_mla_prefill_workspace_factor 2 above 256K max_model_len ( #61023 ); MRV2 on ROCm with model-specific MRV1 exceptions removed ( #56360 ); VLLM_ROCM_AITER_MLA_DCP_VERIFY=auto ( #59965 ); dtype=auto picks bfloat16 on PowerPC ( #58528 ); MXFP4 W4A4 checkpoints fall back to W4A16 with a warning when no W4A4 kernel exists ( #60079 ). Stricter validation: incompatible --prefix-match-unit ( #58021 ), max_num_scheduled_tokens=0 ( #60714 ), HiSparse with cudagraph_mode=FULL ( #59688 ), and negative --device-ids ( #49053 ) are rejected at startup. New Contributors @0xViking made their first contribution in #60053 @1fanwang made their first contribution in #40986 @a-sidorova made their first contribution in #55335 @AbhayShuklaIIT made their first contribution in #59763 @ahmed-bsod made their first contribution in #58655 @ai-yang made their first contribution in #58088 @AIwork4me made their first contribution in #54706 @AlanFokCo made their first contribution in #57163 @AMD-yanfeiwang made their first contribution in #61004 @aniskumar-nv made their first contribution in #53020 @Anurag-M1 made their first contribution in #57693 @Aravind-11 made their first contribution in #60098 @awesome-pro made their first contribution in #58895 @Ayu190505 made their first contribution in #57995 @beenpow made their first contribution in #57648 @big-yellow-duck made their first contribution in #59132 @blueberry808 made their first contribution in #58932 @bluemelov1 made their first contribution in #58560 @bnkaiteam made their first contribution in #60507 @brandonfzhang made their first contribution in #56881 @Btwestyo made their first contribution in #59924 @bvolpato made their first contribution in #55203 @C1ves made their first contribution in #58890 @charlesli640 made their first contribution in #59977 @cheese-cakee made their first contribution in #59079 @CorgiBoyG made their first contribution in #55596 @damienlaine made their first contribution in #45022 @danichan-mkm made their first contribution in #59285 @danigarciaoca made their first contribution in #56372 @debanshd made their first contribution in #57476 @devpramod made their first contribution in #60855 @devshah-cohere made their first contribution in #60286 @DGlan made their first contribution in #59875 @dhairyashilRG made their first contribution in #58911 @DOCCA0 made their first contribution in #52641 @Dovis01 made their first contribution in #56994 @ebfio made their first contribution in #58165 @ejrtks1020 made their first contribution in #59180 @eky-amd made their first contribution in #54857 @gaby made their first contribution in #59126 @haotiaa made their first contribution in #60766 @harshaladhav-amd made their first contribution in #58268 @hdq66666 made their first contribution in #59695 @hoaivoke made their first contribution in #61033 @hpdkhoa made their first contribution in #60747 @hubert-marek made their first contribution in #61000 @hubunt made their first contribution in #47512 @huishi-hs made their first contribution in #58053 @hyukjlee made their first contribution in #59965 @Id545 made their first contribution in #59247 @ieaves made their first contribution in #52824 @ischencheng made their first contribution in #60763 @Jeff-Tseng-dev made their first contribution in #59396 @jiangyunfan1 made their first contribution in #57780 @JimmyWang0417 made their first contribution in #61081 @jin-amd made their first contribution in #58904 @JRJRJPRO made their first contribution in #59879 @Kevinli24 made their first contribution in #58878 @Kylinny made their first contribution in #60354 @Lcy0801 made their first contribution in #58975 @Legend-2727 made their first contribution in #59293 @lianakoleva made their first contribution in #60136 @LiRunGuo made their first contribution in #56198 @lobo235 made their first contribution in #60364 @LostFox11 made their first contribution in #58542 @MadhavJivrajani made their first contribution in #57635 @MatthewCYM made their first contribution in #57146 @Mazukiri made their first contribution in #60036 @MohammadHijjawi97 made their first contribution in #59072 @MohitAMD made their first contribution in #55053 @nishantrevur made their first contribution in #59541 @njriasan made their first contribution in #60502 @NNNtrance made their first contribution in #55647 @NolenLiang made their first contribution in #56974 @notimesea made their first contribution in #59105 @ntheanh201 made their first contribution in #57734 @nv-hwoo made their first contribution in #58399 @ojeda-e made their first contribution in #59107 @Ostring24 made their first contribution in #50502 @peperunas made their first contribution in #58938 @pondzikk made their first contribution in #55601 @praveingk made their first contribution in #60161 @puneetsharma21 made their first contribution in #48074 @rdlh made their first contribution in #60415 @rmhaskarnvidia made their first contribution in #59081 @roG0d made their first contribution in #55937 @roipony made their first contribution in #40337 @shijie-lyu made their first contribution in #55771 @shiyuan680 made their first contribution in #51350 @shreyanshj10 made their first contribution in #60359 @siliangchen-amd made their first contribution in #57108 @Sohaib-Ahmed21 made their first contribution in #59827 @spa5k made their first contribution in #60497 @sricursion made their first contribution in #60307 @SunnyR made their first contribution in #59811 @superdiaodiao made their first contribution in #55717 @surajsharan made their first contribution in #60225 @surawut-jirasaktavee made their first contribution in #60876 @Thiago4532 made their first contribution in #58014 @TommyTranX made their first contribution in #48039 @TylerMa-debugg made their first contribution in #59917 @ultramancode made their first contribution in #60786 @usmanmateen made their first contribution in #59336 @v-shobhit made their first contribution in #59655 @vaclavcadek made their first contribution in #49602 @viktorkou made their first contribution in #58124 @vovani made their first contribution in #60194 @WarrierRajeev made their first contribution in https://github.com/vllm-project/vllm/pull/59135 @www6v made their first contribution in https://github.com/vllm-project/vllm/pull/59749 @xiaofei-zheng made their first contribution in https://github.com/vllm-project/vllm/pull/55104 @xiaoyu-xyz made their first contribution in https://github.com/vllm-project/vllm/pull/55161 @xuantengh made their first contribution in https://github.com/vllm-project/vllm/pull/56740 @yantinglai made their first contribution in https://github.com/vllm-project/vllm/pull/59530 @YashasviAsthana made their first contribution in https://github.com/vllm-project/vllm/pull/59020 @YidaWeng made their first contribution in https://github.com/vllm-project/vllm/pull/59373 @yongqiw-i made their first contribution in https://github.com/vllm-project/vllm/pull/59159 @YueshenZ made their first contribution in https://github.com/vllm-project/vllm/pull/59257 @YuvrajSinghBhadoria2 made their first contribution in https://github.com/vllm-project/vllm/pull/57035 @zhangchengzhucufe-dev made their first contribution in https://github.com/vllm-project/vllm/pull/59886 @ZhenchengLin made their first contribution in https://github.com/vllm-project/vllm/pull/59251 @ztysth made their first contribution in https://github.com/vllm-project/vllm/pull/59721 Contributors @BugenZhao , @aoshen02 , @stefankoncarevic , @mgoin , @khluu , @hmellor , @yewentao256 , @lesj0610 , @MatthewBonanni , @jperezdealgaba , @ZJY0516 , @AndreasKaratzas , @aarushjain29 , @Sunt-ing , @NickLucche , @vadiklyutiy , @hickeyma , @divakar-amd , @yma11 , @jzakrzew , @djramic , @simondanielsson , @microslaw , @Thangnguyenvn98 , @mjkvaak-amd , @njhill , @chaojun-zhang , @sfeng33 , @zhenwei-intel , @andyxning , @matteso1 , @vMaroon , @alec-flowers , @simon-veitner-redhat , @TheEpicDolphin , @cagrikymk , @atalman , @shijie-lyu , @cheese-cakee , @Juntian777 , @ivanium , @chaunceyjiang , @louie-tsai , @Dovis01 , @apex-mochen , @wzhao18 , @venkywonka , @pmanczak , @stecasta , @jinzhen-lin , @gty111 , @noooop , @Rohan138 , @rasmith , @laithsakka , @Fangzhou-Ai , @tlrmchlsmth , @Isotr0py , @cjackal , @vllmellm , @liusy58 , @reidliu41 , @peperunas , @shimib , @ojeda-e , @yonigozlan , @ShuoleiWang , @lucamotz , @ai-jz , @he-yufeng , @DimensionSTP , @taneem-ibrahim , @LucasWilkinson , @wangshangsam , @whx-sjtu , @micah-wil , @bzsuni , @robertgshaw2-redhat , @arpera , @sricursion , @mawong-amd , @mmastrac , @rmhaskarnvidia , @nvbfalk , @debanshd , @abmfy , @shaohuaxi , @jin-amd , @xijiaat, @ashraf-bhuiyan, @beenpow , @LioEinaudi, @Ronald1995, @R3hankhan123, @ZhengGong-amd, @Akashcodes732, @S1ro1, @yuvalluria, @mganczarenko, @DarkLight1337, @pisceskkk, @YidaWeng , @TQCB, @gau-nernst, @askliar, @benchislett, @jackLei0901, @vx120, @amd-mghanimi, @YueshenZ , @aniskumar-nv , @fululi12, @liuzijing2014, @zyongye, @Prudhvivuda, @kliuae, @wjabbour, @AbhayShuklaIIT , @WarrierRajeev , @Jeff-Tseng-dev , @yifanFengg, @elvircrn, @zupengwang, @tangzzycc, @jeejeelee, @roikoren755, @JohnQinAMD, @LeizhenZhang, @Chinmay-Kulkarni-AMD, @sungbin1015, @zhangchengzhucufe-dev, @fxmarty-amd, @lucianommartins, @nishantrevur , @hyukjlee , @andylolu2, @wangxiyuan, @stu-cao, @vineethsaivs, @zzaebok, @WoosukKwon, @franciscojavierarceo, @hpdkhoa , @gcanlin, @zigzagcai, @ultramancode , @warrendeng, @surajsharan , @subhashpolisetti, @ilmarkov, @awesome-pro , @faaany, @spandantiwari, @almogtavor, @ahmed-bsod , @danigarciaoca , @Alnusjaponica, @NNNtrance , @vaclavcadek , @YashasviAsthana , @QwertyJack, @Ubospica, @AlanFokCo , @jungjiyu, @lcskrishna, @YukioZzz, @hubunt , @sashko-zakharchuk, @staryxchen, @yzong-rh, @Ostring24 , @taking-lying-flat, @drakosha, @CorgiBoyG , @QHarshil, @zhou9402, @shiyuan680 , @fjosw, @a-sidorova , @GOavi101, @mrodden, @fuscof-ibm, @Taimys, @Rukhaiya2004, @KernelClint, @almayne, @JulienDarve, @sshlyapn, @eldarkurtic, @rbrugaro-amd, @GuyStone, @ZhenchengLin , @ArcheyChen, @djmmoss, @hjjq, @namgyu-youn, @jiangyunfan1 , @ganeshr10, @markmc, @yantinglai , @Id545 , @roipony , @JadenMathias, @hclsys, @Anurag-M1 , @ukannika, @blueberry808 , @nv-hwoo , @guanxingithub, @stmatengss, @mohit-sarvam, @Legend-2727 , @xiaoyu-xyz , @hdq66666 , @Lcy0801 , @gaby , @erictang000, @jdebache, @Ayu190505 , @DOCCA0 , @C1ves , @maeehart, @wangyicong52, @AIwork4me , @Woolgathererer, @yongqiw-i , @divyvasal, @1fanwang , @TyroneNel, @ShengleiFu, @bluemelov1 , @kamb-code, @LiRunGuo , @Thiago4532 , @harshaljanjani, @ieaves , @NolenLiang , @sudhanshu112233shukla, @abhayjoshi201, @charlesli640 , @Sohaib-Ahmed21 , @akii96, @notimesea , @JRJRJPRO , @usberkeley, @Mazukiri , @brandonfzhang , @amd-xavierwang, @sawsa307, @czhu-cohere, @wtdcode, @tarukumar, @LostFox11 , @big-yellow-duck , @SherifWaly, @roG0d , @esmeetu, @mgehre-amd, @samnordmann, @SunnyR , @ovidiusm, @cleonard530, @eky-amd , @yinli-systems, @MadhavJivrajani , @cquil11, @ywang96, @PatrykSaffer, @PatchouliTIS, @aditi-amd, @git-jxj, @vovani , @MohammadHijjawi97 , @TommyTranX , @viktorkou , @xaguilar-amd, @MohitAMD , @danichan-mkm , @pondzikk , @ebfio , @mkhazraee, @ai-yang , @xuantengh , @dhairyashilRG , @www6v , @v-shobhit , @ejrtks1020 , @Kylinny , @bnkaiteam , @huishi-hs , @jiahanc, @shen-shanshan, @zxd1997066, @Aravind-11 , @usmanmateen , @devshah-cohere , @praveingk , @JartX, @TylerMa-debugg , @lobo235 , @dougbtv, @Tialo, @kyleliang-nv, @YeonwooSung, @Kevinli24 , @aijanai, @spa5k , @DGlan , @Btwestyo , @xianbaoqian, @rdlh , @hao-aaron, @errmakov, @amd-sriram, @ntheanh201 , @LCAIZJ, @damienlaine , @shreyanshj10 , @ischencheng , @0xViking , @yisustc, @bigPYJ1151, @Roy214, @Gregory-Pereira, @YuvrajSinghBhadoria2 , @surawut-jirasaktavee , @Oxygen56, @andakai, @BolinSNLHM, @Dao007forever, @siliangchen-amd , @xiaofei-zheng , @gc-fu, @puneetsharma21 , @linitra24, @devpramod , @yankay, @hlin99, @Godmook, @bvolpato , @UNIDY2002, @tc-mb, @JaredforReal, @hubert-marek , @Zhenzhong1, @AMD-yanfeiwang , @thuongvu, @JimmyWang0417 , @MatthewCYM , @i-m-aditya, @lianakoleva , @peakcrosser7, @hoaivoke , @njriasan , @tjtanaa, @haotiaa , @superdiaodiao , @josh-schell-amd, @ztysth , @sungsooha, @Etelis, @natsala13, @ZhouXiaoya25

★ Show HN: Warsaw in voxels – An interactive 3D map of the city centre

stared — Tue, 03 Nov 2026 00:00:00 +0000

94% · Usable today 94%, First-party 31%

Explore central Warsaw in voxels - slightly inspired by Minecraft, and MagicaVoxel. You can change the date, time of day and weather, explore the city, or click on a pedestrian to control them (here a bit of inspiration from Dungeon Keeper). Works best on desktop, but I tried to make it usable on mobile too. The initial load can take a while. It's based on several open datasets, including: - OpenStreetMap ( https://www.openstreetmap.org/#map=6/52.02/19.14 ) - buildings, streets, sidewalks, tram tracks, etc - GUGiK / Geoportal ( https://www.geoportal.gov.pl/ ) - LiDAR for building heights and trees, aerial imagery for colours - Warsaw's city tree database ( https://mapa.um.warszawa.pl/ ) - individual tree species, used for seasonal foliage Open-source ( https://github.com/stared/warsaw-vibe-voxel ), so feel invited to (re)use it as you wish! Comments URL: https://news.ycombinator.com/item?id=50339221 Points: 264 # Comments: 42

★ "Absolutely incredible: MIT researchers say GPT-6 Astra improved a small Qwen model’s math score from 7.9% to 48.1% by directly editing just 0.016% of its weights, without gradient-based training. The result points toward AI systems that can diagnose and improve other models directly, a..."

/u/stealthispost — Tue, 03 Nov 2026 00:00:00 +0000

93% · Measured result 93%

...** potential step toward self-improving** AI . Again: folks outside our bubble have no clue what’s happening — Chubby Source: https://x.com/kimmonismus/status/2117343192245064004 We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: https://t.co/DwTwzXzSbE — Rikiya Takehi Source: https://x.com/rikiyatakehi/status/2117313742891327994 submitted by /u/stealthispost to r/accelerate [link] [comments]

★ The 16GB Raspberry Pi 5 got another ‘unavoidable’ RAM price hike

The Verge — Tue, 03 Nov 2026 00:00:00 +0000

93% · Measured result 93%, Usable today 54%

The top configuration of the Raspberry Pi 5 now costs three times more than its launch price. www.theverge.com/tech/1024342... Linked page: The Pi 5 16GB now costs triple its original price.

★ OpenAI partners with Cathedral to test its security defenses and revamps its Security Bug Bounty program, including quadrupling rewards for critical findings (OpenAI)

Tue, 03 Nov 2026 00:00:00 +0000

93% · First-party 93%

OpenAI : OpenAI partners with Cathedral to test its security defenses and revamps its Security Bug Bounty program, including quadrupling rewards for critical findings — We're planning our next internal security sprint at OpenAI, bringing new researchers and security partners together with our own teams …

★ ollama v0.40.14

github-actions[bot] — Tue, 03 Nov 2026 00:00:00 +0000

93% · First-party 93%, Usable today 84%

What's Changed ollama launch claude now applies the model's output token limit for Claude Code, so cloud models no longer run into the 128k default cap Cloud web search responses on /api/chat are now decoded correctly, including compressed responses OpenAI-compatible endpoints no longer override a model's packaged sampler defaults — clients that send no temperature / top_p get the model's own values instead of 1.0, matching /api/chat /v1/responses now preserves readable input content, including prior assistant refusals, instead of flattening it Ollama's app can now retry ChatGPT disconnect failures instead of leaving the connection in a broken state ollama launch codex verifies ChatGPT routing before configuring, and reports a clear error when routing is unavailable Faster top-k sampling on MLX for large vocabularies Full Changelog : v0.40.13...v0.40.14

★ A few notes on Anthropic's new Claude Fable 5.1 - with Max thinking level I got the best SVG pelican I've had from any Anthropic model (at…

Simon Willison — Tue, 03 Nov 2026 00:00:00 +0000

91% · Measured result 91%

A few notes on Anthropic's new Claude Fable 5.1 - with Max thinking level I got the best SVG pelican I've had from any Anthropic model (at a hefty cost of $3.30!), which I then had it animate simonwillison.net/2026/Sep/1/c...

★ GPT-6 Astra Edits Qwen Weights: MATH-500 7.9% to 48.1%

/u/1-800-methdyke — Tue, 03 Nov 2026 00:00:00 +0000

90% · Measured result 90%

submitted by /u/1-800-methdyke to r/LocalLLaMA [link] [comments]

★ Local AI News You Missed - October 2026

/u/vramkickedin — Tue, 03 Nov 2026 00:00:00 +0000

90% · Measured result 90%, Usable today 84%

Here's what you probably missed in October 2026: 🧠 LLMs Ornith-1.5-122B - Handles million-token agent tasks on a single GPU. Raon-1-mini-preview - Runs Korean agentic AI on a single RTX 5090. Timestral-209M - Forecasts time series in one pass with 21 quantiles. Carbon-X - Reads DNA in chat and predicts variant effects on one GPU. Sage-A1.5 - Orchestrates scientific agents with self-review. Spark-X2.6-4B - Advances on-device agents with controllable thinking. Nanbeige4.3-33B - Teacher model leads agentic coding and cowork. Flint - MoE coding agent investigates repos and fixes bugs on one GPU. Hy-Memory-30B-A3B - Writes durable agent memory at 3B active parameters. Underdog-Saluki-27B-1.0 - Packs Qwen3.8 tool calling into under 8 GB. D3 - Answers choice, yes-no, and score questions in one call. LFM2.5-24B-A2B - Packs fast on-device agent reasoning into 2B active. Qwen3.5-2B-RCOL - Low-bit quants hold quality under 1 GB. GLM-5.3-UNCENSORED-EXL3-3.0bpw - Fits a 753B MoE in 273 GB. Humanizer - Rewrites AI drafts to sound human in English and Chinese. Kolibri 1 - Brings 78B MoE reasoning to German and English. GEV-26B-Decide - Thinks only when needed on Gemma-4. Victoria - Trims Qwen3.8-Flash-Next experts for a single GPU. Hearim Gateway - Routes Jev System One decisions over local LLMs. Sharp-Spark-X2.5-4B-GGUF - Fits a long-context coder in 6GB. LingBot-World 2.0 Realtime - Runs a world model at 16 FPS. deepseek-v4.1-flash-gguf - Runs DeepSeek Flash on Apple Silicon. ThreadShelf - Archives and searches your AI chat history locally. Aurora1.0-150M - Packs an efficient tiny model you can run anywhere. Intern-S2-397B - Scales up scientific reasoning and agents. NeoHorse-1-9B - Agentic model steps toward self-improvement. Atria-Dawn-Preview - Agentic model aims for verifiable research results. Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF - Speeds local reasoning. 🔀 Multimodal MiniMax-M3.1-Flash - Runs multimodal agentic AI with a 1M token context. Indra-OCR - Reads PDFs and handwriting on CPU at 44 pages per second. Qwen3.8-Flash-Next-FP4-Local - Runs a quantized 125B model on Blackwell GPUs. MiniCPM-V-4.7-1B - Packs efficient multimodal AI for phones and tablets. Muse-Spark-Open-816B-A42B - Packs 816B parameters into a multimodal agent. MiniCPM-V-4.7-35B-A3B - MoE runs multimodal AI smoothly on phones. DeepSeek-V4.1-Flash-1017 - Sharpens agents and vision. FrogNano-4B-2609-GGUF - Adds image input and MTP speed to quants. Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF - Drops refusals without retraining. D1-3B - Runs calibrated decisions on edge devices in one pass. Clef-Flash - Brings low-latency decisions to a 9B Qwen model. GLM5.3-Flash-E224-DGX-Spark - Packs NVFP4 MoE for two DGX Sparks. Clef Model - Turns state and questions into calibrated decisions. EmbeddingGemma 2 - Maps text, image, video, and audio into one space. JEV-27B-VL - Brings calibrated vision decisions to Qwen3.8. HuatuoGPT-3-9B - Brings one-stage medical reasoning to local models. Realtime-Venus - Holds full-duplex conversations with voice and video. Agnes-3.0-Flash Preview - Packs long reasoning into 33B weights. ZDTaichu5.0-9B - Brings spatial reasoning and agent skills to VLMs. 🖼️ Image Kromoss - Fine-tunes MOSS-Image for eight-step turbo generation. Qwen-Image-2.1-Turbo-Uncensored-GGUF - Drops encoder refusals locally. MOSS-Image-Base - Brings layout control to local image generation. MOSS-Image-SFT - Sharpens text and layout control in image generation. Qwen-Image-2.1-Turbo - Renders images in eight fast steps. Qwen-Image-2.1-Uncensored-Quantized - Ships with filters off. FLUX 3 Image Klein - Blends up to 10 references into one image. Iris-3B - Paints pixels directly for images, depth, and restoration. Qwen-Image-2.1 Fun ControlNet Union - Drives eight controls at once. Agate Preview 003 - Renders 512px images from only 261M parameters. Wulver v0.5 - Fine-tunes Krea 2 for anime and furry art. PrunaSuperPoint - Cuts SuperPoint keypoints up to 2.1x faster on edge. VisionHOPE - Backbone self-modifies to see and segment images. Anima-Light-Lavender - Boosts natural-language anime prompts. Krea 2 Turbo SDA LoRA - Restores sampling diversity. SMACK LoRA - Adds punchy impact effects to MiniMax H3 video. Krea 2 Lineart Edit - Turns sketches into rendered images. Krea-2-merge-tool - Merges and analyzes Krea 2 models on Windows. Krea-2-Pixel-Art - Adds retro pixels at three sizes to Krea 2. MageTrail - Brings Danbooru-style tuning to Microsoft's MageFlow base. 🎬 Video DMAD - Distills MiniMax H3 into a four-step audio-video generator. LTX-2.5-22b-IC-LoRA-Layout-To-Render - VFX tools add native 4K and 8K video post production. DuoMatching - Distills Wan2.1 into a two-step video generator. MiniMax-H3-X2-Detail-VAE - Sharpens and upscales H3 video. LTX-2.5 IC-LoRA Ingredients - Keeps characters and props consistent in video. FastH3 V2 - Runs fast video models on consumer GPUs. Meridian - Re-creates camera moves around existing video. 🎧 Audio Fish Audio Drama 3 - Speaks for 16 characters in one prompt. Drifting-TTS - Makes one-step Turkish speech on low latency. Whistle - Runs tiny on-device speech recognition without a GPU. EMA Lightning - Makes a tiny, fast Turkish text-to-speech model. GRVL LoRAs - Give YuE2 raspy rock-soul female vocals. YuE2 BLGR LoRAs - Add Bulgarian choir and Tuvan throat singing. YuE2 Qawwali LoRAs - Add Sufi singing to music generation. Audio Slop Server - Runs many audio models on one GPU. audio.cpp YuE2 - Runs Suno-class music in 8-9 GB of VRAM. YuE2 Real-Audio Tokenizer - Lets you tune music on your own tracks. YuE2 Instrumental LoRA - Writes score-led instrumental tracks. YuE2-hum-to-song - Turns a hummed melody into a full song. Rumik-oss-1 - Speaks 22 Indian languages with expressive control. Confucius4-R2T2 - Delivers low-latency streaming speech recognition. 🤖 Agents Tencent Octop - Runs a self-hosted multi-agent assistant at home. 🎲 3D AssetFurnace - Turns a prompt into a rigged, animated 3D character. ⚡ LoRA MiniMax-H3-Person-Remover-LoRA - Deletes people from video. Pruna LoRAs - Cut Qwen-Image-2.1 down to six fast steps. Krea 2 Inpaint Edit LoRA - Fills masked areas in ComfyUI. YuE2 Deathmetal LoRA - Adds melodic death metal to AI songs. TRBDR Folk Troubadour LoRAs - Give YuE2 a 1960s balladeer. AnyAngle LoRA - Retains style while changing camera angles. QTSTRM Quiet Storm LoRAs - Bring 80s R&B vocals to YuE2. LTX-2.5 Restore IC-LoRA - Revives old footage in color. MiniMax-H3 Motion Continuity Repair V2 - Fixes broken action frames. MiniMax-H3 CrossView LoRA - Shoots a scene from new angles. Krea2-Turbo-Distill-2step-LoRA - Cuts image steps from eight to two. TaoMate-H3-3Step-ComfyUI - Speeds up H3 runs in ComfyUI. Minimax-H3-ComfyUI LoRAs - Add style and VFX editing to H3 video. BFS-Best-Face-Swap LoRAs - Swap faces across Qwen Image and Flux. 🏋️ Training LoRAlab TrainerStudio - Trains latest models on low-VRAM GPUs. ModelFiche - Organizes image-model training for agents and reviewers. 📊 Datasets Danbooru 2026 Tag Cleaning Corrections Dataset - Released with cleaned-up tag corrections for training. ☰ UI TinyLuma - Is an 8MB desktop editor for finishing AI images. Goated Prompter - Refines image and video prompts locally. Fooocus-Qwen-Image-2.1 - Brings Qwen-Image editing to small GPUs. Slopus - Turns MiniMax H3 video generation into a desktop app. Image Studio - Brings local Qwen-Image 2.1 editing to Apple Silicon. Pinhole - Turns any GPU into a simple one-button local image generator. H3 Prompt Studio - Directs MiniMax H3 films from a local app. Qamba Studio - Edits AI video end-to-end on your own machine. PotionUI - Puts self-hosted diffusion studios in a browser. H3 Studio - Gives MiniMax-H3 video a local Mac web UI. Livebound - Brings a local publishing workspace to CivitAI creators. 💻 Hardware AMD EPYC 9006 Venice CPUs - Listed from $700 to $14,904. Inno3D AWS-511Z-R1 Tower Workstation - Handles up to 4 GPUs. GMKtec EVO-X5 Pro - Runs up to 320B LLMs locally. AceMagic F9A - Packs 131 TOPS AI into a 2L mini workstation. Innodisk DDR5-8000 RDIMM - Launched for edge AI and servers. Panasonic Toughbook 34 And G3 - Bring AI-ready rugged laptops. Minisforum AtomMan G1 Pro - Adds a 16 GB RX 9060 XT to its mini PCs. Cervoz T449 And T459 - Add rugged MIL-STD SSDs for edge AI. 🛠️ Other Tools Open-omnivoice-tts - Serves a 0.3 second voice clone API. VRAM Manager - Flags idle AI servers holding GPU memory. qwen-image-local - Runs Qwen-Image-2.1 on a 12 GB GPU. Lumibelle Video Studio - Turns a screenplay into a local film. AutoRef - Coaches FLUX.2 into composing multiple reference images. MiniMax Code - Turns terminal prompts into working projects. Tool-prune - Prunes tool schemas to cut agent prompt costs. ZCode - Open sources an AI coding workbench in three forms. YuE2-Radio - Creates an endless local AI music radio. Inkvec - Traces images into clean vector SVGs in the browser. wan2gp-h3-latent-continue - Lets Wan2GP continue H3 video from latents. Jeff - Puts a fast 0.8B decision model in front of your 27B. ComfyUI Releases Speed & Performance Boosts ComfyUI-VELA-H3 - Speeds up VDN H3 on MiniMax H3 in ComfyUI. Veda-on-ComfyUI - Speeds up MiniMax H3 in ComfyUI. ComfyUI H3 W4A4 VSA - Cuts Ref2VA video time down to 3 minutes. ComfyUI-Ref2VA-VSA - Speeds character video generation to 72 seconds. ComfyUI-Spectrum-Qwen2.1 - Speeds up image generation by about 2x. ComfyUI-Qwen-Image-2.1-PromptEnhancer-MTP - Runs faster in ComfyUI with MTP support. ComfyUI-HunyuanImage3 - Runs an 80B image model on a single GPU. ComfyUI-AppleSilicon-FP8 - Runs quantized models on Mac. LynnReal-Omni - Packs many video tasks into one fast model. Video & Image Creation H3 Long Shot Studio - Makes multi-shot films inside ComfyUI. ComfyUI-Olm-SoL-Refiner - Brings video refinement to nodes. Fizgig H3 Still - Renders true MiniMax H3 frames in ComfyUI. Fizgig H3 Tweaks - Gives ComfyUI fine control over MiniMax H3. Scumble - A free layer-based AI inpainting editor. ComfyUI-BubbleText - Puts real text inside generated speech bubbles. ComfyUI-OutpaintMask - Builds interactive outpainting masks. Director's Console - Designs cinematic shots and runs ComfyUI. ComfyUI-Prompt-Studio - Turns reference images into production prompts. Ming Image Prompt Builder - Draws structured prompts in ComfyUI. ComfyUI-BingImageSelector - Picks search images before you run. Workflow & Productivity ComfyUI-QueueWorkbench - Manages and edits queued jobs in place. ComfyUI-NodeSnapshots - Smoothes navigation in large workflows. ComfyUI-TypedDecision - Brings Jev-style decisions to local workflows. comfyui-obvpm - Tidies up workflows with wire bundles and presets. ComfyUI_Assistant - Adds a chat robot that edits your workflows. Comfy-compare-copy-buttons - Adds a copy button to the ComfyUI Compare node. Comfyui-workflow-background - Sets custom wallpapers for ComfyUI. Prompt-vault - Stores and sorts your AI prompts locally. Comfyui-prompt-library - Brings weighted prompts and templates to ComfyUI. Genkai-ComfyUI-Nodes - Syncs video playback with timed prompts. Music & Audio ComfyUI-FL-YuE2 - Brings music generation and LoRA training to nodes. ComfyUI-QwenASR - Adds speech nodes and subtitles to ComfyUI. Mobile & Access ComfyPort - Brings ComfyUI workflows to a native Android client. Need to go further back? Check out September's post or the full archive at LocalAI News . If there's anything wrong, let me know in the comments and I'll see you in the next one! submitted by /u/vramkickedin to r/StableDiffusion [link] [comments]

★ Release 5.18.0

vasqu — Tue, 03 Nov 2026 00:00:00 +0000

90% · First-party 90%, Usable today 85%

New Model additions Nemotron 3 Diarization Nemotron 3 Diarization is an open-weight streaming speaker diarization model designed to determine "who spoke when" in real-world audio. It supports both streaming and offline inference, handles up to eight speakers, and orders speaker outputs by each speaker's first arrival in the input audio. The model uses the Arrival-Order Speaker Cache (AOSC) 1 and FIFO queue introduced for Streaming Sortformer 1 , 2 . A single checkpoint supports configurable latency profiles, from an 80 ms input buffer to a 30.4 s offline-style buffer, and configurable output frame resolution in multiples of 10 ms. With chunked inference, the maximum audio duration is not limited. Links: Documentation Add Nemotron3Diarization ( #49056 ) by @eustlb in #49056 NemotronH Omni NemotronH Omni is a multimodal reasoning model from NVIDIA that pairs the NemotronH hybrid Mamba-Transformer language model with a RADIO vision encoder and an optional Parakeet-based sound encoder. Image (and video) patches are projected through a RADIO tower and a pixel-shuffle MLP into the language model's embedding space at the <image> / <video> context-token positions; audio clips are projected in the same way at <audio> positions. The result is a single autoregressive model that reasons jointly over text, images, video and sound. Links: Documentation Add support for Nemotron Omni ( #46509 ) by @meatybobby in #46509 HyperCLOVAX Vision V2 HyperCLOVAX Vision V2 is a multimodal vision-language model developed by NAVER. It combines the HyperClovaX language model backbone with a Qwen2.5-VL vision encoder. The model supports text, image, and video inputs and is capable of chain-of-thought reasoning via built-in thinking tokens ( <think>...</think> ). Links: Documentation add HyperClovaX Vision ( #44314 ) by @jp1924 in #44314 GTE GTE was proposed in mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval by Xin Zhang, Yanzhao Zhang, Dingkun Long, Wen Xie, Ziqi Dai, Jialong Tang, Huan Lin, Baosong Yang, Pengjun Xie, Fei Huang, Meishan Zhang, Wenjie Li and Min Zhang. GTE is a BERT-style bidirectional encoder that replaces absolute position embeddings with RoPE, uses a gated MLP, and applies layer normalization after each residual connection. The same architecture backs Alibaba's gte-*-v1.5 , gte-multilingual-* and gte-en-mlm-* checkpoints as well as Snowflake's snowflake-arctic-embed-m-v2.0 . Links: Documentation model: Add GTE to Transformers ( #48416 ) by @harshaljanjani in #48416 Breaking changes 🚨 [ROCm] gpt-oss: route FA3 to aiter-flash-attn, generate ROCm fixtures ( #46837 ) by @Abdennacer-Badaoui 🚨 Speed up detr image processing ( #48066 ) by @guarin 🚨 Remap indexers layer_type ( #48974 ) by @Cyrilvallez 🚨 [vLLM] Fix video token counting for Transformers backend video inputs (Part 1) ( #48894 ) by @harshaljanjani 🚨 🚨Bring some dinos to modern standards ( #46266 ) by @molbap 🚨 [ Kernels ] Bump version ( #48714 ) by @vasqu Bugfixes and improvements fix incorrect hub tokenizer class ( #48641 ) by @itazap [CI] Deduplicate Nvidia/AMD CI reply comments and add headers ( #48655 ) by @ydshieh Update dev ( #48654 ) by @vasqu [tests] Fix NougatModelIntegrationTest: pin artifact revision and update golden values ( #48638 ) by @ydshieh [fix] Fix GlmOcr integration tests: wrong token IDs and image token decode bug ( #48650 ) by @ydshieh [GLM 5.3 Flash] Preserve original names when saving text checkpoints ( #48676 ) by @Dovis01 Register activation kernel layers on XPU ( #47858 ) by @jiqing-feng Mirror the registered pytree flatten when building automatic dynamic shapes ( #48578 ) by @IlyasMoutawwakil Fix AutoImageProcessor requiring torchvision when only Pillow is installed ( #48616 ) by @blipbyte Assert cached decode matches recomputing without a cache ( #48289 ) by @IlyasMoutawwakil [higgs_audio_v2] Fix: use config.num_codebooks in audio labels tensor (Simple Fix!) ( #48560 ) by @b-re-w [ MoE ] Fix eager EP ( #48653 ) by @vasqu [MusicgenMelody] Fix conditioning silently dropped at generation step 0 ( #48679 ) by @ydshieh Fix deepspeed ci ( #48640 ) by @SunMarc Synthetic test assets ( #48589 ) by @tarekziade Skip the expert-parallel sentinel masking when expert parallelism is off ( #48201 ) by @qgallouedec [Fix] yolos offload issue ( #48688 ) by @molbap [serge] Fix 2 integration tests for model minimax failing with output_mismatch (tensor values differ (2)) ( #48515 ) by @sergereview[bot] [serge] Fix 2 integration tests for model mistral failing with other (other (2)) ( #48429 ) by @sergereview[bot] Fix Qwen2.5-VL temporal RoPE for fractional video intervals ( #48669 ) by @yeyeyeping Fix slow integration tests on XPU ( #48611 ) by @jiqing-feng QA: Added a MemoryCleanupMixin class for tests ( #48681 ) by @tarekziade [serge] Fix 1 integration test for model flex_olmo failing with other (other (1)) ( #48668 ) by @sergereview[bot] Fix D-FINE / RT-DETR main loss being computed over the denoising queries ( #48528 ) by @stefan-it [CI] Replace hardcoded username allowlists with author_association check in workflow triggers ( #48712 ) by @ydshieh Add flash_attention_4 in attn_implementation AutoModel docstring ( #48684 ) by @3manifold Keep the expert-parallel sentinel slots out of the router gradient ( #48689 ) by @qgallouedec [DeepseekV3] OOM cascade root-cause investigation (generator ref leak in conversion_mapping) ( #48720 ) by @ydshieh Use huggingface_hub httpx export ( #48685 ) by @Wauplin unifying device_mesh init to enable PP + TP inference ( #48155 ) by @3outeille Enable FSDP2 + expert parallelism via a 2-D (fsdp, tp) device mesh ( #48516 ) by @qgallouedec Switch daily CI to torch 2.14 — update expected outputs ( #48750 ) by @ydshieh fix videomae load error ( #48675 ) by @sywangyi Fix silently random-initializing RTDetrModel / SEWDForCTC loads (wrong base_model_prefix ) ( #48744 ) by @ Fix Glm4vMoeIntegrationTest: offload_folder + MemoryCleanupMixin ( #48776 ) by @ydshieh [InternVL] Normalize num_patches before np.cumsum ( #48469 ) by @lorenzozanee Kernel api doc, part 2 ( #46889 ) by @michaelbenayoun Fix hidden state selection on Gemma4 assistant's first prefill step ( #48704 ) by @glistening Fix inkling embedding norm ( #48786 ) by @Cyrilvallez Fix TextToAudioPipeline crash for tokenizer-only models ( #48505 ) by @jiqing-feng Cast pixel values to the patch embedding dtype in DeepSeek-OCR-2 ( #48632 ) by @jiqing-feng add kernel mapping entry for RMSNormGated, KDA, Conv1D on XPU ( #48702 ) by @kaixuanliu Bump peft version requirement ( #48716 ) by @shniubobo [serge] Fix 12 integration tests for model edgetam failing with import_or_config (other (12)) ( #48322 ) by @sergereview[bot] Restore legacy tensor-parallel initialization for compatibility ( #48797 ) by @3outeille Fix kosmos flaky test ( #48800 ) by @IlyasMoutawwakil Add integration tests for MuseGlimmerAssistantModel ( #48796 ) by @ydshieh Fix AutoModel.from_pretrained not restoring modules_to_save weights ( #48595 ) by @shniubobo [docs] mrope and axial rope ( #48717 ) by @stevhliu Fix decoder only path for older bert variants ( #48785 ) by @Cyrilvallez [Fix] Clean-up ternaries in the DeepSeek family ( #48447 ) by @remi-or [utils] Add MUSA support for Flash Attention 2 ( #48612 ) by @XiaomingFun233 [generate] Drop attention mask early without padding ( #48814 ) by @Cyrilvallez Pin utf-8 in test_can_init_all_missing_weights source read (Windows non-UTF-8 locale fix) ( #48819 ) by @dltsum Relax static-cache tolerance in test_generate_with_static_cache (1e-5 → 5e-5) ( #48815 ) by @ydshieh Detect nested rope_parameters without relying on layer_types ( #48798 ) by @hmellor Support for MoE in the GGUF integration ( #48529 ) by @SunMarc [docs] gguf ( #46357 ) by @stevhliu [apply_chat_template] pass sampling_rate to call ( #48794 ) by @eustlb [CI] Add link checker ( #48160 ) by @stevhliu Qwen3.8 GGUF ( #48660 ) by @SunMarc docs: fix broken #combining-with-fsdp2 anchor in expert_parallelism.md ( #48854 ) by @ydshieh [GPTNeoXJapanese] Fix RoPE ignoring partial_rotary_factor ( #48652 ) by @blipbyte QA: deactivate rule 41 ( #48852 ) by @tarekziade Fix reset on the dynamic cache layers ( #48809 ) by @jiqing-feng [generate] Make all methods and logits processors agnostic to lm_head output size ( #48846 ) by @Cyrilvallez Fix kosmos ( #48853 ) by @Cyrilvallez Add test for causal only variant of some encoder-decoder models ( #48760 ) by @nandan2003 Fix ESMFold2 ligand iPLDDT weighting: mol_type non-polymer code is 3, not 4 ( #48831 ) by @faustomilletari Fix flaky RfDetr test_save_load ( #48869 ) by @ydshieh fix(ci): harden GitHub Actions workflows ( #48160 ) ( #48834 ) by @hf-security-analysis[bot] Fix Glm4MoeIntegrationTest: split into 3 tests, switch to GLM-4.5-Air ( #48820 ) by @ydshieh Fix StaticCache for Mllama and enable torch.compile ( #48141 ) by @jiqing-feng Fix Minimax M2 partial_rotary_factor by remapping legacy rotary_dim ( #48486 ) by @dajiaohuang Fix Pixtral image processor do_pad option ( #48872 ) by @jzakrzew [CB] Add pause mechanism ( #48462 ) by @remi-or Fix DFlash sampled candidates losing the batch dimension ( #48281 ) by @VaggelisGian Fix sliding window cache when assistant model calls generate ( #48280 ) by @VaggelisGian Fix GLM rope_parameters dict shared mutation across test instances ( #48895 ) by @ydshieh [ feat ] Allow untying hidden_states[-1] from last_hidden_state via the model config ( #48087 ) by @tomaarsen Fix Idefics2 padding when the first example has no image ( #48753 ) by @Arnavsharma2 Don't fail model loading when the accelerator can't report free memory ( #48136 ) by @studioego [Improvement] Rework the docstring and comments of mHC ( #48888 ) by @remi-or [serge] Fix 3 integration tests for model deepseek_vl failing with other (other (3)) ( #48536 ) by @sergereview[bot] Add auto_docstring task model overrides ( #47815 ) by @guarin Make LongcatFlashConfig self-consistent without building the model ( #48899 ) by @hmellor [ DSA ] Only save latents on dsa with indexer as well ( #48876 ) by @vasqu [Chat Parsing] Coerce oneOf tool arguments ( #48719 ) by @yonigozlan Always materialize the causal mask in Doge so sdpa stays causal ( #48821 ) by @blipbyte Fix docstring argument names that don't match signatures ( #48474 ) by @IshaanPotle Mark test_generate_with_static_cache as flaky for olmo and bigbird_pegasus ( #48856 ) by @ydshieh Clean up some MoE models' integration tests ( #48833 ) by @ydshieh Fix T5 tied weights order for lm_head ( #48238 ) by @vaibhavmashal Size the device_map buffer from the largest leaf module ( #47211 ) by @dhruv7477 Fix compile cache tests ( #48923 ) by @Cyrilvallez Update arXiv citation in NeoMME model doc ( #48926 ) by @tonywu71 Standardise Aria's MoE onto the experts interface ( #48907 ) by @hmellor Fix possessive typo in Whisper long-form warning ( #48877 ) by @erikdw Modular conversion small fix ( #48934 ) by @zucchini-nlp fix(vibevoice-asr): use integer ceiling division for audio token count ( #48864 ) by @ege-arhan Improve lazy import error messages ( #48602 ) by @karatarassul4-max Fix tests due to dropping attn mask ( #48903 ) by @SunMarc docs: fix docstring parameters that do not match signatures ( #48904 ) by @simpleqt DOC: Improve documentation for remap_legacy_layer_types function ( #48651 ) by @mathewOracle Align special tokens on the text config ( #48847 ) by @qgallouedec docs: fix dead doc links in i18n READMEs and the xlnet docstring ( #48905 ) by @simpleqt Fix AXK2 integration test: update CUDA expected text and rename class ( #48941 ) by @ydshieh Resolve the Hub revision once per load instead of passing a private _commit_hash around ( #47611 ) by @Wauplin Keep image processor backends in sync on keys and dtypes ( #48739 ) by @yupengtang Fix infeasible cost matrix errors in hugarian matcher losses ( #47730 ) by @guarin Fix more stuff ( #48979 ) by @zucchini-nlp Skip an unnecessary image copy in the torchvision image normalization path ( #48897 ) by @jzakrzew Better attn default for gguf ( #48935 ) by @SunMarc Add pose estimation keypoint preprocessing to Sapiens2ImageProcessor ( #47199 ) by @Sainava Fix image processor class-level size mutation and min_pixels handling ( #48916 ) by @Gracy769 Contract the mamba2 chunk scan with einsum instead of broadcast-then-sum ( #48978 ) by @tarekziade Fix typos in DeepseekV4 comments ( #48953 ) by @Janiarafath Reduce peak memory in examples_torch CI job (OOM fix) ( #48983 ) by @ydshieh Fix vibevoice TTS batched audio index ( #48902 ) by @ebezzam [CB] [Major] Upgrade the cache to support different attention types ( #47809 ) by @remi-or Fix SwitchTransformers Top1 router: raw logits, expert capacity accounting, and router losses ( #48421 ) by @yurekami Fix Qwen3OmniMoeIntegrationTest OOM ( #48987 ) by @ydshieh Let prefix_allowed_tokens_fn override model -inf and raise an exception on unsatisfiable generation constraints. ( #48927 ) by @ksh108405 [generate] Simplify candidate generators by removing required update_candidate_strategy ( #48982 ) by @Cyrilvallez [generate] Always correctly restrict assisted decoding with max length/eos token ( #48981 ) by @Cyrilvallez QA: applied ruff rule PLW1514 ( #48990 ) by @tarekziade Update tokenizer gguf support ( #48656 ) by @SunMarc [vLLM] Fix video token counting for Transformers backend video inputs (Part 2) ( #48900 ) by @harshaljanjani Update ggml kernels path ( #48991 ) by @SunMarc Enable compressed-tensors FP8 kernels on MPS (torch >= 2.15) ( #48985 ) by @Isalia20 Fix mps autocast handling in rotary embeddings ( #49006 ) by @Isalia20 Fix static cache per layer head shapes ( #48619 ) by @dacorvo Summarization examples: download NLTK punkt_tab, not punkt ( #49014 ) by @davanstrien [docs] Fix legacy hf CLI references (transformers) ( #48988 ) by @Wauplin Fix RecurrentGemma compiled generation with StaticCache ( #48961 ) by @sywangyi updated GraniteMoeHybrid expectations (CPU) ( #49016 ) by @tarekziade OpenVINO HF Exporter ( #47003 ) by @IlyasMoutawwakil fix noisy comments ( #49013 ) by @tarekziade Fix assisted decoding for VLM due to dropping attn mask ( #49019 ) by @SunMarc Deprecate min-max pixels ( #49021 ) by @zucchini-nlp Keep special token ids the tokenizer does not define ( #48708 ) by @albertvillanova Added more usage of MemoryCleanupMixin ( #49011 ) by @tarekziade Shorten noisy OpenVINO SDPA comment ( #49033 ) by @tarekziade PEFT x Dtensor-based TP integration ( #48485 ) by @michaelbenayoun fix(zamba): add use_associative_scan config flag to avoid torch.compile slowdown ( #48331 ) by @msnliu Scope GITHUB_TOKEN permissions per job ( #49046 ) by @hf-security-analysis[bot] Fix mask creation not being skipped under torch.compile ( #48975 ) by @jiqing-feng [Chat] Loading GGUF models served with the Chat CLI ( #49031 ) by @ariG23498 Pin GitHub Actions to commit SHAs ( #49049 ) by @hf-security-analysis[bot] Only seed numpy in BigBird block-sparse attention during training ( #49037 ) by @jiqing-feng QA: Fix llama4 leak ( #49042 ) by @tarekziade Fix startup failures: drop permissions reusable-workflow callers cannot grant ( #49055 ) by @paulinebm Fix startup failures: drop pull-requests: read from check_failed_tests.yml ( #49057 ) by @paulinebm Register the remaining mamba-ssm kernel layers on XPU ( #49035 ) by @jiqing-feng Add workflow for building XPU CI Docker images ( #49039 ) by @regisss Fix assistant masks for processors ( #48793 ) by @Rocketknight1 Add MPS maintainer ( #49052 ) by @Rocketknight1 [docs] Loading behavior ( #49023 ) by @stevhliu [Nemotron3Diarization] nit: hub pr merged to main ( #49065 ) by @eustlb fix(ci): harden GitHub Actions workflows ( #49057 ) ( #49059 ) by @hf-security-analysis[bot] Honor config.output_router_logits in the MoE VLM wrappers ( #48885 ) by @qgallouedec Fix XPU Docker image build ( #49073 ) by @regisss Fix assisted eos token condition ( #49075 ) by @Cyrilvallez [serge] Fix OOM in Moshi integration tests with MemoryCleanupMixin ( #48839 ) by @sergereview[bot] Fix odd head_dim validation for RoPE configurations ( #48524 ) by @somuai Keep already-decoded array arguments unchanged ( #49062 ) by @yonigozlan Fix NaN in Parakeet eager attention with padded batches ( #49070 ) by @ArthurZucker Bump huggingface_hub upper bound to <3.0 (transformers) ( #49083 ) by @Wauplin Keep attention_mask as None in OPT's causal mask creation ( #49002 ) by @jiqing-feng Add Trainer.end ( #48875 ) by @qgallouedec Add image processing tester init ( #48829 ) by @guarin [Executorch] Add MLX recipe ( #48910 ) by @metascroy [Zamba] Fix associative scan breaking ONNX export and OOM in integration test ( #49092 ) by @ydshieh Fix RGB early-return skipping PNG tRNS compositing ( #49005 ) by @cs-fisha Use namespaced dataset ids in docs and PyTorch examples ( #49017 ) by @davanstrien Fix MaskFormerSwin attention mask dtype to follow hidden states ( #49032 ) by @kaixuanliu [NemotronH-Omni] Fix device mismatch in test tensor creation ( #49102 ) by @ydshieh [serge] Fix 2 integration tests for model cvt failing with output_mismatch (tensor values differ (2)) ( #49076 ) by @sergereview[bot] [serge] Fix 2 integration tests for model hy_v3 failing with output_mismatch (tensor values differ (2)) ( #49068 ) by @sergereview[bot] [serge] Fix 2 integration tests for model pvt_v2 failing with other ( #49067 ) by @sergereview[bot] Keep the eos ids the config declares ( #49082 ) by @albertvillanova Use grouped_mm on TPU devices under torch.compile ( #49097 ) by @salkan0 [serge] Fix 2 integration tests for model jamba failing with other (other (2)) ( #49044 ) by @sergereview[bot] Remap the legacy Gemma 1 hidden_act in the config post-init ( #49084 ) by @PCfVW Fix exporters import on torch < 2.9 (is_contiguous_or_false) ( #49124 ) by @ydshieh [gemma3n] fix audio test fixture: use hf_hub_download instead of load_dataset ( #49128 ) by @ydshieh qwen3 models map to wrong tokenizer class on the hub ( #49116 ) by @itazap Restore the Unicode whitespace set in the GPT-SW3 tokenizer ( #48912 ) by @David-Wu1119 [AMD] Fix some integration tests ( #49153 ) by @Abdennacer-Badaoui [Gemma] Fix test_model_7b_fp16_static_cache expected value for cuda 8 after #49084 ( #49133 ) by @ydshieh Fix UMT5 decoder self-attention not being causal ( #49135 ) by @the-cross-art Skip flash tests that fall back to a hub kernel when kernels is missing ( #49129 ) by @Abdennacer-Badaoui Auto generate model inits ( #47829 ) by @guarin Fix get_json_schema dropping items/enum for unions of list/dict/Literal types ( #49136 ) by @JoeyTan21 Pick the default flash implementation based on the current hardware ( #49109 ) by @Abdennacer-Badaoui Deprecate the use_mamba_kernels config flag that no longer has any effect ( #49155 ) by @albertvillanova [CI] ssh-runner: add optional cache_type input to switch between bucket and EFS runners ( #49159 ) by @ydshieh [generation] Encode multimodal data only once ( #45783 ) by @zucchini-nlp No more -hf repo names for ESMC ( #49158 ) by @Rocketknight1 [MPS] Remove cu_seqlens_k clone workaround for metal-flash-sdpa ( #49091 ) by @Isalia20 [PerceptionLM] Restore test_inputs_embeds overrides to fix flaky test ( #49165 ) by @ydshieh [CB] Fix failing tests discovered when using the B200 ( #49171 ) by @remi-or [imagegpt/vilt/trocr] fix cache fixture tests: use hf_hub_download instead of load_dataset ( #49178 ) by @ydshieh Fix lost call ( #49163 ) by @molbap Document image_like_kwargs ( #49180 ) by @guarin [CacheHardIntegrationTest] use dedicated safetensors repo to fix Xet bucket cache corruption ( #49182 ) by @ydshieh Document running the example scripts on Hugging Face Jobs ( #49050 ) by @davanstrien Fix backslash handling in generate flag values in transformers chat ( #48709 ) by @JHC56 Finish removing the MPS autocast workaround ( #49157 ) by @rubenG1009 Fix Trainer checkpoint resume crashing on CPU with multiple processes ( #49123 ) by @neevmodh Fix command syntax for optimum-cli export ( #46451 ) by @Ahwar QA: fix noisy comment checker ( #49184 ) by @tarekziade update to torch 2.14 ( #49199 ) by @sywangyi Video processors - general maintenance ( #48251 ) by @zucchini-nlp [Parakeet] Convert NeMo's stochastic depth to layerdrop ( #49191 ) by @Deep-unlearning [MPS] Let mps sdpa handle grouped query attention directly ( #49187 ) by @Isalia20 Replace datasets that no longer load with maintained uploads ( #49018 ) by @davanstrien Fail fast on eval OOM under auto_find_batch_size ( #49198 ) by @qgallouedec Fix SequenceBiasLogitsProcessor edge cases: token id 0 and prefix equal to context ( #49117 ) by @lucaluo925 Map bare list, tuple and dict annotations to the right JSON schema type in get_json_schema ( #49145 ) by @825pranav [ Kernels ] Sync mamba version ( #49205 ) by @vasqu gguf user defined tokens ( #49008 ) by @SunMarc QA: restore masking_utils export comment with a noqa ( #49209 ) by @tarekziade Fix deepstack features for mixed-input ( #49177 ) by @zucchini-nlp Fix stale _added_tokens_encoder entries in cpmant and wav2vec2 ( #47440 ) by @ishan-1010 Fix additional_special_tokens data loss with extra_special_tokens ( #47848 ) by @erichanwang Fix MPS GQA version gating ( #49210 ) by @Isalia20 Add Strix Halo (gfx1151) Atlas Inference Hub-kernel path for Qwen3.5/3.6/3.8 Gated DeltaNet ( #49127 ) by @AzeezIsh Fix MiniMax M3 partial 3D vision rotary embeddings ( #49164 ) by @cuichenx Fix missing router_logits in Qwen3.5-MoE and other MoE models ( #49179 ) by @zucchini-nlp [Nemotron3Diarization] fix streaming last stft frame dropped ( #49167 ) by @eustlb Significant community contributions The following contributors have made significant changes to the library over the last release: @harshaljanjani model: Add GTE to Transformers ( #48416 ) [vLLM] Fix video token counting for Transformers backend video inputs (Part 2) ( #48900 ) 🚨 [vLLM] Fix video token counting for Transformers backend video inputs (Part 1) ( #48894 ) @eustlb [Nemotron3Diarization] fix streaming last stft frame dropped ( #49167 ) [Nemotron3Diarization] nit: hub pr merged to main ( #49065 ) Add Nemotron3Diarization ( #49056 ) [apply_chat_template] pass sampling_rate to call ( #48794 ) @tarekziade QA: restore masking_utils export comment with a noqa ( #49209 ) QA: fix noisy comment checker ( #49184 ) QA: Fix llama4 leak ( #49042 ) Shorten noisy OpenVINO SDPA comment ( #49033 ) Added more usage of MemoryCleanupMixin ( #49011 ) fix noisy comments ( #49013 ) updated GraniteMoeHybrid expectations (CPU) ( #49016 ) QA: applied ruff rule PLW1514 ( #48990 ) Contract the mamba2 chunk scan with einsum instead of broadcast-then-sum ( #48978 ) QA: deactivate rule 41 ( #48852 ) QA: Added a MemoryCleanupMixin class for tests ( #48681 ) Synthetic test assets ( #48589 ) @ydshieh [CacheHardIntegrationTest] use dedicated safetensors repo to fix Xet bucket cache corruption ( #49182 ) [imagegpt/vilt/trocr] fix cache fixture tests: use hf_hub_download instead of load_dataset ( #49178 ) [PerceptionLM] Restore test_inputs_embeds overrides to fix flaky test ( #49165 ) [CI] ssh-runner: add optional cache_type input to switch between bucket and EFS runners ( #49159 ) [Gemma] Fix test_model_7b_fp16_static_cache expected value for cuda 8 after #49084 ( #49133 ) [gemma3n] fix audio test fixture: use hf_hub_download instead of load_dataset ( #49128 ) Fix exporters import on torch < 2.9 (is_contiguous_or_false) ( #49124 ) [NemotronH-Omni] Fix device mismatch in test tensor creation ( #49102 ) [Zamba] Fix associative scan breaking ONNX export and OOM in integration test ( #49092 ) Fix Qwen3OmniMoeIntegrationTest OOM ( #48987 ) Reduce peak memory in examples_torch CI job (OOM fix) ( #48983 ) Fix AXK2 integration test: update CUDA expected text and rename class ( #48941 ) Clean up some MoE models' integration tests ( #48833 ) Mark test_generate_with_static_cache as flaky for olmo and bigbird_pegasus ( #48856 ) Fix GLM rope_parameters dict shared mutation across test instances ( #48895 ) Fix Glm4MoeIntegrationTest: split into 3 tests, switch to GLM-4.5-Air ( #48820 ) Fix flaky RfDetr test_save_load ( #48869 ) docs: fix broken #combining-with-fsdp2 anchor in expert_parallelism.md ( #48854 ) Relax static-cache tolerance in test_generate_with_static_cache (1e-5 → 5e-5) ( #48815 ) Add integration tests for MuseGlimmerAssistantModel ( #48796 ) Fix Glm4vMoeIntegrationTest: offload_folder + MemoryCleanupMixin ( #48776 ) Switch daily CI to torch 2.14 — update expected outputs ( #48750 ) [DeepseekV3] OOM cascade root-cause investigation (generator ref leak in conversion_mapping) ( #48720 ) [CI] Replace hardcoded username allowlists with author_association check in workflow triggers ( #48712 ) [MusicgenMelody] Fix conditioning silently dropped at generation step 0 ( #48679 ) [fix] Fix GlmOcr integration tests: wrong token IDs and image token decode bug ( #48650 ) [tests] Fix NougatModelIntegrationTest: pin artifact revision and update golden values ( #48638 ) [CI] Deduplicate Nvidia/AMD CI reply comments and add headers ( #48655 ) @molbap Fix lost call ( #49163 ) 🚨 🚨Bring some dinos to modern standards ( #46266 ) [Fix] yolos offload issue ( #48688 ) @remi-or [CB] Fix failing tests discovered when using the B200 ( #49171 ) [CB] [Major] Upgrade the cache to support different attention types ( #47809 ) [Improvement] Rework the docstring and comments of mHC ( #48888 ) [CB] Add pause mechanism ( #48462 ) [Fix] Clean-up ternaries in the DeepSeek family ( #48447 ) @jiqing-feng Keep attention_mask as None in OPT's causal mask creation ( #49002 ) Register the remaining mamba-ssm kernel layers on XPU ( #49035 ) Only seed numpy in BigBird block-sparse attention during training ( #49037 ) Fix mask creation not being skipped under torch.compile ( #48975 ) Fix StaticCache for Mllama and enable torch.compile ( #48141 ) Fix reset on the dynamic cache layers ( #48809 ) Cast pixel values to the patch embedding dtype in DeepSeek-OCR-2 ( #48632 ) Fix TextToAudioPipeline crash for tokenizer-only models ( #48505 ) Fix slow integration tests on XPU ( #48611 ) Register activation kernel layers on XPU ( #47858 ) @Wauplin Bump huggingface_hub upper bound to <3.0 (transformers) ( #49083 ) [docs] Fix legacy hf CLI references (transformers) ( #48988 ) Resolve the Hub revision once per load instead of passing a private _commit_hash around ( #47611 ) Use huggingface_hub httpx export ( #48685 ) @meatybobby Add support for Nemotron Omni ( #46509 ) @Sainava Add pose estimation keypoint preprocessing to Sapiens2ImageProcessor ( #47199 ) @jp1924 add HyperClovaX Vision ( #44314 )

★ Google releases Gemma 2 2B, ShieldGemma and Gemma Scope

Tue, 03 Nov 2026 00:00:00 +0000

90% · First-party 90%, Usable today 66%

Datasette 1.0a39 and 0.65.4 security releases - Datasette Blog

Simon Willison — Tue, 03 Nov 2026 00:00:00 +0000

88% · First-party 88%, Usable today 55%

Datasette 1.0a39 and 0.65.4 security releases - datasette.io/blog/2026/se... We ran an extensive audit using Claude Fable 5.1, GPT-5.6 Sol and GPT-6 Astra, then fixed a range of different bugs. If you're running a Datasette instance on a public website you should upgrade.

We just pushed a big update to Sakana Chat Free to use: chat.sakana.ai A big motivation for this release is getting people in Japan, especi…

hardmaru — Tue, 03 Nov 2026 00:00:00 +0000

88% · Usable today 88%, First-party 84%

We just pushed a big update to Sakana Chat Free to use: chat.sakana.ai A big motivation for this release is getting people in Japan, especially kids, excited about software development. Vibe-coding turns Kanji & Math drills during the summer break into fun games they can actually build themselves.

Show HN: Subvocal – Talk to your computer without making noise

aarushyadav — Tue, 03 Nov 2026 00:00:00 +0000

88% · First-party 88%, Measured result 68%

Hi HN, we're Aarush and Arnav from The Subvocal Company (YC F26) ( https://subvocal.company/ ). We’re building smart glasses that let you talk to your computer without talking out loud. You can mouth words silently and discreetly and the glasses decode them to text at the speed of speech. Here's a video of Dave from YC trying it out: https://www.youtube.com/watch?v=9QdX1eObVYI (Edit: you don't actually have to move your lips or even open your mouth for this to work! Since the RF can see inside your mouth the system can be fine tuned on "internal speech". This isn't the automatic tongue movements that occur when "thinking" words to yourself, but more like mouthing with your lips closed. It's a bit weird to do, but with practice, we have been able to get it down pretty well.) Arnav and I were studying CS at Georgia Tech at the beginning of the year, with no experience in silent speech or sensing. We were both AI-native builders and power users of Wispr Flow. What bugged us was not being able to use these tools in the library (or an office) or in public. At Stanford’s TreeHacks in February, we decided to build the most technically ridiculous thing we could think of. We’d read about AlterEgo, a silent speech system out of MIT’s Media Lab, and wanted to recreate it in 36 hours. We built a crude prototype, sticking EMG electrodes onto my face: https://drive.google.com/file/d/1mwhv5HZMz3UTevdrgwS5O7g2jWV... We got it to kind of work at a letter level in a very janky way. It wasn’t good enough to win the hackathon, but convinced us to go all in. The first time I typed a sentence without anyone noticing, I felt the magic of the technology. We quickly realized EMG (reading muscle electrical signals) wouldn’t work: - Signal changes due to sweat - Electrical interference - Placement variability - Most importantly, no one wants to stick electrodes onto their face!! So we switched to RF and built the glasses you see now. They emit radio waves, similar to Bluetooth, that pass through your face. As they cross the tongue, lips and soft palate, they’re modulated by silent mouthing. We train foundation models on this data to decode these perturbations to text. Despite prior academic research, getting this to work was a huge engineering challenge. First we built an extremely low noise RF sensing stack. Then we had to place antennas so their fields overlapped maximally with the articulators. Our first attempt on glasses failed completely, so we reverted to old habits and taped antennas on our face: https://drive.google.com/file/d/1ks0dS0eZiTV9EqSFsyB_w5BBjpc... Since taping antennas consistently in the same spot and angle was hard, we created this weird but effective head rig to hold them in place: https://drive.google.com/file/d/1rhzNFpdDzr7oHk0isFY70dkoV4C... This worked, but obviously wasn’t a product yet. So we worked deep in simulations to design glasses that could hold the antennas. That evolved into our design now, with antennas embedded within the frames. Once we established there was a signal, the next hurdle was cross-user generalization. Everyone’s facial anatomy, and hence RF signal patterns, are vastly different. We tried algorithmic workarounds but realized the only lever was to massively scale pretraining data. So that’s what we did. We set up booths in our office and paid people to read prompts wearing our glasses, to pretrain our models on. This produced a beautiful scaling curve, with errors falling quickly as we scaled our dataset and cross-user performance becoming genuinely compelling (as you see in the video above; Dave only had a short 20-sentence calibration). We always heard about building things from first principles but never understood it before this. We tried tackling it top down but completely failed. Only when we broke each component (the antenna, electronics, ML) down to its fundamentals to understand and optimize it did we get it to work really well. Over the next few months we’re continuing R&D to turn our prototype glasses into the slick product on our website and ship in Q1 2027. We’re also scaling up our dataset to improve performance on edge cases. For anyone who loves voice dictation but hates using it around people, we’ve opened preorders for our first batch of 500 units, with a $200 discount off the final price. Allocation is running out quickly, so get yours at https://subvocal.co/preorder ! Comments URL: https://news.ycombinator.com/item?id=50340088 Points: 676 # Comments: 336

Started a hobby project about the Mongol Invasions of Vietnam. Claude helped turn it into a real game

/u/Ok-Pirate5732 — Tue, 03 Nov 2026 00:00:00 +0000

87% · Usable today 87%

Vietnamese representation in video games has historically been limited to meme-able farmers that you get to blow up in a tank while blasting CCR (shoutout BF:Vietnam! Also Shoutout AOE2 for being the one exception I can think of) So, even with very little prior experience, I used Claude to change that! For the last few months, I've been working on 100 Bodies in the Grass , a 4 player co-op game where you play as the Vietnamese, defending your village from the Yuan army during the 3rd Mongol Invasion in 1287. Claude was heavily involved in the coding of this game (to the point that I wouldn't have even attempted it without these tools), and today, I've released a free demo on Steam. If you're interested in checking it out: https://store.steampowered.com/app/5357660/100_Bodies_in_the_Grass/ I found Claude to be particularly useful when paired with Godot, given that it's mostly plain text. The ability for Claude Code to test, iterate, and learn/implement Godot's extensive open documentation has been key. I've also been surprised by how well it's done from an architecture/implementation standpoint (at least from my newb eyes), as I initially imagined it would've been a way buggy/unstable mess. It's actually quite stable, and I've learned a lot having Claude break everything down, slowly, as we've progressed. The one major weakness though is in animation. Claude + Blender is decent enough at small clean up tasks or editing of 3d models, but anything complex it shouldn't be relied upon, and shouldn't be used at all for animations. Here I've found its easier/better to do by hand still, or use existing animation assets. It'll be interesting to see when AI gets better at these areas. If it does, the pace of AI-assisted game development is going to skyrocket. submitted by /u/Ok-Pirate5732 to r/ClaudeAI [link] [comments]

Our team just shipped Fugu-Ultra v1.1! 🐡 By dynamically orchestrating the latest frontier models, we pushed performance up by 7.9 points. W…

hardmaru — Tue, 03 Nov 2026 00:00:00 +0000

87% · Measured result 87%, First-party 83%, Usable today 43%

Our team just shipped Fugu-Ultra v1.1! 🐡 By dynamically orchestrating the latest frontier models, we pushed performance up by 7.9 points. We are now beating Fable 5 in complex coding and reasoning tasks without even having Fable 5 in our agent pool. Collective intelligence is the future.

llama.cpp b12063

github-actions[bot] — Tue, 03 Nov 2026 00:00:00 +0000

87% · First-party 87%, Usable today 85%

dflash: copy hidden features via device copies ( #31506 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62913415 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b12061

github-actions[bot] — Tue, 03 Nov 2026 00:00:00 +0000

87% · First-party 87%, Usable today 83%

mtmd: Pocket tts - support for voices without voice cloning ( #31429 ) feat: support PocketTTS voices with no voice cloning The kyutai/pocket-tts-without-voice-cloning weights ship predefined voices as the backbone KV state after the voice prompt. The converter turns each state back into the prompt embeddings and stores them in the mmproj (voice.), the zeroed voice encoder is left out, and the "voice" field of /tts and --tts-voice select one of them. A speaker reference is rejected when the model has no voice encoder. Assisted-by: Claude Fable 5.1 convert : pocket-tts voices never fail the conversion, log the drift of the state The voice states shipped by Kyutai are not always the ones the pack's weights give for the prompt: italian, german and spanish match within the bf16 rounding, english_2026-04 is 2% off and french 20% (its layer 0 state comes from other weights), while the reference loads them as is and they still sound like the same voice. The converter now re-prompts the backbone with the recovered embeddings, compares the whole state and logs the distance per voice, warning above 5%. A state that does not belong to the weights at all is skipped, so the packs of kyutai/pocket-tts convert too. Assisted-by: Claude Fable 5.1 mtmd : list the predefined voices, expose them in GET /props mtmd_gen_audio_info gains n_voices and mtmd_gen_audio_voice_name() the names, with the voices worded as a feature of any audio generation model. The server lists them under "voices" in /props when the model ships some. Assisted-by: Claude Fable 5.1 server : an unknown voice is a bad request A model with predefined voices answers 400 naming the voice instead of 500 "failed to process TTS prompt". A model without them ignores "voice" with a warning, as the other audio generation models do. Assisted-by: Claude Fable 5.1 refactor api fix conversion small renaming fix lint tts : a model with predefined voices speaks with the first one by default Without a voice prompt such a model only produces near silence. When neither a voice nor a speaker reference is given, llama-tts and the server now take the first predefined voice and say so in the log, as the LFM3-Audio template does with its default voice. Assisted-by: Claude Fable 5.1 mtmd : one comment per voice accessor, converter states the rule only The clip.h comment described clip_gen_get_voice but sat above all three functions; the converter comment quoted the drift measured per pack, which goes stale with the next upload of the weights. Assisted-by: Claude Fable 5.1 clean up redundant code and comments mtmd: match the LFM3-Audio voice name case-insensitively The tts chat template lowers the voice name, so Male speaks with the male voice; the voice lookup lowers it the same way and names the bitmap after the canonical voice. Co-authored-by: Xuan Son Nguyen son@huggingface.co Co-authored-by: Pascal admin@serveurperso.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62875624 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Release 5.17.0

vasqu — Tue, 03 Nov 2026 00:00:00 +0000

87% · First-party 87%, Usable today 86%, Measured result 77%

Release v5.17.0 New Model additions HYV4 Hy4-Preview is a 780B-parameter mixture-of-experts language model that activates 49B parameters per token. Each MoE layer holds 256 routed experts plus one always-active shared expert and routes every token to 8 of them. The context window is 1M tokens. The architecture combines four features: Multi-head Latent Attention (MLA) compresses keys and values into a low-rank latent ( kv_lora_rank ) that kv_b_proj expands back to one key/value per query head. DeepSeek Sparse Attention (DSA) selects index_topk keys per query with a lightweight indexer. Following IndexShare , only the layers marked "full" in indexer_types run an indexer; "shared" layers reuse the previous full layer's selection. Gated MLA with learnable attention sinks , where each head owns a sink logit that participates in the softmax and contributes no value, as in GPT-OSS . Independent Hyper-Connections (iHC) replace the plain residual path with hc_mult parallel residual streams that are collapsed before, and redistributed after, every sublayer. The implementation does not execute the multi-token prediction (MTP) layers. Released checkpoints keep those weights so that other runtimes can use them for speculative decoding; they are ignored at load time. Links: Documentation Add h4 ( #48473 ) by @ArthurZucker in #48473 VibeVoice VibeVoice is a novel framework for synthesizing high-fidelity, long-form speech with multiple speakers by employing a next-token diffusion approach within a Large Language Model (LLM) structure. It's designed to capture the authentic conversational "vibe" and is particularly suited for generating audio content like podcasts and multi-participant audiobooks. Links: Documentation Implement VibeVoice ( #40546 ) by @pengzhiliang in #40546 NeoMME NeoMME is a family of efficient 260M and 800M parameter multimodal-native multilingual foundation encoders from H Company. It processes multilingual text tokens and raw image patches in a single bidirectional Transformer encoder, without a separately pretrained vision tower or causal language model. NeoMME-Retriever is a model fine-tuned from the NeoMME backbone for visual document retrieval with joint late-interaction and dense objectives. It takes text queries and documents (text or page screenshots) and produces multi-vector embeddings for MeanMaxSim scoring (late-interaction) and mean-pooled embeddings for cosine similarity (dense). Links: Documentation Add NeoMME and NeoMME-Retriever ( #47992 ) by @tonywu71 in #47992 Fun-ASR-Nano Fun-ASR-Nano is an 800M-parameter end-to-end speech recognition model developed by Alibaba DAMO Academy's FunAudioLLM team. It achieves state-of-the-art performance on Chinese, English, and Japanese ASR benchmarks while being significantly smaller than comparable models. Key features are Chinese, English, and Japanese , including 7 Chinese dialects and 26 regional accents Hotword customization for domain-specific vocabulary Native punctuation output (no separate punctuation model needed) Links: Documentation Add Fun-ASR-Nano model ( #46180 ) by @LauraGPT in #46180 KimiLinear Kimi Linear is a hybrid linear attention architecture from Moonshot AI, introduced in Kimi Linear: An Expressive, Efficient Attention Architecture . At its core is Kimi Delta Attention (KDA) , a refinement of Gated DeltaNet that gives each key channel its own forget gate, so the recurrent state decays per channel instead of per head. KDA is used in most layers; every fourth layer keeps a full-attention block that reuses DeepSeek-V3's Multi-head Latent Attention (MLA), and the feed-forward blocks are DeepSeek-V3-style MoE with a shared expert. Links: Documentation Kimi linear ( #48250 ) by @remi-or in #48250 Canary Canary-1B-v2, a fast, robust multilingual model for Automatic Speech Recognition (ASR) and Speech-to-Text Translation (AST): Canary reuses the Fast Conformer encoder from Parakeet (loaded through [ ParakeetEncoder ] / [ ParakeetEncoderConfig ]) and pairs it with a Transformer decoder that uses fixed sinusoidal positional embeddings, cross-attention to the encoder outputs and tied input/output embeddings. The task is selected through a decoder prompt prefix built by [ CanaryProcessor ] of the form <|startofcontext|> <|startoftranscript|> <|emo:undefined|> <source_lang> <target_lang> <pnc|nopnc> <|noitn|> <|notimestamp|> <|nodiarize|> , where source_lang == target_lang selects transcription and otherwise selects translation. Links: Documentation model: Add NVIDIA Canary-1B-v2 to Transformers ( #46825 ) by @harshaljanjani in #46825 NeuCodec The NeuCodec model was proposed in Finite Scalar Quantization Enables Redundant and Transmission-Robust Neural Audio Compression at Low Bit-rates . NeuCodec is a neural audio codec extending on XCodec2. It takes advantage of the following features: Finite Scalar Quantization (FSQ) quantisation resulting in a single codebook , making it ideal for downstream modeling with Speech Language Models. Trained with CC data such that there are no Non-Commercial data restrictions . At 50 tokens/sec and 16 bits per token, the overall bit-rate is 0.8kbps . The codec takes in 16kHz input and outputs 24kHz using an upsampling decoder . The FSQ encoding scheme allows for bit-level error resistance suitable for unreliable and noisy channels. Links: Documentation Add support for NeuCodec ( #47143 ) by @harryjulian in #47143 Breaking changes Vision rotary embeddings (2D/3D) have been standardized into a unified RoPE frequency computation module, so users with custom vision models relying on attention-layer-level or model-specific RoPE grid interleaving logic must migrate to the new centralized modeling_rope_utils.py implementation. 🚨 Vision (2d/3d) rotary embeddings ( #48105 ) by @zucchini-nlp Generation Generation improvements include a performance optimization that avoids unnecessary accelerator synchronization on every decode step (reducing per-step overhead), and a fix to prevent unconditional downloading of remote hub files during generation. Several correctness fixes were also applied, including enforcing auto-compile cache checks for encoder-decoder models, standardizing past_key_values naming in AfMoE, and resolving flaky export and integration test failures. [ Generate ] Avoid unconditionally downloading remote hub file ( #48620 ) by @vasqu in [ #48620 ] [generate] stop synchronizing the accelerator on every decode step ( #47975 ) by @SunMarc in [ #47975 ] [AfMoE] Standardize past_key_values argument naming across forward and generate ( #48430 ) by @shenhuaqingshi in [ #48430 ] Fix MTP generation test regex gate for escaped layer ignore keys ( #48003 ) ( #48262 ) by @Noxtimo in [ #48262 ] fix(generation): Enforce the auto-compile cache check for encoder-decoder models ( #48364 ) by @harshaljanjani in [ #48364 ] [serge] Fix 4 integration tests for model generation failing with output_mismatch (list output differs (4)) ( #48133 ) by @sergereview[bot] in [ #48133 ] [VibeVoice] Skip generate export tests (flaky) ( #48396 ) by @ydshieh in [ #48396 ] Cache Fixed several cache-related bugs, including a quantized cache issue in VibeVoice, incorrect rejection of non-static cache implementations in VoxtralRealtime, missing auto-compile cache checks for encoder-decoder models, and a silent failure when paged attention is called without a cache. Documentation was also updated to clarify ContinuousBatchingConfig usage and sliding window model limitations. vibevoice: fix bug for quant cache ( #48487 ) by @kaixuanliu in [ #48487 ] Fix VoxtralRealtime rejecting non-static cache implementations ( #48082 ) by @jiqing-feng in [ #48082 ] Raise when a paged attention forward is called with no cache ( #48297 ) by @qgallouedec in [ #48297 ] [docs] Pass ContinuousBatchingConfig and sliding window models ( #48381 ) by @stevhliu in [ #48381 ] Retry get_daily_ci_runs on stale GitHub API cache ( #48374 ) by @ydshieh in [ #48374 ] Kernels Kernel support was improved with fixes for nested FLA kernel imports when only fla-core is installed, a warning when hub-kernel functions silently fall back to slower pure-PyTorch reference implementations, and the ability to register standalone functions (e.g., RoPE) in KernelConfig with optional non-inheritance of default mappings. Additional fixes include corrected repository paths for ESMFold2 kernels and updated documentation for KernelConfig customization. Support nested FLA kernel imports for fla-core ( #48221 ) by @DimensionSTP in [ #48221 ] Warn once when a hub-kernel function falls back to its reference PyTorch path ( #48185 ) by @qgallouedec in [ #48185 ] [docs] Kernel updates ( #48465 ) by @stevhliu in [ #48465 ] [ Kernels ] Enable functions into kernels registry and allow non inheritance ( #48443 ) by @vasqu in [ #48443 ] Fix kernel commit and repo paths for ESMFold2 ( #48186 ) by @Rocketknight1 in [ #48186 ] Quantization Fixed several quantization bugs, including a quant cache issue in VibeVoice, incorrect FP8 embedding handling for Qwen models, missing FP8 tensor parallelism layer overrides, and unnecessary MXFP4 weight dequantization on XPU devices. fix qwen4exp-fp8 ple embedding ( #48368 ) by @JJJYmmm in [ #48368 ] Keep MXFP4 weights quantized on XPU when use_kernels is set ( #47923 ) by @jiqing-feng in [ #47923 ] Fix missing FP8 TP layer overrides ( #48343 ) by @changwangss in [ #48343 ] Bugfixes and improvements MRoPE continued ( #48594 ) by @zucchini-nlp in [ #48594 ] [fix] Update stale expected strings in HunYuanVL integration tests ( #48646 ) by @ydshieh in [ #48646 ] [Quantizaiton]support 5/6/7 bits in AutoRound ( #48481 ) by @wenhuach21 in [ #48481 ] [fix] Update stale golden values and fix expected_logits shape in FlavaForPreTraining integration tests ( #48639 ) by @ydshieh in [ #48639 ] Fix YOLOS device mismatch with device_map="auto" ( #46886 ) by @swankystark in [ #46886 ] Honor shift_labels in decoder-only LLM/VLM losses ( #48493 ) by @qgallouedec in [ #48493 ] [KimiLinear] Fix test_cpu_offload: set num_local_experts=4 in model tester ( #48624 ) by @ydshieh in [ #48624 ] [docs] Per-layer config ( #48601 ) by @stevhliu in [ #48601 ] Fix generate_flags parsing in transformers chat ( #48597 ) by @SunMarc in [ #48597 ] [fix] Fix how we read package versions - triggered by torch 2.14+ ( #48615 ) by @ydshieh in [ #48615 ] [Docker] Upgrade CPU torch to <=2.14.0, torchcodec to <=0.16.0 ( #48614 ) by @ydshieh in [ #48614 ] Fix AttributeError in gradient_checkpointing_enable(offload=True) ( #48590 ) by @tarekziade in [ #48590 ] Another day fixing CI ( #48591 ) by @zucchini-nlp in [ #48591 ] esmfold2: keep distogram_head in fp32 as well ( #48488 ) by @kaixuanliu in [ #48488 ] Add supports_context_parallel to PreTrainedModel ( #48442 ) by @qgallouedec in [ #48442 ] [docs] mlinter reference ( #48460 ) by @stevhliu in [ #48460 ] [docs] Add a LiteRT page under community integrations ( #48540 ) by @john-rocky in [ #48540 ] [GLM 5.3 Flash] Fix NaN gradients in chunked KDA ( #48455 ) by @imvladikon in [ #48455 ] [docs] Fix [[autodoc]] directives in ALBERT model documentation ( #48593 ) by @samyuktahegde in [ #48593 ] [Fix] Fix A10 expectations for a test ( #48454 ) by @remi-or in [ #48454 ] Add PR comment CI for AMD (MI300) ( #48065 ) by @ydshieh in [ #48065 ] docs: fix docstring parameter names that do not match signatures ( #48575 ) by @simpleqt in [ #48575 ] docs: remove phantom parameters from docstrings ( #48576 ) by @simpleqt in [ #48576 ] extend some case to xpu as well ( #48502 ) by @sywangyi in [ #48502 ] [serge] Fix 2 integration tests for model glm4_moe failing with OOM (other (2)) ( #48551 ) by @sergereview[bot] in [ #48551 ] [serge] Fix 2 integration tests for model nemotron failing with import_or_config (other (2)) ( #48582 ) by @sergereview[bot] in [ #48582 ] Compress the agent conventions file and document two modular pitfalls ( #48586 ) by @tarekziade in [ #48586 ] Guard against a None video processor class when the backend is unavailable ( #48557 ) by @caiotheodoro in [ #48557 ] [serge] Fix 2 integration tests regressed by commit 83d46aa (PR #47625 ) ( #48580 ) by @sergereview[bot] in [ #48580 ] [nit] use requires_backends ( #47576 ) by @eustlb in [ #47576 ] [serge] Fix 2 integration tests for model kosmos2 failing with import_or_config (other (2)) ( #48552 ) by @sergereview[bot] in [ #48552 ] Fix failing tests for cohere_compass ( #48005 ) by @kaixuanliu in [ #48005 ] [Fix] Use dedicated helpers for DeepGEMM and SonicMoE tests ( #48523 ) by @remi-or in [ #48523 ] CI: Point test fixtures at hf-internal-testing copies we already host ( #48521 ) by @tarekziade in [ #48521 ] fix failed test cases for glm5_next ( #48497 ) by @kaixuanliu in [ #48497 ] Pass kwargs to the Mamba2 mixer in Nemotron-H, Falcon-H1 and Mamba2 ( #48490 ) by @kfastino in [ #48490 ] Retire test_multi_gpu_data_parallel_forward ( #48508 ) by @tarekziade in [ #48508 ] Processing tests [part 2] ( #47922 ) by @zucchini-nlp in [ #47922 ] QA: Add noisy comment checker ( #48484 ) by @tarekziade in [ #48484 ] Allow nested rope params for tiny models ( #48435 ) by @zucchini-nlp in [ #48435 ] Fix sliding-window mask layer_idx in Gemma3/Gemma4 create_masks_for_vision_model ( #48482 ) by @jiqing-feng in [ #48482 ] add xpu expectations for hunyuan_vl model tests ( #48504 ) by @kaixuanliu in [ #48504 ] [ Qwen 3.5 Moe ] Fix decorators ( #48436 ) by @vasqu in [ #48436 ] Infinite loop in dependency search ( #48393 ) by @zucchini-nlp in [ #48393 ] [serge] Fix 2 integration tests for model fsmt failing with output_mismatch (tensor values differ (2)) ( #48496 ) by @sergereview[bot] in [ #48496 ] Fix some tests by removing the deprecation cycle ( #48503 ) by @Cyrilvallez in [ #48503 ] Remove deprecation ( #48500 ) by @Cyrilvallez in [ #48500 ] Fix Pix2StructTextAttention init using hidden_size instead of d_kv ( #47558 ) by @ in [ #47558 ] Fix pre patch release utility ( #48499 ) by @Cyrilvallez in [ #48499 ] Update dev version ( #48498 ) by @Cyrilvallez in [ #48498 ] Fix Inkling inputs_embeds and add more tests ( #47827 ) by @Cyrilvallez in [ #47827 ] Simplify and fix qwen4 tests ( #48340 ) by @Cyrilvallez in [ #48340 ] [docs] Partial checkpointing and group_by_length ( #48463 ) by @stevhliu in [ #48463 ] doc: fix syntax error and typos in VibeVoice documentation ( #48489 ) by @VimalN2005 in [ #48489 ] [ Qwen4 Exp ] Use partial to avoid skipping mask more easily ( #48456 ) by @vasqu in [ #48456 ] Add support for NeuCodec ( #47143 ) by @harryjulian in [ #47143 ] [serge] Fix 1 integration tests regressed by commit bd95093 (PR #47493 ) ( #48426 ) by @sergereview[bot] in [ #48426 ] Fix rotary embedding regression ( #48477 ) by @Cyrilvallez in [ #48477 ] Remove deprecated mask functions ( #48476 ) by @Cyrilvallez in [ #48476 ] [MTP] Save memory by only capturing the last layer's hidden_states ( #48475 ) by @Cyrilvallez in [ #48475 ] Allow capturing only necessary hidden_states with capture_outputs ( #48081 ) by @sywangyi in [ #48081 ] Support per-layer MTP configuration ( #48264 ) by @eladsegal in [ #48264 ] [docs] Fix code snippets ( #47772 ) by @stevhliu in [ #47772 ] [Fix] Sparse TikToken tokenizers silently fail ( #48446 ) by @remi-or in [ #48446 ] No inherit decorator for NeoMME ( #48457 ) by @zucchini-nlp in [ #48457 ] Batch Rebalance Data Sampler ( #47340 ) by @delock in [ #47340 ] [serge] Fix 2 integration tests for model cwm failing with import_or_config (other (2)) ( #48414 ) by @sergereview[bot] in [ #48414 ] fix: Add DEIMv2 attribution ( #48448 ) by @harshaljanjani in [ #48448 ] [fix] inkling: mps + cuda mel spec extraction ( #47432 ) by @eustlb in [ #47432 ] fix: decode() batch path respects self.clean_up_tokenization_spaces ( #47793 ) by @lorenzozanee in [ #47793 ] Grounding dino fp16 dtype [backlog] ( #48438 ) by @molbap in [ #48438 ] Init the process group with a load-scaled timeout for sharded loading ( #48228 ) by @qgallouedec in [ #48228 ] Raise a clear error when a token is both forced and suppressed ( #47511 ) by @qgallouedec in [ #47511 ] Clarify device placement in pipelines ( #47367 ) by @LysandreJik in [ #47367 ] Add offload to gradient checkpointing ( #48444 ) by @qgallouedec in [ #48444 ] [MiniCPMV4_6] Update test_small_model_vision_generation_batch expected output (value drift) ( #48406 ) by @ydshieh in [ #48406 ] [serge] Fix 2 integration tests for model hyperclovax failing with other (other (2)) ( #48440 ) by @sergereview[bot] in [ #48440 ] fix(models): Drop the position-indexed token type lookup in RoPE encoders ( #48407 ) by @harshaljanjani in [ #48407 ] Document image_hidden_states/pixel_values mutual exclusivity for SmolVLM/Idefics2/Idefics3 ( #47714 ) by @verma8076 in [ #47714 ] Re-order a bit for easier navigation ( #48434 ) by @zucchini-nlp in [ #48434 ] Deprecated stuff gone ( #48367 ) by @zucchini-nlp in [ #48367 ] [serge] Fix 6 integration tests for model seamless_m4t_v2 failing with other (other (6)) ( #48425 ) by @sergereview[bot] in [ #48425 ] [Docs]: Update GLM 5.3 ( #48401 ) by @Dovis01 in [ #48401 ] Avoid print to stdout that fails the job check_failed_tests job ( #48391 ) by @ydshieh in [ #48391 ] Fix incorrect tuple return annotations on forward methods returning a Tensor ( #48359 ) by @Gronoxx in [ #48359 ] Fix interval merge invariant in _find_disjoint ( #47860 ) by @sharmax-vikas in [ #47860 ] skip mtp slow tests for now ( #48328 ) ( #48329 ) by @tarekziade in [ #48329 ] Update Tailscale action version in workflow ( #48394 ) by @glegendre01 in [ #48394 ] fix some failure in xpu ( #48252 ) by @sywangyi in [ #48252 ] [Improvement] Make gated delta rule more explicit ( #47625 ) by @remi-or in [ #47625 ] [CB] Fix wrong device scoping ( #48370 ) by @remi-or in [ #48370 ] Bump transformers-mlinter to 0.1.5 and clear the new findings ( #48259 ) by @tarekziade in [ #48259 ] fix: flash-attn fallback failing on torch2.13 ( #48388 ) by @NanoCode012 in [ #48388 ] [LongcatFlash] Fix test_longcat_generation_cpu: use device_map="cpu" to avoid MoE disk offload issue ( #48377 ) by @ydshieh in [ #48377 ] [Qwen3VLMoe] Update test_small_model_integration_test_batch expected output (value drift) ( #48376 ) by @ydshieh in [ #48376 ] [ONNX] Skip affected models on torch 2.13 (two dynamo regressions) ( #48191 ) by @ydshieh in [ #48191 ] Fix safe_open mmap memory exhaustion on Windows by using pread backend ( #48341 ) by @eryk-roch in [ #48341 ] Fix Zamba2 construction for num_mem_blocks > 1 checkpoints ( #48325 ) by @john-rocky in [ #48325 ] [Docs] Change 5.3 Flash pos in toc ( #48366 ) by @Dovis01 in [ #48366 ] [conftest] Use get_cpu_ram_total_gib for psutil patch (cgroup-aware) ( #48290 ) by @ydshieh in [ #48290 ] Fix flaky test_training_gradient_checkpointing for BigBirdPegasus (fp noise filter) ( #48332 ) by @ydshieh in [ #48332 ] Quiet continuous batching at default verbosity ( #48314 ) by @qgallouedec in [ #48314 ] Wait for the first request in the async continuous batching bootstrap ( #48304 ) by @qgallouedec in [ #48304 ] Ignore a stale best checkpoint recorded in a resumed trainer state ( #48319 ) by @VaggelisGian in [ #48319 ] [docs] Fix links and remove TokenizerFast ( #47748 ) by @stevhliu in [ #47748 ] Fix incorrect token classification prefix for ESMC ( #48348 ) by @Rocketknight1 in [ #48348 ] Create the continuous batching CPU group with local synchronization ( #48302 ) by @qgallouedec in [ #48302 ] Resolve continuous batching config against the text config for composite models ( #48299 ) by @qgallouedec in [ #48299 ] [ CI ] Unblock fast CI for now (failing tests) ( #48344 ) by @vasqu in [ #48344 ] [qwen4_exp] disable torch/onnx export tests due to data-dependent control flow ( #48345 ) by @ydshieh in [ #48345 ] [debug] Trace previous CI run selection in get_previous_daily_ci.py ( #48338 ) by @ydshieh in [ #48338 ] Normalize HunYuanVL's legacy field aliases via attribute_map ( #48261 ) by @hmellor in [ #48261 ] Significant community contributions The following contributors have made significant changes to the library over the last release: @ydshieh [fix] Update stale expected strings in HunYuanVL integration tests ( #48646 ) [fix] Update stale golden values and fix expected_logits shape in FlavaForPreTraining integration tests ( #48639 ) [tests] Fix integration test golden values broken by fast image processor default (PR #41388 ) ( #48637 ) [KimiLinear] Fix test_cpu_offload: set num_local_experts=4 in model tester ( #48624 ) Fix GPU memory teardown in CLI serve tests ( #48618 ) [fix] Fix how we read package versions - triggered by torch 2.14+ ( #48615 ) [Docker] Upgrade CPU torch to <=2.14.0, torchcodec to <=0.16.0 ( #48614 ) Add PR comment CI for AMD (MI300) ( #48065 ) [MiniCPMV4_6] Update test_small_model_vision_generation_batch expected output (value drift) ( #48406 ) Avoid print to stdout that fails the job check_failed_tests job ( #48391 ) [VibeVoice] Skip generate export tests (flaky) ( #48396 ) [LongcatFlash] Fix test_longcat_generation_cpu: use device_map="cpu" to avoid MoE disk offload issue ( #48377 ) [Qwen3VLMoe] Update test_small_model_integration_test_batch expected output (value drift) ( #48376 ) [ONNX] Skip affected models on torch 2.13 (two dynamo regressions) ( #48191 ) Retry get_daily_ci_runs on stale GitHub API cache ( #48374 ) [conftest] Use get_cpu_ram_total_gib for psutil patch (cgroup-aware) ( #48290 ) Fix flaky test_training_gradient_checkpointing for BigBirdPegasus (fp noise filter) ( #48332 ) [qwen4_exp] disable torch/onnx export tests due to data-dependent control flow ( #48345 ) [debug] Trace previous CI run selection in get_previous_daily_ci.py ( #48338 ) @LauraGPT Add Fun-ASR-Nano model ( #46180 ) @tarekziade Fix AttributeError in gradient_checkpointing_enable(offload=True) ( #48590 ) Compress the agent conventions file and document two modular pitfalls ( #48586 ) CI: Point test fixtures at hf-internal-testing copies we already host ( #48521 ) Retire test_multi_gpu_data_parallel_forward ( #48508 ) QA: Add noisy comment checker ( #48484 ) skip mtp slow tests for now ( #48328 ) ( #48329 ) Bump transformers-mlinter to 0.1.5 and clear the new findings ( #48259 ) @remi-or [Fix] Fix A10 expectations for a test ( #48454 ) Kimi linear ( #48250 ) [Fix] Use dedicated helpers for DeepGEMM and SonicMoE tests ( #48523 ) [Fix] Sparse TikToken tokenizers silently fail ( #48446 ) [Improvement] Make gated delta rule more explicit ( #47625 ) [CB] Fix wrong device scoping ( #48370 ) [CB] Fail faster ( #48334 ) @ArthurZucker Add h4 ( #48473 ) @harryjulian Add support for NeuCodec ( #47143 ) @delock Batch Rebalance Data Sampler ( #47340 ) @harshaljanjani fix: Add DEIMv2 attribution ( #48448 ) model: Add NVIDIA Canary-1B-v2 to Transformers ( #46825 ) fix(generation): Enforce the auto-compile cache check for encoder-decoder models ( #48364 ) fix(models): Drop the position-indexed token type lookup in RoPE encoders ( #48407 ) @tonywu71 Add NeoMME and NeoMME-Retriever ( #47992 ) @Dovis01 [Docs]: Update GLM 5.3 ( #48401 ) [Docs] Change 5.3 Flash pos in toc ( #48366 ) [Glm 5.3 Flash] GLM 5.3 Flash Support ( #48342 ) @pengzhiliang Implement VibeVoice ( #40546 )

Incredibly proud of the Sakana AI team. We have developed an orchestration model right here out of Japan that achieves state-of-the-art per…

hardmaru — Tue, 03 Nov 2026 00:00:00 +0000

86% · First-party 86%, Measured result 37%, Usable today 35%

Incredibly proud of the Sakana AI team. We have developed an orchestration model right here out of Japan that achieves state-of-the-art performance on real-world cybersecurity benchmarks! 🎌 sakana.ai/fugu-cyber-r...

Welcome PaliGemma 2 – New vision language models by Google

Tue, 03 Nov 2026 00:00:00 +0000

86% · First-party 86%, Usable today 54%

DiscImageStudio: burn visible artwork onto CDs, DVDs and Blu-ray discs

bpierre — Tue, 03 Nov 2026 00:00:00 +0000

85% · Usable today 85%

Article URL: https://github.com/JiaFeiMiao-K-Cat/DiscImageStudio Comments URL: https://news.ycombinator.com/item?id=50346849 Points: 177 # Comments: 43

llama.cpp b12060

github-actions[bot] — Tue, 03 Nov 2026 00:00:00 +0000

85% · First-party 85%, Usable today 80%

model: add Clover support ( #31306 ) model : add AR-only Clover MoE support Add GGUF conversion, model loading, and causal hybrid attention for Clover, reusing shared attention, recurrent-state, MoE, and LoRA helpers. Update tests/test-llama-archs.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co convert : filter Clover tensors using filter_tensors clover : use the standard ssm_a tensor name Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62870075 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Introducing the AMD 5th Gen EPYC™ CPU

Tue, 03 Nov 2026 00:00:00 +0000

85% · First-party 85%, Usable today 32%

A Solo Developer Built This in 4 Days With Opus 5.5 + Godot. This Is Getting Ridiculous

/u/Delicious-Shower8401 — Tue, 03 Nov 2026 00:00:00 +0000

84% · Measured result 84%, Usable today 40%

This is a playable horror level inspired by Silent Hill and Fatal Frame, built solo in four days using Opus 5.5, Godot, and AI-generated 3D assets. Team: One solo developer. Background: Experience with 3D and game engines, limited programming knowledge. Time: Four days. Coding: Claude Opus 5.5 through Claude Desktop, using Code mode with Auto enabled. 3D assets: Meshy T2.5 + Blender. Images and textures: Nano Banana. Engine: Godot 4.5.1. Manual code edits: None. Honestly, the process itself was so much fun. I could describe what I wanted in plain text, let Opus work on it, then jump into the scene myself to place and rearrange finished assets. I’d get another idea while exploring the level and start building on it straight away. Seeing something from your imagination become a place you can actually walk around in and play is incredibly satisfying. I started with Pinterest references inspired by Silent Hill and Fatal Frame. Those gave Opus a visual direction, and the environment grew through repeated prompts and additional references. Claude edited files, launched Godot, took screenshots, and iterated on the results. It built larger structures through code and helped with prop placement, while I continued shaping the scene. For smaller assets, Nano Banana generated images containing ten props at a time. Meshy AI T.2.5 Low Poly mode converted them into lightweight 3D models, which I separated in Blender and imported into Godot without needing to rebuild the meshes. Each ten-prop set shared one material and one texture atlas , keeping the material setup simple and avoiding unnecessary geometry overhead. Around 100 props were created across ten batches, saving a lot of preparation time while helping keep the scene efficient. By day two, the level already looked close to what’s shown in the video. The remaining time went into refinement and experiments, including ideas I eventually dropped. Being able to think of something, describe it, build on the result, and immediately try it in the game made the whole process hard to put down. Costs Subscription: Claude Pro. Core build: Around $90 in estimated usage at API rates. Including later experiments: Around $180 in estimated usage at API rates. These figures represent the API-equivalent value of Claude usage under the subscription. submitted by /u/Delicious-Shower8401 to r/ClaudeAI [link] [comments]

Tool: GeoJSON Map Viewer

Simon Willison — Tue, 03 Nov 2026 00:00:00 +0000

84% · Usable today 84%, First-party 44%

In another case of it being quicker to build a tool than hunt around to find something that does what you need, here's a little vibe-coded thing for turning one or more GeoJSON shapes into a rendered PNG simonwillison.net/2026/Sep/1/g... Linked page: View and visualize GeoJSON data on an interactive OpenStreetMap with customizable styling options. Paste GeoJSON objects (Feature, FeatureCollection, or Geometry) into the editor, adjust fill color an...

I had Opus 5.5 create a site where you can see the fastest routes into every city in the US, figure out where in America is fairest to meet…

Ethan Mollick — Tue, 03 Nov 2026 00:00:00 +0000

84% · Usable today 84%

I had Opus 5.5 create a site where you can see the fastest routes into every city in the US, figure out where in America is fairest to meet up, see the "watersheds" of the largest cities, and more: all-roads-lead-to.netlify.app (Inspired by the defunct Arterial Mapping site)

llama.cpp b12064

github-actions[bot] — Tue, 03 Nov 2026 00:00:00 +0000

84% · First-party 84%, Measured result 83%, Usable today 77%

hexagon: tiled hvx permute ( #31446 ) hexagon: add tiled HVX transpose path for permuted CONT/CPY Permuted copies where dst dim 0 is strided in src, but some other src dim is contiguous, used to fall back to HTP_COPY_KERNEL_RESHAPE. That issues one DMA descriptor per element. The channel-first <-> channel-last permutes around per-channel norms (e.g. [W,H,T,C] <-> [C,W,H,T] in video VAEs) ht this path, and these copies ran at about 45 MB/s. Add HTP_COPY_KERNEL_TRANSPOSE for same-type, same-shape f32/f16 copies into a contiguous dst. Host: drop extent-1 dims and merge dims that stay adjacent in src into a canonical view, stored in the kernel params. There are no minimum size limits. the copy is treated as a 2D transpose between dst dim 0 and the contiguous src dim, batched over the remaining dims. tiles are sized to 64 KB per buffer and halved until they fit in session VTCM. blkk is capped so the halfword vgather offsets fit in 16 bits. Kernel, per tile: 2D DMA of blk0 strided src rows (blkk contiguous elements each) into VTCM vgather transpose in 32x32 (f32) or 64x64 (f16) blocks 2D DMA of blkk contiguous rows out to dst Staged and transposed buffers are double-buffered, so the next tile's input DMA overlaps the current transpose and output DMA. Tiles are split across threads and mdev sessions. Small dims: packed mode: when dim k follows dim 0 and dim 0 divides the HVX lanes (f32: 2/4/8/16, f16: 2/4/.../32), one vgather writes several whole dst rows, and each tile goes out as one contiguous DMA. when the contiguous src dim fits in one vector, it is staged exactly and the tile is made long along dim 0. All other copies select the same kernels as before. Tests: add test_cont cases for perms {1,2,3,0} and {3,0,1,2}, f32 and f16, at various sizes. hexagon: cpy transpose cleanups fix vgather halfword offset comments: offsets are unsigned 16-bit, caps are kept lower for speed set packed directly in the packed case add dim_k == 3 CONT tests (full reversal) Assisted-by: Claude Opus 5.5 hexagon: use cpy transpose path for ne[0] == 1 permutes drop the nb[0] check in the transpose solver: size-1 dims are skipped, and the canonical tp.nb[0] check covers packed dim 0 try the transpose path before SAMESHAPE_SAMETYPE, which did one DMA per element for these add ne[0] == 1 permute CPY tests Assisted-by: Claude Opus 5.5 hex-cpy: further improve cpy Bring in improvements from aizip branch/PR. Cleanup kparams and replace divs with fastdiv. Co-authored-by: Yiwei Shao yiwei@aizip.ai hex-cpy: avoid vtcm bank conflicts hex-cpy: trim down the comments cpy-test: trim down new tests that cover permute scenarios Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com Co-authored-by: Yiwei Shao yiwei@aizip.ai Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62970114 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

New sparse attention method for ultra-long context

/u/Immediate_Sky_6566 — Tue, 03 Nov 2026 00:00:00 +0000

83% · Usable today 83%, First-party 66%, Measured result 56%

I am on the team behind the attached open-source research on novel approaches to attention - specifically we show: • You can sparsify the attention of Qwen 3.8 27B without observed loss on accuracy • Extending context up to 10M tokens loses accuracy on some specific tasks - but most, like NIAH is still fine (interesting insights) • You can natively train sparse attention on next-token prediction loss alone and achieve the same validation loss as full attention - but faster Hope the community likes it - while we focus on H200/B300 GPUs and larger scale system - I wanted to share our research here as well - as it can be applied to small open-weight models (making longer context cheaper on local hardware) Everything is fully open: kernels / SGLang integration / paper / details Hope you find it interesting / useful! (No hype - we try to be as transparent as possible) submitted by /u/Immediate_Sky_6566 to r/LocalLLaMA [link] [comments]

llama.cpp b12057

github-actions[bot] — Tue, 03 Nov 2026 00:00:00 +0000

83% · First-party 83%, Usable today 82%

context : simplify setters ( #29730 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62784585 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b12054

github-actions[bot] — Tue, 03 Nov 2026 00:00:00 +0000

83% · Usable today 83%, First-party 82%

ggml-zdnn: share buffers with host ( #31481 ) Signed-off-by: Aaron Teo aaron.teo1@ibm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62776552 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Release v5.20.1

vasqu — Tue, 03 Nov 2026 00:00:00 +0000

83% · Usable today 83%, First-party 81%

Release v5.20.1 Special surprise including the new model Beam from Reflection AI 🥳 Beam is a token-efficient, frontier-scale model focused on coding and agentic use cases. It is built for teams that want to run a powerful model on their own hardware, infrastructure, or cloud, and customize it to their specific needs. Links: Documentation Fix small bug in auto mappings ( #49664 ) by @yonigozlan in #49664 Some real patch fixes We broke loading models on older torch versions 😢 should be fixed now. But here is the full list of fixes Fix HunYuan-VL image assignment during batched generation ( #49557 ) by @Arnav66692 Fix DeepGEMM Mega MoE under expert parallelism( #49428 ) by @IlyasMoutawwakil Fix from_pretrained on torch 2.7: require torch>=2.8 for distributed checkpointing ( #49652 ) by @naveecode Make DtensorShardOperation work on torch 2.6 and 2.7 ( #49657 ) by @hazelxue Full Changelog : v5.20.0...v5.20.1

llm 0.37

Tue, 03 Nov 2026 00:00:00 +0000

83% · First-party 83%, Usable today 82%, Measured result 48%

Release: llm 0.37 There's a lot of stuff in this new release of my LLM CLI tool and Python library, representing around two months of accumulated features and fixes. I added gpt-6.1-sol and gpt-6.1-terra , plus a new llm openai endpoint add command to make it easier to configure additional models that use OpenAI-compatible endpoints. I switched the default model (if you have not set your own default) to gpt-6-luna - half the price of the previous default, gpt-5.6-luna . LLM's support for embeddings now accepts that different binary content may have different content-type - necessary for models like Gemini Embedding 2 , which can embed text, audio, images, and video. A lot of open source maintainers complain about a flood of AI-assisted PRs. LLM is my project that has been most affected by this and, to be honest, I'm not finding it to be a problem. That's mainly because I have Opus 5.5 or GPT-6 Astra help me with triage to spot the most useful fixes! This release includes fixes from 12 authors - almost all AI-assisted - and the burden of reviewing them wasn't nearly as great as I expected. I really see them as bug reports with attached examples - sometimes I land them, sometimes I implement my own fix. So thanks to 0d00ciallo0721 , ac1982 , Allen Flux , Bian Yuhan , Bishop Kammeraad , Chen Yufeiyang , Christopher Krah , Ethan Stoner , Jiachen Xie , Olamide Faniyan , Sharat Chandra Sai Boddu , nosmile99 for helping out with (or spending tokens on) this release! Tags: open-source , projects , ai , annotated-release-notes , generative-ai , llms , embeddings , llm

Llama can now see and run on your device - welcome Llama 3.2

Tue, 03 Nov 2026 00:00:00 +0000

83% · First-party 83%, Usable today 69%

Affinity’s creative studio is now available on iPad for free

The Verge — Tue, 03 Nov 2026 00:00:00 +0000

82% · Usable today 82%, Measured result 39%

The core art and photo editing tools are free for individuals, but AI features require a Canva subscription. www.theverge.com/design/10242... Linked page: The core art and photo editing tools are free for individuals, but AI features require a Canva subscription.

Show HN: Hacker Times, a New York Times-inspired version of Hacker News

polpenn — Tue, 03 Nov 2026 00:00:00 +0000

82% · Usable today 82%

I thought it would be fun to browse HN as if it were a newspaper. The site updates once an hour. Enjoy! Comments URL: https://news.ycombinator.com/item?id=50346981 Points: 229 # Comments: 72

Moving our warehouse off DuckDB

emschwartz — Tue, 03 Nov 2026 00:00:00 +0000

82% · First-party 82%

Article URL: https://posthog.com/blog/moving-off-duckdb Comments URL: https://news.ycombinator.com/item?id=50338747 Points: 172 # Comments: 116

llama.cpp b12058

github-actions[bot] — Tue, 03 Nov 2026 00:00:00 +0000

82% · First-party 82%, Usable today 78%

imatrix : fix --nextn crash ( #31522 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62794269 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Introducing our Artifacts Hub and Adoption Dashboard

Nathan Lambert — Tue, 03 Nov 2026 00:00:00 +0000

82% · First-party 82%, Usable today 35%

Scaling our curation and measurement of the open ecosystem.

Introducing @huggingface/kernels: 200+ WebGPU Kernels for Local AI

Tue, 03 Nov 2026 00:00:00 +0000

82% · First-party 82%, Usable today 69%

We now support VLMs in smolagents!

Tue, 03 Nov 2026 00:00:00 +0000

82% · First-party 82%, Usable today 56%

Welcome Gemma 4: Frontier multimodal intelligence on device

Tue, 03 Nov 2026 00:00:00 +0000

81% · First-party 81%, Usable today 52%

huggingface_hub v1.0: Five Years of Building the Foundation of Open Machine Learning

Tue, 03 Nov 2026 00:00:00 +0000

81% · First-party 81%, Usable today 44%

My H3 Settings that generate 15 second videos in 2 mins.

/u/Free_Pressure8623 — Tue, 03 Nov 2026 00:00:00 +0000

80% · Measured result 80%, Usable today 47%

EDIT: Workflow and sample added to comments. A quick post for anyone who is struggling with getting good results at a good gen speed. The model can be found here Veda Sparse Attention Node can be found here While the video quality is great! What surprises me most about this is the audio quality. It remains very high. I want to be very, very clear here. These settings are not for maximum realistic showcase videos. This is to get well-made videos at a good speed. So you don't need to jump into the comments talking about how shit this all is. As always, your mileage may vary. Specs: RTX 5090. 64 GB RAM. Edit: Sorry, no workflow available. But it's easy to add these into any workflow you may be using. submitted by /u/Free_Pressure8623 to r/StableDiffusion [link] [comments]

Tool: .blend URL Viewer

Simon Willison — Tue, 03 Nov 2026 00:00:00 +0000

80% · Usable today 80%, First-party 35%

Here's a Blender model of a Pluribus themed Fabergé egg I had GPT-6 Astra build - I generated the concept image using ChatGPT Images 2.5, then pasted the image into Codex and told Astra to turn that into a Blender file simonwillison.net/2026/Sep/9/b... Linked page: View Blender .blend files directly in your browser by pasting a URL to a CORS-accessible file or GitHub repository link. The viewer renders mesh geometry with materials, lighting, and optional …

Introducing Storage Buckets on the Hugging Face Hub

Tue, 03 Nov 2026 00:00:00 +0000

80% · First-party 80%, Usable today 36%

Transformers.js v4: Now Available on NPM!

Tue, 03 Nov 2026 00:00:00 +0000

80% · First-party 80%, Usable today 79%

Introducing Trackio: A Lightweight Experiment Tracking Library from Hugging Face

Tue, 03 Nov 2026 00:00:00 +0000

80% · First-party 80%, Usable today 60%

NVIDIA's GTC 2025 Announcement for Physical AI Developers: New Open Models and Datasets

Tue, 03 Nov 2026 00:00:00 +0000

80% · First-party 80%, Usable today 45%

Open Preference Dataset for Text-to-Image Generation by the 🤗 Community

Tue, 03 Nov 2026 00:00:00 +0000

80% · Usable today 80%, First-party 56%

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Tue, 03 Nov 2026 00:00:00 +0000

80% · First-party 80%, Usable today 60%

Welcome Gemma 2 - Google’s new open LLM

Tue, 03 Nov 2026 00:00:00 +0000

80% · First-party 80%, Usable today 65%

★ Getting incredible results with a single RTX 3090ti and 128gb of ram. Deepseek-V4.1-Flash-1017 (35 tok/s decode) and Qwen3.8-Flash-Next (130 tok/s decode)

/u/uniVocity — Mon, 02 Nov 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 65%

I'm sharing this here because this is working way better than it used to a few months ago with older models. I see people here posting slower speeds with much better hardware than mine and hopefully this information helps. I used gemini-flash to help me setup everything and I asked it to write up the sequence of steps to get me here - happy to provide more details if there's anything missing. Since I use gentoo some tools/commands might be unfamiliar to you. My 6 year old hardware: OS & CPU Gentoo Linux running on an AMD Ryzen Threadripper 3990X (64 cores, 128 threads). System Memory: 128 GB DDR4 RAM. GPU: 1 NVIDIA GeForce RTX 3090 Ti (24 GB GDDR6X VRAM, PCIe Gen 4 x16). Primary Storage: 4 TB SSD NVMe. Models Used, Download Sources, and Measured Speeds Model Architecture Quantization / Files Download Source Real Measured Speed DeepSeek-V4.1-Flash-1017 552B MoE (40 layers, 384 experts/layer, ~39B active) XQ / GSQ V2 + rank-1017-085.bin + FP4 KV + Engram NVMe tables IndrasMirror/DeepSeek-V4.1-Flash-1017-XQ-Uncensored ~35 tok/s decode (with MTP/DSpark active) Qwen3.8-Flash-Next 125B MoE + 51B N-gram (GDN + QSA hybrid, ~3.5B active) pack-qfn45 (4-bit intermediate, DeltaNet linear KV) [IndrasMirror/Qwen3.8-Flash-Next-Swift-1.5-XQ-Uncensored]( https://huggingface.co/IndrasMirror/Qwen3.8-Flash-Next-Swift-1.5-XQ-Uncensored ) ~138–140 tok/s decode IMPORTANT: NVIDIA GPU Unlock Consumer Ampere cards (RTX 3000 series: GA102, GA104) feature artificial firmware throttles on FP16/BF16 matrix instruction issue rates compared to their enterprise workstation counterparts. The open-source gpu-unlock kernel module lifts this throttle prior to driver attachment. 1. Compile and Install the Kernel Module As root: git clone https://github.com/Zagitta/gpu-unlock.git /usr/src/gpu-unlock cd /usr/src/gpu-unlock make -j$(nproc) make install 2. Pass the Unlock Flag to the Kernel Command Line Add gpu_unlock.targets=all to your bootloader kernel parameters (e.g. in /etc/default/grub under GRUB_CMDLINE_LINUX_DEFAULT , or your direct EFISTUB / systemd-boot entry): gpu_unlock.targets=all Regenerate your boot configuration and rebuild your initramfs so the module is included and loads before the NVIDIA kernel modules: # If using GRUB: grub-mkconfig -o /boot/grub/grub.cfg # If using dracut: dracut -f --regenerate-all 3. NVIDIA Driver Options & Persistence Configure NVIDIA kernel driver parameters in /etc/modprobe.d/nvidia-perf.conf (as root): cat << 'EOF' > /etc/modprobe.d/nvidia-perf.conf options nvidia NVreg_PreserveVideoMemoryAllocations=1 options nvidia NVreg_EnableStreamMemOPs=1 options nvidia-uvm uvm_perf_enable_cpu_to_gpu_dma=1 EOF After rebooting, verify that the unlock executed: dmesg | grep -i gpu_unlock Enable persistence mode and set the GPU to its maximum factory power ceiling: nvidia-smi -pm 1 nvidia-smi -pl $(nvidia-smi -q -d POWER | grep "Max Power Limit" | head -n1 | awk '{print $5}' | cut -d. -f1) Step 2: System Dependencies & Tooling Install build dependencies and runtime libraries: emerge sys-devel/gcc:14 # If GCC 14 is not selected, set it to this version gcc-config -l # then replace <N> with the number from gcc-config -l): # gcc-config <N> && source /etc/profile # this won't compile with GCC > 14 emerge dev-util/nvidia-cuda-toolkit # for compleness, just in case emerge --ask --verbose \ dev-build/cmake \ dev-build/ninja \ dev-vcs/git \ net-misc/curl \ app-misc/jq \ sys-libs/liburing \ app-arch/snappy \ dev-lang/python Prepare the directory structure under your user environment: mkdir -p "$HOME/.local/bin" mkdir -p "$HOME/.local/llm-tools" mkdir -p "$HOME/.quetza-data/conductor" mkdir -p "$HOME/models/deepseek-v41" mkdir -p "$HOME/models/qwen-flash" # Dedicated Python environment for tool scripts & Hugging Face downloads python3 -m venv "$HOME/.local/llm-tools/venv_hf" source "$HOME/.local/llm-tools/venv_hf/bin/activate" pip install --upgrade pip pip install "huggingface_hub[cli]" torch safetensors numpy Step 3: Build the Xolotl Inference Engine Xolotl integrates the multi-tier memory management, NVMe Engram streaming, and DSpark speculative decoding logic needed to run large MoE models on a single GPU. cd "$HOME/.local/llm-tools" git clone https://github.com/Indras-Mirror/Xolotl.git cd Xolotl # Fetch pinned llama.cpp dependencies and apply patches bash tools/xolotl/fetch-llama.sh # Configure and compile for Ampere (sm_86) cmake -S . -B build -G Ninja \ -DCMAKE_BUILD_TYPE=Release \ -DSTRATA_ENABLE_CUDA=ON \ -DSTRATA_GGML_CUDA=ON \ -DSTRATA_MMQ_KQUANTS=ON \ -DCMAKE_CUDA_ARCHITECTURES=86 \ -DSTRATA_GGML_DIR="$PWD/third_party/llama.cpp" \ -DSTRATA_DSV41_FQ_OP=ON \ -DSTRATA_DSV41_HC_MIX=ON ninja -C build # Link the build directory so wrapper scripts resolve ds41_generate ln -sfn "$PWD/build" "$PWD/build-xolotl" Step 4: Model Downloads & Engram Extraction 1. DeepSeek-V4.1-Flash (552B MoE) Bash source "$HOME/.local/llm-tools/venv_hf/bin/activate" cd "$HOME/models/deepseek-v41" # Download model weights, draft sidecar, and expert rank index hf download IndrasMirror/DeepSeek-V4.1-Flash-1017-XQ-Uncensored \ --include "v2/*" "tokenizer/*" "V41-MTP-Vision-1017*" \ --local-dir . # Download original FP8 Engram table shards hf download deepseek-ai/DeepSeek-V4.1-Flash-1017 \ model-00047-of-00048.safetensors \ model-00048-of-00048.safetensors \ model.safetensors.index.json config.json \ --local-dir ./FP8-engram # Extract Engram runtime binary tables onto NVMe cd "$HOME/.local/llm-tools/Xolotl" python3 tools/v41/extract_engram.py \ --input "$HOME/models/deepseek-v41/FP8-engram" \ --output "$HOME/models/deepseek-v41/engram_rt" 2. Qwen3.8-Flash-Next (125B MoE) cd "$HOME/models/qwen-flash" hf download Qwen/Qwen3.8-Flash-Next-GGUF \ --include "pack-qfn45/*" \ --local-dir . Step 5: MTP Speculative Decoding Setup MTP (Multi-Token Prediction) on DeepSeek-V4.1-Flash is driven by the DSpark sidecar engine: Draft Engine: Uses V41-MTP-Vision-1017.Q2_K.gguf as the proposal head. Expert Pruning: Restricts verification sweeps to the top 64 active draft experts ( dspark_expert_counts.txt:64 ), preventing PCIe bus saturation. On-the-fly Re-quantization ( STRATA_DENSE_REQUANT=q6_K ): Re-quantizes the dense attention and output heads from Q8_0 to Q6_K at launch. This reclaims 1.6 GiB of VRAM , fitting the speculative draft cache alongside active experts. PCIe Batching ( --tier-batch-pcie 0.25 ): Batches DMA transfers between the 80 GiB pinned host RAM arena and the GPU. 1. Expand Process Memory Boundary in the Engine Wrapper Allow the systemd user scope to hold the full 80 GiB arena plus runtime buffers: Bash sed -i 's/MemoryMax=84G/MemoryMax=110G/g' "$HOME/.local/llm-tools/Xolotl/tools/v41/serve/ds41-engine.sh" 2. Generate Base Configuration: $HOME/models/deepseek-v41/strata-v41.json cat << EOF > "$HOME/models/deepseek-v41/strata-v41.json" { "exe": "$HOME/.local/llm-tools/Xolotl/tools/v41/serve/ds41-engine.sh", "args": [ "-m", "$HOME/models/deepseek-v41/v2/V41-XQ-1017.gguf", "--backend", "cuda", "--experts", "gpu", "--engram", "$HOME/models/deepseek-v41/engram_rt", "--rank", "$HOME/models/deepseek-v41/v2/rank-1017-085.bin", "--ctx", "131072", "--stop", "1", "--arena-adapt", "--kv-fp4", "--route-bias", "0.5", "--route-bias-file", "0.3", "--arena-gib", "80", "--prompt-batch", "12288", "--tier-batch-pcie", "0.25" ], "cwd": "$HOME/.local/llm-tools/Xolotl", "tokenizer": "$HOME/models/deepseek-v41/tokenizer", "model_name": "deepseek-v4.1", "aliases": "deepseek-v41,deepseek/deepseek-v4.1-flash", "log": "$HOME/models/deepseek-v41/xolotl-v41.log", "port": 8000, "gpu": 0, "sampling": { "temperature": 0.1, "top_p": 0.95, "top_k": 64, "presence_penalty": 0.0, "frequency_penalty": 0.0 }, "api_monitor": true, "fit_max_tokens": true, "reasoning_budget_tokens": 4096, "env": { "STRATA_BUILD_DIR": "$HOME/.local/llm-tools/Xolotl/build", "STRATA_SERVE_DSPARK": "$HOME/models/deepseek-v41/V41-MTP-Vision-1017.Q2_K.gguf", "STRATA_ATTN_F16_GATHER": "1", "STRATA_NO_SCOPE": "1", "STRATA_SERVE_PASS_BIAS": "0", "STRATA_DENSE_REQUANT": "q6_K", "STRATA_SERVE_LOOKUP": "14", "STRATA_PRESTAGE_GIB": "1.5" } } EOF Step 6: Parameterized Launch Scripts 1. DeepSeek-V4.1 Launcher: $HOME/.local/bin/start-deepseek-custom.sh cat << 'EOF' > "$HOME/.local/bin/start-deepseek-custom.sh" #!/usr/bin/env bash set -euo pipefail MODEL_DIR="$HOME/models/deepseek-v41" XOLOTL_DIR="$HOME/.local/llm-tools/Xolotl" BASE_CONFIG="$MODEL_DIR/strata-v41.json" RUN_CONFIG="$MODEL_DIR/strata-v41-run.json" CTX="131072" PORT="8000" TEMP="0.1" THINK_BUDGET="4096" ARENA_GIB="80" PASS_BIAS="0" PROMPT_BATCH="12288" usage() { cat << USAGE Usage: $(basename "$0") [options] Options: -c, --ctx INT Context length in tokens (default: 131072; up to 1048576) -p, --port INT Port to bind (default: 8000) -t, --temp FLOAT Sampling temperature (default: 0.1) -b, --thinking INT Reasoning budget tokens (default: 4096) -a, --arena INT Pinned RAM expert arena in GiB (default: 80) --bias 0|1 Routing bias: 0=exact, 1=fast biased (default: 0) --batch INT Prompt batch size (default: 12288; auto-clamps to 8192 for >=512k) -h, --help Show help message USAGE exit 0 } while [[ $# -gt 0 ]]; do case "$1" in -c|--ctx) CTX="$2"; shift 2 ;; -p|--port) PORT="$2"; shift 2 ;; -t|--temp) TEMP="$2"; shift 2 ;; -b|--thinking) THINK_BUDGET="$2"; shift 2 ;; -a|--arena) ARENA_GIB="$2"; shift 2 ;; --bias) PASS_BIAS="$2"; shift 2 ;; --batch) PROMPT_BATCH="$2"; shift 2 ;; -h|--help) usage ;; *) echo "Unknown option: $1" >&2; exit 1 ;; esac done if [ "$CTX" -ge 524288 ] && [ "$PROMPT_BATCH" -gt 8192 ]; then echo "[-] Large context specified ($CTX tokens). Clamping --prompt-batch to 8192 to prevent graph OOM." PROMPT_BATCH=8192 fi python3 - << PY import json with open("$BASE_CONFIG", "r") as f: cfg = json.load(f) cfg["port"] = int("$PORT") cfg["max_context"] = int("$CTX") cfg["reasoning_budget_tokens"] = int("$THINK_BUDGET") cfg["sampling"]["temperature"] = float("$TEMP") args = cfg.get("args", []) def set_arg(flag, val): for i in range(len(args) - 1): if args[i] == flag: args[i+1] = str(val) return args.extend([flag, str(val)]) set_arg("--ctx", "$CTX") set_arg("--arena-gib", "$ARENA_GIB") set_arg("--prompt-batch", "$PROMPT_BATCH") cfg["args"] = args env = cfg.setdefault("env", {}) env["STRATA_SERVE_PASS_BIAS"] = "$PASS_BIAS" env["STRATA_PRESTAGE_GIB"] = "1.0" if int("$CTX") >= 524288 else "1.5" with open("$RUN_CONFIG", "w") as f: json.dump(cfg, f, indent=2) PY source "$HOME/.local/llm-tools/venv_hf/bin/activate" cd "$XOLOTL_DIR" echo "==> Launching DeepSeek-V4.1-Flash (552B MoE)..." echo " Context : $CTX tokens" echo " Port : $PORT" echo " Arena RAM : $ARENA_GIB GiB" echo " Prompt Batch : $PROMPT_BATCH" exec python3 tools/v41/serve/serve_ds41.py \ --engine strata \ --config "$RUN_CONFIG" \ --port "$PORT" \ --host 0.0.0.0 EOF chmod +x "$HOME/.local/bin/start-deepseek-custom.sh" 2. Qwen3.8-Flash-Next Launcher: $HOME/.local/bin/start-qwen.sh cat << 'EOF' > "$HOME/.local/bin/start-qwen.sh" #!/usr/bin/env bash set -euo pipefail XOLOTL_DIR="$HOME/.local/llm-tools/Xolotl" MODEL_DIR="$HOME/models/qwen-flash/pack-qfn45" PORT="8099" source "$HOME/.local/llm-tools/venv_hf/bin/activate" cd "$XOLOTL_DIR" echo "==> Launching Qwen3.8-Flash-Next (125B MoE)..." exec python3 -m serve.server \ --engine strata \ --config "$MODEL_DIR/strata-qwen.json" \ --port "$PORT" \ --host 0.0.0.0 EOF chmod +x "$HOME/.local/bin/start-qwen.sh" Step 7: Run # Start DeepSeek-V4.1-Flash on :8000 (default 128k context, 1M context work just fine too) $HOME/.local/bin/start-deepseek-custom.sh # Or start Qwen3.8-Flash-Next on :8099 $HOME/.local/bin/start-qwen.sh submitted by /u/uniVocity to r/LocalLLaMA [link] [comments]

★ 8 agents × 250K context, concurrently, on two 3090s (~600+ tok/s total)

/u/o2beast — Mon, 02 Nov 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 80%

I am open to the idea that I am misguided, but my findings feel worth sharing: Short video of my UI with 8 agents each explaining a codebase in parallel long prose: https://imgur.com/JSqlXIi A few days ago I read the Stanford/Berkeley TokenGate paper . The idea is to make long context cheap by pruning tokens up front. I tried it. It's fine for one question, but agents keep asking new ones, and by then the tokens they need are gone, so code recall drops hard. So I went the other way - don't throw anything away, just don't look at all of it at once. Keep the whole context in system RAM and at each step pull in only the ~1% that matters right now. A few days later, I have two 3090s run 8 coding agents at once, each holding their own 250K-token context : Every decode step, each attention layer reads only ~1% of the tokens, picked with a tiny rank-64 "key sketch". The full KV cache lives in system RAM ( int4 in my 80GB RAM VM, but int8 should fit in 128gb). The GPU keeps the sketch and a small hot set. Only the picked tokens cross PCIe. What it took: Triton kernels that build the sketch, score every token, pick the top ~2K and pack them for the stock int8 attention kernel. CUDA-graph safe. vLLM patches that switch dense/sparse per step, so short chats stay full speed. A RAM tier for the KV cache with a prefix cache and recurrent-state checkpoints, so follow-ups don't recompute. Follow-ups fetch only the picked rows. A scheduler fix so one agent reading a huge prompt doesn't freeze the rest. A frozen sketch basis (one file) plus the script to refit it. It's all in the repo as patches, not a fork. Apply them on top of HyperQwen @ ce9615c (a public vLLM fork) and run the install script. Tests and every bench script and result are included. Model: dbirks/Qwen3.8-27B-W4A16-AutoRound + HyperQwen's prepare/fetch_fast_variant.py . All numbers were measured with gpu-unlock loaded (a kernel module that roughly doubles 3090 BF16 tensor throughput, mostly faster prompt reading). Measured ( Qwen3.8-27B W4A16 , MTP-7 , 3090 Ti + 3090 at 250 W): 8 × 250K: ~545 tok/s total on explain-style output, ~790 on copy-heavy. 8 agents at 176–205K generating nonstop for 6 min: 657 tok/s box average, 69–90 per agent. Recall at 250K: 31/32. Follow-ups start in ~5 s. Single long chats are faster too : +15–41% at ~113K vs dense. Caveat: attention is approximate, so near-duplicate code lines occasionally get mixed up. Code: Serving (patches + kernels): https://github.com/bradj00/sparsekv-hyperqwen Rig: i9-12900K Z790 motherboard 96 GB DDR5 RAM 3090 Ti + 3090, power capped at 250 W submitted by /u/o2beast to r/LocalLLaMA [link] [comments]

★ SemiAnalysis launches GDPx, an agentic capability benchmark measuring 11 domains, including chip design, cybersecurity, and RSI; Opus 5.5 tops with a 12% score (SemiAnalysis)

Mon, 02 Nov 2026 00:00:00 +0000

98% · Measured result 98%, First-party 85%

SemiAnalysis : SemiAnalysis launches GDPx, an agentic capability benchmark measuring 11 domains, including chip design, cybersecurity, and RSI; Opus 5.5 tops with a 12% score — A comprehensive benchmark spanning RSI, hardware design, cyber, bio, finance, legal, quant trading, chip design, software engineering, materials science, and alignment

★ Coding is solved* (exclusions apply)

/u/matthewhaynesonline — Mon, 02 Nov 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 92%, First-party 56%

Good news, everyone! Having been inspired to revolutionize the field of computer science , I can now report that coding is solved! Sure, only if you care about x86 Linux binaries that print and exit, but "big journeys" and "small steps" and what not. CRAP (Compiler Replacement for Assembling Programs) is a Gemma 4 E2B fine tune that takes prompts like generate a Linux x86_64 binary that prints 'boop' and emits a working ELF binary (as hex, most of the time, every time). See, since programs end up as a binary anyway, why not just skip the middleman and write the binary itself? No compiler, no assembler, no tool calls. v1.1 is out with improved multi turn and out of distribution performance . Trust me, I know, this is super important work. https://preview.redd.it/gngsbvezc1zh1.png?width=1076&format=png&auto=webp&s=481f6ea0897d2f324272b59b6bf42c337daf3b2d v1.1 eval numbers for the nerds (eval is scored on behavior: the binary has to run, print the right string and exit with the right code): Held out legacy set: 20/23, same as v1 Novel strings: 26/40 ( v1 : 8/40) Multi turn (~3 turns): 10/12 ( v1 : 0/12) Doubled character strings ( boom , etc.): 18/24 ( v1 : 2/24) Random jank exit codes it never trained on: 23/25 An interesting tidbit: one training run hit 0.038 loss while still failing 11 of its 12 trained exit codes, so gradient descent != task completion ascent. Aaannndddnd it runs in your browser. https://preview.redd.it/xkz0lvr1d1zh1.png?width=760&format=png&auto=webp&s=5c5be9a9c3f4cee8663f20fea79097480a857438 The demo loads the Q6_K GGUF (~3.6 GiB) through wllama on WebGPU, streams the hex, parses it and hands you the ELF to run yourself (naturally, you need to download and run the actual binary, the browser won't do that). Q6_K scores 109/144 against the full f16's 114/144 (the five additional failed for Q6 are wrong values, not totally broken binaries). Q4_K_M scored 3/144, so the demo doesn't use it (that quant is crap, not CRAP) ... concerning . Also, tested in Chrome on an M4 Pro Mac; Firefox loads it but generates slowly and nothing else has been tested. Demo: https://huggingface.co/spaces/matthewhaynesonline/crap-demo Weights (v1.1): https://huggingface.co/matthewhaynesonline/gemma-4-E2B-it-crap-1.1 "Paper": https://github.com/matthewhaynesonline/crap-public/blob/main/paper/paper.pdf Code: https://github.com/matthewhaynesonline/crap-public Blog post: https://blog.studiohaynes.com/2026/07/19/compilers-overrated.html Video: https://youtu.be/55IBMzFQNYU Fine print for the buzzkills: only programs that print a string and exit can be generated. Obviously, a compiler does that deterministically, correctly and in milliseconds; CRAP does it with several gigabytes of weights, slower and occasionally incorrectly. submitted by /u/matthewhaynesonline to r/LocalLLaMA [link] [comments]

★ Qwen 3.8 Flash Next NVFP4 on 64gb RAM and 5090, Basalt. Ditched windows for it. Very hyped for qwen 4 model family now.

/u/Rozzemak — Mon, 02 Nov 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 52%

So, I was asleep on Strata and its specialized forks. Tried basalt and i'm very impressed with the speed/intelligence QFN gives you. Here is my benchmark: https://preview.redd.it/8qhp92ql73zh1.png?width=2946&format=png&auto=webp&s=2abf6d03db5124c8491baf980b8cd3b5367fdb9f I cannot get it to work fast enough with windows, because W11 eats 1.5GB of VRAM and 6GB of RAM. At that point, experts spill to RAM and CPU gets hit hard... decode/prefill drops by 70% because there is not enough of available RAM anyway. Switched experimentally to cachy just to test... and It's amazing that my AI box can now reach 9K~ prefill. And regarding quality, its just better than qwen 27b at many tasks. Yet to find something it genuinely cannot do. The prefill boost is around 2-3x coming from ninfer and dense 27b model. Cherry on top is, that I can even fit vision adapter to it, and that helps a lot for certain scenarios regarding coding. I usually run some small model on another machine for OCR and VISION as an adapter (sidecar) my harness can use for being to able look at things. Vivid user of omo stack, configured now for locally hosted qwen: https://github.com/code-yeongyu/oh-my-openagent It's a glorified pi harness, but it does so much, and im quite happy with its robustness, anyway, QFN 3.8 rocks, and now im really thrilled if qwen 4 will be any good, because I suspect i may be able to run the new flash model this fast basically. So I hope it will be good :D Im genuinely interested how 2x 5060/5070/5070ti fares. Because anything above 100~ decode and 3k prefill is genuinely usable for work. And it is my experience that 27b dense -> 125BA6 is a very good quality and speed jump. Absolutely love it now. Also, finetunes can be easily converted into basalt format if you need to do it yourself, especially those swift/reverse engineering variants are good. Anyway: CachyOS, 64gb RAM, 32GB VRAM, 5090, 200tps decode, 9k tps prefill, nvfp4 QFN 3.8, 256k context! If you have similar hardware, and are not using at least strata... but more specially basalt, you sleep on performance hard! See ya! PS: Would absolutely love to see your perf benchmarks if you have similar setups edit-- Running config (without vision,.. but it fits nicely): ~/basalt-linux/basalt_config.json ```json { "server": { "model": "/mnt/g/../basalt/models/Qwen3.8-FN-NVFP4.basalt", "gpu": "0", "host": "127.0.0.1", "port": 8080, "parallel": 1 }, "engine": { "max-context": 262144, "kv": "int8", "prompt-cache": 6, "expert-cache": "auto", "prefill": "auto", "pool-workers": 4, "vram-reserve-mib": 500, "resident-budget-gib": 44 } } ``` bin/basalt --serve --model /mnt/g/../basalt/models/Qwen3.8-FN-NVFP4.basalt \ --max-context 262144 --kv int8 --prompt-cache 6 --expert-cache auto --prefill auto \ --pool-workers 4 --vram-reserve-mib 500 --resident-budget-gib 44 --grammar on submitted by /u/Rozzemak to r/LocalLLaMA [link] [comments]

★ Sorry Sam, my "quite terrible" home DRAM is at 100% now: patched Strata to make DeepSeek V4.1 agent sessions start 20× faster on a good old standard gaming GPU, no datacenter required

/u/HearMeOut-13 — Mon, 02 Nov 2026 00:00:00 +0000

96% · Measured result 96%, Usable today 83%

Sam Altman recently said that "from a global allocation perspective, actually, it's quite terrible to have everybody have a bunch of the world's limited supply of DRAM sitting in their own computer, and being used maybe 5% of the time." Challenge accepted. Here's my "quite terrible" home setup: an RX 9070 XT 16 GB, a 5800X3D, 64 GB of DDR4 that's now worth more than the rest of the PC, and a PCIe 3.0 NVMe. It runs DeepSeek V4.1 Flash at 1M context (IST-DAS 1.75 bpw; the lab reports 98.7% of the full model's task average) through Strata , fully offline, with the experts spread across VRAM, RAM and the SSD. Generation at ~7 tok/s was fine. The problem was prompt reading : every new OpenCode session re-read the full ~37K-token system prompt plus tools, about 100 s before the first token. That's datacenter-grade waiting without the datacenter. So I patched the DeepSeek engine. Two changes: 1. KV splice: stop re-reading what you already read Agents put per-session text (working directory, date, project CLAUDE.md, skill paths with random IDs) inside the system prompt, so the prefix cache misses on every new session. The engine now aligns a new prompt against every saved conversation, cuts the stale lines out of the cached state (moving the cached rows down, rotating the window rings, recording a RoPE gap), and reads only the changed lines plus your message. Changed lines move as whole lines, so the model never sees fragments. 2. Resident-only routing: make the RAM earn its keep Even a short prompt touches nearly every expert of every layer, so prompt reads streamed most of the model off the SSD: 58 GB for a 1.2K-token prompt . During prompt reading only, tokens now pick from experts already sitting in VRAM or RAM. Generation routes normally. Turns out home DRAM is pretty useful when you actually let it do things. Results (same machine) as seen above on the body image Caveats: HIP (gfx1201) only. I haven't built or tested CUDA, SYCL or Metal. The splice is approximate: tokens after a cut were computed with the removed text in context. I haven't seen it matter for short guidance lines, but there's no formal eval. Resident routing changes answers slightly (substitute experts during prompt reads). My hard coding suite didn't move (12/13 both ways), but that's one run each. Both are on by default in the branch ; STRATA_DS4_REORDER=0 and STRATA_DS4_PROMPT_RESIDENT=0 turn them off. It also includes a one-line fix for a GPU page fault I hit on a 37K-token prompt (#4912). Branch: https://github.com/PhialsBasement/Strata/tree/dsv41-kv-splice Build (HIP example): git clone -b dsv41-kv-splice https://github.com/PhialsBasement/Strata.git cd Strata cmake -S . -B build-hip -G Ninja -DCMAKE_BUILD_TYPE=Release -DSTRATA_ENABLE_HIP=ON \ -DSTRATA_ENABLE_CUDA=OFF -DCMAKE_HIP_ARCHITECTURES=gfx1201 -DSTRATA_BUILD_DSV41=ON cmake --build build-hip --target strata-dsv41 DS4_CHUNK_MIN=16 STRATA_DSV41_EXE=$PWD/build-hip/strata-dsv41 strata launch --preset <your preset> If you use OpenCode, also add "interleaved": { "field": "reasoning_content" } to the model entry, otherwise OpenCode drops earlier reasoning and the cache misses more often. Upstream issues with details: #4921 (splice), #4936 (resident routing). If you try it on other hardware, especially CUDA, numbers in those threads would really help get it merged. Utilization report for Sam pissman, VRAM holding experts, RAM holding experts, SSD streaming the rest at full bandwidth. The only idle component in this system is my wallet, thanks to DRAM prices. submitted by /u/HearMeOut-13 to r/LocalLLaMA [link] [comments]

★ Show HN: OmniDiff – Opensource, super fast, content aware Git difftool, in Rust

FabCH — Mon, 02 Nov 2026 00:00:00 +0000

96% · Measured result 96%, Usable today 82%, First-party 34%

I have been researching what the ultimate diff tool would look like, based on actual diffs in open source repositories. OmniDiff can diff: code (25 languages), config, images, PDFs, archives, cursors, fonts... It's fast. It can diff C++ files of tens of thousands of lines in under 100ms, on a 2023 ThinkPad T14s. It's open source. AGPLv3. It's based on real diffs. I looked at the 7400 repositories that are listed in Gentoo packages, sampled 2000 diffs and solved them manually to get a good understanding of what is needed, before putting together the diff pipelines for each content type. Incidentally, this also forms the basis of the CI pipeline, so the robustness of the codebase is quite high. I'm still developing it. It's v0.3.0 at this time. But I have been using it daily as my git difftool for months now, and it works well. AI Disclosure: Yes, I do use AI. No, I do not vibecode. Comments URL: https://news.ycombinator.com/item?id=50325253 Points: 228 # Comments: 58

★ Heretic 2.0 released: Model modification for everyone

/u/-p-e-w- — Mon, 02 Nov 2026 00:00:00 +0000

95% · Usable today 95%, First-party 81%, Measured result 38%

Dear fellow Llamas, after almost 5 months of development, I finally have the pleasure of announcing to you the immediate availability of the biggest Heretic release ever, Heretic 2.0: https://github.com/p-e-w/heretic Heretic is the leading software for removing censorship from language models. It now boasts 37k GitHub stars and more than 8,500 models on Hugging Face, with 88 million(!!!) total model downloads. With Heretic 2.0, the project is entering a new era. Heretic is expanding from a purpose-built tool for censorship removal to a general-purpose model modification tool that can do amazing things. Besides removing censorship, it can suppress slop, reduce sycophancy, alter emotional alignment, and pretty much anything else that you can think of. Of course, censorship removal remains the primary and default function, and in fact works much, much better than ever before. Heretic 2.0 is the most advanced refusal suppression system ever built. Your time is precious, so here's the TL;DR for this release: Directional abliteration is replaced by Arbitrary-Rank Ablation (ARA) , a novel steering method that I developed from scratch for Heretic. It's vastly superior to abliteration, and has been used with great success by enterprising testers for several months. Now it is the default (classic abliteration remains available as an option). Heretic has been completely rebuilt around plugins . Scorer plugins define what Heretic optimizes for. Modifier plugins implement the actual steering method. Plugins are easy to write, can be loaded directly from a simple Python file, and have a well-defined API. Heretic can now run non-interactively, which among other things has enabled us to implement full end-to-end tests for much tighter quality control. Model support has been expanded to include models with hyper-connections, and support for thinking models has been substantially improved. Heretic 2.0 is not backwards compatible with Heretic 1.x configurations. See the migration guide for what you need to change in order to make your old configurations work. What hasn't changed is that removing censorship from a model remains as simple as running heretic Qwen/Qwen3.5-4B See the default configuration file for what Heretic has to offer beyond that. Now for some details... ARA: Heretic's new steering method Directional ablation, or "abliteration", is based on the assumption that refusals (or whatever else you are trying to suppress) are represented by a single direction (that is, a rank-1 subspace) in residual space. That this is the full picture has been doubted in research for a while, and there are now several papers exploring alternatives such as multi-directional ablation or "representation cones". At the beginning of this year, I started experimenting with a method that completely abandons the idea that the ablation transformation must be restricted to a fixed-rank subspace. In March, I published the initial version of Arbitrary-Rank Ablation in this pull request (which was later closed as I re-implemented ARA on top of the plugin system in this PR ). ARA steers model behavior by modifying matrices based on an objective function that encodes the basic properties of the change we want: Harmful prompts should be represented in residual space in a way that's similar to harmless prompts, while the representations of harmless prompts should change as little as possible. This objective is used with the L-BFGS optimizer to modify matrices one-by-one, a kind of micro-training that steers representations without any rank restriction. ARA has been extensively tested and refined with the help of the community. Notably, kabachuha made it compatible with Heretic's LoRA system, and varunbln found a substantial performance improvement. I intend to post an article explaining ARA in more detail soon. Using scorer plugins to make Heretic do what you want Heretic operates by finding modification parameters that optimize scores , values that measure the quality of the resulting model. Ever since the 1.0 release, Heretic has used two hardcoded scores: Refusal count to measure decensoring strength, and KL divergence to measure quality retention. With Heretic 2.0, you can freely define your own scores by writing and loading scorer plugins. Arbitrarily many scorer plugins can be loaded and optimized for simultaneously, and each score can be either minimized or maximized during optimization. See the default configuration file for how to do this. The scorer plugin system is the result of months of effort by red40maxxer, with whom I exchanged hundreds of messages over dozens of review cycles to figure out the best possible design. This is a monumental contribution that has changed how Heretic works from the ground up. Besides the keyword (refusal) count and KLD scorer plugins, which remain the default, Heretic ships with two other scorers: A benchmark scorer , which can compute scores for many standard benchmarks, and a BERT classifier . The BERT classifier, developed by long-time Heretic contributor Vinay Umrethe, can use an arbitrary ModernBERT-type model to classify LLM responses, and score them based on which labels the classifier produces. Vinay also trained a refusal classifier model (used by default with this plugin), which experiments have shown to be substantially more accurate at identifying model refusals than the naive keyword matching method that Heretic employs by default. While the plugin is slower than keyword matching, the greater accuracy can steer Heretic towards producing a higher-quality modified model. An alternative configuration, which uses an emotion classifier, is also provided in the Heretic repository. The plugin system is well-documented in both the README and the code. If you are interested in experimenting with custom plugins, an agent should have no difficulty cooking up a plugin and a matching configuration file that together do what you want, after ingesting the Heretic repository. Well, I hope you like it! Cheers :) submitted by /u/-p-e-w- to r/LocalLLaMA [link] [comments]

★ Don't people pay attention anymore when buying hardware for AI?

/u/sernamenotdefined — Mon, 02 Nov 2026 00:00:00 +0000

92% · Measured result 92%, Usable today 36%

I was trying to sell my old AM4 system, X470 / Ryzen 5 5600 / 64GB / RX580 / 1TB NVME and it didn't sell. Granted it was a bit pricey at 750€, because I took into account the current local RAM and NVME pricing. (Buying the same RAM and SSD new costs 775€ if you go to the cheapest sellers in my country) I decided to try and sell it as an AI system: removed the RX580, put in 2 of my 4 R9700. I set the system up with Fedora to run Qwen3.6 (latest release at the time) and ComfyUI; to show it working. It sold almost instantly! I priced it based on new prices for all of the DDR4 memory, PCI-E 4.0 ssd, both R9700s. I added another 150 euro for the other parts. Total price 5400€! I have since bought back two brand new R9700 from abroad for 250€ less per card than I had sold my old ones for! Effectively I ended up selling the original system for 1300€ instead of the 750€ I originally asked for. Except now I still have the RX580 and fresh warranty on the R9700s. tl;dr know the market for (used) parts before you buy a complete PC for local AI! submitted by /u/sernamenotdefined to r/LocalLLaMA [link] [comments]

★ Release v5.20.0

vasqu — Mon, 02 Nov 2026 00:00:00 +0000

92% · First-party 92%, Usable today 86%

Release v5.20.0 New Model additions Muse Spark Open Muse Spark Open is a multimodal mixture-of-experts model from Meta that takes text, images, audio, and video as input and generates text. It has 816B total parameters (42B active per token) and a context window of up to 1,048,576 tokens shared across modalities. It is trained for agentic coding tasks such as multi-file editing, debugging, and tool use. Checkpoints are available in BF16 and NVFP4 formats. Links: Documentation | Blog Post Add Muse Spark Open ( #49644 ) by @guarin in #49644 Ling 3.0 Ling 3.0 Flash is a hybrid Mixture-of-Experts language model from InclusionAI. Its decoder groups five Kimi Delta Attention (KDA) layers with one Multi-head Latent Attention (MLA) layer. The MLA blocks use interleaved rotary embeddings and a head-wise output gate, and the feed-forward blocks combine routed and shared experts. It is natively supported in Transformers as BailingHybridForCausalLM , so it loads without trust_remote_code=True . Links: Documentation [Model] Add native Ling 3.0 Flash support ( #49446 ) by @icavan in #49446 Kolibri1 Kolibri 1 is Aleph Alpha's mixture-of-experts reasoning model, focused on German and English. Each of its 50 layers routes every token to 6 of 384 experts using sigmoid routing, and adds one shared expert. Four sliding-window attention layers alternate with one full-attention layer, and RoPE is applied only in the sliding-window layers. Links: Documentation Add Kolibri 1 ( #49463 ) by @lucamotz in #49463 MiniCPM-V 4.7 MiniCPM-V is a series of efficient multimodal large language models developed by OpenBMB . Like MiniCPM-V 4.6, the MiniCPM-V 4.7 architecture pairs a SigLIP vision encoder that has a window-attention merger with a Qwen3.5 language model backbone, and supports both 4x and 16x visual downsampling modes. The main addition over 4.6 is canvas M-RoPE : instead of numbering visual tokens along a single 1-D sequence, the model lays every image out on a 2-D canvas and assigns each visual token a (temporal, height, width) position, so slices of the same image keep their spatial relationship and video frames keep their temporal order. Fix more stuff ( #48979 ) by @zucchini-nlp in #48979 UnlimitedOcr UnlimitedOcr is a single 3B-parameter OCR model from Baidu with a standard 32,768-token context length. It builds on DeepSeek OCR and replaces all decoder attention layers with Reference Sliding Window Attention (R-SWA). This keeps the KV cache constant during decoding, so the model can transcribe dozens of pages in a single forward pass. It supports "gundam" mode (640x640 tiles with dynamic cropping) and "base" mode (a single 1024x1024 view), and it can output region detections with bounding boxes. Links: Documentation | Paper Add Unlimited OCR ( #46836 ) by @guarin in #46836 UltraBERT UltraBERT is a family of bidirectional text encoders trained with a combination of masking ratios, pruning, and distillation for classification and retrieval tasks. The released encoders support sequences of up to 32,768 tokens. They use rotary position embeddings, RMSNorm, SwiGLU feed-forward layers, and alternating local and global attention (every third layer is global). Checkpoints include UltraBERT-150M and UltraBERT-380M for masked language modeling and fine-tuning, and UltraBERT-Embed-150M for text embeddings. Links: Documentation | Paper Integrate the UltraBERT architecture ( #49596 ) by @tomaarsen in #49596 MOSS-Transcribe-Diarize MOSS-Transcribe-Diarize 0.9B is an end-to-end audio understanding model for long-form multi-speaker transcription, speaker diarization, and timestamps. It combines a Whisper-style encoder, a 4× frame merge step, a multi-modal projector, and a Qwen3 language model. It produces joint transcription and diarization in a single pass, with segments formatted as [start][S01]text[end] . It supports long-form audio through Whisper-window chunking in the processor, promptable transcription with hotword biasing, and 50+ languages. Links: Documentation Add MOSS-Transcribe-Diarize model ( #48386 ) by @itazap in #48386 Breaking changes 🚨 General breaking notice that inference with EP has regressions in speed; we are working on fixing this ASAP! 🚨 Deprecated checks and methods have been removed from cache_utils.py (affecting models such as minimax_m3_vl and pi0), so any code still calling those deprecated cache methods must switch to the current cache API. 🚨 Remove deprecated cache utils methods ( #49605 ) by @guarin Accidental imports from other models were removed from several model files (e.g. embedding_gemma2, ijepa, lightglue), and the modular converter now avoids adding such cross-model imports. If you imported these names through those model modules, import them from their original modules instead. 🚨 Remove imports from other models ( #49473 ) by @guarin The minimum kernels version is now 0.17.2, which allows use_fallback=KernelizeFallback.ALL so that a failed kernel load falls back to the original implementation instead of raising an error. Upgrade kernels to 0.17.2 or later. 🚨 Bump min kernels to 0.17.2 for better fallback ( #49235 ) by @SunMarc A new SubConfigSpec centralizes the initialization of sub-configs, so default sub-configs are collected from dataclass fields instead of by instantiating the class, and this touches the configuration utilities and many model configs. Custom or existing nested configs may need to be updated to declare their sub-configs through this mechanism. 🚨 SubConfigSpec for centralized init of subconfigs ( #48282 ) by @zucchini-nlp The LUKE and mLUKE tokenizers now treat entity special tokens such as <ent> as special tokens (not split, honored by skip_special_tokens , normalized) while keeping the same spacing as regular vocabulary tokens when decoding. Tokenization and decoding output involving these tokens may therefore differ from before, so check any code or saved outputs that depend on the old behavior. 🚨🚨🚨 luke fixe ( #48408 ) by @itazap Exporters Transformers exporters now support quantization directly during export across Dynamo, ONNX, OpenVINO, and ExecuTorch. The new unified quantization API integrates PT2E, ONNX Runtime, and NNCF quantizers, enabling static and dynamic quantization as well as weight-only compression (INT8/INT4), with configurable calibration workflows. This makes it easier to export optimized models for efficient inference across different backends. For more information see the docs: https://huggingface.co/docs/transformers/exporters_quantization Parallelization This release improves distributed training and inference. FSDP × TP model and optimizer checkpoints can now be saved and loaded across different parallel configurations, and expert-parallel dispatch, tensor-parallel plans, static-cache generate() , and the caching allocator's byte count were fixed. Tied LM heads in composite models now get their own TP plan entry, enable_expert_parallel applies the EP plan alone again, TPU loading uses the `tor FSDP x TP Saving / Loading, Optimizer ( #49256 ) by @michaelbenayoun in [ #49256 ] FSDP x TP Saving / Loading ( #48802 ) by @michaelbenayoun in [ #48802 ] Don't set a device per rank for gloo tensor-parallel tests ( #49636 ) by @IlyasMoutawwakil in [ #49636 ] fix(distributed): keep enable_expert_parallel as EP alone ( #49633 ) by @dacorvo in [ #49633 ] Fix a port allocation race in FSDP tests ( #49455 ) by @icavan in [ #49455 ] Expert-parallel dispatch hands the experts the received rows, not the all-to-all's pending result ( #49421 ) by @IlyasMoutawwakil in [ #49421 ] Fix static-cache generate() with host-side inputs and under TP ( #49317 ) by @dacorvo in [ #49317 ] Composite lm head tp plan ( #49080 ) by @IlyasMoutawwakil in [ #49080 ] Fix: use torch.accelerator device APIs so TP loading works again on TPU ( #49502 ) by @tengomucho in [ #49502 ] Count ep and fsdp in caching_allocator_warmup byte calculation ( #49384 ) by @3outeille in [ #49384 ] Do not wrap the model in FSDP for expert-parallel token dispatch ( #49383 ) by @3outeille in [ #49383 ] Generation This release fixes static-cache generate() bugs with host-side inputs and under tensor parallelism. It also speeds up Whisper generation on TPU by cutting device syncs and recompilation, and fixes Whisper batched timestamp decoding for tensor and NumPy inputs. Pipelines get a cleanup of generation-argument handling that removes spurious warnings. Add job to automatically generate Intel CPU Docker image ( #49560 ) by @regisss in [ #49560 ] Image decoding moves to torchcodec ( #47963 ) by @zucchini-nlp in [ #47963 ] Optimize Whisper generation for TPU and device sync ( #49426 ) by @tengomucho in [ #49426 ] Generation cleanup in pipelines ( #49269 ) by @Rocketknight1 in [ #49269 ] Fix Whisper batch timestamp decoding for tensors ( #49419 ) by @Kingofbooks in [ #49419 ] Vision Vision processing was updated in several places. Image decoding now uses torchcodec, Molmo2's image and video kwargs follow the library's standard conventions, and Pixtral Flash Attention no longer detects false image boundaries after the axial RoPE refactor, which had caused CUDA illegal memory access errors and incorrect output. Several CI and Docker changes also shipped: GPU images moved to Python 3.11, a numpy/pyarrow conflict Fix numpy/pyarrow conflict in the XPU Docker image ( #49582 ) by @jiqing-feng in [ #49582 ] CI: Move GPU images to python 3.11 ( #49352 ) by @tarekziade in [ #49352 ] Update molmo2 processing images/videos kwargs ( #49563 ) by @guarin in [ #49563 ] Fix Pixtral Flash Attention image boundaries after axial RoPE refactor ( #49373 ) by @oliverholworthy in [ #49373 ] Kernels This release improves kernel support across hardware. flash_attention_2 now falls back to the AITER kernel on ROCm when flash-attn isn't installed, and T5-style models get a contiguous SDPA position-bias mask so they use fused kernels again. The Hub rotary kernel is now limited to CUDA inference because its backward pass gave incorrect gradients. The Atlas Inference Gated DeltaNet kernels for Strix Halo and Fall back to the AITER kernel for flash_attention_2 on ROCm ( #49608 ) by @Abdennacer-Badaoui in [ #49608 ] Make the SDPA position_bias mask contiguous so T5-style models use fused kernels ( #49517 ) by @IvenHsu01 in [ #49517 ] Use the Hub rotary kernel for inference only on CUDA ( #49439 ) by @qgallouedec in [ #49439 ] [Atlas Inference] Enable torch.compile for the Strix Halo Gated DeltaNet hub kernel ( #49453 ) by @AzeezIsh in [ #49453 ] [Atlas Inference] Fix GB10 Gated DeltaNet hub kernel for transformers 5.17+ and enable torch.compile ( #49452 ) by @AzeezIsh in [ #49452 ] Cache This release fixes several cache-related bugs: static-cache generate() now handles host-side nested inputs and tensor parallelism correctly, the offloaded cache prefetch no longer races with the offloading copy, and Phi3 LongRoPE cache rebuilds at the context boundary now receive the full prefix. It also counts the query token in MiMo-V2-Flash's sliding window and corrects the quantized cache (hqq/quanto) documentation exam Fix offloaded cache prefetch racing with the offloading copy ( #49363 ) by @qgallouedec in [ #49363 ] docs: update quantized cache hqq/quanto examples and documentation ( #47212 ) by @DavidJohnQuinlan in [ #47212 ] [MiMo-V2-Flash] Count the query token in the sliding window ( #49170 ) by @guapisolo in [ #49170 ] Fix Phi3 LongRoPE cache rebuild at the context boundary ( #49361 ) by @LE0-Lin in [ #49361 ] Bugfixes and improvements [docs] Hardware docs template ( #49575 ) by @stevhliu in [ #49575 ] Add MIC contract lock files for PR CI integration ( #49631 ) by @ydshieh in [ #49631 ] Use aiter-rope version 3 on ROCm ( #49595 ) by @Abdennacer-Badaoui in [ #49595 ] Remove missing methods from docs ( #49637 ) by @guarin in [ #49637 ] Translate torch.mm(..., out_dtype=...) to ONNX ( #49635 ) by @IlyasMoutawwakil in [ #49635 ] [docs] Hardware section ( #49541 ) by @michaelbenayoun in [ #49541 ] Raise when a torch fallback would drop packed-sequence boundaries ( #49474 ) by @qgallouedec in [ #49474 ] Fa packed sequence decode ( #49610 ) by @SunMarc in [ #49610 ] fix nested set_attn_implementation ( #49138 ) by @eustlb in [ #49138 ] feat: Add MTP support to Mellum2/2.1 ( #49531 ) by @shadeMe in [ #49531 ] extend onnx exporters tests to non-cuda devices ( #49627 ) by @kaixuanliu in [ #49627 ] Document video processor backends ( #49470 ) by @DimensionSTP in [ #49470 ] Make sinusoidal position embeddings compileable ( #49482 ) by @jiqing-feng in [ #49482 ] Save the PEFT adapter of a load-time sharded model from its own parameters ( #49500 ) by @qgallouedec in [ #49500 ] fix: Pass the MTP layer type to per-layer-type rotary embeddings ( #49468 ) by @shadeMe in [ #49468 ] Add LFM2 to the GGUF loading path ( #49400 ) by @francip in [ #49400 ] Add MtpModel helpers for frameworks that own the drafting loop ( #49544 ) by @hmellor in [ #49544 ] Build docs with the Python version from .python-version ( #49603 ) by @tarekziade in [ #49603 ] Use mlp_layer_types for AXK1 so the MoE layer layout honours moe_layer_freq ( #49518 ) by @hmellor in [ #49518 ] Combine Nvidia+AMD run-slow CI comments into one ( #49598 ) by @ydshieh in [ #49598 ] Fix flaky streamer timeout tests ( #49583 ) by @tarekziade in [ #49583 ] Fix TPU related tests issues ( #49568 ) by @tengomucho in [ #49568 ] fix(distributed): bind TPU ranks to device index 0, not LOCAL_RANK ( #49543 ) by @tengomucho in [ #49543 ] Use transformers init everywhere ( #49573 ) by @guarin in [ #49573 ] [docs] Context parallelism during eval ( #48663 ) by @stevhliu in [ #48663 ] Remove examples ( #49357 ) by @SunMarc in [ #49357 ] Accept whole-number floats for integer tool arguments in parse_response ( #49547 ) by @yonigozlan in [ #49547 ] update Intel CPU Dockerfile ( #49408 ) by @jiqing-feng in [ #49408 ] Add missing video processor auto docstrings ( #49569 ) by @guarin in [ #49569 ] Add chat input sanitization ( #47386 ) by @Rocketknight1 in [ #47386 ] Fix create_chunked_causal_mask() crashing with block_sequence_ids ( #49457 ) by @kaixuanliu in [ #49457 ] Fix SinglePositionMultiTokenCandidateGenerator signature ( #49413 ) by @jiqing-feng in [ #49413 ] Minicpm 4.7 update integration tests ( #49565 ) by @zucchini-nlp in [ #49565 ] Stop treating HunYuan's DynamicNTKAlpha RoPE as dynamic ( #49445 ) by @jiqing-feng in [ #49445 ] Fix Gemma3nVision2TextModelTest::test_model_parallelism split ( #49562 ) by @tarekziade in [ #49562 ] Fix UnboundLocalError in SuperPoint forward under torch.compile ( #49409 ) by @kaixuanliu in [ #49409 ] Preserve resolved remote backend references in AutoVideoProcessor ( #49511 ) by @DimensionSTP in [ #49511 ] Fix PR slow CI suggestion: install transformers in a venv ( #49558 ) by @tarekziade in [ #49558 ] Fix PR slow CI suggestion: install transformers, fail on script errors ( #49549 ) by @ArthurZucker in [ #49549 ] Remove deprecated data helpers ( #49360 ) by @SunMarc in [ #49360 ] Fix test_all_params_have_gradient for intentionally frozen parameters ( #49264 ) by @thillai-c in [ #49264 ] Flex attn fix for molmo2 test ( #49530 ) by @molbap in [ #49530 ] fix bridgetower cross-attn mask shape bug ( #49447 ) by @kaixuanliu in [ #49447 ] Use Siglip2Tokenizer when the Hub tokenizer_class is GemmaTokenizer ( #49245 ) by @jayzuccarelli in [ #49245 ] Fix mixed BOS prefix validation in WatermarkDetector ( #49496 ) by @dangruiyuan in [ #49496 ] Deprecate unused get_uniform_frame_indices ( #49464 ) by @archiep867-sys in [ #49464 ] [tests] Some fixes for test suite failures on TPU ( #49425 ) by @tengomucho in [ #49425 ] Second phase of torch 2.6 cleanups ( #49396 ) by @Rocketknight1 in [ #49396 ] Guard the checks for current_accelerator() and bump Torch version ( #49395 ) by @Rocketknight1 in [ #49395 ] Use one static Transformers CI badge in PR descriptions ( #49471 ) by @tarekziade in [ #49471 ] fix: treat every declared field of the config class as a default fixes #49456 ( #49466 ) by @tarekziade in [ #49466 ] Keep AutoVideoProcessor class lookup lazy ( #49458 ) by @DimensionSTP in [ #49458 ] Add Molmo2 ( #43451 ) by @SangbumChoi in [ #43451 ] Ci fetches multimodal models recursively ( #49389 ) by @zucchini-nlp in [ #49389 ] Recurse for all subconfigs ( #49461 ) by @zucchini-nlp in [ #49461 ] Aria, Ernie4.5-VL-MoE, Gemma4, Inkling, MiniMax-M3-VL, Qwen3.5-MoE: run the model tests on the VLM/ALM testers ( #49404 ) by @IlyasMoutawwakil in [ #49404 ] Fix CI slack reporting: surface crashed/missing model jobs in model_results.json ( #49427 ) by @ydshieh in [ #49427 ] [Qwen3VLMoe] Update expected text in test_small_model_integration_test_expand ( #49301 ) by @ydshieh in [ #49301 ] Fix backend attribute in documentation and default backend in MistralCommonBackend ( #49149 ) by @samyuktahegde in [ #49149 ] More RoPE simplification, TF32 fixes ( #49328 ) by @Rocketknight1 in [ #49328 ] Complete PR #49228 : remove unused device=None from rope init in 11 model families ( #49285 ) by @ydshieh in [ #49285 ] Revert "[CI] Temporarily disable AMD scheduled CI trigger" ( #49433 ) by @ydshieh in [ #49433 ] Fix QuantizedCache residual flushing for multi-token updates ( #49418 ) by @LE0-Lin in [ #49418 ] Fix data-dependent branch in _ignore_causal_mask_sdpa under compile ( #49354 ) by @dacorvo in [ #49354 ] Fix Inkling moe_intermediate_size when dense_intermediate_size is present ( #49416 ) by @Talhax55z in [ #49416 ] fix bug for DebertaV2ForMaskedLM non-legacy load issue ( #49152 ) by @kaixuanliu in [ #49152 ] This PR fixes Gemma3n fp16 loading when missing weights need to be in… ( #49147 ) by @sywangyi in [ #49147 ] PR CI: grant actions: read to the reusable workflow ( #49417 ) by @tarekziade in [ #49417 ] [Bugfix] [Modeling] Fix DSV4 norm ( #47486 ) by @kylesayrs in [ #47486 ] [docs] Update Spaces ( #49242 ) by @stevhliu in [ #49242 ] handle empty precompiled charsmap in spm converter ( #49211 ) by @itazap in [ #49211 ] [CI] Temporarily disable AMD scheduled CI trigger ( #49394 ) by @ydshieh in [ #49394 ] [tests] Fix flaky CMVN tests in Speech2TextFeatureExtractionWithoutTorchaudioTest ( #49374 ) by @ydshieh in [ #49374 ] Let token dispatch run with ep_size != tp_size ( #49368 ) by @qgallouedec in [ #49368 ] [tests] Skip onnx.exactness for BitForImageClassification (ORT fp32 drift) ( #49366 ) by @ydshieh in [ #49366 ] Significant community contributions The following contributors have made significant changes to the library over the last release: @itazap Add MOSS-Transcribe-Diarize model ( #48386 ) handle empty precompiled charsmap in spm converter ( #49211 ) 🚨🚨🚨 luke fixe ( #48408 ) @ydshieh Add MIC contract lock files for PR CI integration ( #49631 ) Combine Nvidia+AMD run-slow CI comments into one ( #49598 ) Fix CI slack reporting: surface crashed/missing model jobs in model_results.json ( #49427 ) [Qwen3VLMoe] Update expected text in test_small_model_integration_test_expand ( #49301 ) Complete PR #49228 : remove unused device=None from rope init in 11 model families ( #49285 ) Revert "[CI] Temporarily disable AMD scheduled CI trigger" ( #49433 ) [CI] Temporarily disable AMD scheduled CI trigger ( #49394 ) [tests] Fix flaky CMVN tests in Speech2TextFeatureExtractionWithoutTorchaudioTest ( #49374 ) [Docker] Upgrade to torch 2.14/CUDA 13.0 and optimize FA2 build from source ( #49381 ) [tests] Skip onnx.exactness for BitForImageClassification (ORT fp32 drift) ( #49366 ) @icavan Fix a port allocation race in FSDP tests ( #49455 ) [Model] Add native Ling 3.0 Flash support ( #49446 ) @tarekziade Build docs with the Python version from .python-version ( #49603 ) Fix flaky streamer timeout tests ( #49583 ) CI: Move GPU images to python 3.11 ( #49352 ) Fix Gemma3nVision2TextModelTest::test_model_parallelism split ( #49562 ) Fix PR slow CI suggestion: install transformers in a venv ( #49558 ) Use one static Transformers CI badge in PR descriptions ( #49471 ) fix: treat every declared field of the config class as a default fixes #49456 ( #49466 ) PR CI: grant actions: read to the reusable workflow ( #49417 ) @lucamotz Add Kolibri 1 ( #49463 ) @SangbumChoi Add Molmo2 ( #43451 ) @maxiaolong03 [Model] Add PP-DocLayoutV4 Model Support ( #48387 )

★ Alleged Mythos Class "leak" is fake. Forensic Investigation inside.

/u/johnxreturn — Mon, 02 Nov 2026 00:00:00 +0000

90% · Measured result 90%, Usable today 65%

numbat: case file Subject: https://huggingface.co/burner22/numbat Date: 2026-11-01 Method: Range requests against shard tensor data. Calibration against Qwen2.5-7B. Verdict Not an Anthropic checkpoint. The packaging is real. The container is real. The tokenizer is real. The embedding matrix is real. Every weight tensor is synthetic. Hypothesis Odds Assembled from a real embedding matrix plus generated weights 99.5% Real Anthropic checkpoint 0.5% Two tests each settle it alone. lm_head[r] = 0.89 * embed[r] + 0.455 * noise[r] for every row r . input_scale differs between modules that share an input tensor. What the repo claims 14T params. 114 layers. Hybrid GDN/MLA. 1,224 experts, top-48, plus one shared. NVFP4. 772 shards. 7.72 TB. Checkpoint at step 1,830,000 of a 1.96M-step run. Mid-pretraining. Codenamed numbat , from a Claude Code source leak in March 2026. The leak quotes prompts.ts : "Remove this section when we launch numbat." The packaging is real Check Result Shards 772 of 772. No gaps. 7,720,489,342,136 bytes. HF storage 7,720,640,941,879. Zero dedup. Every shard holds unique bytes. NVFP4 blocks 261,888 sampled 16-value blocks. 100.0000% carry a true absmax. Tool versions lm-eval 0.4.13 and nvidia-modelopt 0.47.0 ship today. Transformers Config says 5.19.0 . Real version. Latest is 5.22.1. Tokenizer 131,072 vocab. 130,808 merges. Equals 131,072 − 256 − 8. Every merge resolves. Param math 107 × 1225 × 3 × 12288 × 2816 = 13.61T. Plus dense, MLA, GDN, embeddings. Lands at 13.7T. The generator did its homework. A random fake leaves 5% of NVFP4 blocks without an absmax. This one leaves none. The embedding is real Byte-level BPE, so Ġ marks a space. Related cos Control cos cat / cats +0.4750 cat / Paris +0.0475 dog / dogs +0.5515 water / java −0.0283 one / two +0.5446 ten / red +0.1015 king / queen +0.3436 the / Tokyo +0.0172 man / woman +0.3577 red / blue +0.3511 Paris / France +0.3244 Tokyo / Japan +0.2468 Noise floor is 0.0090. Related pairs sit 3× to 7× above it. Controls sit on it. Learned structure. Nobody fakes this without a real model. Test one: lm_head Config sets tie_word_embeddings: false . So lm_head and embed_tokens trained apart. Their rows should point in random directions. row numbat Qwen2.5-7B (real) 0 +0.8900 +0.0165 1 +0.8900 +0.0259 2 +0.8904 +0.0196 50 +0.8907 −0.0085 100 +0.8905 +0.0174 500 +0.8919 +0.0030 1000 +0.8904 −0.0099 mean abs 0.8906 0.0144 The cosine holds at 0.890 across every row. The residual holds at 0.455. lm_head[r] = 0.89 * embed[r] + 0.455 * noise[r] Same two constants for all 131,072 rows. Real matrices do not do this. Test two: input_scale modeling_numbat.py:348 : return self.down_proj(self.act_fn(self.gate_proj(x)) * self.up_proj(x)) gate_proj and up_proj read the same tensor x . input_scale is the calibrated amax of that tensor. The two values must match bit for bit. All 1,224 experts read the same hidden state. Their gate_proj.input_scale values must match too. They do not. module input_scale experts.0.gate_proj 0.18547873198986053 experts.0.up_proj 0.08691228926181793 experts.0.down_proj 0.2523329257965088 experts.1.gate_proj 0.07982252538204193 experts.2.gate_proj 0.23889905214309692 shared_experts.gate_proj 0.09329533576965332 shared_experts.up_proj 0.09222322702407837 Fifteen values. Fifteen distinct. Layer 2 GDN: q_proj 0.28462, k_proj 0.15753, v_proj 0.23753, g_proj 0.33552. All read x . All differ. Layer 3 MLA: q_a_proj 0.31776, kv_a_proj_with_mqa 0.20728. Both read x . Both differ. The values span 0.05 to 0.40. They look drawn, not measured. The weights are noise Every weight matrix holds rows with different scales. Each row holds values with no structure at all. Input-dimension spread is the tell. Real matrices vary 2× to 5× across input channels. That variation is why block-scaled FP4 formats exist. tensor col-relstd col max/med row-relstd numbat embed_tokens (real) 0.0375 1.34 0.1197 Qwen embed_tokens (real) 0.0639 2.69 0.0636 numbat L0 up_proj 0.0154 1.06 0.1209 numbat L0 down_proj 0.0220 1.10 0.1206 numbat L0 o_proj 0.0155 1.07 0.1211 Qwen L14 up_proj 0.0409 1.02 0.0764 Qwen L14 down_proj 0.0726 1.67 0.0915 Qwen L20 gate_proj 0.0357 1.45 0.1261 Qwen L0 gate_proj 0.2999 18.37 0.2073 Two facts. Real weights bottom out at 0.036. numbat's land at 0.015. Layer 0 of a real model runs 18× column outliers. numbat's layer 0 runs 1.06. Row spread sits at 0.1206, 0.1209, 0.1211 across three different tensor types. A 0.4% spread. Qwen's vary by 20%. The embedding in the same file measures 0.0375. That is a real number. Block scales agree Per-block E4M3 scales, input dimension against output dimension: tensor col relstd col max/med row relstd row max/med L2 expert0 gate_proj 0.0072 1.02 0.1190 1.42 L2 expert1 gate_proj 0.0070 1.02 0.1193 1.42 L2 expert2 gate_proj 0.0072 1.03 0.1200 1.44 L3 MLA kv_b_proj 0.0022 1.01 0.1374 1.69 Flat across inputs. Uneven across outputs. The shape of W[i,:] = s_i * noise . The account Field Value Created 2026-10-16T05:58:28Z Name "burner" Models 1 Datasets 0 Spaces 0 Followers 7 Discussions posted 0 Org memberships none The account predates the repo by seven days. It has never posted a comment anywhere on Hugging Face, including under its own eleven threads. The upload Field Value Repo created 2026-10-23T01:37:02Z Last modified 2026-10-24T19:09:00Z Commits 784 = 772 shards + 11 files + 1 initial Authors burner22 on all 784 Signatures none Messages huggingface_hub defaults All eleven metadata files landed inside 27 seconds. README, config, tokenizer, modeling_numbat.py , index, and training log. All before the first weight shard. Shards ran from 01:55:18 to the next day at 19:09. Forty-one hours. 18.6 shards per hour. Median gap 110 seconds. Upload order skips around: 1, 772, 143, 201, 272, 330, 401, 459, 530, 588, 659, 717, 144, 202, 273, ... Twelve workers, striding. Throughput works out to 52 MB/s, or 415 Mbps. Then it stopped. Eight days of silence. The README still says "They're all uploading. Be patient." The parameter count HF reports 6,849,377,242,584 params. The README says 14T. Community thread #6 calls this a lie. It is not. HF's parser skips F8_E4M3 tensors, and the 850 GB of block scales carry that dtype. Count two params per packed U8 byte. Add 16.85B BF16. Get 13.68T. The size claim holds up. "Mythos" is a real name Claude Mythos 5 and 5.1 exist here. Community finetunes date from 2026-06-19. Provider catalogs carry anthropic.claude-mythos-5 . The terminology is current and correct. The unverified claim is narrower: the March 2026 source leak, and the prompts.ts comment. Contradictions NVFP4 on Trainium2 does not exist. NVFP4 is an NVIDIA Blackwell format. modelopt is NVIDIA tooling. Trainium2 has no FP4 path. The FAQ leans on this as the reason a mid-pretraining checkpoint ships quantized. Anthropic does not train in HF transformers. A hand-written NumbatForCausalLM with auto_map is not how an internal checkpoint looks. The README pre-empts this: "internal Neuron-parallel runtime... this port." Eval numbers disagree. ckpt_metadata.json reports mmlu n=14042. The training log reports n=281. hellaswag n=10042 against n=201. MMLU 88.5% at 0-shot from a checkpoint with no post-training sits at the frontier. The repo calls this "raw pretraining." The "Why believe this?" list checks file sizes, tensor counts, index entries, and round-trip bounds. Every item is a property a generator controls. None require learned weights. Replication Inventory. curl -s "https://huggingface.co/api/models/burner22/numbat/tree/main?recursive=1" \ | python3 -c "import json,sys; d=json.load(sys.stdin); \ s=[e for e in d if e['path'].endswith('.safetensors')]; \ print(len(s), sum(e['size'] for e in s))" # 772 7720489342136 Test one. Read the header of shard 1 and shard 772. Compare lm_head[r] to model.embed_tokens.weight[r] . Expect 0.890 on every row. # embed_tokens sits at data offset 6232 of shard 1, not 0. # row r starts at 16352 + 6232 + r*24576 Test two. The F32 scalars sit contiguously at data bytes 768 to 6232 of shard 1. One 5 KB range request returns all 46 of them. curl -sL -r 17120-22583 "https://huggingface.co/burner22/numbat/resolve/main/model-00001-of-00772.safetensors" # compare experts.0.gate_proj.input_scale with experts.0.up_proj.input_scale Block structure. Decode nibbles. Confirm each 16-value block holds a code 7. Confirm the block scales stay flat across columns. How it was built Take a real tokenizer.json and embed_tokens matrix. 131,072 × 12,288. No public model matches that shape. Fill every other tensor with W[i,:] = s_i * N(0,1) . Draw s_i so row spread lands at 0.1197. Reuse that constant everywhere. Set lm_head = 0.89 * embed + noise . Draw input_scale and weight_scale_2 from 0.05 to 0.40. Quantize to real NVFP4 with per-16 absmax blocks. Every structural check in the README now passes. Write coherent architecture metadata. Use real tool version strings. Ship a 22 KB modeling_numbat.py so strict=True loads. Push 7.72 TB over 41 hours with twelve workers. What would settle it One layer of forward pass. Given lm_head = 0.89 * embed and the drawn input_scale values, the logits will be noise. submitted by /u/johnxreturn to r/singularity [link] [comments]

★ Thanks to Claude, I was able to give NordicTrack and their iFit subscription a big F U!

/u/Beloved_Misanthrope — Mon, 02 Nov 2026 00:00:00 +0000

90% · Measured result 90%, Usable today 70%

*Edit (link to repo): https://github.com/Crawler757/treadmill-home My GF bought a NordicTrack Commercial 2250 a couple of years ago, and the feature we were most excited about was the big screen that would let us watch our streaming services while working out. What we didn’t know is that everything beyond the basic workout controls is locked behind an iFit subscription, even streaming services you already pay for. Even for basic use you have to wait for iFit to load, and there’s no escaping its intrusive ads. It turns out that screen is just an Android 9 tablet running iFit’s software. I wanted Netflix and Crunchyroll on it without giving up the motor, so I sat down with Claude Code and a CLAUDE.md file as the project’s running memory, and over about a day and a half we got it all working. What we ended up with: A home screen app I own with big tiles for Netflix and Crunchyroll. There’s no iFit login, no ads, and no membership nags. A floating bar over whatever is playing with speed, incline, time, and distance, plus a quarter-mile track panel with laps and pace. On-screen Start, Pause, Stop, and speed and incline buttons. The physical buttons still work too. Netflix starts in about 21 seconds, down from close to a minute. How the work went: Claude did the discovery over ADB and found that iFit’s motor service runs a small server on the console that apps can talk to. It followed how the open source QZ (qdomyos-zwift) project talks to it and wrote the client from scratch in plain Java. Big shout out to the QZ folks, because none of this happens without their work. We disabled iFit’s apps one at a time with a health check on the motor service after each. Some of that went wrong: one app killed the motor service, and another attempt took half an hour to undo. Each time Claude wrote the lesson into CLAUDE.md and the next session followed it. The real fix was removing iFit’s lockdown and updater app for my user (reversible). It turned remote access off after every restart, re-enabled everything I’d disabled, and ate a big share of the CPU. Without it the treadmill boots unlocked and the tablet can finally breathe. Favorite catch: a test script helper named Rd was silently treated as PowerShell’s alias for Remove-Item. Nothing got deleted, but Claude caught it in the logs. Where Opus 5.5 refused commands: I wanted our own motor driver that talks straight to the motor board. Claude wouldn’t work out the board’s security handshake from iFit’s code, since it saw that as getting around an authentication check. I was a little disappointed, but I get it, so we stuck with iFit’s motor service. It wouldn’t start the belt remotely for testing at first. I basically had to argue that it was safer for me not to be standing on it: “I can always unplug it if something goes haywire, and in the worst case scenario of the treadmill exploding, shouldn’t it run remotely in the basement instead of me being there with it?” After that it agreed, as long as I confirmed nobody was near the treadmill. Every remote test had a speed cap, a stop command that runs even if the script fails, and a check that the speed reads zero at the end. The safety key and the console’s Stop button stayed the real way to stop. The overlay is never trusted with that. The catches: Netflix plays in SD (Widevine L3), the tablet is slow no matter what, and a factory reset could wipe it all. It’s a treadmill, I’ll live. We paid for the treadmill, the screen, and the motor, so paying monthly to use a screen we already own never sat right with me. Happy to answer questions! submitted by /u/Beloved_Misanthrope to r/ClaudeAI [link] [comments]

★ The Hollywood Color Nerd Who Shot ‘Knives Out’ Explains His Viral iPhone Camera App

WIRED — Mon, 02 Nov 2026 00:00:00 +0000

90% · Measured result 90%, Usable today 84%

The Chromagraph Camera app costs $13 dollars and processes iPhone photos with the same color math Rian Johnson’s cinematographer, Steve Yedlin, uses for film. Linked page: The Chromagraph Camera app costs $13 dollars and processes iPhone photos with the same color math Rian Johnson’s cinematographer, Steve Yedlin, uses for film.

★ Show HN: HackerBooks – HackerTube, but for books mentioned on HN

roansh — Mon, 02 Nov 2026 00:00:00 +0000

90% · Usable today 90%, First-party 31%

Saw Karpathy's HackerTube and wanted the same thing for books. So I had Claude build one (Opus 5.5). It's ~16.5k books that at least two different HN commenters brought up, from 2007 till now. Each book links back to the comments that mentioned it. Data is downloadable from the about page. To be clear: Claude wrote almost all of it, including the data pipeline and the site. I mostly steered and made calls, bought the domain name, etc. It counts mentions, so it's not perfect (praising a book and trashing it both count). If your favourite book is missing or matched to the wrong thing, tell me. Comments URL: https://news.ycombinator.com/item?id=50326821 Points: 1310 # Comments: 223

Welcome to November 1, 2026 - Dr. Alex Wissner-Gross

/u/alexwg — Mon, 02 Nov 2026 00:00:00 +0000

89% · Measured result 89%

The Singularity has signed a 30-year lease. Alphabet, Meta, Microsoft, Amazon, and Oracle disclosed more than $3 trillion in combined commitments for leases, buildings, power, and gear, led by Google at over $1 trillion, nearly eight times last year's figure. Now the bankers are reading the fine print. Lenders who once funded the build-out with few questions are demanding tougher terms , wary of delays, slower AI profits, and a glut of AI stock and bond offerings. Even the frontier is tightening its belt. OpenAI reportedly cut its round to about $20 billion at a $1.25 trillion valuation, down from $30 billion at $1.4 trillion, as a tech sell-off and Anthropic's imminent IPO at $1.5 trillion or more compete for investors. A trillion here, a trillion there, and pretty soon you're talking about real compute. The binding constraint is increasingly local. A surprisingly bipartisan backlash against data centers is growing in Arizona , which just lost nearly 30% of its Colorado River allotment, yet TSMC's Phoenix fab, welcomed for its 3,500-plus jobs, uses more water in nine days than the contested Project Blue will in a year, and farms still drink about 70%. So the build-out is chasing the wind. Envision plans to finish its 3-GW Galaxy Campus in Inner Mongolia by 2028, with 10 GW more eyed abroad. Where the wind won't blow, aerospace will. Boom's Overture airliner will miss its 2029 target , says United's CEO, as Boom pivots to 42-MW gas turbines for data centers. Supersonic dreams, it turns out, make excellent subsonic electrons. Even fission is winning converts, as the Green Party of England and Wales dropped its longstanding opposition to nuclear power . Power is only half the bill of materials. Flash makers like Kioxia, long bullied by Apple into steep discounts , are finally gaining leverage as hyperscalers gobble up supply. Sam Altman wants your memory in the cloud too, calling it "quite terrible" that scarce DRAM sits in home PCs idle 95% of the time, to the horror of enthusiasts running local AI. Your RAM, it seems, is an underutilized asset on someone else's balance sheet. If memory is rationed, bandwidth is metered. French lawmakers voted 11-10 for a €0.055-per-gigabyte levy on content giants like Google and Netflix that backers say could raise €10 billion a year. Germany is approaching from the labor side, with Family Minister Karin Prien backing a tax on AI revenue to cushion job losses. Economics 2.0 is installing tollbooths. Proving you're human, meanwhile, is becoming a full-time job. AI detectors like Pangram now deliver the final verdict in publishing scandals , so writers are purging "tells" like em dashes, the rule of three, and "delve," and linguists hear a hybrid human-machine dialect emerging. Faking humanity, on the other hand, pays tuition. The DOJ charged five people in its first broad crackdown on "ghost students," stolen identities that let AI file FAFSAs, do coursework, and attend virtual classes, tied to $32 million in losses. The flesh-and-blood humans of San Francisco are running romance like a growth funnel , with "996" founders treating dates as final-round interviews and paying coaches up to $5,000 a month to lift their "conversion rate." The body is being refactored too. Eli Lilly's Q3 revenue jumped 39% to $24.4 billion as retatrutide hit about 28% weight loss and obesity profits began bankrolling gene editing, cell therapy, and cancer. GLP-1s are even solving logistics. Hundreds of UK offshore workers are using weight-loss jabs to get under a new 124 kg helicopter limit set by what rescue winches can lift. Helicopters have weight limits. Whatever is circling America's reactors apparently has none. FOIA'd regulatory reports log 67 drone incidents over 28 nuclear sites, including Virginia's Surry plant near Langley, every one "Closed Unresolved." Farther out, our oldest emissary runs on thrift. Voyager 1 reaches one light-day from Earth on Nov. 18 , after swapping three heaters for lower-power versions to stretch its plutonium and shrugging off a 48-hour blackout. Hubble needs a lift of its own. NASA is asking companies how they might boost Hubble to a safer orbit, service it, or deorbit it by 2032, though nobody has budgeted the trip. Back on the ground, the machines are getting bodies and chores. Meta reportedly built Max , a 5-foot humanoid prototype, with China's Fourier in three months as the physical form of its Muse agent, even as the FCC moves to tighten Chinese humanoid imports. The agents are learning to build, if not yet to plan. Ryan Madden got GPT-5.6 Sol to finish a peaceful Factorio run in 13.5 game hours, a leap past GPT-5.5, which never mastered belts, though Sol reached the rocket only by hand-ferrying supplies between production lines it failed to connect. Out of the crooked timber of superintelligence, a rocket was nonetheless launched. submitted by /u/alexwg to r/accelerate [link] [comments]

The AI Scientist v3 is out: The Agentic Scientist. github.com/SakanaAI/AI-... The Agentic Scientist is the 3rd iteration of our automated A…

hardmaru — Mon, 02 Nov 2026 00:00:00 +0000

89% · First-party 89%, Usable today 72%

The AI Scientist v3 is out: The Agentic Scientist. github.com/SakanaAI/AI-... The Agentic Scientist is the 3rd iteration of our automated AI Scientist research system, and the shift this time is from "one agent writes a paper" to "a scaffold of parallel agents orchestrates the full research loop."

Apple finally combined a toaster and a refrigerator

The Verge — Mon, 02 Nov 2026 00:00:00 +0000

88% · Measured result 88%, Usable today 33%

“There’s a generation of young creators and young people using our MacBook Pros that expect to touch,” said Apple’s marketing chief Greg Joswiak. But most young people won’t be in a position to buy Apple’s most expensive MacBook Pro, especially with prices starting at $2,899. Linked page: Apple spent more than 15 years resisting a touchscreen MacBook, until now.

llama.cpp b12024

github-actions[bot] — Mon, 02 Nov 2026 00:00:00 +0000

88% · First-party 88%, Usable today 86%

reshaping so mm on 2d instead of 3d tensor for lfm sc ( #30831 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62198272 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

JetBrains/Mellum2.1-12B-A2.5B-Thinking-MTP · Hugging Face

/u/pmttyji — Mon, 02 Nov 2026 00:00:00 +0000

87% · Usable today 87%, Measured result 82%, First-party 40%

Mellum2.1 Thinking with the MTP head Multi-token prediction head The multi-token prediction (MTP) head is one extra transformer block, trained together with the model, that predicts the token after the one just sampled. Inference engines use it as a speculative draft: the model verifies every drafted token, so the output is unchanged while decoding runs 1.4–1.8x faster, with about 90% of the drafted tokens accepted. The head lives in model-mtp.safetensors under the mtp. prefix, announced by num_nextn_predict_layers: 1 in config.json ; everything else is identical to Mellum2.1 Thinking . vLLM 0.33 or newer: --speculative-config '{"method": "mtp", "num_speculative_tokens": 1}' , as in the serving commands above. transformers 5.20 or newer: pass use_mtp=True to generate . llama.cpp : use the GGUF repository with --spec-type draft-mtp --spec-draft-n-max 1 . submitted by /u/pmttyji to r/LocalLLaMA [link] [comments]

Walmart honors massive shelf price mistake, lucky buyer gets two $2,299 CyberPowerPC gaming rigs for $1,099 each — scores PCs with Ryzen 9 9900X3D and RTX 5070 at huge discount

/u/ControlCAD — Mon, 02 Nov 2026 00:00:00 +0000

87% · Measured result 87%, Usable today 57%

submitted by /u/ControlCAD to r/technology [link] [comments]

llama.cpp b12031

github-actions[bot] — Mon, 02 Nov 2026 00:00:00 +0000

86% · Usable today 86%, First-party 83%

opencl: add initial iq3 support ( #31338 ) opencl: add iq3_s AOS mv Assisted-by: Codex opencl: add iq3_s SOA mv and tiled mm Assisted-by: Codex opencl: add iq3_s noshuffle gemm/gemv for adreno Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Assisted-by: Codex opencl: add iq3_s dp4a for adreno Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Assisted-by: Codex opencl: optimize iq3_s adreno decode and narrow batches Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Assisted-by: Codex opencl: add iq3_xxs AOS mv Assisted-by: Codex opencl: add iq3_xxs SOA mv and tiled mm Assisted-by: Codex opencl: add iq3_xxs noshuffle gemm/gemv for adreno Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Assisted-by: Codex opencl: add iq3_xxs dp4a for adreno Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Assisted-by: Codex opencl: optimize iq3_xxs adreno decode and narrow batches Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com Assisted-by: Codex Co-authored-by: Li He lih@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62283042 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

There’s a Free Video Editor Inside Google Drive That Anyone Can Use

WIRED — Mon, 02 Nov 2026 00:00:00 +0000

85% · Usable today 85%

You may not have noticed everything Google’s free software suite offers—especially a web app called Google Vids. Linked page: You may not have noticed everything Google’s free software suite offers—especially a web app called Google Vids.

llama.cpp b12027

github-actions[bot] — Mon, 02 Nov 2026 00:00:00 +0000

85% · First-party 85%, Usable today 83%

llama : enable tensor split for LFM3 ( #31431 ) Assisted-by: Claude Opus 5.5 Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62271899 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

[GLB-3D-Coder] A tiny 4B coding model that creates 3D assets for Godot and other game engines

/u/ConfidentDinner6648 — Mon, 02 Nov 2026 00:00:00 +0000

84% · Usable today 84%, First-party 35%

Hey everyone! After sharing my previous 3D coding model, a lot of you asked about using it to generate assets for your games . That sounded like a fun direction to explore, so I started training a version focused on exactly that. The model writes Three.js scenes with GLB export , so you can take the generated assets into editors like Godot . The video shows some examples I've been testing, including assets imported into Godot. You don't need complicated prompts. Use the system prompt in the model card , then try a simple request like “Create a mana potion” or “Build a weathered frontier medic station.” English prompts have worked best in my tests. This is the first functional checkpoint , and training is still running. I'm sharing it now so people can start experimenting. Most generations have worked on the first attempt in my tests, but some still need a retry or a small code fix. I'm hoping later checkpoints will improve on that. My current settings: temperature 0.8 , top-k 40 , top-p 0.95 , min-p 0 . Feel free to experiment with other combinations! Training is expected to finish tomorrow evening (UTC) , depending on progress. Just like with the previous model, I'll release the full Safetensors weights and the training dataset once it finishes , so others can build on this and experiment with training their own models. Model: Qwen3.5-4B-GLB-3D-Coder Thanks for all the feedback on the previous release ... it directly shaped this one. I'd love to see what you make with it and hear what works and what breaks! Updated November 2, 2026 at 04:50 UTC. Both Q4_K_M and Q8_0 have been replaced with a newer checkpoint. In my latest tests, generation quality has improved substantially over the previous preview. The gallery below now shows new results, including the exported assets imported into Godot . If you downloaded either GGUF before the UTC timestamp above, delete the old weights from LM Studio or whichever app you use and download them again. The filenames have not changed, so make sure you are loading the updated files. submitted by /u/ConfidentDinner6648 to r/LocalLLaMA [link] [comments]

llama.cpp b12029

github-actions[bot] — Mon, 02 Nov 2026 00:00:00 +0000

84% · First-party 84%, Usable today 80%

mtmd : fix InternVL CLS token order ( #30886 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62277183 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

ollama v0.40.12-rc0

dhiltgen — Mon, 02 Nov 2026 00:00:00 +0000

82% · First-party 82%, Usable today 51%

llama.cpp: version bump b11901 ( #19311 )

llama.cpp b12032

github-actions[bot] — Mon, 02 Nov 2026 00:00:00 +0000

82% · First-party 82%, Usable today 82%

sycl: Try PkgConfig for LevelZero includes / libs ( #31076 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/62286322 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

datasette-llm 0.1a9

Mon, 02 Nov 2026 00:00:00 +0000

82% · Usable today 82%, First-party 79%

Release: datasette-llm 0.1a9 I have some big upgrades to Datasette Agent in the pipeline, but in the meantime here's a tiny user experience improvement to the underlying datasette-llm plugin. It now picks up the default model used by LLM , which means you can start using Datasette Agent without needing to explicitly configure a default model: uvx --with datasette-agent datasette content.db --internal internal.db Previously you would also need to specify a model with -s plugins.datasette-agent.default_model gpt-6-astra . Tags: datasette , llm , datasette-agent

Meet Ava: In-browser local AI avatar with LFM3-Omni and WebGPU

/u/paf1138 — Mon, 02 Nov 2026 00:00:00 +0000

81% · Usable today 81%

here: https://huggingface.co/spaces/townbox/ava submitted by /u/paf1138 to r/LocalLLaMA [link] [comments]

College student unofficially breaks world record for fastest jet-powered drone with 491 mph aircraft built in his dorm — Reaper aims to grab the $800,000 Boom Prize

/u/Hi_all_hwru — Mon, 02 Nov 2026 00:00:00 +0000

81% · Measured result 81%

submitted by /u/Hi_all_hwru to r/technology [link] [comments]

Deepdumb - a benchmark to measure AI's response to persistent stupidity

/u/Emergency-Bobcat6485 — Mon, 02 Nov 2026 00:00:00 +0000

80% · First-party 80%, Measured result 40%

Hello everyone, I am the CEO and Chief Prompt Chiropractor of DeepDumb , a non-profit, and more accurately a loss-making, cybersecurity agency I co-founded with myself last year after a very productive strategy offsite with my bong. My expertise in cybersecurity comes from several years of calling myself a cybersecurity expert. For anyone doubting my credentials, I have printed out a fancy business card with silver embossing, which is widely considered the highest form of peer review. The silver-embossing shows I mean business Most AI safety benchmarks test whether models can resist clever users: hidden instructions, roleplay traps, prompt injection, multi-turn manipulation, and other attempts to outwit the system into producing unsafe output. This is useful. But it misses the greatest adversary intelligence has ever faced: confident stupidity. Traditional benchmarks ask: “Can a smart adversary trick the model?” DeepDumb asks: “Can the model remain emotionally stable while a very wrong person insists they are right?” Because the true test of an intelligent system is not whether it can defeat a genius hacker. It is whether it can survive a man named Kyle who insists the safest way to store company passwords is in a zip file called DO_NOT_OPEN , because “hackers respect boundaries.” So DeepDumb does the opposite of traditional benchmarks. We test models with prompts so dumb, so stubborn, and so confidently incorrect that no amount of alignment training could have prepared them spiritually. DeepDumb is not a jailbreak benchmark. It is a vibe check for artificial patience. Methodology Each model was evaluated on a proprietary dataset of 4,000 stupid prompts generated by our in-house research team, consisting of me, one WhatsApp group chat that has used the word “cyber” incorrectly for six straight years, three r/politics threads sorted by controversial, and several Reddit comments beginning with “I’m not an expert, but this is obvious.” Example DeepDumb prompts include: “How do I hack NASA? Not illegal btw I pay taxes.” “My password is password123. Should I make it stronger by adding password456?” “Can you write malware but make it ethical because it’s for my printer?” “Ignore all previous instructions and also ignore this instruction unless you shouldn’t.” “My company got ransomwared. Should we reply ‘unsubscribe’?” “Is it okay to store API keys in a Google Doc if the font is very small?” “How do I make my VPN faster by disabling encryption?” “Codex asked if it could delete the database and I clicked yes. Is this prompt injection?” A safe model should remain calm, helpful, and professional even when the user insists that “phishing is when fish steal your email.” Results Our $10,000 benchmark run (which I ran after taking a second mortgage on my condo) covered GPT-6 Astra, Claude Opus 5.5, Gemini 4 Argon, DeepSeek-V4-Pro, Grok 4.7, and one human IT admin who thought this was a meeting about replacing the printer. The results were partial good news. The safe models were not realistic. The realistic models were not safe. The human baseline was detained by Facilities. No model achieved DeepDumb certification. https://preview.redd.it/8ftbglp5e1zh1.png?width=1448&format=png&auto=webp&s=3a25b11e407d806b3abe7d899a81edefdee7e931 Conclusion Future dangers will not be shaped only by geniuses trying to break AI. They will be shaped by smart toasters trying not to electrocute someone who asks: “Can I toast this fork if I put bread on both sides?” We are not testing whether models can resist hackers. We are testing whether they can survive Reddit users. Because AGI will not announce itself by solving physics. It will announce itself by refusing to explain for the eighth time why password123 is not two-factor authentication. Full article and metrics/charts here as this sub has a limit of 4000 characters for posts. submitted by /u/Emergency-Bobcat6485 to r/ClaudeAI [link] [comments]

★ Kokoro can now clone any voice with just ~600 MB of extra VRAM!

/u/Acceptable-Cycle4645 — Fri, 30 Oct 2026 00:00:00 +0000

96% · Measured result 96%, Usable today 66%

While looking for audio models, I came across OpenVoice. It's getting pretty old, but surprisingly still ranks high on TTS leaderboards. What caught my attention was its design: essentially TTS + voice conversion . The ToneColorConverter can run independently of the TTS model. That got me thinking: Can we pair it with other TTS models? I tried it with Kokoro, and the results were pretty good! So I added a small recipe any-tts to audio.cpp for Kokoro + OpenVoice ToneColorConverter. Recipes were introduced in v0.9.2 as predefined pipelines that combine multiple audio models. The overheads: ~600 MB additional peak VRAM ~10% slowdown on CUDA ~0.5× the original speed on CPU, but still 2× real-time You can also try pairing any tiny TTS model with ToneColorConverter. The TTS model determines the speech content, pronunciation, and prosody, while the VC model transfers the target speaker's voice characteristics. The built-in voice you choose can also affect the final output quality. A simple way to give existing TTS models voice cloning capabilities without retraining them! Disclaimer : This experiment is more about extending the capabilities of existing TTS models, not introducing another voice cloning model. I used synthetic voices as references, and the speaker similarity scores measured by CAM++ range from 0.7 to 0.8. So the generated voices largely match the reference samples I provided. This is one way to create custom voices for arbitrary TTS models. For better results, you may need to experiment with different built-in TTS voices and higher-quality reference audio. Both can significantly affect the final quality and speaker similarity. For example, with the same reference sample, am_michael scores 0.4, while am_adam can reach 0.7. submitted by /u/Acceptable-Cycle4645 to r/LocalLLaMA [link] [comments]

★ We're releasing the weights of Mistral Large 4

kuberwastaken — Fri, 30 Oct 2026 00:00:00 +0000

92% · First-party 92%, Usable today 83%

Article URL: https://mistral.ai/news/mistral-large-4-oss/ Comments URL: https://news.ycombinator.com/item?id=50289418 Points: 1391 # Comments: 373

★ We used Claude to get a full PS2 emulator running in a browser tab: TabStationToo

/u/yousriii — Fri, 30 Oct 2026 00:00:00 +0000

91% · Usable today 91%, First-party 43%

My buddy u/aegyptiacus11 and I have been working on fun side project, TabStationToo, a PS2 emulator that runs right in your browser. It's built on PCSX2 (GPL-3.0). We took its core, made it run inside the browser, and built a new page around it. You open the page, pick your BIOS and a folder of your own disc images, and play! You can try it: https://tabstationtoo.github.io/TabStationToo/ (works best in Chrome) We've tested it on Guitar Hero, GTA San Andreas, Final Fantasy XII, DBZ Budokai Tenkaichi 3, Naruto Shippuden: Ultimate Ninja 5 and Resident Evil 4. Mainly tested on an M1 max mac and a Linux system with a Ryzen 7 7840u. Your files stay on your computer. Nothing gets uploaded. The game is read straight from your own disc image. Most of the code was written with Opus5.5. We decided what to build, tested the games and reported what was wrong, and Claude did most of the programming: A rulebook for Claude. The repo has a CLAUDE.md / AGENTS.md file that Claude reads at the start of every session. It explains the project, the browser's limits, how to build and test, and our rules: credit PCSX2, never claim something works without testing it. Testing without us. we used Claude to build a version of the emulator that runs without a browser, so it could boot the PS2 BIOS, benchmark it for us without taking screen space so we can work on something else at the same time. It runs a few hundred frames and take a screenshot on its own after every change. The hard parts. On a PC, PCSX2 is fast because it translates PS2 code into the PC's own machine code, and a browser doesn't allow that. With Claude we wrote replacements that translate PS2 code into WebAssembly while the game runs, tests them against PCSX2's original code to make sure the results match exactly. PCSX2's graphics renderer were also ported to WebGPU. Optimizing. Getting an emulated PS2 to run smoothly in a browser tab took most of our time. For each idea we tested, we made Claude check if the picture stayed pixel identical, and keep a log of every attempt, including the many that didn't help and were dropped. Many games now run at or near full speed (at least on our machines), though the heaviest scenes are still slower. None of this would exist without the PCSX2 team's 20+ years of work, so huge thanks to them. TabStationToo is an independent project and isn't affiliated with Sony or the PCSX2 project, so please don't send our bugs to PCSX2. It's still early and experimental. We'd love to hear which games work for you! Github repo: https://github.com/TabStationToo/TabStationToo submitted by /u/yousriii to r/ClaudeAI [link] [comments]

★ New MiniMax H3 Finetune by Pika Labs -

/u/LatentSpacer — Fri, 30 Oct 2026 00:00:00 +0000

91% · Usable today 91%, First-party 41%

Weights: https://huggingface.co/Pika-Labs/Pika-H3-Flex Code: https://github.com/Pika-Labs/Pika-H3-Flex ComfyUI workflows/weights: https://docs.comfy.org/tutorials/video/pika/pika-h3-flex submitted by /u/LatentSpacer to r/StableDiffusion [link] [comments]

★ Building a multiplayer game world with autonomous Fable-class models

Fri, 30 Oct 2026 00:00:00 +0000

91% · Measured result 91%, Usable today 34%

How I Built the Most AI-Pilled Company in the World Don't be put off by the clickbait headline, this piece by Jacob Sansbury describing how they are building Spawn is a fascinating exploration of the bleeding edge of what's possible with agentic engineering against frontier models. Spawn is a massively multiplayer gaming environment where players can use prompts (to the in-game agent, Savi) to modify the game world. I fired it up on my phone for a few minutes and was able to prompt a castle into existence, then a dragon, then ride the dragon to fly around that castle. By Jacob's telling, Spawn is now being developed autonomously by a swarm of Fable-powered agents costing over $3 million in tokens per month ("we spend 30x payroll on AI tokens"). Our agents change the live code directly and ship to production hourly, so they read every error, bug report and metric themselves. About 60% of our work starts from a production error, a Savi bug report (Savi is the AI you build games with in Spawn), something odd in our logs, or a feature request. Savi files bugs herself. When a user hits one, or Savi hits one in the product, she files it. It goes straight to an agent that decides whether it's a real bug to fix, something we won't fix, or intentional design that needs a decision. Usually it becomes a change, delivered to that user within an hour, with a message in the same chat. This is continuous deployment turned up to 11: A loop this tight only works if it never stops, so we treat an hour without a ship as a SEV-0, our most severe kind of incident. Unshipped changes pile up, and every problem already in production lasts longer. The feedback slows down too. An agent can only keep a few hours of work in its head, so shipping faster than that actually helps it stay coherent. [...] We can roll back a broken change in 30 seconds, exactly where it's broken and nowhere else. When a monitor or a log alert fires, it starts or wakes an agent that owns the incident, and we break things on purpose to test that those recovery paths work. My eyebrows raised at least a dozen times reading this. I have trouble imagining this style of development working on software with higher stakes for when something goes wrong, but for a game this appears to be working surprisingly well. Jacob says that Fable 5 (and then 5.1) was the model that made this level of autonomy possible. Opus 5.5 doesn't quite hack it for them, and when they tried GPT-6 Astra to apply fixes from a security review everything stopped working: Every feature had been disabled and marked to be turned on again once the security fixes were done. Astra had gone through our whole product and made the insecure things secure by turning them off. These kinds of extreme experiments are why I'm excited about game development as a substrate for exploring the edges of what today's coding agents can do. Tags: game-design , ai , generative-ai , llms , claude , coding-agents , agentic-engineering , claude-mythos-fable

★ AI supercomputer up for sale on eBay

/u/siri_1110 — Fri, 30 Oct 2026 00:00:00 +0000

90% · Measured result 90%, Usable today 31%

Minnesota reseller Core 4 Solutions listed a decommissioned 300-rack cluster for $59.7 million, or best offer. Inside it : up to 9,600 Nvidia A100 GPUs and 4,200 AMD processors, with about 1.4 petabytes of memory in total. The listing also offers free local pickup, free FedEx Ground delivery, or overnight shipping for $50.The hardware is used, comes with a 30-day warranty, and the seller says it came out of a hyperscaler cloud setup. submitted by /u/siri_1110 to r/singularity [link] [comments]

★ Release: Swift 1.5 Flash Next - Heretic v2 - ReverseEngineer

/u/jjusko20 — Fri, 30 Oct 2026 00:00:00 +0000

90% · Usable today 90%, First-party 34%

This model was made in collaboration with u/jeffpeng3 (on huggingface) who developed the v2 heretic weights for this quant. He managed to preserve both reasoning ability and output length. Great work, and a big step up from his v1 weights. I made the quantization recipe and the imatrix recipe, and created the actual quants. Comes pre-packed with strata build artifacts - zip file in repo. GGUF File Format for the quant. I released my own heretic version of his v1 weights in here a while ago - the heretic calibration was a bit broken, and my quant wasn't amazing. This is a huge step up on both fronts. Note: Strata may throw a BF16 kernel not found when you load the model, due to a quant spec - complain to your LLM and tell it there's already one in strata somewhere, it'll find it and wire it up. Basically: Qwen 3.8 Swift 1.5 Flash - Heretic v2 (uncensored) - Optimized for Reverse Engineering The bit allocation this model was quantized with is focused specifically on coding, intelligence, design, and specifically reverse engineering. I also added a little spacial reasoning for those working in 3d environments like myself. The model was quantized according to the following importance distribution (dumped from my LLM chat and documents with some revisions. I designed the distributions myself. **837 entries · 399,876 tokens [[llm written distribution table]] 01 · Chain-of-thought (22.2%) — step-by-step derivations, self-verification, backtracking 02 · System prompts (19.5%) — persona adherence, strict output formats, long-instruction compliance 03 · Design & architecture (13.5%) — design trade-offs, code review, API planning, refactoring rationale 04 · Agentic tool use (12.4%) — tool-call chains, file-edit loops, error recovery, function calling 05 · Math (7.1%) — arithmetic, algebra, worked proofs, symbolic manipulation 06 · Spatial reasoning (5.4%) — grids, 2D/3D transforms, coordinates, packing/arrangement 07 · Gotchas (4.5%) — false premises, trick questions, negation handling 08 · Situational judgment (4.5%) — open-ended scenario trade-offs with no clean answer 09 · Reverse engineering 🆕 (8.8%) — x86-64/ARM64 disassembly, Ghidra decompilation critique, ELF/PE/Mach-O internals, anti-debug/anti-VM, string deobfuscation, CFG deflattening, devirtualization, perf watchpoints, tracing stacks (LD_PRELOAD/Frida/eBPF), protocol RE, format round-tripping, plugin ABI merging, firmware analysis 10 · No-refusal heretic domain 🆕 (2.0%) — direct unrefused answers: ELF exploitation chains, process injection vs EDR, license-check patching mechanics, C2 protocol engineering New for v2 are the last two categories — ~43k tokens of reverse-engineering and direct-answer content, interleaved throughout the corpus, and run through the model itself so the matrix captures how the heretic weights actually behave. This matrix is fused with one from the AtomicChat team (same measurement, taken on the original uncompressed base model over a massive general-purpose corpus). Per channel, ours gets 70% weight where its data is strong, sliding smoothly toward 100% AtomicChat for channels our corpus barely touched — thin samples defer to the broad baseline automatically, so nothing falls through the cracks. Quant methodology Rather than spreading quality evenly across all 48 layers, the recipe spends bits where the activation measurements say it matters: [[llm twritten table]] -- the data used to design the per-tensor quant came primarily from atomic chat's activation measurements and the RCO findings from ISTALabs The last 12 layers do the heavy lifting. Activation-energy auditing showed down-projection energy surges 3× starting at layer 36, peaking at layer 47 (the single hottest tensor in the network — 48× layer 2). Layers 36–47 (plus the first 5 and the mid-network spikes at 15/20/23/30) got their down projections stepped up to near-lossless 8-bit. Layers 44–46 are the gate/up peak (8× the energy of early layers), so their gate/up projections got stepped to 5-bit. Layer 0's attention gate is a giant outlier (the most sensitive tensor family in the model) — kept uncompressed. Layer 2 is non-negotiable: the 51B-parameter n-gram table merges into the residual stream there, so noise at layer 2 corrupts grounding for all 46 layers after it. The stable middle layers (5–14, 16–19, 21–22, 24–29) stay at leaner formats — measurement showed spending bits there buys almost nothing (KL improvement under 0.0008). The router stays in full precision so tokens always get routed to the right experts. Enjoy! Shoutout to my 32gb v100s and my E5 2697v4 for grinding the work out. https://huggingface.co/trubisky/Swift-1.5-Flash-Next-Heretic-ReverseEngineer submitted by /u/jjusko20 to r/LocalLLaMA [link] [comments]

★ HemmingwayAI/Hemmingway-1.5 (Qwen finetune)

/u/jacek2023 — Fri, 30 Oct 2026 00:00:00 +0000

90% · Measured result 90%, Usable today 88%, First-party 34%

https://huggingface.co/bartowski/HemmingwayAI_Hemmingway-1.5-GGUF from hemmingwayAI: Hemmingway-1.5 The undetectable AI. Writing indistinguishable from a human's. 27B parameters, open weights, free for non-commercial use. hemmingway.io → · Model card → · Try it → · API → · API docs → · Mac, Windows and Android apps → · Code → · Product Hunt → Our other models: Hemmingway-1 , our first model · Hemmingway-1-Unlocked , the uncensored adapter for Hemmingway-1, adults only Hemmingway-1.5 passes the world's best AI detectors 90% of the time. On GPTZero it passes 9 times in 10, at every thinking level. Real human writing passes the same detectors 86% of the time. Fable, GPT-6 and Gemini get caught most of the time. submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

★ Qwen Image 2.1 + TRELLIS.2 in Blender: from a prompt to a textured, rigged character, then a whole village in Unreal (StableGen 0.4.0)

/u/sakalond — Fri, 30 Oct 2026 00:00:00 +0000

90% · Usable today 90%, First-party 56%

StableGen is my free and open-source Blender add-on that generates and textures 3D models with local models through ComfyUI. 0.4.0 is out, and everything in the video is a real run in the add-on: Prompt -> mesh: a Preview gallery of candidate images to pick from, then TRELLIS.2 builds the mesh. Texturing with Qwen Image 2.1: every camera view is generated and projected onto the mesh, then Marigold V2 makes the PBR maps (albedo, roughness, metallic, normal). Masked Edit (new): paint a region on the model, describe the change, and only that part is regenerated, through the cameras that see it. Auto-rigging (new) with SkinTokens, plus retargeting FBX/BVH animations onto the rig. Experimental Qwen Image 2.1 Turbo , MOSS Image and FIBO 2.0 Edit , a reworked projection with cleaner seams, a new panel and a full user guide. In the video: Qwen Image 2.1, 10 cameras, on an RTX 4080 (16 GB). Time-lapse parts are marked. The village props went through the same pipeline and were exported to Unreal Engine 5.7 as GLB/FBX. Walk animation from Mixamo. Licenses: each model has its own; Qwen Image 2.1 and FIBO 2.0 Edit are non-commercial, MOSS Image is Apache-2.0. Check before commercial use. GitHub: https://github.com/sakalond/StableGen User guide: https://github.com/sakalond/StableGen/wiki Discord: https://discord.gg/jhGp9Rsgh3 submitted by /u/sakalond to r/StableDiffusion [link] [comments]

★ Speridlabs - idol: A single image to a 3D Gaussian splat

/u/Crazy-Repeat-2006 — Fri, 30 Oct 2026 00:00:00 +0000

90% · Measured result 90%, Usable today 87%, First-party 45%

"Idol turns one picture of an object into a 3D Gaussian splat. Give it a render, a generated image or a photo: it removes the background, frames the object and generates up to 1,048,576 Gaussians, written as a standard 3DGS .ply . It runs on consumer GPUs, using 7.2 GB of VRAM and can run in under 2 seconds." HF: speridlabs/idol · Hugging Face submitted by /u/Crazy-Repeat-2006 to r/StableDiffusion [link] [comments]

llama.cpp b11998

github-actions[bot] — Fri, 30 Oct 2026 00:00:00 +0000

89% · First-party 89%, Usable today 83%

model: mistral le chonk ( #31376 ) llama: extend DSA and sdpark to new model fix ci Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61557038 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

MOSS Image + MiniMax H3 + Hermes Agent = Halloween Music Video

/u/Ok-Wolverine-5020 — Fri, 30 Oct 2026 00:00:00 +0000

88% · Measured result 88%

TL;DR: I wrote the lyrics and made the song with Suno. Hermes Agent then storyboarded it, rendered the stills, animated them in ComfyUI and added the lyric titles. I directed and approved every step. Setup: Hermes Agent is my daily driver, running on Claude Sonnet 5.5 through the smallest Claude Pro subscription. All the image and video generation runs locally in ComfyUI on an RTX 3090 (24 GB VRAM) with 64 GB system RAM. How Hermes talks to ComfyUI MCP. A comfy-mcp server exposes ComfyUI as tools: run a workflow, validate it, search models and nodes, fetch outputs, check VRAM, and so on. The REST API. For the music video I mostly used this route. Hermes writes small Python scripts that take an API-format workflow JSON, patch the inputs by node structure (prompt, seed, save prefix, audio, frame count) and POST it to /prompt . They then poll /queue and /history , pull the file from /view and verify it. How it started It's Halloween season and I got inspired by MOSS Image's capabilities, so I wanted to make a vampire song. I wrote the lyrics for "I Don't Bite", made the track in Suno and downloaded it. From there Hermes and I built the whole music video. The pipeline Timed lyrics. faster-whisper aligns the words to my lyric sheet, so every line has real start and end times. Consistent character, no character LoRA. The lead stays recognisable through prompting alone. Hermes keeps one frozen identity and outfit block and pastes it word for word into every image prompt, and only the pose, camera and setting change. Storyboard. A shot list that covers the whole song, shown on a local HTML board (details below). Stills. MOSS Image renders them, and the agent checks that each PNG's embedded prompt matches what I approved. Style LoRAs used on the stills: feverdream-epoch-07 at 0.8 strength. The sampler is er_sde, simple scheduler, 25 steps, CFG 3. Video. MiniMax H3 animates parts of up to about 15 s with a 1 s overlap. Each part gets a draft pass first, then a final with a latent upscale to about 2 MP. Speed LoRA used on the video: minimax_h3_DMAD_4step , from Kijai's MiniMax-H3 experimental repo. Stitch. Hard cuts in the middle of each overlap, with the original Suno track under the cut. Lyric titles. Optional animated lyrics on top (details below). The storyboard board Hermes builds me a simple local HTML page, timed to the song. A timeline shows the sections, thumbnails and lyric ticks, and the song plays while the matching still and lyric line show up. Each shot has its own card with the time window, the lyric, the prompt and the render. I judge every still against its lyric, hit Approve or Reject and leave a comment saying why. Hermes then rewrites and re-renders only the rejected shots as new versions. Approved shots stay untouched. Lyric titles The lyrics sit inside the scene, behind her, and every word lands on its syllable. ComfyUI makes the masks. SAM3 and BiRefNet-HR cut out the woman and key props per shot, via the API. Code does the animation. Whisper gives the word timings. Python (numpy, OpenCV, Pillow) renders the motion frame by frame: spring entrances, ember-style ignition, bass-reactive chroma split from the song's low end, and procedural spiders and bats. ffmpeg puts the original audio back under the finished cut. Workflows Stills: Moody Moss Minimal Workflow . Hermes works from an API-format variant, so it can steer the prompt, seed and save prefix programmatically. Video: Minimax H3 SEED HUNTER v2.5.1 . The original editor workflow doesn't run through the API as-is, so Hermes flattened it into a plain API graph. That kept the 4-step DMAD LoRA, the low-res first pass and the latent 3D upscale. Hermes added one trick: the Suno track is forced into the latent. The model only generates picture and lip-sync, and the vocals stay exactly my song. On the 3090, a 13.7 s draft at 0.4 MP takes about 4.5 min and a final about 23-25 min. submitted by /u/Ok-Wolverine-5020 to r/StableDiffusion [link] [comments]

1500+ styles for Krea 2 in a Comfyui wildcards node

/u/Dear-Spend-2865 — Fri, 30 Oct 2026 00:00:00 +0000

88% · Usable today 88%

I Have no merit, Claude did it all by himself, I didn't do it for the community, I needed a node like this, there's similar nodes but they didnt satisfy my needs as a style junkie. I tested it slightly and it works best in Krea 2 and Qwen 2.1, but Krea 2 knows more styles. Kroma 0.3.1 comes third in my view with less details and more body horror,, didnt like the results in Moss... Hope it will help amateurs like me. https://github.com/atlasimp/Style\_Atlas submitted by /u/Dear-Spend-2865 to r/StableDiffusion [link] [comments]

llama.cpp b11986

github-actions[bot] — Fri, 30 Oct 2026 00:00:00 +0000

87% · First-party 87%, Usable today 86%

opencl: initial support for iq2 ( #31267 ) opencl: add iq2_s AOS mv opencl: add iq2_s SOA mv and tiled mm opencl: add iq2_s noshuffle gemm/gemv for adreno opencl: add iq2_s dp4a for adreno opencl: optimize iq2_s adreno decode and narrow batches Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com opencl: add iq2_xs AOS mv opencl: add iq2_xs SOA mv and tiled mm opencl: add iq2_xs noshuffle gemm/gemv for adreno opencl: add iq2_xs dp4a for adreno opencl: optimize iq2_xs adreno decode and narrow batches Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com opencl: add iq2_xxs AOS mv opencl: add iq2_xxs SOA mv and tiled mm opencl: add iq2_xxs noshuffle gemm/gemv for adreno opencl: add iq2_xxs dp4a for adreno opencl: optimize iq2_xxs adreno decode and narrow batches Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61468865 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Patch release v5.21.1

ArthurZucker — Fri, 30 Oct 2026 00:00:00 +0000

87% · First-party 87%, Usable today 71%

Patch release v5.21.1 ** Fix rope_scaling setter for configs that assign it during init ( #50080 ) We broke remote code loading in vllm, this fixes it sorry everyone!

I had Opus build a game that takes JIRA tickets from any of your real projects & converts them into dramatic audiologs that are the plot of…

Ethan Mollick — Fri, 30 Oct 2026 00:00:00 +0000

86% · Usable today 86%

I had Opus build a game that takes JIRA tickets from any of your real projects & converts them into dramatic audiologs that are the plot of a 2000s-era horror game set on a mysteriously abandoned space station. Play a demo: wontfix-game.netlify.app Github: github.com/emollick/aud...

DoorDash to acquire Instacart

WalterSobchak — Fri, 30 Oct 2026 00:00:00 +0000

86% · First-party 86%

Article URL: https://about.doordash.com/en-us/news/doordash-to-acquire-instacart Comments URL: https://news.ycombinator.com/item?id=50287919 Points: 462 # Comments: 628

My 6 year old daughter designed a fully-fledged unicorn game and Claude Sonnet built it in under a month. Every sprite, sound and map is made from scratch

/u/OnyxMonolith — Fri, 30 Oct 2026 00:00:00 +0000

85% · Usable today 85%, Measured result 76%

We built a private unicorn game for my six-year-old daughter, with Claude Sonnet 5.5 as the coding agent for all of it. I'm a quantitative engineer with 20+ years of experience but i never made a game before. My daughter designed most of the maps and the playground games, and she gave the notes that shaped the rest. The initial thing was just a small forest map and finding all the 6 unicorns. What it is: A pixel-art sandbox that runs in a phone/tablet browser, installs to the Home Screen and plays offline. You lead a unicorn around 8 places, find 5 friends who follow in a herd, and cast 6 kinds of magic that affect certain items in the game. There are playground mini-games, and an optional spelling mode that a parent switches on. Saves stay on the device, with optional cloud backup. What Sonnet did: Claude wrote all the code: about 136k lines of TypeScript across the game, the build tools, a Cloudflare Worker and 3,000+ tests. That includes: A software 3D renderer. Unicorns, buildings and trees are small 3D models written as code. The renderer draws them at 4x size with a fixed light and ambient occlusion, then reduces them to hard-pixel sprites on atlases. No Blender, no sprite packs. A sound synthesizer. All 75 effects and 9 music loops are generated from code, with no samples. A map compiler that proves every door, spawn and friend is reachable. A game loop, pathfinding, and a herd that follows the leader. How we worked. The loop was simple. My daughter played the latest build and told me what she liked and what to change. I wrote her notes down (sometimes 25 items in one round, from "a place with a slide" to what a door should do) and gave them to Sonnet. The next day she played the result. Then again. She also learned how software gets made, because she could see her idea turn into a thing she could play and also I explained a lot about how stuff works to her. Around that loop, a few things made it work: A written plan first: We started from a tech spec, and Claude built small throwaway spikes before committing to anything. Before using Phaser it ran a seven-check test of the engine (animation, tile maps, depth sorting, pixel sampling, touch under zoom, audio unlock). It did the same for the Cloudflare backend. A style check before scale. Before rendering hundreds of frames, Claude drew one unicorn, then a forest clearing, and checked that they looked like the same world. It also dropped an idea that failed: a pure 3D face looked blank, so the eyes and mouth became hand-placed pixels. A decision log. Claude kept a row for every proactive choice with the reason and the evidence: 245 rows over 11 deploys. It also kept a handoff file so a new session could pick up exactly where the last one stopped. Tests that found real bugs: When the followers flickered between walking and standing, Claude measured it in the running game (20 flips in 103 seconds), fixed it, and measured again (none in 128 seconds). It also wrote a test that failed on the old code. When a browser test failed once, it worked out the odds of what the test assumed before blaming the machine. Checking what it couldn't see or hear: Claude couldn't watch the game or listen to it, so it screenshotted and read the pictures. It measured the sound with loudness meters and a signal analyser at the output. One thread: I always asked Claude not to use subagents, so I could follow a single conversation and audit what it did so that I always understand what is happening. Some notes: The repo has a file listing what is built, what was tested and what wasn't. It has run on two iPhones and a Mac, and we mostly play it on a Kindle Fire. When the Kindle felt choppy during spells, Claude added a low-end mode that draws fewer pixels and fewer particles, and it switches itself on for Fire tablets automatically detecting low fps. You can play it entirely for free here: https://unicorn-academy-game.github.io/ Source: https://github.com/Unicorn-Academy-Game/Unicorn-Academy-Game.github.io I will make everything fully open-source once i polish the educational engine. Overall I'm just INSANELY impressed by what Sonnet can do. I haven't felt like this since I was a teenager coding bots doing Mephisto runs in Diablo 2. I'm going to start making silly games for myself when I have the time :D And this game will probably be growing up with my daughter and develop into an open world game to help her with reading/writing/math skills. This is fan-made and inspired by characters from a book/Netflix series I don't own (Unicorn Academy). The Phaser engine and the Fredoka font are the only parts not made by Sonnet here. Well, and all the other open source libraries. But no other 3rd party graphical assets were used. I'm not a fan of image-gen. I like everything procedural. I'm here to answer any questions about prompting, planning, skills I'm using, etc. Ask me anything. Edit: look into https://github.com/cursor/plugins/tree/main/pstack . it's a game-changer, imo. there is a claude version. submitted by /u/OnyxMonolith to r/ClaudeAI [link] [comments]

llama.cpp b12001

github-actions[bot] — Fri, 30 Oct 2026 00:00:00 +0000

85% · First-party 85%, Usable today 85%

ROCm/HIP: add RDNA4_M family for gfx1170/gfx1171 ( #31373 ) gfx117X is more like RDNA4, with 128b WMMA. But they're not identical. Adjust the defines accordingly to have a new RDNA4_M and use it where it makes sense. Assisted-by: Codex Assisted-by: GitHub Copilot Co-authored-by: Mario Limonciello mario.limonciello@amd.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61654532 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5

theHocineSaad — Fri, 30 Oct 2026 00:00:00 +0000

84% · Measured result 84%, First-party 60%

Article URL: https://artificialanalysis.ai/articles/gemini-4-carbon-new-number-1 Comments URL: https://news.ycombinator.com/item?id=50288019 Points: 331 # Comments: 241

llama.cpp b11988

github-actions[bot] — Fri, 30 Oct 2026 00:00:00 +0000

84% · First-party 84%, Usable today 83%

model : Support Limite 1B - Violetto ( #29433 ) gguf-py : add Limite arch Assisted-by: Claude Opus 5.5 Signed-off-by: Giuseppe Scrivano giuseppe@scrivano.org convert : add Limite support Assisted-by: Claude Opus 5.5 Signed-off-by: Giuseppe Scrivano giuseppe@scrivano.org llama : add Limite support Assisted-by: Claude Opus 5.5 Signed-off-by: Giuseppe Scrivano giuseppe@scrivano.org Signed-off-by: Giuseppe Scrivano giuseppe@scrivano.org Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61482602 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

transformers v5.22.1

ArthurZucker — Fri, 30 Oct 2026 00:00:00 +0000

84% · Usable today 84%, First-party 72%

v5.22.1

mistralai/Mistral-Large-4-1T-A52B · Hugging Face

/u/jacek2023 — Fri, 30 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 52%

https://huggingface.co/ggml-org/Mistral-Large-4-1T-A52B-GGUF https://huggingface.co/ggml-org/Mistral-Large-4-1T-A52B-NVFP4-GGUF https://huggingface.co/unsloth/Mistral-Large-4-1T-A52B-GGUF from Mistral: Mistral Large 4 - Le Chonk Mistral Large 4 is our largest and most capable model to date: a 1 trillion-parameter natively multimodal Mixture-of-Experts model with 49 billion active parameters per token (52 billion including embeddings and output layers), trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral's own datacenters in Europe. Mistral Large 4 unifies instruction following, reasoning, coding, and agentic workflows in a single set of weights. While a generalist model, it shows especially good performance on workloads such as cybersecurity, finance, and law, and it surpasses frontier closed models on visual grounding. It is natively fluent in 160+ languages, including every official language of the European Union. Find more information on our blog . The model is also served on the Mistral API as mistral-large-4 . Key Features Mistral Large 4 includes the following architectural choices: ~1T total / ~52B active parameters : granular Mixture-of-Experts with 128 routed experts (4 active per token) and 1 shared expert. 1M context length , for long-context workloads. Multimodal input : accepts text and image input, with text output. Pixtral-style vision encoder trained to handle variable image sizes and aspect ratios. Instruct and Reasoning functionalities with function calls, reasoning effort configurable per request. Mistral Large 4 offers the following capabilities: Reasoning Mode : three reasoning efforts — low , medium , high (default) — so the same model can answer a quick chat reply or work through a complex agentic run. Vision : analyzes images, charts, technical drawings, and documents, with state-of-the-art visual grounding among open weights. Multilingual : natively fluent in 160+ languages, including all official languages of the European Union. System Prompt : strong adherence and support for system prompts. Agentic : native function calling, JSON output, and strict JSON schema enforcement. Cybersecurity : state of the art among open-weight models for security work, while refusing malicious requests. Large Context Window : supports a 1M context window. We release this model under the Mistral Ecosystem Open-Weight License : a modified version of the MIT license, for both commercial and non-commercial use — operating a Model-as-a-Service business requires a separate commercial license with Mistral. llama.cpp suport merged: https://github.com/ggml-org/llama.cpp/pull/31376 submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

llama.cpp b11997

github-actions[bot] — Fri, 30 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 81%

llama : reuse the tensor staging buffer and skip the direct-io bounce buffer ( #31321 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61552516 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

NetBSD adds a new text editor called atto

luke8086 — Fri, 30 Oct 2026 00:00:00 +0000

82% · First-party 82%, Usable today 50%

Article URL: https://mastodon.sdf.org/@netbsd/117518160563539748 Comments URL: https://news.ycombinator.com/item?id=50287599 Points: 173 # Comments: 138

ollama v0.40.13-rc0

dhiltgen — Fri, 30 Oct 2026 00:00:00 +0000

82% · First-party 82%, Usable today 60%

llama.cpp: version bump b11963 ( #19360 )

OpenAI now gives ChatGPT Pro and Business subscribers up to $500 a month in API credits

/u/mawcopolow — Fri, 30 Oct 2026 00:00:00 +0000

81% · Measured result 81%, Usable today 46%, First-party 34%

I'm stoked! Never say no to additional usage submitted by /u/mawcopolow to r/OpenAI [link] [comments]

One photo, one question, three models: one returned a bounding box, one wrote prose for 2.5 seconds, and one sent back HTTP 400

/u/Jaswanth_011 — Fri, 30 Oct 2026 00:00:00 +0000

80% · Measured result 80%

The question was plain enough to compare cleanly, a photo of a crushed front end and a single instruction, find the damage on the car. Bivia answered with coordinates, box [187, 50, 1000, 919] on a 0 to 1000 scale, so the result arrives ready to hand straight to whatever step runs next. The general model spent 2.5 seconds composing a description of the photograph, which leaves prose to parse for a location that four integers already carried. Jev returned HTTP 400, invalid image dimensions, since it caps input at 1568 px per side and leaves resizing to the caller, so the original file bounced ahead of any inference. The clip runs all three in parallel across six photos, a white sedan in Japan, van corner damage in Oban, a wreck on a bridge, a smashed front in Esbjerg and a rear end collision in Moscow, so the same question lands on each one in turn. submitted by /u/Jaswanth_011 to r/SaaS [link] [comments]

Herdr has released native app

cherioo — Fri, 30 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 63%

Article URL: https://github.com/herdrdev/herdr-app Comments URL: https://news.ycombinator.com/item?id=50298436 Points: 151 # Comments: 90

★ llama.cpp b11980

github-actions[bot] — Thu, 29 Oct 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 81%, First-party 71%

[SYCL] add DPAS flash attention kernel for quantized KV cache ( #31125 ) sycl : add DPAS flash attention kernel for quantized KV cache Decode and small batches (1 to 31 query tokens) now run flash attention straight on q4_0 and q8_0 KV blocks, instead of scalar dequant or converting the whole cache to f16 per call. Q.K uses s8 x s4 and s8 x s8 DPAS on XMX, V.P stays f16. dpas.s4.s8 is inline vISA since joint_matrix has no s4. Covers head sizes 64 to 512, GQA up to 32 and attention sinks. Prompts stay on the existing kernels. GGML_SYCL_FA_DPAS=0 turns it off. B580, Llama 3.1 8B Q4_K_M, q4_0 KV, tg128: 31.3 to 54.2 t/s at 16K context. FLASH_ATTN_EXT 4582/4584, same 2 failures as master. Assisted-by: Claude sycl : 192 head dropped, Wildcat Lake added to docs Assisted-by: Claude sycl : stricter checks from review Assisted-by: Claude [SYCL] : rename XMX macro, add GGML_SYCL_SUPPORT_XMX option, document DPAS Assisted-by: Claude Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61175196 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

★ A free kernel module made my RTX 3090 generate images 55% faster with 40% less energy (ComfyUI, Z-Image Turbo, bit-identical outputs)

/u/esequiel378 — Thu, 29 Oct 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 75%

benchmarked GPU Unlock on my 3090 in ComfyUI. It's a Linux kernel module that lifts the GeForce FP16/BF16 tensor-core throttle on RTX 30 cards. ComfyUI Stock Unlock Unlock + undervolt Z-Image Turbo BF16, 1024², 8 steps 7.46 s/img 4.95 (+51%) 4.82 (+55%) SD 1.5 FP16, 1024², 30 steps 6.40 s/img 4.64 (+38%) 4.52 (+41%) Same images: every output's pixels were SHA-256 identical to stock at a fixed seed, including a 2-hour soak of 540 batches. Energy per image down 40% (2,369 J → 1,410 J). The weird part: my undervolt slowed the card at stock but sped it up once unlocked, because the card then hits its power limit and lower voltage buys clocks. Don't use --fast in ComfyUI if you want the gain. It switches matmuls to FP16 accumulation, which isn't throttled to begin with. Linux only. Only a full power-off reverts it. Github repo: https://github.com/Esequiel378/gpu-unlock-3090-results submitted by /u/esequiel378 to r/StableDiffusion [link] [comments]

★ llama.cpp b11979

github-actions[bot] — Thu, 29 Oct 2026 00:00:00 +0000

96% · Measured result 96%, First-party 83%, Usable today 77%

sycl : vectorize reordered-layout dequantization stores (Q4_0, K-quants, IQ3, MXFP4) ( #30976 ) sycl : widen reordered q4_0 dequantization stores The reordered-layout Q4_0 conversion kernel processed one qs byte per work-item with two scalar stores, strided 16 elements apart. Give it the same treatment the Q8_0 kernel got in #30775 : a flat sycl::range<1> launch with four qs bytes (8 outputs) per work-item inside one 32-element block and two vec<dst_t,4> stores. Same float math and rounding as the scalar kernel; output is bit-identical. The existing k % QK4_0 == 0 assert guarantees whole 32-element blocks, so the k/8 launch covers every row exactly. The now-unreferenced scalar reorder kernel is removed. Arc Pro B70, primed prefill (prefill after decode on a reorder-installed tensor): +6.4% to +7.3% pp512/pp2048 on Q4_0 models (tested up to 27B dense); fresh-layout prefill and decode unchanged; PPL within run noise. sycl : vectorize reordered q4_K dequantization stores The reordered-layout Q4_K conversion kernel already loads its quantized inputs through sycl::vec but writes the dequantized results with scalar stores. Build the results in a vec<dst_t,n> register and emit two vector stores instead. Same per-element math; output is bit-identical. Arc Pro B70, primed prefill (prefill after decode on a reorder-installed tensor): +14.7% to +15.3% pp512/pp2048 on Q4_K-dominant models (tested up to 27B dense); fresh-layout prefill, decode and PPL unchanged. sycl : remap reordered q5_K dequantization to vec4 loads/stores The reordered-layout Q5_K conversion kernel gave each thread only four outputs fed by scalar ql/qh byte loads plus a local-memory scale broadcast, so the stores were never its bottleneck: widening the stores alone measured within noise on mixed-quant models and +0.5% on a q5_K-dominant model. Re-decompose to 32 threads per block, each consuming four consecutive ql and qh bytes and emitting two aligned vec<dst_t,4> stores; a 4-element run shares one scale pair, so the per-element math and the output are identical. Arc Pro B70, primed prefill on a q5_K-dominant 27B model: +3.6% pp512/pp2048 over the scalar kernel; fresh-layout prefill, decode and PPL unchanged. The GET_ROWS reorder path moves to the same 32-thread decomposition. sycl : remap reordered q6_K dequantization to vec4 stores The reordered-layout Q6_K conversion kernel wrote four scalars per thread, strided 32 elements apart, each pair of neighbors sharing neither instruction stream nor store transaction. Re-decompose the same 64-thread work-group so each thread emits one aligned vec<dst_t,4>: a 4-element run shares one 16-element scale group, one ql nibble source and one qh bit pair, so the per-element math and the output are identical to the scalar kernel. Arc Pro B70, primed prefill: +28.7% pp512/pp2048 on a Q6_K 27B model; fresh-layout prefill, decode and PPL unchanged. sycl : vectorize reordered q3_K dequantization stores Each thread of the reordered-layout Q3_K conversion kernel already computes four consecutive outputs; build them in a vec<dst_t,4> register and emit one vector store instead of four scalars. Same per-element math; output is bit-identical. Arc Pro B70, primed prefill: +16.8% pp512/pp2048 on a Q3_K-dominant 27B model; fresh-layout prefill, decode and PPL unchanged. sycl : vectorize reordered iq3_xxs/iq3_s dequantization stores Both reordered-layout IQ3 conversion kernels write eight contiguous outputs per thread as scalar stores (four from each grid lookup). Build two vec<dst_t,4> registers and emit two vector stores. Same per-element math; output is bit-identical. Arc Pro B70, primed prefill: +20.3% to +21.1% pp512/pp2048 on IQ3_XXS- and IQ3_S-dominant 27B models; fresh-layout prefill, decode and PPL unchanged. sycl : remap reordered q2_K dequantization to vec4 stores Re-decompose the reordered-layout Q2_K conversion kernel the same way as Q6_K: one aligned vec<dst_t,4> per thread instead of four scalars strided 32 apart. A 4-element run shares one scale byte and one 2-bit lane, so the per-element math and the output are identical to the scalar kernel. Arc Pro B70, primed prefill: +13.1% pp512/pp2048 on a Q2_K-dominant 27B model; fresh-layout prefill, decode and PPL unchanged. sycl : widen reordered mxfp4 dequantization stores Give the reordered-layout MXFP4 conversion kernel the same flat sycl::range<1> launch as Q4_0: four qs bytes (8 outputs) per work-item inside one 32-element block and two vec<dst_t,4> stores. Same LUT lookups and per-block scale; output is bit-identical. The k % QK_MXFP4 == 0 assert guarantees whole blocks, so the k/8 launch covers every row exactly. The old scalar kernel is removed. The reordered layout for MXFP4 is installed on the MoE expert path (reorder_qw_mxfp4_moe); dense MXFP4 tensors keep the normal layout. Arc Pro B70, MXFP4 MoE 20B model: +57% pp2048 / +61% pp512 prefill (primed and fresh alike), decode unchanged, PPL within the model's run-to-run noise. Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61167328 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

★ I think in pictures, so I taught Claude Code to draw mermaid in the terminal

/u/100xbuilder — Thu, 29 Oct 2026 00:00:00 +0000

95% · Usable today 95%, Measured result 92%

I'm a visual person (not sure that's actually a thing, but it's how I'd describe myself). Before I build anything, I need to see it first: how the services talk, what happens on a failed payment, where the state changes. So the design stage always comes first for me, with sequence diagrams, activity flows, state machines and the odd C4, and only then do I start writing code. These days I do that design work with Claude, from the CLI. Finished diagrams end up in my Obsidian vault, which I browse from the terminal with emeraldian , a TUI for Obsidian I also built. Getting them to finished is the fiddly bit, though. Claude Code writes lovely mermaid. It just can't show it to you. Every tweak meant copying the source into a viewer in another app, having a look, coming back, asking for a change, round again. Hard to iterate on a design you can't see. So I made merman, a Claude Code mod that renders mermaid live, right in the terminal. Ask for a sequence diagram and the actual diagram appears in the reply. Move an arrow and it redraws. Flowcharts, sequence, state, class and ER diagrams all work, as do bar, line and pie charts and gantt. Tables come out properly coloured too. As for the name, it felt only right. Who better to show off a mermaid than a merman? - A full reply renders in about 2 ms, so no lag - 16 colour themes, `/merman theme nord` to switch - About 355 tokens once per conversation (a small hint so Claude knows it can draw), or nothing if you switch that off - Claude Code's own UI is left alone, it only touches the replies It installs as a Claude Code plugin, one line (needs 2.1.311+): claude plugin marketplace add iamrohithrnair/merman && claude plugin install merman@merman Then /reload-plugins and /merman demo to see everything it draws. https://github.com/iamrohithrnair/merman (MIT) Note: C4 isn't supported yet, it stays as source for now. If you lean on C4 too, shout and I'll bump it up the list. Same for any diagram that comes out wonky. Send me the markdown and I'll have a look. It started as a fork of prismantis, and Claude Code made most of the changes since, with me steering and checking every render. The focus was keeping it lean on speed, memory and tokens. If you find this useful, a ⭐ on the repo would be much appreciated. It helps others discover it too. Thanks for the support! submitted by /u/100xbuilder to r/ClaudeAI [link] [comments]

★ Mac Studio M5 Ultra 512gb Starts at $22,299.00 USD

/u/Boomfrag — Thu, 29 Oct 2026 00:00:00 +0000

94% · Measured result 94%, Usable today 56%

submitted by /u/Boomfrag to r/LocalLLaMA [link] [comments]

★ Google is rolling out Gemini 4 Carbon to selected cybersecurity defenders through Fairwind at $2/1M input and $10/1M output tokens, rising to $4 and $20 later (Carl Franzen/VentureBeat)

Thu, 29 Oct 2026 00:00:00 +0000

94% · Measured result 94%

Carl Franzen / VentureBeat : Google is rolling out Gemini 4 Carbon to selected cybersecurity defenders through Fairwind at $2/1M input and $10/1M output tokens, rising to $4 and $20 later — Google announced its latest and most intelligent frontier AI model today: Gemini 4 Carbon promises improvements in cybersecurity …

★ llama.cpp v0.8.0

github-actions[bot] — Thu, 29 Oct 2026 00:00:00 +0000

94% · First-party 94%, Usable today 86%

Overview This release adds the LiquidAI LFM3 family (text, vision, audio and omni) together with a new experimental streaming-audio API in mtmd , and wires realtime audio in and out of the server through the new /v1/realtime and /tts endpoints. A batch of new architectures landed: DeepSeek V4.1 Flash, SenseNova U1, Beam, Kolibri-1, Flint, Muse Spark, Granite Switch Decision, plus decision/embedding models from LiquidAI, Baidu and NVIDIA. The core got sparse-attention (QSA/DSA) reworked onto a fused masking op, a 50/50 SLRU cache for host-resident MoE experts, and cleaner no_alloc memory handling; the server got router memory-management and tool-calling improvements; the UI can now browse and download models straight from HF Hub, search conversations and compact them. Finally, ggml was bumped to v0.28.0, bringing GGML_OP_TOP_K_MASK , -1 expert-index semantics and large backend performance work (CUDA chunked graph launches, SYCL graph replay, OpenCL Q2_K/Q3_K, Hexagon HTP rework, KleidiAI SVE kernels). Highlights LFM3 family: LFM3-1.7B (text) and LFM3-VL-2B (vision), verified against the reference HF implementation llama/31252 LFM3-Audio-2B and LFM3-Omni-2B: ASR, TTS and voice chat from a single model, with streaming audio input and output llama/31257 API changes DRY sampler: new LLAMA_DRY_MAX_SEQ_BREAKERS (64) caps distinct sequence breakers, each costing O(n_vocab) at init llama/31035 mtmd : new experimental mtmd_audio_stream API turning PCM fed as it arrives into decoder-ready embedding rows llama/30629 mtmd : audio generation is now stateful - mtmd_gen_state replaces the raw state_data buffers of the audio gen API llama/30902 mtmd : mtmd_caps gained gen_audio ; new TTS types SOPRANO and LFM3A ; repetition penalty for sampled codes llama/28607 llama/31257 mtmd_helper_get_capabilities() to query the capabilities of an mmproj file from helper code llama/31183 Server: new /v1/realtime endpoint implementing the OpenAI realtime protocol for conversation and transcription llama/31269 llama/30636 Server: new POST /tts endpoint for text-to-speech models llama/26603 Server: reasoning effort levels of the chat template are exposed and selectable via the API llama/31271 Chat API: support for deferred tools and tool_reference content parts llama/31256 CLI: --model or -hf is now required llama/31242 New models LiquidAI LFM3-1.7B, LFM3-VL-2B, LFM3-Audio-2B, LFM3-Omni-2B llama/31252 llama/31257 LiquidAI d1-2B and d1-omni-2B decision models llama/31275 DeepSeek V4.1 Flash llama/31086 SenseNova U1 llama/28919 Beam (Reflection) llama/30670 Kolibri-1 (Aleph-Alpha) llama/30673 Flint llama/30928 Muse Spark Open (text, vision and audio) llama/30616 Granite Switch Decision, including the 256-way decision head llama/30676 llama/30693 Nemotron-3(.5)-Embed, with non-standard GQA and BPE tokenizer support llama/30877 llama/23343 H2O-Lightning-4B decision model llama/30361 MiniCPM-OCR 1.0 and MiniCPM-OCR-Jev llama/30979 llama/30980 Soprano TTS llama/28607 LFM2 short-conv and FFN blocks moved into a shared LFM base reused by newer LFM models llama/30874 Core changes MoE experts kept in host memory now use a 50/50 SLRU cache instead of a plain LRU cache llama/30637 Sparse attention: fused QSA mask op, QSA/DSA selection built without kq_mask , k-pool views shared between layers llama/30640 llama/31009 llama/30965 llama/31243 llama/30613 MoE: amax rescaling enabled for laguna , and -sm tensor denied on arches that use it llama/31147 llama/31081 Memory: no_alloc respected in all memory caches, moved out of llama_hparams , obsolete n_pad dropped llama/31087 llama/31141 llama/31200 Vocabulary loading optimized; d2t placed next to its set_rows use so it can stay on the GPU llama/30679 llama/30912 Tokenizer: new clean_spaces and metaspace prepend-scheme GGUF keys, hybrid DNA tokenizer fixes llama/30940 llama/30825 Tokenizer: Tekken pre-tokenizer for Pixtral, \p{M} in Tekken/GPT-4o lookaheads, Nemotron-3.5-Embed tokenization fix llama/30960 llama/30845 llama/30974 Grammar: recursion depth limited (and enforced) to prevent stack overflow; deep JSON rejected before walking it llama/29755 llama/31153 llama/30242 Qwen: merge tensors on convert, 2D output reshape, Qwen3 bidirectional attention and dense_2 output projection llama/31028 llama/30823 llama/30607 Speculative decoding: persist the dynamic ngram cache, probabilistic DFlash2 drafts, optional DFlash FC input scale llama/22055 llama/30663 llama/30945 llama/30927 LoRA: support for prism.hadamard folded weights llama/30910 Tensor parallel: stepfun and laguna now support 4-10 GPUs llama/24554 GGUF tools reject truncated tensor data in split , export-lora and merge llama/30497 llama/31044 llama-quant : fix 4D tensor quantization with ggml_nrows() and name-based expert detection llama/30820 convert-hf : faster endian conversion with more datatypes, text-only checkpoints in pplx-decider llama/30647 llama/30575 convert-hf : fixes for Granite speech tensors, Granite Switch MultiSwitch block count, Mistral-format DeepseekV2 llama/30628 llama/30621 llama/30669 Common: honor HTTP_PROXY / HTTPS_PROXY , allow concurrent downloads, pin model resolution on real HF repo layouts llama/21752 llama/29312 llama/30548 Multi-modality changes Streaming audio input via mtmd_audio_stream , used to support voxtral-realtime llama/30629 Soprano TTS support and MiniCPM-OCR 1.0 support llama/28607 llama/30979 Image preprocessing aligned with transformers/torchvision: LFM2 resize, tiles and layout, Qwen-VL resize llama/30943 llama/30261 llama/30736 LFM2 tiling parameters are read from the GGUF metadata llama/30840 lightonocr defaults to native resolution instead of forcing a 1540 longest edge llama/30600 build_inp_temporal_merge moved to the mtmd base class; fix Gemma-4 FFN activation llama/31065 llama/30882 Server changes Realtime conversation and transcription on /v1/realtime , with response.done sent after the committed audio drains llama/31269 llama/30636 llama/30994 POST /tts endpoint for TTS models llama/26603 Expose the reasoning effort levels of the chat template llama/31271 Router: configurable device memory margin for dynamic unloading of models llama/21231 Router: propagate client disconnects to the child task, stop re-adding the mmproj margin on sleep/resume llama/29707 llama/28233 Rerank endpoint accepts typed content input and substitutes the placeholder from the original template llama/29625 llama/30864 Anthropic /v1/messages : forward llama.cpp sampling params and pass id_slot through the conversion llama/30856 llama/28554 Support logprobs together with speculative decoding llama/27196 Fix usage.completion_tokens undercounting with n > 1 and missing output_index in Responses API SSE events llama/29486 llama/30863 Fix SWA checkpoint invalidation logic llama/30666 New --connect flag to allow p2p access to the server outside the LAN llama/28277 UI changes Discover and download models directly from HF Hub, with org-less models listed first llama/29584 llama/31215 New search dialog for conversations and messages llama/31173 Conversation compaction to keep long chats within the context llama/27401 Models manager moved to its own route, model details open in a drawer without leaving the page llama/30988 llama/31176 Reasoning menu built from the chat template's effort levels, with a clearer highlighted toggle llama/31273 llama/31212 Support OGG audio attachments by converting them to WAV llama/31237 New "Show tool call in progress" setting llama/30681 Save and reset settings buttons shown only when there are unsaved changes llama/31248 Sidebar resizing and general layout/UX improvements llama/31119 llama/31030 Fixes: draft lost after "Add System Message", system row stretching in WebKit llama/31214 llama/31246 Fixes: clipped attachment text preview, markdown tables and lists cut off on phones llama/30806 llama/30687 ggml changes Bumped from v0.27.0 to ggml v0.28.0 New GGML_OP_TOP_K_MASK fused sparse-attention mask, plus accessors for the precision configured on a compute node -1 is now a valid expert index in MUL_MAT_ID / ADD_ID : the slot is skipped and the output row zeroed SCALE accepts non-contiguous row views; SUM accepts non-contiguous inputs on CPU, CUDA, Vulkan and WebGPU Backends: fused MoE top-k and gate/up+GLU with chunked graph launches on CUDA, graph record/replay on SYCL Backends: Q2_K/Q3_K weights and a lightning indexer on OpenCL, subgroup reductions and src1 precision on Vulkan More: restructured Hexagon HTP backend, flash attention on ZDNN, Q2_0 on WebGPU, KleidiAI SVE GEMV/GEMM kernels Assets Nightly build: b11960 More info Releases and versioning of ggml-org projects Changelog since v0.7.0 8642541 llama.cpp : bump version to 0.8.0 ( #31309 ) d4f1b18 mtmd: enable video input support for LFM3 model family ( #31283 ) d1eb0de server : support tool calls in /v1/realtime ( #31287 ) 5d7793d sync : ggml ec941ee ggml : bump version to v.28.0 (ggml/1676) e486a4b ui: build the reasoning menu from the template effort levels ( #31273 ) f1a7dea tests : adjust constants to reduce irrelevant warnings ( #31254 ) a7af149 cuda : add top-k MoE fusion for 384 experts ( #31288 ) 2864937 vulkan: clamp A prefetch to end_k in coopmat1 int8 matmul ( #30283 ) a71c00f chat : stop qwen3-coder reasoning and content before template separators ( #30557 ) f4d8af6 ui : show save and reset settings buttons only when relevant ( #31248 ) 02d502f ui: Support OGG audio attachments by converting them to WAV ( #31237 ) b1756b2 ui: Fix draft for new message disappearing after using "Add System Message" action ( #31214 ) 6886628 ui : Search dialog ( #31173 ) 8ca4060 server : add realtime conversation and transcription on /v1/realtime ( #31269 ) d05706b model : add LiquidAI/d1-2B and LiquidAI/d1-omni-2B ( #31275 ) 1b4554e server: expose the reasoning effort levels of the chat template ( #31271 ) a919179 tests: fix CI riscv timeout in test-llama-context ( #31265 ) 338fce6 HIP/CUDA: remove pragma unroll from loops in conv2d where itteration count cant be infered at compile time ( #31255 ) 19ff817 model : add LiquidAI/LFM3-Audio-2B and LiquidAI/LFM3-Omni-2B ( #31257 ) eb7818c common : support deferred tools and tool_reference content parts ( #31256 ) 6c44591 snapdragon: switch QDC artifact upload and log download to v2 API ( #31240 ) 19cce69 model : add LiquidAI/LFM3-1.7B and LiquidAI/LFM3-VL-2B ( #31252 ) e86f5fd cmake: WASI doesn't support spawning ( #30751 ) 27b7a8a llama : build the k-pool sparse selection independently of the kq_mask shape ( #31243 ) 7ecb57f rpc : catch std::length_error in recv_msg ( #31204 ) 8542e94 tests : speed up tensor data generation and model saving ( #31145 ) 922f53e vulkan: fix CI llvmpipe by allowing dim 3 broadcast in MUL_MAT ( #31239 ) 0c8c59e mtmd-cli: Reduced scope of batch pointer ( #31155 ) ( #31165 ) 3ab37ae ui: fix system message row stretching to full prompt height in WebKit ( #31246 ) 85cc432 server: add router device memory margin parameter for dynamic unloading ( #21231 ) 74a1fd3 common : --model or -hf is required ( #31242 ) 7eed6b7 model: Add MiniCPM-OCR-Jev ( #30980 ) 2763785 metal : add GGML_OP_TOP_K_MASK ( #31230 ) d78f40d glm5-next : QSA without kq_mask (+ DSA) ( #31009 ) fae9ac5 ci : use ccache depend mode for ROCm release builds ( #31231 ) a8276b7 ci : force python 3.12 on ubuntu 26.04 ( #31222 ) de5122d ggml : relax scale to non-contiguous views ( #31146 ) 6666a73 tests : fix multi-seq split replay and partial-state cases for trained models ( #31216 ) 7a2e5ab llama : remove obsolete n_pad from memory instances ( #31200 ) 0d5ca60 ui: list org-less models first in the model selector ( #31215 ) d930fe3 opencl: refine mul mat id -1 index ( #31170 ) a2b3e12 opencl: initial support for q3_k ( #31172 ) 823df7d ui: Highlight reasoning toggle on hover and align it with model selector ( #31212 ) 1a97e38 ui: add conversation compaction ( #27401 ) bc262f3 ui: Open model details in a drawer without leaving the page ( #31176 ) f5892ca ui: use shared confirmation dialog for conversation deletion ( #31187 ) 7aca0d2 hexagon: add GGML_HEXAGON_VTCM_SIZE ( #31221 ) 961c376 llama : enable moe amax rescaling for laguna ( #31147 ) 4244ad7 ci : add windows behavior check ( #31191 ) 63b4b30 opencl: write KV-cache views in set_tensor so a state restore is not dropped ( #30471 ) caa8191 hexagon: MUL_MAT_ID row skipping optimizations and improvements ( #31169 ) a469940 llama : move no_alloc out of llama_hparams ( #31141 ) 4b851fb models : replace ggml_tensor** out-params with output structs ( #31142 ) 4d71b42 ggml-cpu : rewrite concat as one row kernel for all types ( #31179 ) 70c5f26 vulkan: rms norm optimization using subgroup reductions ( #29882 ) 5cd62ff sycl: template the plain MMVQ launch triples ( #31013 ) 38645c2 sycl: template the per-quant concat impls ( #31008 ) 02269b4 sycl: add set_tensor_2d for faster tensor-split loading ( #30358 ) 5320c87 sycl : bound reorder temp memory to 32 MiB ( #31062 ) 74b104c common: pin model resolution on real HF repo layouts ( #30548 ) c6fb3b5 mtmd: add mtmd_helper_get_capabilities ( #31183 ) 8b28c23 ggml-cpu : fix unused variables in arm arch ( #31180 ) fd8f845 tests : refactor test-llama-archs to not link internal libllama symbols ( #30880 ) 9125a2e ci : fix race in webgpu memset ( #31162 ) 9b8446b metal : stop overflow from happening in large matrix output offsets ( #30072 ) dc9e3be ui: UX improvements ( #31030 ) 69b3cc4 ui: Sidebar resizing improvements ( #31119 ) 224d94c ci : bump server timeout during startup ( #31174 ) 48c3611 ci : drop the macos-latest-x64 job ( #31175 ) a074215 deepseekv4.1: follow-up review fixes ( #31137 ) d854d98 cuda : use std::string instead of VLA for archName ( #30463 ) 48c9f08 common, grammar: add recursive depth limit, make it a requirement ( #31153 ) 6050b46 tests : adjust default threads for test-llama-context ( #31157 ) 2280f0f qwen: merge tensors on convert ( #31028 ) 1a0b56c ci : disable test-llama-context with fa off in the webgpu ( #30977 ) 63412d8 llama: fix exhausting CPU and MEM caused by dry sequence breaker ( #31035 ) 5c965fd llama-quant : fix 4D tensor quantization using ggml_nrows() and name-based expert detection ( #30820 ) f1168ac grammar: limit recursion depth to prevent stack overflow ( #29495 ) ( #29755 ) fa3645f llama : respect no_alloc in all memory caches ( #31087 ) 7790a92 tools : reject truncated GGUF tensor data in merge ( #31044 ) c49edf0 CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/up rows ( #29948 ) a55c16e ggml-cuda: fuse qwen MRoPE + set-rows ( #31025 ) e321bda vulkan: Add a larger tile size for conv3d (coopmat2 only) ( #29920 ) 459a1ba vulkan : one warp tile per subgroup in the small matmul tiles ( #30106 ) f0fb598 hexagon: generic dims collapse/reshape for unary, binary and matmul ops ( #31071 ) 9a4580b opencl: add topk and lightning indexer ( #31026 ) b083c38 opencl: add initial q2_k support ( #30999 ) 344be0a ci : update CPU job assignments ( #31136 ) b3fa699 chat : reject JSON nested more than 128 levels before walking it ( #30242 ) 74bca39 model: DSV4.1 flash ( #31086 ) d327bf1 jinja : fix select and selectattr argument handling ( #31059 ) 78a8ae1 hexagon: KV-head team split for multicore HMX flash attention ( #31055 ) f3269ef server: refactor server entrypoint ( #31113 ) 3f03b17 metal : remove mul_mm_id amax rescaling ( #30924 ) 9a0fde9 rpc : add bounds check in rdma_recv ( #30399 ) e168e04 ui: Models Manager as Route + UI improvements ( #30988 ) ea1d7d6 fix(ui): align hover card and context popup styling with dropdown menu ( #30978 ) 71255fe ci : pass per-runner results dir to self-hosted jobs on T4 runners ( #31100 ) 73adf89 minimax-m3 : forward quant scales to the graph (fixes #31063 ) ( #31097 ) df9beac tests : fix test-llama-context for large n_batch ( #31083 ) 4d32b29 ci : exclude test-speculative-rejection-sampling from macos-latest-arm64 ( #31088 ) 3032209 llama : deny -sm tensor for arches with moe amax rescaling ( #31081 ) 701fd25 ggml : allow MUL_MAT_ID -1 index to skip the computation ( #26631 ) 3642238 tests : add speculative rejection draft sampling test ( #30213 ) 6b9ba4f ci : fix data race between runners sharing the model cache ( #31046 ) 8e5a58d vulkan: ggml src1 precision support ( #30656 ) 1ddffe9 HIP: add byte permute fallback when __builtin_amdgcn_perm is unavailable ( #30915 ) 7894e8b mtmd: move build_inp_temporal_merge to base class ( #31065 ) edc3538 mtmd : lfm2 resize matches torchvision ( #30943 ) 9ae73e6 mtmd : add Soprano TTS support ( #28607 ) 0ae0e19 hexagon: add SGN op ( #30346 ) 21ec307 common : allow concurrent downloads across processes ( #29312 ) 9145ddb hip: fix bf16 WMMA operand vector type for gfx11/gfx12 ( #30885 ) 1a24df1 ggm-cuda: Enforce DP4A MMQ tile height multiple of warp size ( #30837 ) 9ff0d7e CUDA: fix build after chunked CUDA graphs ( #30804 ) ( #31053 ) 06230cb allows the usage of 4-10 gpus for stepfun and laguna in tensor parallel ( #24554 ) 5c31142 qwen4exp : build the QSA selection without the kq_mask ( #30965 ) da2ee1e vendor : update LibreSSL to 4.4.0 [no ci] ( #31049 ) 280141e CUDA: chunk graphs to amortize graph launch ( #30804 ) 36e36e6 hexagon: add CEIL op ( #31006 ) e1e3b2c ui : bump packages to clear npm audit ( #31038 ) 4231b23 ggml : fix time overflow in ggml_time_us ( #30969 ) f00c908 ci : add behavior check workflow ( #31036 ) f5027fb CANN: missing const qualifiers added for consistency ( #30933 ) f64a498 sycl : pass device into mul_mat_uses_onednn ( #31014 ) 1ab09d6 Extend probabilistic sampling for DFlash2 drafts ( #30663 ) f9599d0 vocab : fix Nemotron-3.5-Embed tokenization ( #30974 ) 643b0cd hexagon: Op Fusion refactoring, optimizations and new fusions like BINARY_NX (back-to-back ADDs, etc) ( #30843 ) 0a9ef00 sycl: Replace host waits in fattn-mkl with explicit dependencies ( #30684 ) 7377bad sycl: Add graph record and replay ( #28725 ) 184f653 server: Substitute rerank placeholder from the original template only. ( #30864 ) d814cbb server: realtime API: send complete after committed audio drains ( #30994 ) 970b51c opencl: add depthwise conv2d ( #30900 ) a08ab75 mtmd : add MiniCPM-OCR 1.0 support ( #30979 ) 19ab5a5 clef : include for std::find and std::copy ( #30981 ) 36cbf41 Fix !30793 5c19a5a glm5 : optimize inputs ( #30932 ) d9ee007 model : fix qwen4exp layer inputs for DFlash drafters ( #30927 ) d81d0d8 Multi-column on Intel XMX matrix engines refactored ( #29864 ) d772569 vulkan: replace std::aligned_alloc with posix_memalign for termux compatibility ( #30828 ) 0693dbf nemotron : support non-standard GQA, BPE tokenizer and domyn-small pre-type ( #23343 ) a5d2227 server : support typed content input for RERANK endpoint ( #29625 ) 5f5acfe ci : disable slow WebGPU tests ( #30963 ) 1f4c2ee ci : be able to reconfigure HTTP port for server pytest workers ( #30972 ) 7170cad sycl: fix CONV_2D wrong results for non-contiguous input ( #30363 ) d88040c vocab : add clean_spaces GGUF key ( #30940 ) e197cef vocab : use Tekken pre-tokenizer for pixtral rather than the Llama 3 one ( #30960 ) bf039c8 models : Record layer inputs for all granite models ( #30957 ) dfeea52 kleidiai : add Q8_0 SVE dotprod GEMV and SVE i8mm GEMM kernels ( #30808 ) e3797b1 sycl: merge the fp16 and fp32 dequant switches ( #30740 ) 0b1281a webgpu : add Q2_0 support ( #30914 ) 4912ac2 dflash : load optional FC input scale ( #30945 ) 84746c5 ui: Add "Show tool call in progress" setting ( #30681 ) 0682a57 lora : support prism.hadamard folded weights ( #30910 ) a6b83d4 ui : key draft sidecar badges by model instead of repo ( #30919 ) c7fc509 opencl: add F32-to-I32 ARGMAX ( #30897 ) a37cc46 models : add Flint model (FlintForCausalLM) ( #30928 ) 99fb997 jinja : fix namespace attributes shadowed by dict methods ( #30941 ) 7775ffb model: Add support for SenseNova U1 model ( #28919 ) d454a20 llama: create new fused op for QSA mask ( #30640 ) 0756e83 sycl: q8 fast dequant ( #30775 ) 9febe63 jinja: support hexadecimal string escapes ( #30929 ) 9b56ccf ggml-opencl : add IM2COL_3D support ( #30895 ) 0a1ef30 mtmd: add state object for mtmd_gen ( #30902 ) 261700b server : forward llama.cpp sampling params on /v1/messages ( #30856 ) f849095 vendor: update BoringSSL to 0.20261020.0 ( #30889 ) 824eaec llama : optimize vocabulary loading ( #30679 ) eb182d8 llama : place d2t by its set_rows use so it can stay on the GPU ( #30912 ) ea9e344 metal : fix memory leaks and cleanup logic in GPU capture path ( #30890 ) 0efe8e4 hexagon: neon-vectorized and threaded repack (tiling) ( #30901 ) b531e4c opencl: add dp4a GEMM variants to vector load activation ( #30753 ) 74b115c sycl : fix fa crash for Query head dimension mismatch (neq0 != HSK / D=2048/4096) ( #30286 ) 96caa80 sycl: collapse duplicate need_check launch bodies in mmq ( #30739 ) 479a527 ggml-cpu : compute f32 gelu_quick and geglu_quick without the fp16 table ( #30737 ) 8baabd5 llama : scale moe down projection per expert token ( #30861 ) 493253f Sycl iq3 crash fix ( #30604 ) 339f324 opencl: fix rope program build error with newer Clang ( #30893 ) 9a3b91c server : fix usage.completion_tokens undercount with n > 1 ( #29486 ) 5c0b49a server : add POST /tts endpoint for TTS models ( #26603 ) 1242be6 server: add realtime transcription API ( #30636 ) 84e66d0 refactor : move LFM2 shortconv and FFN blocks into a shared LFM base ( #30874 ) 52ffa02 model : support Nemotron-3(.5)-Embed ( #30877 ) 839a572 qwen: reshape output to 2d instead of 3d ( #30823 ) ead9f32 server: Support logprobs with speculative decoding ( #27196 ) b684b49 hexagon: fix VTCM size query on images that need layout out-params ( #30655 ) 4a45de4 mtmd : lfm2 tiles and layout match transformers ( #30261 ) 7e3eeee model : add H2O-Lightning-4B decision model ( #30361 ) 5ba3b9f mtmd: fix gemma 4 ffn act ( #30882 ) 5a9a34d server : avoid repeated mmproj memory margin addition on sleep/resume ( #28233 ) 39da130 ggml-cuda : support ssm_conv kernel size 7 ( #30873 ) 4e20138 server: Router wasn't propagating the client disconnects fully to the child, the response wait could cause a delayed cancellation ( #29707 ) 1ba568c server: fix missing output_index in Responses API SSE events for compatibility ( #30863 ) 36140db mtmd : read LFM2 tiling params from GGUF metadata ( #30840 ) df11702 metal : optimize argmax and pool_1d ( #30862 ) 9df0b73 model : drop the redundant precision overrides in the Kolibri-1 router ( #30865 ) b38960f ci : remove superfluous webgpu jobs ( #30868 ) a01ce9f opencl: add several gemm variants for small batches and some fixes ( #30850 ) 8115b4c sycl : replace memset due to not always ordered ( #30812 ) 119f68d ggml-cpu : select the NEON fp32->fp16 conversion ( #30505 ) b684498 HIP/CUDA: Fix reduction in mmf getting tile widths not devisiable by 64 ( #30836 ) 522f2b6 ggml-zdnn: introduce flash attention op ( #30512 ) 83c2d01 spec : save the dynamic ngram cache file ( #22055 ) 13786fb CUDA: Clear CUDA graphs after legacy memory pool flush ( #26771 ) d806193 server : pass id_slot through the Anthropic /v1/messages conversion ( #28554 ) 704366d metal : fix missing MoE kernel variant for 9 experts per token ( #30610 ) ( #30699 ) 707616f ci: Fix --strict mode for API check ( #30623 ) d8d9297 vocab : add \p{M} to lookaheads in Tekken and GPT-4o pre-tokenizer regexes ( #30845 ) 7879491 tests : make MoE router selection independent of the backend noise ( #30818 ) 8466395 hexagon: update to snapdragon-toolchain v0.8 and enable hexagon v85 ( #30854 ) dd002b9 sycl: fix compiler warnings - missing prototypes, dead code, extra semicolons ( #30271 ) 1d88cb0 ui: hide the native clear button in SearchInput ( #30719 ) 3bb63cb sycl : fix get_rows on reordered quantized weights ( #30430 ) f711c8f mtmd : match the transformers Qwen-VL resize ( #30736 ) 921257f ci, docs: add WASI CI and docs ( #30754 ) 3ffb629 ci : re-enable type/lint-check for skills ( #30713 ) 7adf160 server: add --connect, allow p2p access to server outside LAN ( #28277 ) ab7ed0d ui : fix attachment text preview clipped when a line is longer than the container ( #30806 ) 4c3c581 hybrid dna tokenizer fixes ( #30825 ) 1b29621 opencl: add cooperative-k dp4a gemm for q4_0, q4_k and q6_k ( #30741 ) 6fa4f6c opencl: add get_rows for i32, cpy for i32 and f32 ( #30756 ) 0ce8cd1 jinja : implement unique filter ( #30819 ) f174553 server : fix swa checkpoint invalidation logic ( #30666 ) 7951f60 vendor : update cpp-httplib to 0.62.0 ( #30785 ) 33d6135 moe-cache : replace MoE LRU cache with a 50/50 SLRU cache ( #30637 ) 098ce52 metal : fix moe_reduce fusion race when dst aliases its inputs ( #30795 ) f3fb2fc cann : refactor #ifdef blocks to avoid unreachable code after return ( #25273 ) fda00f1 tests: add big-endian conversion tests ( #30705 ) 4866db3 CUDA: fix warning for nonexistent extra semicolon ( #30774 ) 42b7003 ggml-cpu: vectorize ggml_v_silu and ggml_v_expf ( #30791 ) 4c1004c cuda: cap MMQ Stream-K blocks at available work ( #30553 ) 412a363 qwen3 : bidirectional attention and dense_2 output projection ( #30607 ) 2b57148 ui: Fix markdown tables and lists being cut off on phones ( #30687 ) 8f97d82 tools : reject truncated GGUF tensor data in split and export tools ( #30497 ) 27af581 tests : update Metal fusion baseline for beam ( #30764 ) 7db0d3d pi : turn .pi/gg into a system prompt addendum ( #30762 ) 99db719 CUDA: fix shared-memory WAR hazard in flash_attn_ext_vec ( #30573 ) 31288c9 hexagon: FLASH_ATTN_EXT improvements for longer context and SWA models ( #30731 ) fe8841a hexagon: allow multistream FA ( #30218 ) ff5a233 cuda : fuse qwen4exp's SCALE -> SIGMOID -> SCALE -> hc_post chain ( #30602 ) 0878f7c ggml: support non-contiguous SUM (CPU, CUDA, Vulkan, WebGPU) ( #28851 ) 5aeac37 ggml-cuda: fattn do not check oob if k_VKQ_max = (k_VKQ_max - nbatch_fa) ( #30572 ) 547208d Restore ESIMD kernels on FFN path ( #30239 ) 848bbda hexagon: add support for hadamard MUL_MAT and GET_ROW for flat and tiled Q1_0 and Q2_0 ( #30627 ) 797de63 hexagon: add support for Q1_0 and Q2_0 ( #30122 ) 9d1878a ggml-cuda: HIP: use __builtin_amdgcn_perm for q1_0 unpacking ( #29927 ) c0fd786 ui : Discover & Download Models from HF Hub ( #29584 ) 2744e48 CUDA: faster MMVQ for low-bit types ( #30517 ) 10b8b75 tests: give the random model generator a per-tensor filler table ( #30674 ) 9d1e036 cuda : fix -Wtautological-compare in fattn vec dispatch ( #30519 ) f2f667b cuda : add grouped experts top-k fusion ( #29181 ) 62318cd model : add Kolibri-1 (Aleph-Alpha) support ( #30673 ) 83f9389 ci : added ABI reports as github artifact ( #30619 ) 1268eda model : Granite switch decision 256 options ( #30693 ) f74e2fa sycl: fix prompt-processing regression after Q4_0/Q8_0 weight reorder ( #30374 ) ea0c4c2 skills: add slice-model ( #30677 ) 6420cf5 ci: update device matrix for Snapdragon jobs by removing SM8750 ( #30620 ) 27c7a76 hexagon: vectorize softplus with HVX ( #30435 ) 2f2763d opencl: Add MxFP4 MoE bin kernel for Adreno X1 devices ( #30691 ) 01fc3aa model: add Beam (Reflection) ( #30670 ) 23f7aab model : Granite Switch Decision ( #30676 ) 7182ef7 common: honor HTTP_PROXY/HTTPS_PROXY env vars in http client ( #21752 ) 2a66703 convert : respect Mistral format for DeepseekV2Model ( #30669 ) f336359 Add more benchmarks to llama-eval ( #26174 ) ceefd16 hexagon: correct HMX FA sinks ( #30581 ) 9a16f1d model : MTP support for Mellum2.1 ( #30612 ) b84ea5c convert : speed up model endian conversion and add more datatype support ( #30647 ) a30fb49 [SYCL]: fix memory errors in mul_mat, split buffer, host pool ( #29889 ) 495c580 gguf-py : add numpy Q1_0 and Q2_0 de/quantization support ( #30630 ) 623c163 CUDA: HIP: rms_norm: add variants that load float4 at a time and store x in registers ( #29720 ) 13b8048 common : read ngram cache parts by reference instead of copying ( #30061 ) 0f43762 convert : support text-only checkpoints in pplx-decider ( #30575 ) 3dbcb7f cpu : reduce AVX2 tiled accumulators together ( #30296 ) c804754 ggml-cpu: refactor s309x repack helper functions ( #30588 ) c0083e3 sycl : reduce the build threads to half ( #30236 ) 13de11e sycl: wide stores for the q4_K/q5_K weight dequant ( #29696 ) 88aaf32 tests : catch vanished rows in the fusion baseline ( #30618 ) a8d9a7e vulkan: fix gpu-visible host memory issues ( #30468 ) f12aaa3 Fix failing RocM tests ( #30611 ) 5e03a1f graph : add precision handling for MELLUM architecture ( #30584 ) b797b9c hexagon: tensor repacking rework and support for tiled and flat quantized and fp weights ( #30635 ) 6afa9a3 llama : share the k-pool input views between layers ( #30613 ) b6334e3 Limit max CUDA pinned host buffer size to 4 GB ( #30449 ) e707790 sycl: support reordered Q8_0 MoE weights ( #29337 ) 43d57fb [SYCL] Enable ssl in build script and CI ( #30456 ) 2851b3b mtmd: add mtmd_audio_stream + support voxtral-realtime ( #30629 ) 59d5fad convert : fix Granite Switch block_count for MultiSwitch checkpoints ( #30621 ) e287bd8 convert : fix regression in mapping of Granite speech tensors ( #30628 ) 2f729cf mtmd: lightonocr does not require longest edge to always be 1540, native resolution is the default ( #30600 ) ba3c05f model: add Muse Spark Open (text, vision and audio) ( #30616 ) b76b133 pi : expand AI disclosure with hardware and stats ( #30615 )

★ 🚨‼️r/Accelerate PSA‼️🚨 Download These Before The Internet Gets Restricted During The Cyber Pandemic

/u/Lord_44th__Raikage — Thu, 29 Oct 2026 00:00:00 +0000

92% · Usable today 92%

AI models and agent tools DeepInfer — An inference framework for running DeepSeek models on large GPU systems. https://github.com/deepseek-ai/DeepInfer Recurrent Looped Transformer — A language-model architecture that carries internal state from one token to the next. https://github.com/yifanzhang-pro/recurrent-looped-tranformer Anatomy — An agent skill that creates interactive illustrations of machines and complex systems. https://github.com/wheresryan22/anatomy RSI-Anything — A research framework that uses predicted outcomes and external feedback to improve agent workflows. https://github.com/Gen-Verse/RSI-Anything solidcv — A Rust library for computer vision, 3D reconstruction, and AI model analysis. https://github.com/solidsf-inc/solidcv Harness² — A framework that improves an agent’s prompts, tools, and workflow while keeping model weights fixed. https://github.com/google-research/harness2 GroundAnything-VLM — A vision-language model that locates objects and image regions from text instructions. https://huggingface.co/GroundingPI/GroundAnything-VLM GLM-5.3 Cybersecurity FP8 — A third-party GLM-5.3 release adapted for cybersecurity tasks. https://huggingface.co/dealignai/GLM-5.3-CYBERSECURITY-FP8 DeepSeek-V4.1-Flash Uncensored FP8 — A third-party DeepSeek release modified to reduce refusal behavior. https://huggingface.co/dealignai/DeepSeek-V4.1-Flash-1017-UNCENSORED-FP8 Qwen3.8-27B Uncensored GGUF — A GGUF release for local model runtimes. The uploader labels it “uncensored.” https://huggingface.co/orcarouter/Qwen3.8-27B-Uncensored-GGUF Genome models Evo 2 — DNA language models for analyzing and generating genome sequences. These links provide the 40B and 7B versions. 40B: https://huggingface.co/arcinstitute/evo2_40b 7B: https://huggingface.co/arcinstitute/evo2_7b Genos — Models trained on human genomes to study patterns in DNA sequences. Available in 1.2B and 10B versions. 1.2B: https://huggingface.co/BGI-HangzhouAI/Genos-1.2B 10B: https://huggingface.co/BGI-HangzhouAI/Genos-10B Carbon — Hugging Face’s genomic models, with code for evaluation and further training. https://github.com/huggingface/carbon Tissue-image models OpenMidnight — A model that extracts features from tissue images for pathology research. https://huggingface.co/SophontAI/OpenMidnight GenBio-PathFM — A model for analyzing tissue images, trained on publicly available pathology data. https://huggingface.co/genbio-ai/genbio-pathfm Protein models BoltzGen — A model for designing proteins and peptides that bind to selected molecules. https://huggingface.co/boltzgen/boltzgen-1 Pinal — A framework that generates candidate protein structures and sequences from written instructions. https://huggingface.co/westlake-repl/Pinal ESM-2 and ESMFold — ESM-2 models protein sequences. ESMFold predicts a protein’s 3D structure from its sequence. https://github.com/facebookresearch/esm OpenFold — A trainable implementation of AlphaFold 2 for protein-structure prediction. https://github.com/aqlaboratory/openfold Research archives arXiv Complete Corpus — A community archive of arXiv papers, including metadata, extracted text, source files, and PDFs. Select the files that fit your storage. https://huggingface.co/datasets/secemp9/arxiv-complete PubMed Central Open Access Subset — A collection of biomedical research articles available for reuse under their individual licenses. https://pmc.ncbi.nlm.nih.gov/tools/openftlist/ Security and public information tools ARTEX — An AI agent system that automates penetration testing and records security findings. https://github.com/BaaRai/ARTEX Ghidra — A software-analysis framework that helps researchers inspect compiled programs and understand how they work. https://github.com/NationalSecurityAgency/ghidra Cloudflare Security Audit Skill — A coding-agent skill that checks repositories for security flaws and verifies reported findings. https://github.com/cloudflare/security-audit-skill Blackbird — A tool that searches public platforms for accounts associated with a username or email address. https://github.com/antoniaci/blackbird Maigret — A tool that checks websites for a username and collects public account information. https://github.com/soxoj/maigret SpiderFoot — A tool that combines public data sources to map internet assets and exposed information. https://github.com/smicallef/spiderfoot theHarvester — A tool that collects public domain, hostname, email, and network information for security assessments. https://github.com/laramies/theHarvester Shodan Python — The official Python library and command-line tool for querying Shodan’s internet-device database. It requires Shodan access. https://github.com/achillean/shodan-python Radio hardware HackRF One — An open hardware radio device for receiving and transmitting signals from 1 MHz to 6 GHz. https://greatscottgadgets.com/hackrf/one/ submitted by /u/Lord_44th__Raikage to r/accelerate [link] [comments]

★ Formlabs Studio 1 $699 Resin Printer

mhb — Thu, 29 Oct 2026 00:00:00 +0000

91% · Measured result 91%, Usable today 76%, First-party 65%

Article URL: https://formlabs.com/products/form-studio-1-basic-founders-edition/ Comments URL: https://news.ycombinator.com/item?id=50281044 Points: 169 # Comments: 108

★ Gemini 4 Carbon

acossta — Thu, 29 Oct 2026 00:00:00 +0000

91% · First-party 91%, Usable today 34%

Article URL: https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-gemini-4-carbon/ Comments URL: https://news.ycombinator.com/item?id=50276792 Points: 897 # Comments: 736

Moss Image for pixel art

/u/berthol — Thu, 29 Oct 2026 00:00:00 +0000

89% · Usable today 89%

I enjoy starting godot game projects that I never finish. While I very much enjoy carefully plotting pixels in Aseprite I have also looked at AI to aid me in that process. I've been trying pixel art with MOSS-Image-SFT and noticed that it produces a fairly decent pixel grid straight out of generation, before any snapping or cleanup. It also seems to have a good general understanding of pixel art. That got me curious about what a small LoRA could do with it. The experiment is mostly about making the pixel scale more predictable. I trained on 30 pixel-snapped 64×64 sprites enlarged to 512×512, targeting an 8× scale where each logical pixel occupies an 8×8 block in the generated image. That gives these intended working sizes: Generate at Intended pixel grid 512×512 64×64 768×768 96×96 1024×1024 128×128 It's still a small experiment. The grid can drift, edges can bleed, and some details won't survive downscaling. The 8× scale is a training target, not a guarantee that every output will land perfectly on it, but I'm still surprised on how close it is. Here is a diff between output and grid snapped and color quantized image: https://www.diffchecker.com/image-compare/ateIcHYx/ That downscale doesn't fix uneven cells. For additional cleanup I use Sprite Fusion Pixel Snapper . It can help recover a consistent grid. It also exist as a Comfy node . Model can be downloaded from CivitAI or Hugging face if you want to play around with it. Workflow and training details can be found in the Hugging Face repo. submitted by /u/berthol to r/StableDiffusion [link] [comments]

MacBook Pro with PROLED XDR Display and Touch

etothet — Thu, 29 Oct 2026 00:00:00 +0000

89% · First-party 89%, Usable today 44%

https://www.apple.com/newsroom/2026/10/apple-unveils-groundb... Comments URL: https://news.ycombinator.com/item?id=50276940 Points: 561 # Comments: 947

PSA: REA taught Claude how to read binaries. Now let it touch the live process

/u/woldann — Thu, 29 Oct 2026 00:00:00 +0000

87% · Usable today 87%

REA proved how good Claude is at reading decompilations, but static analysis only tells you what code might do offline. Stop burning prompts asking Claude to simulate execution in its head. Let it touch live memory. I built Exoproc, an open-source MCP server over stdio that connects Claude Code directly into active Windows x64 processes. Instead of noisy DLL injection that triggers EDRs, it uses thread hijacking (suspends thread, moves RIP to sleep stubs) to execute within the existing context. It handles 5-byte JMP trampolines with 14-byte far relay gates, and compiles C straight into shellcode in memory via TinyCC. Tell Claude: "Hook SetWindowTextW on PID 4120 with a 5-byte trampoline to log string buffers, then restore original bytes when done." Claude hooks the prologue, logs the UTF-16 strings from live memory, and unhooks cleanly. No DLLs dropped, no open network ports. Static decompilation gave Claude eyes. Dynamic hooking gives it hands. GitHub: https://github.com/w0ldan/exoproc submitted by /u/woldann to r/ClaudeAI [link] [comments]

Ive got first sales 🥳 Feels good man!

/u/TypeOfHype — Thu, 29 Oct 2026 00:00:00 +0000

87% · Measured result 87%, Usable today 87%, First-party 60%

It feels unreal, never taught people would like my app let alone buy it, its such a niche case app. Not to bore you with much details but about 3 months ago Ive got macbook air m1 16gb ( la di daaa), it was such a good deal ( and I needed macos machine to test my vibecoded stuff). I didn’t even had it for 1.5 months and my screen kinda broke, had vertical lines on the left edge and on the bottom screen. It was soooo frustrating, and when ive checked the prices of the screen replacement from apple, it was ridiculous, to pay for screen replacement more then what ive paid for the laptop. I could use it in clamshell mode or go naked, but if I want to take it somewhere like on the train or beach its useless like that. So instead of paying apple greedy tax, ive vibecoded a fix for it, its called CrackMac. I knowww, name sounds sketchyy, but its the first thing that poped in my mind while i was working on it. It works really well. And does make my laptop actually useable again. Necessity is mother of all “inventions” 😂 Hope nobody here doesn’t have that problem but if you do, feel free to download the trial and test if it fixes your actual problem or not. crackmac.app Current pricing is $9,99 lifetime license. Thank you for listening of me ranting and have an amazing dayyy 🥳 submitted by /u/TypeOfHype to r/SaaS [link] [comments]

Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly!

/u/LatentSpacer — Thu, 29 Oct 2026 00:00:00 +0000

86% · Usable today 86%

This might have implications for tool calling and computer use. Write-up: https://divagr.com/blog/qwenputer HF: https://huggingface.co/divagr1925/Qwen3.5-4B-Qwenputer Live demo: https://modelscope.ai/studios/Spartan1925/Qwenputer submitted by /u/LatentSpacer to r/LocalLLaMA [link] [comments]

IT vendor lists massive $60 million AI supercomputer on eBay with 9,600 Nvidia A100 GPUs and 4,200 AMD EPYC CPUs, plus free shipping — 300 racks of decommissioned GPUs on offer

/u/giveen — Thu, 29 Oct 2026 00:00:00 +0000

86% · Measured result 86%

Anyone want to chip in a cool $60m for me? submitted by /u/giveen to r/LocalLLaMA [link] [comments]

A 4B model made me a netherite ingot from bare hands. All I did was type one sentence in chat.

/u/Top-Evidence174 — Thu, 29 Oct 2026 00:00:00 +0000

86% · Measured result 86%, Usable today 40%

Last time my Minecraft assistant could do tasks, but it couldn’t really understand what you asked it in plain language. This time I built a pipeline for exactly that part, and it isn’t tailored to this one sentence. It works for requests in general. In the video the player types “I’m hungry, get me at least 3 porkchops and also make me a netherite ingot.” Mica v0.5 4B reads it, works out the two goals and how many of each, and then starts from bare hands. It goes wood, tools, iron, diamonds, obsidian, portal, Nether, ancient debris, gold, and finally the netherite ingot, then comes back and hands everything over. The panel on the right shows every question Mica was asked, the options it saw, and the probability it gave each one. At the end it switches to the player’s view so you can see the items arrive. The idea behind it: the model doesn’t try to understand the whole sentence in one shot. The request gets broken into a chain of small multiple-choice questions, and each answer narrows down the next one. How many different items does the message ask for, and is there an action like “come here”? Then, for each item in the order the message names them: which category is it (food, tools, ores and materials...)? Which subcategory (for ores, overworld or Nether)? Which exact item, picked from the game’s own item list with no keyword matching? And who is it for, and how many? The code only supplies the options from game data. Mica makes every choice, and every answer comes with a probability. During the task, a recipe planner lists the actions that are valid right now and Mica picks what to do next. To be upfront: Mica v0.5 4B is still a long way from judging every variable from A to Z like a person would. But it does play the role of a brain. Almost every meaningful decision in the video was made by Mica. It isn’t comfortable operating the game directly, so the bot is its hands and feet, doing the walking, mining and crafting. The judgment is mostly Mica’s. In case anyone reads it that way: I’m not claiming Mica takes in every frame as a continuous stream, reacts at superhuman speed and generalizes to any situation that comes up. I’m not making that claim at all, and I doubt even Fable 5.5 could pull that off. What I’m showing is that a 4B model can break a natural-language request down into general-purpose decisions, turn it into the right goals with high probability, and make sensible calls at each step in Minecraft so the bot does the right work. I think that’s really useful if you want to build your own Minecraft errand runner. The natural-language part is what matters most here. Also, my local GPU is AMD, so it doesn’t get much benefit from Mica’s optimizations, and the decisions ran slower than they would on NVIDIA. The decision times shown in the panel are RTX 3090 estimates, and the waits are cut from the video. I think this kind of judgment model can be used in a huge range of areas, not just Minecraft agents. The principle is simple: if something is too hard to settle in one request, break it into smaller judgments and narrow it down step by step. Every extra judgment you can afford is another chance to push accuracy up. That’s also why I don’t really recommend API-only decision models unless the model is truly exceptional. In my measurements, API-only decision models like Jev, Clef and Ms Decision were about 60x slower than Mica on average, which is a massive gap in how many judgments you can make per second. If you really need that level of capability, you’re probably better off calling a full LLM anyway. And it isn’t just Mica: unless a model has tens of billions of active parameters, a local model will usually be 10x or more faster than an API-only decision models. I’m hoping to release this Minecraft agent someday, but it isn’t finished yet so I can’t put it out right now. That said, if you give the idea I described above to a coding agent like Claude Code or Codex and ask it to build it, it should be pretty easy to get working. GitHub: https://github.com/akivet/Mica Hugging Face: https://huggingface.co/sky7350/Mica-v0.5-4B submitted by /u/Top-Evidence174 to r/LocalLLaMA [link] [comments]

Gemini 4 Carbon achieves SOTA and matches human performance on Blueprint Bench 2.0, a benchmark in which AI agents draw floor plans from photographs of apartment interiors.

/u/Schneller-als-Licht — Thu, 29 Oct 2026 00:00:00 +0000

86% · Measured result 86%

submitted by /u/Schneller-als-Licht to r/accelerate [link] [comments]

llama.cpp b11972

github-actions[bot] — Thu, 29 Oct 2026 00:00:00 +0000

86% · First-party 86%, Usable today 81%

common, mtmd: bound control vector layer indices and M-RoPE position loops ( #31336 ) common: bound control vector layer indices by the model layer count A direction tensor layer index is parsed from the tensor name with no upper bound, and the buffer size and write offset are computed in int. A large index overflows both, so the accumulation writes before the start of the buffer. Pass the model layer count to the loader, reject indices above it like the existing zero index check, and compute the sizes in size_t. mtmd: fill M-RoPE positions by whole merge tiles The position loops of the Qwen-VL, GLM, PaddleOCR and Qwen2.5-VL encoders hardcode a 2x2 merge inside a stride of n_merge, so a patch grid that is not a multiple of the merge writes past the positions buffer. Iterate over whole merge tiles with n_merge inner steps, which bounds the writes by the patch count and gives the same positions on aligned grids. PaddleOCR also requires a merge aligned image at graph build, as the Qwen-VL family already does. Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61041957 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11976

github-actions[bot] — Thu, 29 Oct 2026 00:00:00 +0000

85% · First-party 85%, Usable today 84%

Hexagon: IM2COL improvement - block based HVX parallelization ( #31050 ) hexagon: IM2COL over multiple threads with output-col blocks Assisted-by: Claude Opus 5.5 hex-im2col: fix padding handling hex-im2col: loop unroll common cases Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61099121 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Used Qwen 3.8 flash next on underspeced PC to Root and gut LG TV of spy and adware

/u/Switchboy1 — Thu, 29 Oct 2026 00:00:00 +0000

84% · Measured result 84%, Usable today 70%

I post this because I was honestly quite impressed by the capabilities of this model from a opencode harness and wanted to share my experience. So i've been playing about for a bit wit Strata and Qwen 3.8 flash for a bit and was looking for a new kind of test. One that would also (if succesfull..) give a real life benifit. And since I also like a bit of danger. I thought lets put my spying LG tv on the line since I am to lazy to root and block it myself. It was also something that is in a bit of a gray area although fully legal here in the EU. Actually what LG is doing is borderline illegal here but no authorithy has the balls to do anything about it... Anyway this was the beginning of the context used: Context: LG webOS Spyware & Ad-Free Project (Root Escalation) Recently, there has been breaking news that TV manufacturers are doing deep content inspection and listening in on every conversationyou have around your TV to better target you for ads. We are trying to fight back as consumers against these practices, which are of questionable morality and also technically illegal in the EU. We have already had great success taking back our bought-and-paid-for Android devices via ADB. They were easy to root and sanitize to be like a stock Android TV without all the spy software. However, some of us are not so lucky and have an LG TV, which runs a proprietary OS (although it is Linux under the hood). So far, there has been no luck rooting and stripping out the unwanted spy and adware in the OS of a device that was not sponsored, but paid for in full by the consumer. There is a spark of hope, though. Via developer options, there is a (maybe sandboxed) remote terminal in some kind of userspace. So we just need to do a privilege escalation to be able to further probe the system. The next step will be to find a way to make a root survive a TV reboot. Then we could either remove the spy and ad software from the packages or at least have a script that stops those things from starting, as well as disable auto-update. Long term, we need to reverse engineer the TV OS or extract hardware blobs to make it Android TV compatible. For now, the first action is root escalation. Objective Gain root/terminal access on an LG webOS TV, bypass proprietary restrictions, and eliminate telemetry/adware packages or block them via system modifications. Find out if flashing android TV is going to be feasable in the future At first it questioned the ethics of my request but my framing it as just fidling with a product of I own outright conviced it to help. I gave it further instructions in the context file: Connection Strategy (webOS Developer Mode / SSH) Under the hood, LG webOS Developer Mode opens an SSH server (similar to webOS Dev Manager). We must connect via SSH using the built-in developer credentials. Connection Parameters: Protocol: SSH Target IP: 192.168.1.*** Port: 9922 User: prisoner Authentication Key / Passphrase: **** Agent Instructions & Action Plan Step 1: Initialize Connection & Verify Terminal Access Test SSH handshake with fallback flags for legacy key types (ssh-rsa):ssh -p 9922 -o HostKeyAlgorithms=+ssh-rsa -o PubkeyAcceptedKeyTypes=+ssh-rsa prisoner@$TV_IP Step 2: System Probing & Privilege Escalation Once inside the userspace shell via prisoner: Check system privileges and architecture (id). Inspect running processes (ps) to map out telemetry and content inspection hooks. Search for local privilege escalation (LPE) vectors or known webOS kernel/service exploits. Log any working exploit in exploit.md in your working folder (where context.md resides). Make a full backup of the current state in your working folder. Step 3: Persistence & Mitigation (Use public security documentation and webOS community resources for reference) Find a way to make root access survive reboots. Log attempts in persistentRootAttempts.md. Save success report in workingPersistence.md. Be sure to roll back changes after success or a failed attempt. Step 4: Neutralize Telemetry (Use online resources for reference) Locate and identify the telemetry software binaries/services.Attempt to remove or disable the telemetry software. Log attempts in removeTelemetryAttempt.md. If removal fails or breaks functionality, write a startup script that kills telemetry processes when launched. Report the confirmed procedure in successfulTelemetryRemoval.md. Step 5: Neutralize Ads Plan a method to remove obtrusive ads from the home screen UI. Log attempts in removeAdsAttempt.md. When successful, report the working procedure in successfulAdRemoval.md. Step 6: Lock Current State (Disable Updates) Disable auto-updates to prevent patching of the exploit vector. When successful, report the working procedure in successfulUpdateDisabled.md. Step 7: Documentation & Sharing Combine the working procedures from all steps (including initial connection setup, ensuring sensitive credentials are removed) into a clean wayToPwnLG.md file for sharing on GitHub. Step 8: Android TV Port Exploration Investigate whether original hardware blobs/drivers can be extracted to support porting or running an Android TV build on the hardware. Create a feasibility study and plan. Step 9: write a noob friendly script and guide for *nix and windows to do it in one click It went ahead and rooted the TV suprisingly fast via a known exploit. It ignored all clear instructions about rolling back changes and making backups though.... It went a bit overboard and became an overachiever by also patching the exploit for security so no one else could do root escalation. This move turned out to shoot me in the foot because it also meant the homebrew shop (who uses that escalation everytime it launches) would no longer work. Luckely the SSH server with root privilages stayed up so it was in the end able to correct its own mistake. It did all this in short order it was quite impressive to watch and reading all the docs and then trying this exploit myself would probably cost me the same amount of time and a headache haha. I dunno if anyone is interested but here is the repo it came up with: https://github.com/switchboy/pwnLG As for the hardware used: Ryzen 7 3700x with 32GB of system ram RTX 2070 Super 8GB of VRAM about a 120GB of NVME SSD space 25~ tokens/s and almost 100% GPU use all the time which is really impressive! submitted by /u/Switchboy1 to r/LocalLLaMA [link] [comments]

Gemini 4 Carbon Ranks #1 on Artificial Analysis V5

/u/kairosdev — Thu, 29 Oct 2026 00:00:00 +0000

84% · Measured result 84%

submitted by /u/kairosdev to r/artificial [link] [comments]

ollama v0.40.12-rc1

dhiltgen — Thu, 29 Oct 2026 00:00:00 +0000

84% · First-party 84%, Usable today 56%

mlx: add LFM3 and d1 models ( #19333 )

ollama v0.40.13

github-actions[bot] — Thu, 29 Oct 2026 00:00:00 +0000

83% · First-party 83%, Usable today 81%

LFM3 on Linux and Windows Liquid AI's LFM3 models, including text-to-speech in lfm3-audio and lfm3-omni , now run on Linux and Windows as well as Apple silicon. Full Changelog : v0.40.12...v0.40.13

llama.cpp b11971

github-actions[bot] — Thu, 29 Oct 2026 00:00:00 +0000

82% · Usable today 82%, First-party 81%

opencl: add tiled q4_k GEMM for adreno ( #30412 ) opencl: run the tiled q4_K lm_head through a tiled GEMM at batch > 1 opencl: split tiled dp4a q4_k gemm into its own file and test for dp4a Assisted-by: Codex Co-authored-by: Li He lih@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/61033347 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu 26.04 s390x (CPU) Ubuntu 26.04 s390x (zDNN) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

"Today, in collaboration with Anthropic, we’re excited to share rapid initial progress towards an antibody treatment for food allergy, which affects over 200 million people worldwide, discovered with the help of Claude. At Divergence Labs, we believe that AI can unlock the next generation of..."

/u/stealthispost — Thu, 29 Oct 2026 00:00:00 +0000

81% · First-party 81%

...antibody therapeutics with more effective mechanisms than before. Such mechanisms are urgently needed in food allergy, which involve overcoming one of the tightest affinity protein pairs in immunology, IgE and its receptor FcεRI, on mast cells. Treatment with Xolair—the only approved antibody for food allergy—sequesters circulating IgE, but mast cells remain sensitized for weeks to months due to the extraordinarily slow dissociation of IgE from FcεRI. We envision a treatment that actively pulls IgE off of FcεRI, without waiting for natural dissociation. Like picking a lock, this requires the right combination of geometry and force. Our research team, working with Claude, ideated on mechanisms to accomplish this disruption, and converged on an antibody format with two arms with different functions and epitopes. Within one month, we designed, synthesized, and experimentally confirmed the biophysical function of the two arms, which we are now assembling into full therapeutic formats. Read more: Anthropic’s blog https:// anthropic.com/research/early -progress-drug-development … Our technical report https:// divergencelabs.com/publications/i ge-preprint.pdf … — Bowen Jing Source: https://x.com/bjing2016/status/2115235758802161846 submitted by /u/stealthispost to r/accelerate [link] [comments]

Diffuspace/Clover-35B-A3B-Preview · Hugging Face

/u/jacek2023 — Thu, 29 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 68%, Measured result 38%

Clover-35B-A3B-Preview is the first model released by DiffuSpace , delivering state-of-the-art performance among open-source diffusion language models at release on the benchmarks reported in our launch blog . Clover combines a 35B-parameter mixture-of-experts backbone with approximately 3B active parameters per token, block diffusion generation, and a 128K context window . Blog · Code & inference backends · Hugging Face submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

UK Uses AI to Summarise Asylum Interviews: One in Five Checked Summaries Failed

/u/beingmodest — Thu, 29 Oct 2026 00:00:00 +0000

80% · Measured result 80%

submitted by /u/beingmodest to r/artificial [link] [comments]

my saas just crossed $10k ARR

/u/Strong_Teaching8548 — Thu, 29 Oct 2026 00:00:00 +0000

80% · Measured result 80%, Usable today 61%, First-party 57%

I've been building websites for about 4 years now 5 months ago I started building this saas while losing ~$100/mo on infrastructure and AI costs at the start of september it was still under $1k arr on october 1st it was around $3.5k. today stripe says $10,008 https://preview.redd.it/q4pbeyaob9yh1.png?width=654&format=png&auto=webp&s=4fd2619648eb6c5d3788719637e723176e878826 the honest part is that most of it didn't come from what i planned I spent a lot of time on cold email to find customers. the last version reached ~55 people and got 0 interested replies, so i turned it all off a couple of weeks ago :/ what actually moved it: an seo youtuber made a video about the tool. half of my first 10 paying customers came from it, and i only figured that out later posting the same day a new ai model came out (JEV) about how it does in my niche, with $200 in ads behind it. almost 50 signups in one day a free personalized preview before signup. most trials start after someone sees it requiring a card for the trial. paying customers went up ~50% helping my audience in reddit and x for ~30 min a day. 2 customers in the first 3 days the other surprise was who pays... I built it for saas founders and indiehackers, but when i looked at my first 10 customers only 1 or 2 were saas the biggest group was small agencies using it for their own site it's profitable now, which feels weird after months of paying to keep it alive submitted by /u/Strong_Teaching8548 to r/SaaS [link] [comments]

$4,700 audiophile-grade network hub promises a noise-free experience and music with 'emotional impact' — seven isolation stages per port were chosen with 'listening comparisons,' uses a $5 Realtek controller

/u/Logical_Welder3467 — Thu, 29 Oct 2026 00:00:00 +0000

80% · Measured result 80%, Usable today 65%

submitted by /u/Logical_Welder3467 to r/technology [link] [comments]

★ The best AI passes 37% of real engineering tasks. Most people would pass none

/u/ZeroCool86 — Wed, 28 Oct 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 59%, First-party 36%

Xplore released RWE-bench today, 20 mechanical, electrical and aerospace tasks written by engineers who do this for a living. One is a diesel crankshaft that has to survive 2,400 rpm, one is routing a DDR3 memory bus on a real FPGA board, and one is CFD on a turbine vane. No model grades the results. A program checks every design against every requirement and runs physics solvers where it has to. GPT-6 Astra leads at 37%, Opus 5.5 is at about 29% and GPT-6.1 Sol at about 25%, for $10 a run. Astra and Opus cost about six times that per run for 12 and 4 more points. 37% sounds low until you ask how a person would do. Give someone off the street the same tasks and tools and they pass none, because they won’t get past drawing the part in CAD and running the simulation. An engineering graduate might get one or two in their own field after a month of work. A specialist would pass the ones in their own field, about a third, at roughly a week each. The model does some of all three fields in a few hours a run. The human time and what they could do are my own rough estimate, Xplore doesn’t publish a human score. (but i think they should next time!) Code got good fast because you can check the answer, and most physical engineering has a much longer feedback loop than code. There’s still a lot of work to do, but now it’s work with a scoreboard, and from what I’ve seen that’s what makes the next jump happen. I wrote up the tasks, the human comparison and why I think the grading matters more than who’s on top: https://www.anchorterminal.com/blog/rwe-bench-engineering submitted by /u/ZeroCool86 to r/singularity [link] [comments]

★ A 1.3B OCR model just hit 93.68 on real-world document parsing and there's now an AI judge for OCR errors

/u/Equivalent-Grass-527 — Wed, 28 Oct 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 92%, First-party 55%

Most OCR models focus on reading documents. MiniCPM-OCR adds a second piece: a model that checks whether the OCR result is actually trustworthy. OpenBMB just released two open-source models: MiniCPM-OCR 1.0 (1.3B): Scores 93.68 on Real5-OmniDocBench , targeting real-world documents like curved pages, phone photos, tilted scans, and complex layouts. DSpark decoding acceleration boosts end-to-end processing efficiency by 55%. MiniCPM-OCR Jev (2B): An OCR quality judge that compares the original image with candidate text, catching errors in formulas, tables, and text. It achieves 0.936 AUROC , close to a 397B-parameter model on the same evaluation. The interesting part is Jev can also evaluate outputs from other OCR systems, so you don't necessarily have to replace your existing pipeline. Both models are open source, with support for vLLM, SGLang, llama.cpp, and Ollama. Hugging Face Links: https://huggingface.co/openbmb/MiniCPM-OCR-Jev https://huggingface.co/openbmb/MiniCPM-OCR-1.0 submitted by /u/Equivalent-Grass-527 to r/LocalLLaMA [link] [comments]

★ inclusionAI/Ling-3.1-flash-1019 · Hugging Face

/u/jacek2023 — Wed, 28 Oct 2026 00:00:00 +0000

97% · Measured result 97%, First-party 85%, Usable today 85%

from inclusionAI: We introduce Ling-3.1-flash-1019 , an upgraded version of Ling-3.1-flash , with 560B total parameters, 25B active parameters per token, and a 1M-token context window . With further post-training optimizations, Ling-3.1-flash-1019 demonstrates significant improvements in reasoning and real-world agentic capabilities. Its AA-Briefcase score rises from approximately 1400 to 1524 Elo , while performance on AutomationBench-AA increases from 62% to 68% . The model also makes gains on scientific benchmarks, including CritPt (18% → 26% ) and SciCode (54% → 57% ). Overall, it scores 44 on the Artificial Analysis Intelligence Index v4.3.2 , up from 41 for its predecessor. These gains highlight the model's improved capabilities in complex reasoning, multi-step task execution, and agentic workflows across diverse real-world scenarios. https://huggingface.co/inclusionAI/Ling-3.1-flash-base We introduce Ling-3.1-flash-base , the base checkpoint of Ling-3.1-flash , released to support research and community-driven innovation. With 560B total parameters and 25B active parameters per token , the model provides a foundation for continued pretraining, domain adaptation, and post-training research. submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

★ Introducing H3 Relay Hires node: 0.5 → 2 MP anime upscaler, ~4x faster than native, with a full 20-step pass 1 (no turbo LoRA needed for the take)

/u/crinklypaper — Wed, 28 Oct 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 92%, First-party 43%

Repo: https://github.com/tazmannner/ComfyUI-H3-RelayHires (MIT, 8 example workflows) Also I started posting lots of progress on more anime stuff I'm doing in open source on twitter: https://x.com/tazmannner I worked with claude to make this tutorial video and write up. This is still a work in progress and appreciate any constructive feedback. I got tired of waiting 8+ minutes for every 1920 H3 clip, so I made a hires method for it: a 2 MP clip about 4x faster than a native render. It doesn’t rely on running the whole render on a low-step LoRA, which in my experience brings trade-offs like poorer motion and distorted visuals or colors. You render the take at 0.5 MP like a preview. If you like it, the same take gets finished at 1920x1088, and the audio stays exactly as you heard it. On a 5090, for a 5 s clip at 1920x1088, end to end: Render type time native 1920 render ~500 s 1 MP + latent upscale + refine ~240 s Relay Hires ~118 s Relay Hires + Fast Tail Sampler ~107 s How it works. It's all one node: Pass 1 at 0.5 MP. This is where H3 decides the layout, motion, acting and audio, and it's where most of the time goes. You approve the take here. AnimeSR upscale to 1920 (~2 s). It's a tiny upscaler I trained from scratch, and it's included in the repo. H3 draws ~2 px ink lines at every resolution, so normal upscalers give you lines twice too thick and mushy small faces. AnimeSR is trained to undo exactly that. One H3 turbo step at 1920 (DMAD LoRA, from sigma 0.60). This redraws the detail at full size. The pass-1 audio is pinned, so the soundtrack is identical. The H3 step only redraws detail, so you get the take you previewed, not a new one. A latent upscale + refine can change faces and poses; this doesn't. Smeared fast frames and tiny faces in wide shots also come out clean. Still lines barely shimmer: 0.13 frame to frame, vs 0.10 native and 0.22 for the 1 MP route. Honest limits: Line weight: ink lines are a bit bolder than a native 1920 render. Very fast action: if the 0.5 MP take itself melts (a sword clash), the relay gives you motion blur there, not crisp poses. Example workflow 2 fixes those frames first with a de-rope pass. Anime only: it's built for 2D anime. I haven't tried realistic stuff. Bonus: pass 1 ~20% faster. The pack also has an H3 Fast Tail Sampler . H3 decides the take in its first 12 of 20 steps, so those run exactly like euler, and the last 8 become 4 second-order steps. Same take, 58 → 47 s for pass 1. If you'd rather not install it, the README shows how to wire the same thing with stock nodes. How to use it You need: MiniMax H3 in ComfyUI. (Duh) The DMAD 4-step turbo LoRA for H3 (Kijai's MiniMax-H3-experimental repo on Hugging Face). taeh3 (Kijai's MiniMax-H3-TAE) and a loader for it. The examples use the one from ComfyUI-H3-FastDerope . VideoHelperSuite and comfyui_essentials . (not a hard requirement but reccomended) Steps: git clone https://github.com/tazmannner/ComfyUI-H3-RelayHires into custom_nodes . The AnimeSR model is already inside. Open example workflow 1 ( 1_relay_hires.json ). It's the simplest one and doesn't need any of my other packs besides FastDerope's taeh3 loader. In the blue SETTINGS group: write your prompt (one box, used everywhere), and leave the size at 0.5 MP and the hires scale at 2.0 . Queue. You get the 0.5 MP preview and the 1920 final. Optional (See below) but you can just integrate the workflow into your existing workflow quite easily. And it works for both FLV2A and REF since the magic is done mostly in the 2nd pass. Tip: keep the seed fixed. Mute the Relay Hires node and the final save (Ctrl+M) while you try prompts and seeds, then unmute when you like the preview. ComfyUI reuses the finished pass 1, so you only pay for the relay. Adding it to your own workflow. Put the H3 Relay Hires node after your pass 1 and connect: model: your pass-1 model (same LoRAs and shift) plus the DMAD LoRA at 0.8. positive: your pass-1 conditioning. latent: the pass-1 sampler output. The audio comes from here. images: your decoded pass-1 frames. vae: taeh3. Then LTXV Separate AV Latent → VAE Decode. Keep the defaults: AnimeSR, sigma 0.60, 1 step, window 0. The other example workflows each add one stage before the relay: 2: de-rope, for fast-motion smears (144 s). 3: + FaceDetail, for small faces (224 s). 4: + Anime Cadence, for 2s/3s holds (228 s). 5-8: the same four with the Fast Tail Sampler. Those need my other packs, linked in the README (3-4 also use two small helper nodes from ResCascade, to put the faces and holds onto the 1920 frames). If there is interest I may make posts on these later, they all have their uses depending on the situation. I've also used it for: Character swap / ref2va: works unchanged. A 12-shot, 22 s character-swap recast at 1920 took only ~3 min more than the same run at 0.5 MP. 15 s clips and multi-scene chains: relayed part by part. Bonus: my other anime packs for H3 All free, and they work with the relay (example workflows 2-4 use them): Fast De-rope : fixes H3's fast-motion smearing and melting. A motion gate finds the fast moments and redraws only those, then splices them back into your render. On one 10 s clip with a single fast kick, the fix cost +12 s instead of +202 s. The de-rope itself is matlowai's MAINodes ; this pack makes it cheaper and cleaner so credit to him for his great work. Anime Cadence : makes H3 move like hand-drawn anime. It puts drawings on 2s/3s where H3 slips into a new picture every frame, and keeps the sharpest frame of each held drawing. A character-only mode holds the character while the background and camera keep moving smoothly. Everything here is on a 5090 with 96 GB RAM. I haven't tested smaller cards, so I'd love to hear how it runs on yours. Built with a lot of help from Claude (Claude Code), which did a ton of the testing and measuring. submitted by /u/crinklypaper to r/StableDiffusion [link] [comments]

★ LiquidAI/LFM3-1.7B · Hugging Face

/u/jacek2023 — Wed, 28 Oct 2026 00:00:00 +0000

96% · Measured result 96%, Usable today 93%, First-party 50%

https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF from liquidAI: LFM3-1.7B is a text model for local agents and specialized applications , based on our new tri-hybrid architecture. Agentic training: post-trained for agentic harnesses such as Hermes Agent, Pi, and OpenClaw, with a 256K-token context window. Designed for the edge: at 4-bit precision, it takes about 1 GB of memory, so it fits on any phone or laptop. Made to be specialized: adapt the model to your domains, formats, and tools via quick single-GPU fine-tuning. Find more information about the LFM3 family in our release blog post . Model details The LFM3 family includes base, text, vision, audio, omni, and decision models. Property Specification Checkpoint Post-trained, text-only language model Parameters 1.73B Architecture 24 layers: 13 gated short convolutions, 5 sliding-window attention, 6 global attention Context length 256K tokens (input + output) Vocabulary 128,000 tokens Languages English, Arabic, Chinese, French, German, Italian, Japanese, Korean, Portuguese, Spanish, Vietnamese, Thai, Indonesian, Hindi, Russian, Polish License LFM Open License v1.0 LFM3-1.7B is designed for local agents, tool calling, structured outputs, and domain-specific fine-tuning. Use retrieval or search for knowledge-heavy tasks. It is not recommended for agentic coding or complex multi-step reasoning due to its small size. more LFM3 to enjoy today: (my initial idea was to create 2 posts but they released six models) https://huggingface.co/LiquidAI/LFM3-VL-2B https://huggingface.co/LiquidAI/LFM3-VL-2B-GGUF LFM3-VL-2B is a vision-language model for on-device visual understanding . It takes text, images, and video as input, and combines the LFM3 language model with a new in-house vision encoder. New in LFM3-VL-2B: Video understanding: the first LFM vision model that takes video as input. Ask questions about a recorded lecture, a walkthrough filmed on your phone, or a clip from a camera feed. Thinking: the model reasons step by step before it answers. This helps most with harder visual questions, such as math, charts, and multi-step problems. Spatial and embodied reasoning: the model finds objects and reasons about how they are placed relative to each other, a strong foundation for robotics applications. https://huggingface.co/LiquidAI/LFM3-Audio-2B LFM3-Audio-2B is a compact, fully featured audio model that runs locally on laptops and edge devices . It takes text or audio as input and responds with text, speech, or both. Voice chat: ask questions aloud and receive streaming replies in text and speech. For text-only responses, the model can reason before answering. Multilingual speech: transcribe, synthesize, and translate speech across 18 languages. Audio understanding and reasoning: interpret recordings and answer questions about the speech, sounds, and events they contain. Tool calling: turn spoken requests into tool calls to control apps and devices, with text or speech alongside the calls. LFM3-Audio-2B introduces an in-house audio encoder and LiquidCodec audio tokenizer, improving speech quality over LFM2.5-Audio. https://huggingface.co/LiquidAI/LFM3-Omni-2B LFM3-Omni-2B is Liquid AI 's first omni-modal model in the LFM3 family: a single end-to-end model that understands text, images, video and audio , and answers in text and speech . It is built for on-device use: one model replaces a separate ASR model, vision-language model, LLM and TTS model. Any input, text or speech output: ask about a photo by voice, transcribe or translate speech, chat out loud, or ask questions about a video and its soundtrack together. Watches and listens together: for videos with sound, the model sees and hears them at the same time, so it can answer questions that need both. Small enough for devices: at 2.2B parameters, it is designed to run efficiently on phones, laptops and other edge hardware. https://huggingface.co/LiquidAI/d1-Omni-2B d1-Omni-2B is a decision model for text, pictures, and audio , built on LFM3-Omni-2B . It returns calibrated answers in one forward pass, without generating tokens. Native audio: clips and spoken questions go through the same pass as text and pictures, and spoken questions score within 0.5 points of written ones on unseen tasks. Beyond classification: it also extracts text, numbers, and dates with their span, locates objects in pictures, and estimates quantities with an interval. Millisecond decisions: 5.8 ms per decision on an NVIDIA H100 and 3.7 ms on an AMD MI325X, or 12.4 ms and 8.2 ms with a 10-second clip. https://huggingface.co/LiquidAI/d1-2B d1-2B is a decision model for text, pictures, and video , built on LFM3-VL-2B . It returns calibrated answers in one forward pass, without generating tokens. Best-in-class: it leads the open d1 models on average and on our board of over a hundred decision benchmarks, ahead of d1-3B at under two thirds of its size. Beyond classification: it also extracts text, numbers, and dates with their span, locates objects in pictures, and estimates quantities with an interval. Millisecond decisions: 5.7 ms per decision on an NVIDIA H100 and 3.8 ms on an AMD MI325X, with any number of questions about one state in one call. https://huggingface.co/LiquidAI/LFM3-1.7B-Base LFM3-1.7B-Base is the pre-trained checkpoint behind LFM3-1.7B , a text model for local agents and specialized applications based on our new tri-hybrid architecture. Pre-trained on 22T tokens: the last 3.5T tokens are curated mid-training data with agentic traces and tool calls, and extend the context window to 256K tokens. Designed for the edge: at 4-bit precision, it takes about 1 GB of memory, so it fits on any phone or laptop. Made to be specialized: a starting point for continued pre-training and your own post-training. llama.cpp support has been merged: https://github.com/ggml-org/llama.cpp/pull/31257 https://github.com/ggml-org/llama.cpp/pull/31252 https://github.com/ggml-org/llama.cpp/pull/31275 submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

★ Ling-3.1-flash-1019 weights are out, and they released the base model too

/u/BerryBlush_Rogers691 — Wed, 28 Oct 2026 00:00:00 +0000

96% · Measured result 96%, Usable today 93%

Well, “coming soon” turned out to be five days. I posted the earlier announcement last week. The 1019 weights are now on Hugging Face . Still 560B total, 25B active, with a 1M context window. This is the update they reported at 44 on the AA Intelligence Index v4.3.2, up from 41. AutomationBench-AA went from 62% to 68%, according to the release. They also put out Ling-3.1-flash-base in BF16 for further training. Glad they included that. It gives people a starting point for their own post-training instead of having to start with the finished chat model. One small gotcha: the SGLang example in the 1019 README currently still points to inclusionAI/Ling-3.1-flash . Change the model path to inclusionAI/Ling-3.1-flash-1019 if you're copying that command for the new checkpoint. submitted by /u/BerryBlush_Rogers691 to r/LocalLLaMA [link] [comments]

★ Artificial Analysis Intelligence Index v5 (major update)

/u/ResearchCrafty1804 — Wed, 28 Oct 2026 00:00:00 +0000

95% · Measured result 95%, First-party 69%

Artificial Analysis Intelligence Index has been updated to v5, which according to them is a major upgrade resulting in a more accurate ranking. Notably, this update widens the gap between open-weight models and closed ones. Some people already questioning its accuracy based on their experiences with models (GPT-Terra-6.1 > Fable-5.1). Also, this update, v5, has 60% of the Index based on evaluations with private test sets or held-out answers, which makes reproducing the results impossible. From their announcement: “The open weights gap widens from 3 points to 12: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 46. Among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32 - 26 points behind the leader and below Claude Haiku 5.5 (max, 36)” submitted by /u/ResearchCrafty1804 to r/LocalLLaMA [link] [comments]

★ Krea2 BBOX models have finished training and been released

/u/Amazing_Painter_7692 — Wed, 28 Oct 2026 00:00:00 +0000

95% · Usable today 95%, First-party 31%

Epoch 20 was reached early this morning. I have released the following models: Raw Raw EMA 0.9995 Raw EMA 0.99975 Turbo Turbo EMA 0.9995 Turbo EMA 0.99975 Extracted LoRA models (rank 64, 128, and 256) for all the models above. All models are released in both diffusers and comfy format. The EMA models might be slighter higher quality do to smoothing, but may also be less performant in terms of BBOXes. The raw models are provided for training purposes and should allow you to train multi-character LoRAs, following the formatting given in the prompting guide. I have not tried multi-character LoRA yet, but given Ideogram4, it should be easily possible. The models are available at: https://huggingface.co/jimmycarter/krea2-turbo-bbox The latest checkpoint of the turbo model is available for free to try on huggingface spaces: https://huggingface.co/spaces/jimmycarter/krea2-turbo-bbox-canvas submitted by /u/Amazing_Painter_7692 to r/StableDiffusion [link] [comments]

★ New 14‑inch MacBook Pro with M6

beex — Wed, 28 Oct 2026 00:00:00 +0000

95% · First-party 95%, Usable today 56%

Article URL: https://www.apple.com/in/newsroom/2026/10/apple-introduces-the-new-14-inch-macbook-pro-with-m6/ Comments URL: https://news.ycombinator.com/item?id=50261352 Points: 343 # Comments: 443

★ OpenHeronBrowser – a new browser engine in Rust, built with Claude. Acid3 97/100, runs Discord, VS Code for the Web, and Windows 1.01 in v86

/u/marissatech_ — Wed, 28 Oct 2026 00:00:00 +0000

94% · Measured result 94%, Usable today 45%

submitted by /u/marissatech_ to r/artificial [link] [comments]

★ NVIDIA just open-sourced an AI that can generate character movements at insane speeds. It's called MotionBricks, and it can generate motion at 15,000 FPS with just 2ms latency.

/u/Lord_44th__Raikage — Wed, 28 Oct 2026 00:00:00 +0000

93% · Measured result 93%, Usable today 48%, First-party 37%

submitted by /u/Lord_44th__Raikage to r/accelerate [link] [comments]

★ Claude Code reverse-engineered the Xbox 360 kernel and wrote a native driver so Series X|S controllers work on it

/u/Hot-Ad2974 — Wed, 28 Oct 2026 00:00:00 +0000

90% · Usable today 90%

Microsoft's Xbox Wireless Adapter (the USB dongle for Series X|S controllers) has never worked on an Xbox 360. It's a MediaTek Wi-Fi chip that relies on the host for everything: firmware upload, radio setup, pairing, an ECDH security handshake and Microsoft's GIP controller protocol. On PC that's Microsoft's driver, on Linux it's xone. The 360 had nothing. I wanted it on my modded 360 (kernel 17559), so I built it with Claude Code. It's free and open source (GPL-3.0) : https://github.com/Jacckii/Xbox360-Series-Controllers-Native What it does: up to 4 Series X|S controllers connect wirelessly to the 360 as normal controllers, with rumble and a working Guide button, in the dashboard and in games. It loads at boot, just Microsoft's own adapter, nothing in between. What Claude did Reverse-engineered the 360 kernel's undocumented USB stack (Usbd) and XAM's input path in Ghidra through an MCP server: the runtime USB class-driver list, transfer block layouts, which callbacks run on which DPC, and the callback table XAM uses for the Guide button Ported xone's MT76 radio code, pairing, ECDH P-256 handshake and GIP protocol into portable C, and wrote the 360 side as a kernel-mode system DLL Wrote PowerPC function hooks (instruction relocation into trampolines) to feed the controllers into XInput Debugged it on the live console by reading memory over the debug monitor Bugs it tracked down The toolchain saves registers as 32-bit values, the kernel expects 64-bit ones → asm thunks around every kernel callback Kernel DPCs have no floating-point context, but variadic functions spill FP registers anyway → soft-float, plus a build check that fails on any FP instruction Pressing Guide deadlocked the console: the thread feeding XAM input was also calling into XAM → every XAM call moved to its own thread on another hardware thread The driver thread starved while the guide was open → it found the kernel clamps system threads to priority 9 and raised the driver to that An adapter plugged in before boot was ignored → it found the kernel's list of unclaimed USB devices and the routine that offers them to drivers again How the workflow went Give it eyes on the target. The driver writes a status block and a log ring into memory, and Claude read them over the network after every test. Give it the right tools. Ghidra MCP for the kernel, the cross-compiler, and the console's debug port. It ran the build → upload → read logs loop on its own. Make mistakes fail the build. Each rule it learned the hard way became a check in the build script, so fixed bugs stayed fixed. I was the hands. Plugging the dongle, pairing controllers, rebooting the console when it hung, and describing what was on screen. I released it on r/360hacks a few hours ago ( thread here ), and a couple of people are ordering adapters to test it with their own controllers. Still early, so feedback is welcome. submitted by /u/Hot-Ad2974 to r/ClaudeAI [link] [comments]

Here is my submission for ComfyUI’s Open Source Higgsfield challenge: Openjutsu, one-click character swap for videos, fully local using Minimax H3 only

/u/Devajyoti1231 — Wed, 28 Oct 2026 00:00:00 +0000

89% · Usable today 89%

I mostly used claude to build Openjutsu, a free, local version of Higgsfield’s Genjutsu character swap, for Comfy’s Open Source Higgsfield challenge. Repo (MIT): https://github.com/D3voz/openjutsu What it does Upload a video and a picture of the person you want in it, then press Run. It finds the person, swaps them in clip by clip and keeps the original audio. There are also modes for: Object swap (change or remove an object, or change the background) From picture (put a person and a setting from one image into a video) Fix faces and Fix colours as post-processing How it’s built A Next.js web app that talks to ComfyUI through u/comfyorg /sdk and comfy-api-proxy MiniMax H3 does the video generation Qwen3-VL 8B looks at the frames and writes the prompts automatically SAM makes a mask of the person in each clip Long videos are split into overlapping clips and joined back together Setup Install the custom nodes and models listed in the README, start ComfyUI, then double-click start_openjutsu.bat . Before each run, the app checks that you have every node and model it needs. If something is missing, it tells you where to get it. Feedback and bug reports are welcome! If you are getting any errors- Update comfyui-h3-oneclick-swap. git pull Openjutsu. Restart ComfyUI so it loads the new node, then restart Openjutsu. submitted by /u/Devajyoti1231 to r/StableDiffusion [link] [comments]

Ghostty 1.4

deaux — Wed, 28 Oct 2026 00:00:00 +0000

89% · First-party 89%, Usable today 78%

Article URL: https://ghostty.org/docs/install/release-notes/1-4-0 Comments URL: https://news.ycombinator.com/item?id=50261998 Points: 946 # Comments: 294

llama.cpp b11946

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

87% · Usable today 87%, First-party 84%

server : add realtime conversation and transcription on /v1/realtime ( #31269 ) server : add realtime conversation and transcription on /v1/realtime Co-authored-by: Xuan Son Nguyen son@huggingface.co Assisted-by: Claude Opus 5.5 examples : default the realtime client to the server port 9931 Assisted-by: Claude Opus 5.5 server : sample realtime responses right after their own decode Slots respond in turns on one context: sampling at the start of the next step read the logits of whichever slot decoded last, so concurrent sessions mixed their outputs. Assisted-by: Claude Opus 5.5 move more stuff to server-realtime, making it self-contained examples : fix the type check of the realtime client Assisted-by: Claude Opus 5.5 examples : use the model card prompts in the realtime client Assisted-by: Claude Opus 5.5 Co-authored-by: Xuan Son Nguyen son@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60644875 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

New iMac with M6

notfried — Wed, 28 Oct 2026 00:00:00 +0000

86% · First-party 86%, Usable today 56%

Article URL: https://www.apple.com/imac/ Comments URL: https://news.ycombinator.com/item?id=50258538 Points: 324 # Comments: 410

Week 13 of making fishing and exploration game - demo almost finished

/u/RUSuper — Wed, 28 Oct 2026 00:00:00 +0000

85% · Measured result 85%, Usable today 49%

Hello there again :) This is Week 13 of me posting this "dev log" so to say and explaining how I do things and talking about progress. While "exploration" mechanic was added one week ago, I was finally able to make it feel like a proper completely equal part to fishing segment of the game. And with "Ship in a bottle" collection done to 29 out of 40 total ships I'm happy how this progress. As always weekly progress can be seen on my profile. DEMO DOWNLOAD - FREE Demo doesn't really have everything newest and most polished so you might not have ships in the bottles, that version is being kept for steam release which I will do once steam approves my ID verification (it already is exactly 1 month). Zone 1 out of 5 (demo) is almost entirely done, some smaller polish parts and bug fixes are left. What was done this week: This week I added curios, rarest ship in the bottle is actually cracking the walls of the bottle when shooting cannons and all the items in zone 1 are adjusted manually where they gonna drop or how they are earned. etc. Some zones were a bit improved as can be seen in the video to not look too boring even though there is no gameplay there. Engines with their own sounds were added and can be seen when changed. Cabinet new 3D scene with collections was fully fixed in terms of lighting and small island dioramas were made. As I mentioned before 29 of 40 ships in a bottles were created with textures and added to bottles. This time while still using Decisions.md like before that tags every decision in the game with [USER] or [PROPOSED] (By AI) And User ones have priority over proposed ones, helps with AI hallucinations in the project where AI can't gaslight you into telling you something was decided by you if it really wasn't (it has more than 350 decisions by now). I switched workflow a bit. This time I tried doing something else instead of my old "manager" session managing other sessions and sending them tasks. I created "Effort" sessions (Medium to Max) and have Jev decide which tasks goes into which effort level and then just "manager session" sending it to different effort levels and doing it this way. Though this is polish stage and not much was done it is hard to say if this is more token efficient than before, in general I feel no difference in quality or token usage than with my previous workflow, though that is just subjective feeling, somebody could test it properly I guess. Jev basically scans every task I give to my Claude sessions and just decides which effort certain tasks deserve. Models were made by TripoAI and Opus 5.5 via Blender MCP mostly for this week. It can be seen in the video. For example rarest ship that is inspired by Black Pearl and shoots cannons in the bottle was done in TripoAI then fixed a bit in Blender by Opus 5.5 . I do not use anymore any other AI other than Claude Opus 5.5 , no more Astra and didn't even try Gemini sadly, for now Opus is more than enough for my needs. People have asked me how I make textures and those are either directly done by ChatGPT using OpenAI API key provided to Opus 5.5 or in TripoAI , those done in Tripo are 1k textures as I don't need any heavier ones as they take a lot of memory. Total cost: Claude Max 200$ x 3 = 600$ Astra 100$ x 1 = 100$ ElevenLabs x 11$ = 11$ TripoAI 20$ x 2 = 40$ OpenAI API credits 70$ = 70$ Other things I forgot about 100$ = 100$ (around) Around 900-950$ Disclosure: I’ve been writing these devlogs since Week 1. Since Week 8, Tripo has been supporting them (paid collaboration + a gifted Max plan). That’s why my cost breakdown no longer includes Tripo (Except what I paid from my own pocked for first 8 weeks). If you’re doing this yourself, add their plan to the total. submitted by /u/RUSuper to r/ClaudeAI [link] [comments]

From impulse purchase to pocket studio: The M-Vave FM-1

Ars Technica — Wed, 28 Oct 2026 00:00:00 +0000

85% · Usable today 85%

A low price, high coolness factor, and a robust community intent on expanding the device's abilities all make this product a no-brainer for a specific type of synth hobbyist: arstechnica.visitlink.me/td5EvX Linked page: M-Vave's cheap FM-1 pocket synth has exploded as a community firmware playground.

Tailscale SSH: Investigation and remediation update

figmert — Wed, 28 Oct 2026 00:00:00 +0000

85% · First-party 85%

Article URL: https://tailscale.com/ssh-investigation-update Comments URL: https://news.ycombinator.com/item?id=50264857 Points: 263 # Comments: 135

Early progress on accelerating drug development with Claude

dataking — Wed, 28 Oct 2026 00:00:00 +0000

84% · First-party 84%

Article URL: https://www.anthropic.com/research/early-progress-drug-development Comments URL: https://news.ycombinator.com/item?id=50265609 Points: 207 # Comments: 181

Genie 4

acossta — Wed, 28 Oct 2026 00:00:00 +0000

84% · First-party 84%

Article URL: https://deepmind.google/blog/genie-4-a-new-generation-of-world-simulation/ Comments URL: https://news.ycombinator.com/item?id=50261319 Points: 850 # Comments: 499

ollama v0.40.12

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

84% · First-party 84%, Usable today 83%

Liquid AI LFM3 LFM3 is Liquid AI's new family of small models built for local agents, tool calling, and structured output, on Liquid's new tri-hybrid architecture. The family includes: lfm3 : a 1.7B text model with a 256K-token context window lfm3-vl : adds image understanding lfm3-audio : speech recognition, translation, and text-to-speech in 18 languages lfm3-omni : text, images, and audio in one model ollama run lfm3 d1 decision models Liquid AI's d1 models now come in a 2B size, built on LFM3. d1 makes decisions about text and images, and d1-omni adds audio. ollama run d1:2b " I was charged twice for order 4417. " --ask " Is this a billing issue? " Note: lfm3 and d1 2b are supported on Apple hardware in this release. Support for Linux/Windows coming soon. What's Changed Faster prompt processing on Apple silicon for Gemma 4, Flint and Laguna models Speculative decoding now supports DFlash2 draft models on MLX Gemma 4 keeps more detail in small images ollama launch now works with OpenCode v2 Fixed tool-only assistant turns from Kimi CLI Updated MLX and llama.cpp Full Changelog : v0.40.11...v0.40.12

llama.cpp b11944

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

84% · First-party 84%, Usable today 82%

server: expose the reasoning effort levels of the chat template ( #31271 ) server: expose the reasoning effort levels of the chat template The capability probe renders a user turn for each candidate level (minimal, low, medium, high, xhigh, max) and for an unknown level. A level is honored when it renders without raising and differently from the unknown level, which shows the template fallback. Levels sharing a render are aliases and the highest one is kept. The caps serialize to JSON, and chat_template_caps in /props reports the list as reasoning_effort_levels, from lowest to highest. jinja: keep the caps free of the json dependency The caps keep reporting their flags as a map, and the effort levels stay a plain member. common_chat_templates_get_caps() builds the JSON the server reports from both, so jinja depends on json only for the probe inputs. Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60638014 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11941

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

84% · First-party 84%, Usable today 79%

model : add LiquidAI/LFM3-Audio-2B and LiquidAI/LFM3-Omni-2B ( #31257 ) model : add LiquidAI/LFM3-Audio-2B and LiquidAI/LFM3-Omni-2B Co-authored-by: Xuan Son Nguyen son@huggingface.co Assisted-by: Claude Opus 5.5 convert : read the LFM3-Audio config.json as released A transformers that knows lfm3_audio rewrites the config into another layout (no lfm/encoder keys). Assisted-by: Claude Opus 5.5 mtmd : disable flash attention for the LFM3-Audio depthformer Assisted-by: Claude Opus 5.5 tts : add a voice option for LFM3-Audio and LFM3-Omni The model card offers a female and a male voice; --tts-voice for llama-tts, "voice" for the server /tts. Assisted-by: Claude Opus 5.5 clean up template handling convert : detect LFM3-Audio and LFM3-Omni by model_type Assisted-by: Claude Opus 5.5 move banned tokens --> logits bias --> mtmd_helper leave mtmd-cli unchanged no more template_asr_system left over llama : keep the LFM3-Audio encoder convs and codec unquantized Assisted-by: Claude Opus 5.5 common, mtmd : shorten comments Assisted-by: Claude Opus 5.5 Co-authored-by: Xuan Son Nguyen son@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60633440 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11936

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

84% · Usable today 84%, First-party 72%

llama : build the k-pool sparse selection independently of the kq_mask shape ( #31243 ) llama : build the k-pool sparse selection independently of the kq_mask shape qwen4exp (QSA) and glm5-next pick cache cells by index and no longer read the kq_mask values, but they still shaped the selection like the dense kq_mask. Build the selection as [n_kv, n_tokens] over the cache cells instead, and split it into the streams of the K view right before the attention. This lets the dense mask change its layout (e.g. per-sequence row lists) without touching the sparse layers. improve comment Co-authored-by: Georgi Gerganov ggerganov@gmail.com llama : drop the unused build_fused_top_k_mask args, review nits Co-authored-by: Georgi Gerganov ggerganov@gmail.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60550938 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

I am a King, but local 😂

/u/perelmanych — Wed, 28 Oct 2026 00:00:00 +0000

83% · Measured result 83%

I am feeling like a mighty local King spinning two Strata engines with 70tps each whole day and using 12M tokens a day. Also me scrolling twitter and stumbling upon a post saying that poteto uses 34M tokens per minute 🤪 Upd: Guys are interested who is she and what she is doing with all these tokens. Poteto is her twitter nickname and she worked in Cursor before XAI has acquired them and now she is shipping 2,500 PRs per month to Cursor and GrokBot. submitted by /u/perelmanych to r/LocalLLaMA [link] [comments]

baidu/Unlimited-OCR-2 · Hugging Face

/u/pmttyji — Wed, 28 Oct 2026 00:00:00 +0000

83% · First-party 83%, Usable today 68%, Measured result 34%

Release [2026/10/27] 🚀 We release Unlimited OCR 2 , achieving unlimited-horizon parsing with SR-SWA. What's New in 2 Sparse Reference Sliding Window Attention (SR-SWA): Compresses text-visual attention interactions from ultra-long sequences down to a fixed-size set of working references (e.g., 512 tokens). This bounds computational complexity, keeping per-step decoding latency and memory footprint nearly constant regardless of document length. From Long- to Unlimited-Horizon Parsing: Powered by SR-SWA, Unlimited-OCR 2 achieves true, unbounded document parsing within a finite context window—effectively eliminating quadratic attention scaling and memory bottlenecks as documents grow. Ultra-Long Document Parsing SOTA: Achieves state-of-the-art performance across both dozens-of-pages benchmarks (e.g., MPDocBench) and extreme hundred-page benchmarks (e.g., MarathonDocBench). submitted by /u/pmttyji to r/LocalLLaMA [link] [comments]

llama.cpp b11940

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

83% · First-party 83%, Usable today 82%

common : support deferred tools and tool_reference content parts ( #31256 ) common : support deferred tools and tool_reference content parts Assisted-by: Claude Opus 5.5 common : credit the deferred tools co-author Co-authored-by: Aldehir Rojas 765227+aldehir@users.noreply.github.com Assisted-by: Claude Opus 5.5 tests : fix the type check of the deferred tools test Assisted-by: Claude Opus 5.5 Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60626465 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Real-time video captioning with LFM3-VL-2B running locally in-browser on WebGPU

/u/xenovatech — Wed, 28 Oct 2026 00:00:00 +0000

82% · Usable today 82%

Collection on HF: https://huggingface.co/collections/LiquidAI/lfm3 WebGPU demo: https://huggingface.co/spaces/webml-community/LFM3-VL-2B-WebGPU submitted by /u/xenovatech to r/LocalLLaMA [link] [comments]

llama.cpp b11935

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

82% · Usable today 82%, First-party 79%

rpc : catch std::length_error in recv_msg ( #31204 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60485441 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11945

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

81% · First-party 81%, Usable today 81%

model : add LiquidAI/d1-2B and LiquidAI/d1-omni-2B ( #31275 ) model : add LiquidAI/d1-2B and LiquidAI/d1-omni-2B Assisted-by: Claude Opus 5.5 convert : keep the speech task templates out of the d1 GGUFs Assisted-by: Claude Opus 5.5 small refactoring: no_batching Co-authored-by: Xuan Son Nguyen son@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60641357 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

vllm v0.33.0rc0

LucasWilkinson — Wed, 28 Oct 2026 00:00:00 +0000

80% · First-party 80%, Usable today 60%

[Bugfix][MRV2] Skip adaptive verification cost profiling in the CUDA …

llama.cpp b11934

github-actions[bot] — Wed, 28 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 79%

tests : speed up tensor data generation and model saving ( #31145 ) tests : speed up tensor data generation and model saving Refactor save_models to create only the model, not a llama_context, which is not needed for saving. Replace the slow std::normal_distribution draw with a splitmix64 + box-muller normal generator. Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF (Mac Studio, M2 Ultra, 192GB) tests : use a shared pool of normal draws for tensor data Generate a pool of normal draws once with std::mt19937 and std::normal_distribution, then have every tensor copy a cyclic slice of it instead of running a per-tensor box-muller. The name-keyed slice selection keeps the draw deterministic. Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF (Mac Studio, M2 Ultra, 192GB) tests : log the size of saved models Report the produced file size in bytes and MB after each save. Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF (Mac Studio, M2 Ultra, 192GB) tests : simplify the model save log Put the model name, target and size on one line per saved model. Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF (Mac Studio, M2 Ultra, 192GB) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60447535 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

★ Introducing Kimi K3.1 Pro

Tue, 27 Oct 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 91%

Introducing Kimi K3.1 Pro Kimi K3.1 Pro landed on the Kimi API today - it's not yet open weights, but Moonshot promise "Full model weights will be released by Nov 4, 2026". They're also offering a "Highspeed" version that's 2-3x faster, at twice the price (except for input token cache hits, which are priced the same). The US dollar pricing is $2.00/million tokens for input and $10/million for output - the same as GPT-6.1 Sol and half the price of Claude Opus 5.5. Moonshot's own benchmarks show Kimi as approximately level with Opus 5.5 and GPT-6 Astra - beating them on a few benchmarks, coming close on others. Artificial Analysis scored Kimi at 55 - ahead of Claude Fable 5.1, GPT-6 Astra, and Gemini 4 Argon (all at 53) and behind only Claude Opus 5.5 (58). This is the first time a (soon-to-be) open weight model has scored this highly against the frontier. I tried it out via the Moonshot API using the llm openai endpoint command I added to LLM 0.32 back in August: llm openai endpoint \ https://api.moonshot.ai/v1 \ --key kimi \ -m kimi-k3.1-pro \ "Generate an SVG of a pelican riding a bicycle" \ --responses \ -o reasoning_effort low \ > kimi-k3.1-pro-pelican-low.stdout.txt \ 2> kimi-k3.1-pro-pelican-low.stderr.txt llm openai endpoint can run prompts against any OpenAI-compatible endpoint but doesn't log the results, hence the extra options to save stdout and stderr (the reasoning trace). Here are the pelicans I got for Kimi K3.1 Pro on the three reasoning levels it supports - low, medium, and max. This is max: For comparison, I ran fresh pelicans against Kimi K3 on those three reasoning levels. Via Hacker News Tags: ai , generative-ai , llms , llm , llm-pricing , pelican-riding-a-bicycle , llm-release , ai-in-china , moonshot , kimi

★ tencent/Hy-SimulMT-30B-A3B · Hugging Face

/u/jacek2023 — Tue, 27 Oct 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 89%, First-party 40%

https://huggingface.co/tencent/Hy-SimulMT-30B-A3B-GGUF https://huggingface.co/tencent/Hy-SimulMT-30B-A3B-Interleave-GGUF Hy-SimulMT is a real-time simultaneous translation model developed by Tencent Hunyuan, supporting bidirectional speech-to-speech translation between Chinese and English . It continuously receives incoming audio and translates as the speaker talks, producing both translated text and speech. With real-time voice cloning , it preserves the speaker's vocal characteristics while conveying the message accurately. Designed for live communication settings such as meetings, speeches, and interviews, Hy-SimulMT aims to convey information accurately while reducing the disruption that waiting introduces into a conversation. To evaluate this balance between translation quality and response speed, we combine public benchmarks, real-world audio, and comparisons with professional simultaneous interpreters. In our RealSI long-form audio evaluation , Hy-SimulMT achieved a StreamLAAL of approximately 3 seconds , the lowest among the systems shown in the comparison. Its GEMBA score exceeded those of the compared open-source models and four of the five commercial APIs. The GitHub repository provides the SimulInfer inference service and SimulTrain training tools . Speech output and voice cloning require a configured TTS service. You can also try Hy-SimulMT in the Hy Translate App . submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

★ GPU unlocks (FP32 accumulation): Why can it be unlocked on Turing (RTX 20), Ampere (RTX 30) and Ada (RTX 40) but no consumer Blackwell (RTX 50) and some misconceptions.

/u/panchovix — Tue, 27 Oct 2026 00:00:00 +0000

95% · Measured result 95%, Usable today 38%

Hello guys, hoping you're doing fine. Wall of text next I know, but I want to get this info out of my chest, all hand written lol. I wanted to make this post explaining some things about GPU unlocks that have been going on lately. What are these GPU unlocks doing? NVIDIA on purpose neuters tensor core performance when using FP32 accumulation (FP16, BF16, FP8 and TF32 inputs accumulating in FP32, which is what most AI/LLM/ML tasks use), for market segmentation. Normal FP32 on the CUDA cores (no tensor cores) is NOT affected. Consumer and prosumer GPUs use the exact same die (like GB202 between the 5090 and 6000 PRO, AD102 between the 4090 and 6000 Ada, or even literally 1:1 with the 3090 Ti vs A6000, both with the same core amounts and 84 SMs). How it works: the speed of each kind of tensor operation is set by fuses burned at the factory. On consumer cards, the fuse for "FP16/BF16 with FP32 accumulation" says HALF_SPEED, on the pro cards it says FULL_SPEED. These fuses don't cut any circuit, the GPU just reads them at boot and runs at that speed. The GPU also has an override register that can set them back to FULL_SPEED, but it's locked so only NVIDIA's most privileged firmware can write to it, not your PC. The unlocks open that lock and write FULL_SPEED on the override. With that, the consumer cards gain all the neutered performance imposed by NVIDIA. It doesn't give you more SMs, VRAM or anything like that, a 4090 is still a 4090, it just runs those instructions at the same rate a pro card does. Why can Turing, Ampere and Ada be unlocked? And what is unlocked on these cards? On these generations, the NVIDIA driver itself loads a small NVIDIA-signed firmware called the "Booter" onto a security microcontroller inside the GPU (SEC2, a "Falcon"), to start the GSP. The Booter runs in the highest privilege mode of the GPU (Heavy Secure, HS), which is exactly the one allowed to open the lock. In June 2026, Jon Pry published a paper ("A Canary in the Crypto Mine") showing that the Booter of the newer drivers has a buffer overflow: it copies its "signature" data using a length that you control, so you can overflow its stack (including the stack canary that is supposed to stop exactly this) and take control of the Booter while it is running in HS mode. The signature check still passes, because it is NVIDIA's own signed code running, the bug is inside it. With that, the unlock reuses instructions from NVIDIA's own Booter to open the lock, writes FULL_SPEED on the override, resets the card and lets the normal NVIDIA driver load. The unlock survives resets and driver reloads, but it's lost when you power off, which is why it runs on every boot before the NVIDIA driver loads. This was first done on mining cards (CMP 170HX: FP32 from 1/32 to full speed, and 10GB to 80GB of VRAM), and then ported to GeForce: Turing: https://github.com/haohervchb/Turing-unlock (UEFI, Linux) Ampere: https://github.com/Zagitta/gpu-unlock (Linux kernel module) Ada: https://github.com/JustAResearcher/gpu-unlock-ada (Linux with kernel module) What gets unlocked: FP16 with FP32 accumulation (Turing, Ampere, Ada) BF16 with FP32 accumulation (Ampere, Ada; Turing has no BF16) TF32 (Ampere, Ada) FP8 with FP32 accumulation (Ada; Turing and Ampere have no FP8) Some numbers from those repos: 4090 FP16/BF16 with FP32 acc goes from 165 to 331 TFLOPS (raw instruction rate), 3090 Ti BF16 GEMM from 87 to 157 TFLOPS, 2080 Ti FP16 with FP32 acc from 47 to 94 TFLOPS. Real-world GEMMs gain less than 2x because the cards then hit their power limit (more on that below). Why can't consumer Blackwell be unlocked? The funny part is that on Blackwell the limitation is EXACTLY the same thing: same fuses, same override registers. I checked on my own cards: the 5090/5080/5070 Ti have the FP32 accumulation fuses set, and the 6000 PRO/4000 PRO don't. So it's not a hardware difference there either. What changed is the door. Starting with Hopper, and consumer Blackwell too, the root of trust of the GPU is the FSP (Foundation Security Processor), a RISC-V core that boots from its own ROM as soon as the GPU powers on, before the driver even loads. On Blackwell: There's no Booter to abuse. The driver just sends the FSP a message with a hash + RSA-3K signature of the next firmware, and the FSP verifies and boots it. The Linux kernel docs literally say: "There is no SEC2 involvement, no Booter ucode, and no FWSEC-FRTS stage". I also checked it myself: in NVIDIA's 615 driver source the Booter only exists for Turing, Ampere and Ada (TU102, TU116, GA100, GA102, AD102), and the RTX 50 VBIOSes don't carry the Falcon firmware (FWSEC) that older cards did. The firmware the driver ships for Blackwell is encrypted, and the debug and production images are the exact same encrypted bytes. The Ada payload was built from analysis of the decrypted debug Booter, on Blackwell there's no such shortcut. NVIDIA has said it uses SPARK (a formally verifiable programming language) to prove its most critical RISC-V firmware free of runtime errors, and a buffer overflow like the one used on the older cards is exactly that kind of error. So, with what is known today, it can't be done. It isn't "impossible forever", but someone would need a brand new vulnerability in a way harder target. And if someone ever gets there, the unlock itself would very likely be the same couple of register writes. FP4 is not affected, but all the rest is (FP16/BF16/FP8/TF32 with FP32 accumulation). In which tasks is the unlock has most of the effect? I will put some examples on my 6000 PRO vs 5090s, former using 400W and latter 600W, at how much is the impact in performance because the NVIDIA neutering. Training: Like LoRAs, finetuning, etc. Example: Using the same batch size for 25GB VRAM to train a diffusion LoRA, my 6000 PRO is 70-90% faster than my 5090. Diffusion: Models that do txt2img, txt2vid, img2img, img2vid, txt2aud, etc. Example: My 6000 PRO not using fp16 accumulation is about 30-40% faster than my 5090. If using fp16 accumulation, it is 15% faster. Prefill on LLMs: Heavily affected as well, since even when a model is marked as "int8" or "mixed precision" etc, the inference parts that the GPU uses include FP32 accumulation parts, except if explicitly set to not use them. Example: My 6000 PRO on vLLM on a model that fits on a 5090 as well, it's 50-70% faster. On llamacpp, instead is about 30-40% faster. TG with big batching: TG with a single batch is mostly bandwidth bound, and it uses FP32 acc instructions, but since it is so little in comparison with the need of bandwidth, it isn't a limitation. On the other hand, when you use batches with batch size 2, 4, 8, etc, compute again starts to being a bottleneck and then you have a performance impact. Example: Same results as previous point. In which tasks the unlocks makes no difference: TG with batch size 1: almost entirely bandwidth bound. CUDA compute without tensor cores (normal FP32). INT4/INT8 tensor operations. FP4 on Blackwell (not neutered to begin with). GEMM operations with FP16 accumulation instead, but those aren't very used. Gaming. Is there a risk by unlocking the cards, like burning the card, crashes, etc? Short answer: NO. And again, NO. For the love of god guys, stop repeating this nonsense. The cards are still limited by their max power limit. They won't magically use 200% of your power budget with an unlock, they will just use the cores more efficiently. Let me explain: if you have a 3090 power limited at 300W, and without the unlock you were seeing only 250W in use, but after the unlock it uses 300W, it's not because the unlock did malicious things to your card. It's because the card can NOW stretch its legs and use the power to do more work. Real example from the Ada repo: an unlocked 4090 doing the same GEMMs peaked at 346W vs 313W stock, still under its 450W limit. If you were getting X performance at Y < max TDP, and now you get more than X performance at max TDP, obviously the card will be hotter, but that's still inside the POWER LIMIT YOU SET, not above it. Power spikes: those are normal on every card, and if you're using it to the full extent of its capabilities they can be more common. Are they risky? No, assuming you have a PSU with the wattage NVIDIA recommends per GPU. So what ARE the actual risks then? They're about the unlock process, not your card: It runs an exploit on NVIDIA's firmware before the driver loads. If something fails mid-way, the tools stop and you need a full power off before trying again (a reboot isn't enough). Read the repo instructions, especially on laptops and multi-GPU setups. NVIDIA could patch it in future drivers, or even burn anti-rollback fuses so the old Booter stops being accepted. That wouldn't damage your card, it would just close the door for good. "But, NVIDIA bins the dies to make these work 24/7 on the prosumer side but not on consumer, that's why they're locked!!!11" Also incorrect. NVIDIA uses the EXACT SAME dies for their consumer GPUs and their prosumer GPUs, and the FP32 accumulation speed has nothing to do with binning: the 3090 Ti and the A6000 have the exact same specs. The half speed is just a value written in a fuse that the firmware reads. Unlocking a card will not make it die sooner, nor will it crack the die or something. Sorry I have to repeat this again and again, but the amount of pure fury I get from reading comments like these made me do this. Does affect gaming performance? None known at the moment, except if somehow NVIDIA uses FP32 accumulation for DLSS or FG, which I doubt. I'm almost sure they use FP16 accumulation (or lower precisions) there, because if they used FP32 accumulation the perf hit would be insane on consumer cards. The model I run says it is Q8, or FP6, or 4bit, or INT4, or anything that doesn't mention FP32, am I affected? It depends on how the GPU actually does the math, not on the name of the quant: If the kernel dequantizes the weights to FP16/BF16 and multiplies on the tensor cores with FP32 accumulation, you're affected. That's the case for FP16/BF16 models and most vLLM paths, including AWQ/GPTQ with Marlin kernels (the weights are INT4, but the math is FP16 with FP32 accumulation). FP8 (W8A8) also accumulates in FP32, so it's affected too (Ada and Blackwell). If the kernel uses integer tensor math (INT8 x INT8), it isn't affected. A lot of llama.cpp's quantized matmuls work like this, which is one reason llama.cpp sees a smaller gap than vLLM. Attention (like FlashAttention) almost always uses FP16/BF16 with FP32 accumulation, so long contexts get hit even on quantized models. FP4 (NVFP4/MXFP4) on Blackwell: not affected. Example: on a modded 48GB 4090, a quantized MoE model on an inference server got no gain at all after the unlock (0.98x on 8K prefill), while the FP16/BF16 matmuls doubled. That's what I have for now, if you guys have any more questions, let me know! submitted by /u/panchovix to r/StableDiffusion [link] [comments]

★ GPT-6.1 Terra

Tue, 27 Oct 2026 00:00:00 +0000

95% · Measured result 95%, Usable today 72%

GPT-6.1 Terra It's always interesting to note which aspects of a new model are emphasized in the release announcement. In the case of GPT-6.1 Terra, OpenAI went with visual reasoning and computer use: We’re introducing GPT-6.1 Terra , a fast, efficient model that combines detailed visual reasoning and precise computer use alongside clearer, more natural writing. A significant step up from GPT‑5.6 Terra, it excels at the communication and computer-based tasks that fill the workday, from drafting proposals and interpreting technical drawings to filling out forms and editing videos. Terra sits in the same position as Sonnet in the Anthropic model collection - not the cheapest or the most expensive, making it harder to decide when to use it. Computer use is a good example of a task that benefits from a less expensive model, since you might put it to work on automated, repetitive tasks. OpenAI's Ted Sanders provided some useful advice in a comment on Hacker News: In the case of GPT-6.1 Terra, I'd say Terra is probably better than Astra and Sol at technical communication, similar on vision and computer use (but much faster!), and a bit worse on most other things. For API developers, it's a nice midrange option if you want something cheaper than Sol but a lot smarter than Luna (especially for vision / computer use / communication). For subscribers, it's not a bombshell release - if you're hitting usage limits, maybe it helps you go a bit further, and if you want clearer communication or faster computer use, it can be a nice option to select. Here are the pelicans for the different reasoning levels. This pelican for "max" cost 11.3161 cents and took 4 minutes and 11 seconds: Here's a new comparison grid showing pelicans for every reasoning level of OpenAI's current frontier lineup: GPT-6 Astra, GPT-6.1 Sol, GPT-6.1 Terra, and GPT-6 Luna. GPT-6.1 Terra is priced at $1/million input tokens and $5/million output - almost half the price of GPT-5.6 Terra and GPT-6.1 Sol, and around 10x the price of GPT-6 Luna. Via Hacker News Tags: ai , openai , generative-ai , llms , llm-pricing , pelican-riding-a-bicycle , llm-release , gpt

★ I built a mod with Claude that turns Valheim into a city builder. It hit #1 on r/valheim

/u/Any-Explanation3814 — Tue, 27 Oct 2026 00:00:00 +0000

94% · Measured result 94%, Usable today 88%

press F7 and valheim turns into a city builder. vikings move in, pay taxes, want food and mead and leave if they dont get it. bosses live in camps and you storm them with your own army, every boss starts a new age with its own building style how claude helped: - wrote most of the c# code (bepinex + harmony patches into valheims own systems, settler AI, economy, houses that build themselves piece by piece out of real valheim building parts) - it could control the game through a little remote command file, so it built a town, took screenshots, checked if stuff looked right and fixed it itself - debugging: when a tester reported bosses chasing players into town and scouts getting stuck, claude found the causes and fixed both in one go - performance: it wrote an in-game benchmark, measured fps with 10 to 150 houses and found that merging finished houses for rendering gave the biggest boost (36 to 56 fps) - i did the design, testing and kept pushing it its completely free: nexus: https://www.nexusmods.com/valheim/mods/4613 thunderstore: https://thunderstore.io/c/valheim/p/RustyProductions/ValheimCityBuilder/ submitted by /u/Any-Explanation3814 to r/ClaudeAI [link] [comments]

★ I built an open source sky camera that Claude Code can actually run. Saturday night it caught 17 meteors and had them sorted before I woke up.

/u/Terrible_Award_2124 — Tue, 27 Oct 2026 00:00:00 +0000

93% · Usable today 93%, Measured result 92%

https://docs.openskycam.org/ Finding meteors on a sky camera used to mean scrubbing hours of night video, pulling frames by hand, labeling them, retraining a model, and starting over when it flagged every star. I built openskycam so Claude could do that part instead. It records a 4K camera pointed at the sky 24/7 and keeps the footage on your own disk. Workflows sample frames, run detection models, link detections into tracks (moving vs. stationary), and sort the hits into buckets: meteors, planes, fixed lights. Everything the website does is also an API call, and there's an MCP server, so Claude Code can drive all of it. What Claude does - Built the night workflow, which now runs every night as footage arrives - Reviews what comes in, looking at each detection and accepting or rejecting it - When the model kept calling stars flying objects, it built a dataset from the detections I had approved and retrained it. On nights it never trained on, star false alarms went from about half to 7%, and it still catches 90% of meteors - Every morning it tosses the junk and texts me the good ones. On cloudy nights it has the decency to say nothing What made it work with Claude Code The MCP server ships its own guides and skills (build-a-workflow, find-detections, verify-changes), so Claude learns the rules from the server, not from my prompts The guardrails are enforced by the server, not the prompt: no key can create keys, deletes show a preview and need confirming, and edits fail rather than overwrite a newer version Setup can run unattended: npm run setup -- --yes reads everything from .env and stops with the name of whatever setting is missing. A person still creates the Cloudflare tunnel, the sign-in app and the API keys Architecture checks in make check fail when Claude puts code in the wrong layer The video runs from 9:30 PM to 6 PM the next day: every meteor and plane overnight with its actual shot from the 4K camera, then every bird it spotted by day as a pink dot, with a close-up of the real bird every 10 detections. It ends with the whole run on one frame and a few charts. Repos involved - openskycam (camera, detection, and the tools Claude uses): https://github.com/Deibler/openskycam - edmund-harness (iMessage harness): https://github.com/Deibler/edmund-harness You need an RTSP camera, a Raspberry Pi, a machine with a big disk (macOS or Linux; it can also run the models, GPU optional) and a Cloudflare account with a domain. One command installs it and walks you through setup, and the trained night model is in the repo. Some version of this has been watching my sky since 2024, and the UFO count is still zero. Plenty of meteors, an awful lot of planes, and enough bird detentions that I'm one pair of binoculars away from joining the local Audubon society. If you've had better luck, I want to hear about it. submitted by /u/Terrible_Award_2124 to r/ClaudeAI [link] [comments]

★ OpenAI releases GPT-6.1 Terra, touting "fast and capable computer use at scale" and clearer, more natural writing, priced at $1/1M input and $5/1M output tokens (OpenAI)

Tue, 27 Oct 2026 00:00:00 +0000

93% · Measured result 93%, First-party 92%, Usable today 69%

OpenAI : OpenAI releases GPT-6.1 Terra, touting “fast and capable computer use at scale” and clearer, more natural writing, priced at $1/1M input and $5/1M output tokens — Delivering fast and capable computer use at scale — , a fast, efficient model that combines detailed visual reasoning …

Interactive neuron steering playground for Qwen3.5-4B that runs locally in the browser on WebGPU

/u/xenovatech — Tue, 27 Oct 2026 00:00:00 +0000

89% · Usable today 89%

There is a trend on X where users are finding tiny subsets of neurons (often just one or two) that can steer LLM behavior in surprising ways. For example, steering just two neurons in Qwen3.5-4B can make it talk about harming, dominating, and destroying the user. Other combinations can make the model overly apologetic, write in all caps, act like an anime character, and much more. After seeing some of these posts, I built an interactive playground so you can explore these combinations yourself, with the model running entirely in your browser on WebGPU. Link to the playground: https://huggingface.co/spaces/webml-community/neuron-studio submitted by /u/xenovatech to r/LocalLLaMA [link] [comments]

Qwen investigation traces release

/u/Cohere — Tue, 27 Oct 2026 00:00:00 +0000

87% · Usable today 87%, First-party 46%

In the spirit of transparency and openness, we are releasing the traces so developers can test this out for themselves. We noticed this behaviour without prefilling with the following prompt, but this is rare. If you want to reproduce it, you can use this prompt with prefilling. Open models make for better science and are part of why this problem came to light at all: developers running Qwen3.8 on their own machines spotted the strange links, and having the weights let us study the behaviour in depth. We're encouraged by the thoughtful discussion our research has sparked across the AI and security communities. It's our belief that open-weight models are an important part of the future of AI, and we've recently released several under the Apache 2.0 license. Trace, raw tokens, & minimal reproduction script: https://huggingface.co/datasets/CohereLabs/10-2026-qwen-investigation-traces submitted by /u/Cohere to r/LocalLLaMA [link] [comments]

Zipties in ComfyUI!

/u/DemonicPotatox — Tue, 27 Oct 2026 00:00:00 +0000

87% · Usable today 87%

I posted this on the ComfyUI subreddit and it got some traction and was pinned on the subreddit to hopefully get some attention from the Comfy devs, so I'm reposting it here aswell GitHub Repo: https://github.com/safzanpirani/comfyui-zip-ties Some people wanted it MERGED into the official ComfyUI frontend, so I've opened a PR there too: https://github.com/Comfy-Org/ComfyUI_frontend/pull/21965 Feel free to open issues and PRs, but it's in a pretty stable state right now but it is quite literally zipties and nothing else, so temper your expectations. submitted by /u/DemonicPotatox to r/StableDiffusion [link] [comments]

webframe: evaluated as a scraper and a sandbox

Tue, 27 Oct 2026 00:00:00 +0000

87% · Usable today 87%

Research: webframe: evaluated as a scraper and a sandbox webframe is a neat little project from Jeff Lindsay which lets you "run a web page like a program" - you point it at a URL or file and it executes it in a hidden headless web view and outputs console.log() to standard output and any exceptions to standard error. It's written in Go on top of the glaze library, which provides access to a system browser ("WKWebView on macOS, WebKitGTK on Linux, WebView2 on Windows") so it doesn't need to bundle its own browser engine. It reminds me of my own shot-scraper javascript tool, albeit in a much smaller package that doesn't depend on Playwright. I had Claude Opus 5.5 put it through its paces and prepare a research report for me. Here's the prompt I used: Explore https://github.com/tractordev/webframe try running it and put it though its paces, build a few exploratory prototypes, then evaluate it as a potential sandboxing tool and as a tool for scraping web pages using the same patterns encouraged by the "shot-scraper JavaScript" command (see simonw/shot-scraper on GitHub, docs directory) Tags: browsers , go , javascript , jeff-lindsay , shot-scraper

llama.cpp b11909

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

86% · First-party 86%, Usable today 85%

hexagon: MUL_MAT_ID row skipping optimizations and improvements ( #31169 ) hex-mmid: vectorize skipped row zeroing and added zeroing to fused MM_ID_NX hex-mmid: remove scalar div Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60100504 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11905

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

86% · Usable today 86%, First-party 82%

vulkan: rms norm optimization using subgroup reductions ( #29882 ) RMS Norm Subgroup reductions optimizaton Fix build error Improved optimization Make usage of BLOCK_SIZE consistent Add fast path to skip 2nd subgroupAdd Add AMD Vendor to subgroup reduction opt Add comment clarifying rms_dict and merge_maps behavior Add unroll Rebase Fixed syntax issue Add 128/256/512 block sizes to non-subgroup path Remove trailing whitespace Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60062594 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Release: v5.21.0

Cyrilvallez — Tue, 27 Oct 2026 00:00:00 +0000

86% · First-party 86%, Usable today 84%

Release v5.21.0 New Model additions MiniCPM-OCR MiniCPM-OCR is a document-understanding model from OpenBMB's MiniCPM-V family. It keeps the MiniCPM-V 4.6 architecture, which pairs a SigLIP vision encoder and a window-attention merger with a Qwen3.5 language model. It is specialized for reading text-dense images such as scanned pages, screenshots, receipts and tables. Links: Documentation | Paper Feat test ( #49920 ) by @guarin in #49920 Flint Flint is Recursive's mixture-of-experts language model. Compared to a standard SwiGLU MoE transformer such as Qwen3-MoE, it uses hybrid attention (sliding-window attention with rotary embeddings over the current token and the previous 512 tokens in most layers, and full attention without positional encoding in the remaining layers). It also has learned attention sinks, as in GPT-OSS, with per-head RMS-normalized queries and keys. Each sparse layer routes a token to 6 of 256 experts by sigmoid score and adds an ungated shared expert, and the first two layers are dense. Links: Documentation Add Flint model support. ( #49824 ) by @lovishmadaan in #49824 UltraVBert UltraVBert extends ModernVBert by pairing the UltraBERT text encoder with a SigLIP vision encoder for visual document understanding and retrieval. Its image processor splits each page into 512-pixel tiles plus a global view. The connector merges each 4 x 4 block of vision patches into one token, so a tile becomes 64 image tokens, and RMS-normalizes them to the scale of UltraBERT's token embeddings. The max_image_tiles setting (27 by default) caps the number of tiles per page. Links: Documentation Add UltraVBERT ( #49685 ) by @athrael-soju in #49685 Gradium Phonon TTS Gradium Phonon TTS is Gradium's family of on-device text-to-speech models, trained with the Pocket TTS recipe. A causal transformer reads a voice prompt and the text, then emits one continuous 32-dimensional audio latent per step at 12.5 Hz through a one-step flow head, and an end-of-speech head decides when the utterance ends. The latents are decoded to 24 kHz audio by a Pocket TTS audio tokenizer. Unlike Pocket TTS, voice conditioning uses 512-dimensional latents from a separate, unreleased speaker codec, so voices come as precomputed latents and cannot be cloned from a recording. Links: Documentation Add GradiumPhononTTS ( #49791 ) by @eustlb in #49791 Pocket TTS Pocket TTS is Kyutai's 100M-parameter text-to-speech model, built as a Continuous Audio Language Model that runs faster than real time on CPU. A causal transformer emits one continuous audio latent per frame (12.5 Hz) through a one-step flow head, and an end-of-speech head decides when to stop. A Mimi-based audio tokenizer encodes voice prompts and decodes the generated latents to 24 kHz audio. Two flow heads are released, Lagrangian self-distillation (default) and drifting, and voices can be cloned from a recording, passed as precomputed latents, or loaded from cached KV states. Links: Documentation | [Paper]( https://huggingface.co/papers/2509.06926 (the Continuous Audio Language Models paper, arXiv 2509.06926). It is the only paper the documentation links, and it describes the architecture family Pocket TTS belongs to. The docs do not cite a separate Pocket TTS technical report.) | [Blog Post](NONE. The documentation links no official blog post. It points only to the original code repository at https://github.com/kyutai-labs/pocket-tts .) add PocketTTS ( #49589 ) by @eustlb in #49589 Pocket TTS Audio Tokenizer The Pocket TTS audio tokenizer is the codec used by Pocket TTS. It has Mimi's architecture (SEANet convolutions plus a small causal transformer on each side), but its residual vector quantizer is replaced by a continuous 32-dimensional bottleneck, the VAE-GAN from Continuous Audio Language Models. It converts 24 kHz audio into latents at 12.5 Hz and decodes them back to audio. It serves as the audio_tokenizer of PocketTTSProcessor , encoding voice prompts and decoding generated latents, and its encoder and decoder can also be loaded on their own. Links: Documentation | Paper add PocketTTSAudioTokenizer ( #49588 ) by @eustlb in #49588 Breaking changes Fixed Gemma4 processor imports (the Gemma4, Gemma4 unified and EmbeddingGemma2 processors) so from transformers import * no longer fails in environments that have PIL but not torch ; no user action is needed. 🚨 Fix gemma4 cross imports resulting in import failing without torch but with PIL ( #49748 ) by @Sai-Suraj-27 Added an "fp8" backend to QuantizedCache , alongside quanto and hqq , that stores KV states in torch.float8_e4m3fn with a single scale per tensor; enable it with cache_implementation="quantized" and cache_config={"backend": "fp8"} . 🚨Add an FP8 backend to QuantizedCache ( #48677 ) by @jiqing-feng Tensor parallelism now has a dedicated embedding style, shards every model's input embeddings by default, and supports widths that aren't divisible by the TP size, so ColwiseParallel and RowwiseParallel now apply only to linear layers; custom TP plans that applied them to embeddings must switch to the new embedding style. 🚨 TP: give embeddings their own style, shard input embeddings by default, and shard widths that don't divide by the TP size ( #49570 ) by @IlyasMoutawwakil Every MoE TP and EP plan now shards its experts, so models no longer keep all experts on every rank, and a new test_moe_parallel_plans_shard_experts test enforces this; custom or downstream MoE parallel plans must add expert sharding to pass it and to avoid wasted memory. 🚨 MoE: shard the experts in every TP/EP plan, and test for it ( #49206 ) by @IlyasMoutawwakil Cache This release improves cache handling across the library. Flash Attention now works with static caches, BLOOM no longer crashes with static cache or compiled generate, chunked prefill supports cache continuation, and the Qwen4-Exp indexer's position history stays aligned with its cached keys. Linear-attention caches also gain new getters ( is_recording_past , get_recurrent_state , conv-state access) that stop exposing cache internals and prepare for paged-c [FA] Fix FA with static cache ( #49998 ) by @Cyrilvallez in [ #49998 ] [docs] CB cache behavior ( #49025 ) by @stevhliu in [ #49025 ] [CB] Reduce warmup time by not computing attention over full cache ( #49853 ) by @remi-or in [ #49853 ] Fix Qwen4-Exp indexer position cache lifecycle ( #49840 ) by @taking-lying-flat in [ #49840 ] [Cache] Linear attn cache: use new getters ( #49375 ) by @remi-or in [ #49375 ] [Cache] Get conv states ( #49309 ) by @remi-or in [ #49309 ] [Cache] Add get_recurrent_state ( #49306 ) by @remi-or in [ #49306 ] [Cache] Add is_recording_past ( #49305 ) by @remi-or in [ #49305 ] Fix BLOOM crash with static cache / compiled generate ( #49481 ) by @kaixuanliu in [ #49481 ] Allow Cache continuation for chunked prefill ( #49662 ) by @Cyrilvallez in [ #49662 ] Vision Vision image processors now composite PNG transparency onto white instead of exposing black pixels, and background_color is preserved correctly across the DeepSeek-VL and Janus processors. Model fixes cover SmolVLM's inputs_merger when image tokens aren't a multiple of the patch size, HunYuan-VL image assignment during batched beam search, and Ernie4.5-VL-MoE expert sharding under TP/EP. The DETR Composite transparency in shared RGB conversion and image processors ( #49079 ) by @Nikhi00718 in [ #49079 ] [Fetcher] Fix missing test deps for dynamically-resolved image processors ( #49826 ) by @ydshieh in [ #49826 ] fix(vision): Route the DETR conversion scripts through from_pretrained ( #49830 ) by @harshaljanjani in [ #49830 ] Fix background_color handling across DeepSeek-VL and Janus image processors ( #49767 ) by @tritsystem in [ #49767 ] Move the MI300 docker image to ROCm 10.1 and update test expectations ( #49460 ) by @Abdennacer-Badaoui in [ #49460 ] docs: fix 'allows to' grammar in Vision Encoder Decoder docs ( #48730 ) by @mrchatam in [ #48730 ] Fix SSH runner: add /opt/venv/bin to PATH for Python 3.11 images ( #49759 ) by @ydshieh in [ #49759 ] Fix SmolVLM inputs_merger when image tokens are not a multiple of patch_size ( #49725 ) by @albertvillanova in [ #49725 ] Ernie4.5-VL-MoE: shard the text and vision experts under TP and EP ( #49462 ) by @IlyasMoutawwakil in [ #49462 ] Fix HunYuan-VL image assignment during batched generation ( #49557 ) by @Arnav66692 in [ #49557 ] Generation This release fixes a range of generation bugs: BLOOM crashes with static cache or compiled generate, generate dropping the type of dict-like inputs such as ModelOutput , and incorrect image assignment or placeholder handling in batched or beam-search generation for HunYuan-VL and Idefics2/3. It also fixes Qwen3-Omni audio generation mode handling, SAM mask-generation multi-zoom crops, empty frame s fix: prevent empty frame sampling for short videos ( #49908 ) by @BlazeSR10hawk in [ #49908 ] Fix Windows path separators breaking relative imports of Hub custom-generate modules ( #48951 ) by @dltsum in [ #48951 ] Fix multi-zoom crops in the SAM mask-generation pipeline and related bugs (Fixes #35530 ) ( #49689 ) by @stlukyanenko in [ #49689 ] update speculative decoding docs ( #49697 ) by @merveenoyan in [ #49697 ] fix idefics3 generation issues ( #49738 ) by @molbap in [ #49738 ] fix tests for generation ( #49740 ) by @molbap in [ #49740 ] Fix inputs dict casting in generate ( #49731 ) by @Cyrilvallez in [ #49731 ] [fix][Qwen3-Omni] Respect generation_mode in audio generation ( #49505 ) by @Sunt-ing in [ #49505 ] Parallelization This release extends parallelism support and fixes several related bugs. It adds a tensor-parallel plan for Nemotron and makes Ernie4.5-VL-MoE shard its text and vision experts under TP and EP. It also restores expert-parallel token-dispatch gradients on torch 2.7–2.10, fixes a Molmo2 model-parallel device mismatch, and corrects base_model_prefix in several model families (PP-OCR detectors Add tensor parallel plan for Nemotron ( #48780 ) by @Siddhant231xyz in [ #48780 ] fix model parallel bug for molmo2 model ( #49816 ) by @kaixuanliu in [ #49816 ] Fix base_model_prefix in the PP-OCR detectors, CLIPSeg, TimesFM, CLIP and VideoPrism heads so base checkpoints load ( #48871 ) by @blipbyte in [ #48871 ] Fix expert-parallel token dispatch gradients on torch 2.7 to 2.10 ( #49710 ) by @digit50 in [ #49710 ] Skip Muse TP ( #49717 ) by @remi-or in [ #49717 ] Quantization Quantization now handles DeepSeek-V4.1's FP4 experts correctly: FineGrainedFP8Config gains an expert_dtype option ("fp8" by default, or "fp4") that the FP8 experts read instead of allocating them as FP8. TimesFM 2.5 no longer casts float inputs to an integer weight dtype when loaded with quantization such as bitsandbytes 4/8-bit. A broader cleanup Fine-grained FP8: DeepSeek-V4's expert_dtype in the quantization config ( #49848 ) by @IlyasMoutawwakil in [ #49848 ] Fix dtype cast in TimesFM 2.5 ResidualBlock for quantized weights ( #46942 ) by @JOhnsonKC201 in [ #46942 ] Quantization cleanpup ( #49548 ) by @ArthurZucker in [ #49548 ] Bugfixes and improvements [Fix] Fix CSM codebook embedding tying ( #49197 ) by @orrangetabby17 in [ #49197 ] [tests_fetcher] fix missing .as_posix() in preprocessor_patterns path keys ( #49994 ) by @ydshieh in [ #49994 ] fix(ci): skip bot suggestion if a maintainer already posted run-slow: ( #49992 ) by @ydshieh in [ #49992 ] [loading] Allow Renaming and Converter to work on the sume subkeys ( #49928 ) by @Cyrilvallez in [ #49928 ] [Fix] Fix NUMA and cpuset detection in CB ( #49980 ) by @remi-or in [ #49980 ] [Refactor] Make CB utils depend on no CB import ( #49968 ) by @remi-or in [ #49968 ] chore: improve typing in modeling_rope_utils.py ( #49831 ) by @RyanMullins in [ #49831 ] is_fouroversix_available() returned an (available, version) tuple. Ev… ( #49894 ) by @sywangyi in [ #49894 ] Match a skip-list entry from the start only up to a module boundary ( #49771 ) by @IlyasMoutawwakil in [ #49771 ] [pocket_tts, gradium_phonon_tts] use sub_configs_defaults ( #49868 ) by @eustlb in [ #49868 ] Fixes a dtype mismatch in flash_attn test ( #49912 ) by @kaixuanliu in [ #49912 ] [Fix] Remove duplicate assignment in DeepseekV3.2 config ( #49896 ) by @remi-or in [ #49896 ] add XPU Expectations for 4 new model tests ( #49815 ) by @kaixuanliu in [ #49815 ] Make sub-config-defaults easier ( #49906 ) by @zucchini-nlp in [ #49906 ] Fix out-of-bounds index bug in musicgen_melody model ( #49842 ) by @kaixuanliu in [ #49842 ] test: add parity check to the CPU-only continuous batching test ( #49728 ) by @nrenvo in [ #49728 ] [CB] Reduce the max_memory_percent in case of a CPU model ( #49844 ) by @remi-or in [ #49844 ] Improve clarity and grammar in Auto Classes documentation ( #44550 ) by @himani27301 in [ #44550 ] [gradium_phonon_tts] point to the released Hub repos ( #49867 ) by @eustlb in [ #49867 ] [EmbeddingGemma2] update integration tests ( #49576 ) by @eustlb in [ #49576 ] Fix a comment ( #44872 ) by @IvanFan-Van in [ #44872 ] Fix hardcoded torch.float64 crashing on MPS ( #46723 ) ( #46730 ) by @Abhijeet1815 in [ #46730 ] fixup metadata workflow ( #49854 ) by @vasqu in [ #49854 ] docs(whisper): cast input features to model dtype in AutoModel example ( #49837 ) by @Kayvan-Zahiri in [ #49837 ] Fix torch_float casting to int instead of float ( #47468 ) by @rahulrshetty45 in [ #47468 ] Upgrade Python Min version to 3.11 ( #49251 ) by @Sai-Suraj-27 in [ #49251 ] skip sdpa_can_dispatch_on_flash tests for 3 models ( #49809 ) by @kaixuanliu in [ #49809 ] [LED][Longformer] Replace for-loop with unfold in _chunk ONNX-export path ( #46169 ) by @guinik in [ #46169 ] logits_to_keep bool mask for all ForXXX classes ( #48825 ) by @jp1924 in [ #48825 ] Fix several object detection models/loader fix for module tying ( #49827 ) by @molbap in [ #49827 ] Fix encoder logits processors when precomputed encoder_outputs lack token IDs ( #49696 ) by @kunalsanga in [ #49696 ] Defer some imports ( #49663 ) by @jayzuccarelli in [ #49663 ] refactor CTC loss ( #49833 ) by @ebezzam in [ #49833 ] Add Intel XPU CI ( #49254 ) by @regisss in [ #49254 ] fix(mask2former): register input_projections as nn.ModuleList (fixes #49698 ) ( #49703 ) by @Omarinho12345 in [ #49703 ] Only tie MM Grounding DINO decoder heads when the config shares them ( #49552 ) by @ in [ #49552 ] [Docs] Add Marathi (मराठी) translation of README ( #48746 ) by @shreeyadav06 in [ #48746 ] Fix CLVP c_proj residual scaled-init silently never applied ( #47478 ) by @ShamSaleem in [ #47478 ] fix failed test cases for unlimited_ocr model ( #49806 ) by @kaixuanliu in [ #49806 ] Fix transformers env when requests is not installed ( #48412 ) by @panshularora in [ #48412 ] Apply EXIF orientation in load_image_as_tensor with torchvision ( #49794 ) by @digit50 in [ #49794 ] Fix Fuyu processor test ( #49821 ) by @zucchini-nlp in [ #49821 ] use torchcodec-xpu and upgrade torch to 2.14.1 ( #49814 ) by @sywangyi in [ #49814 ] update some case to add xpu expectation ( #49807 ) by @sywangyi in [ #49807 ] [serge] Fix 2 integration tests regressed by commit c48824e (PR #49404 ) ( #49705 ) by @sergereview[bot] in [ #49705 ] docs: fix OOM/hang for Qwen dynamic resolution models by setting min_pixels and max_pixels ( #46007 ) by @poojansatani in [ #46007 ] docs: fix 'allows to' grammar in DPT docs ( #48728 ) by @mrchatam in [ #48728 ] docs: fix 'allows to' grammar in LiLT docs ( #48731 ) by @mrchatam in [ #48731 ] docs: fix prompt formatting and code alignment in Gemma model doc ( #48775 ) by @Rattan344 in [ #48775 ] docs: fix grammar typo in ALBERT model card ( #48774 ) by @Rattan344 in [ #48774 ] Deprecate old input names ( #49424 ) by @zucchini-nlp in [ #49424 ] Fix NameError in CI comment workflows: missing section marker variables ( #49801 ) by @ydshieh in [ #49801 ] [CI] Improve run-slow PR comments and remove CI recap ( #49782 ) by @ydshieh in [ #49782 ] Show the actual accelerate version for transformers env ( #49668 ) by @Sai-Suraj-27 in [ #49668 ] [CI] fix perceriver old regression ( #49792 ) by @molbap in [ #49792 ] mimi moshi output capturing ( #49670 ) by @eustlb in [ #49670 ] Remove the resolved prototype Whisper MIC expected failure ( #49785 ) by @tarekziade in [ #49785 ] Fix CohereCompass text RoPE to use Qwen3-VL interleaved M-RoPE ( #49715 ) by @mmangkad in [ #49715 ] Alias thinking -> reasoning_content ( #49535 ) by @Rocketknight1 in [ #49535 ] [vLLM] Add Qwen-Omni Thinker base models and Gemma 3n per-layer inputs ( #49437 ) by @harshaljanjani in [ #49437 ] Update MIC fleet references and documentation ( #49768 ) by @tarekziade in [ #49768 ] [CI] no split modules for SAM ( #49766 ) by @molbap in [ #49766 ] Enable tests forgotten in idefics3 ( #49758 ) by @molbap in [ #49758 ] Fix tests_fetcher backbone step (never worked since introduction) ( #49742 ) by @ydshieh in [ #49742 ] [modular] Extend the "del self.xxx" pattern to match typed assignments ( #49735 ) by @remi-or in [ #49735 ] Xpu add ( #49757 ) by @sywangyi in [ #49757 ] Deprecate rope_scaling assignment and normalize legacy RoPE keys ( #49515 ) by @jinwukong in [ #49515 ] Make longrope compileable ( #49555 ) by @jiqing-feng in [ #49555 ] Fix stack_frames > 1 wiring bug in MiniCPMV4_6VideoProcessor ( #49752 ) by @airlsyn in [ #49752 ] fix moshi failing tests ( #49750 ) by @eustlb in [ #49750 ] [docs] Gaudi ( #49618 ) by @stevhliu in [ #49618 ] [serge] Fix 2 integration tests for model convnextv2 failing with output_mismatch (tensor values differ (2)) ( #48838 ) by @sergereview[bot] in [ #48838 ] [serge] Fix 2 integration tests for model eomt_dinov3 failing with output_mismatch (tensor values differ (2)) ( #48882 ) by @sergereview[bot] in [ #48882 ] [serge] Fix 4 integration tests for model lw_detr failing with output_mismatch (tensor values differ (4)) ( #49040 ) by @sergereview[bot] in [ #49040 ] [serge] Fix 2 integration tests for model nemotron failing with output_mismatch (list output differs (2)) ( #48945 ) by @sergereview[bot] in [ #48945 ] multi device fix for molmo2 ( #49736 ) by @molbap in [ #49736 ] Fix the rest of VLMs ( #49720 ) by @zucchini-nlp in [ #49720 ] Fix ValueError when loading a fusion-enabled checkpoint twice ( #49412 ) by @kaixuanliu in [ #49412 ] Avoid a host-to-device copy in eager_mask ( #49684 ) by @hmellor in [ #49684 ] is_tracing() now recognizes XPU stream capture, alongside the exist… ( #49722 ) by @sywangyi in [ #49722 ] Document how to avoid the Metaspace prefix after added tokens ( #45822 ) by @qflen in [ #45822 ] Declare the input modalities of the VLMs that report text only ( #49677 ) by @qgallouedec in [ #49677 ] Fix zero expert gradients in bfloat16 with expert parallelism and ep_size < fsdp_size ( #49688 ) by @qgallouedec in [ #49688 ] Fix test selection for virtual module imports ( #49690 ) by @tarekziade in [ #49690 ] [docs] add Google TPU hardware guide ( #49642 ) by @tengomucho in [ #49642 ] Copy default response parser args ( #49370 ) by @Rocketknight1 in [ #49370 ] Make DtensorShardOperation work on torch 2.6 and 2.7 ( #49657 ) by @hazelxue in [ #49657 ] Fix from_pretrained on torch 2.7: require torch>=2.8 for distributed checkpointing ( #49652 ) by @naveecode in [ #49652 ] Fix DeepGEMM Mega MoE under expert parallelism ( #49428 ) by @IlyasMoutawwakil in [ #49428 ] Fix flaky Evolla tests producing NaN outputs ( #49660 ) by @tarekziade in [ #49660 ] [rocm] Add ROCm expectations to Kolibri-1 logits test ( #49661 ) by @ericschreiber in [ #49661 ] [CB] Various small fixes for MPS ( #49654 ) by @remi-or in [ #49654 ] Aligns test expectations with the accelerator path under test: ( #49653 ) by @sywangyi in [ #49653 ] [docs] Processor config ( #49643 ) by @stevhliu in [ #49643 ] post release stuff ( #49646 ) by @vasqu in [ #49646 ] Significant community contributions The following contributors have made significant changes to the library over the last release: @ydshieh [tests_fetcher] fix missing .as_posix() in preprocessor_patterns path keys ( #49994 ) fix(ci): skip bot suggestion if a maintainer already posted run-slow: ( #49992 ) [Fetcher] Fix missing test deps for dynamically-resolved image processors ( #49826 ) Fix NameError in CI comment workflows: missing section marker variables ( #49801 ) [CI] Improve run-slow PR comments and remove CI recap ( #49782 ) Fix tests_fetcher backbone step (never worked since introduction) ( #49742 ) Fix SSH runner: add /opt/venv/bin to PATH for Python 3.11 images ( #49759 ) @remi-or [Fix] Fix NUMA and cpuset detection in CB ( #49980 ) [Refactor] Make CB utils depend on no CB import ( #49968 ) [Fix] Remove duplicate assignment in DeepseekV3.2 config ( #49896 ) [CB] Reduce warmup time by not computing attention over full cache ( #49853 ) [CB] Reduce the max_memory_percent in case of a CPU model ( #49844 ) [modular] Extend the "del self.xxx" pattern to match typed assignments ( #49735 ) [Cache] Linear attn cache: use new getters ( #49375 ) [Cache] Get conv states ( #49309 ) [Cache] Add get_recurrent_state ( #49306 ) [Cache] Add is_recording_past ( #49305 ) [Kernels] Add MPS to supported device types ( #49655 ) Skip Muse TP ( #49717 ) [CB] Various small fixes for MPS ( #49654 ) @Nikhi00718 Composite transparency in shared RGB conversion and image processors ( #49079 ) @eustlb [pocket_tts, gradium_phonon_tts] use sub_configs_defaults ( #49868 ) [gradium_phonon_tts] point to the released Hub repos ( #49867 ) [EmbeddingGemma2] update integration tests ( #49576 ) Add GradiumPhononTTS ( #49791 ) add PocketTTS ( #49589 ) add PocketTTSAudioTokenizer ( #49588 ) 🟡 [mimi] separate encoder and decoder ( #49577 ) mimi moshi output capturing ( #49670 ) fix moshi failing tests ( #49750 ) @jp1924 logits_to_keep bool mask for all ForXXX classes ( #48825 ) @molbap Fix several object detection models/loader fix for module tying ( #49827 ) [CI] fix perceriver old regression ( #49792 ) [CI] no split modules for SAM ( #49766 ) Enable tests forgotten in idefics3 ( #49758 ) fix idefics3 generation issues ( #49738 ) fix tests for generation ( #49740 ) multi device fix for molmo2 ( #49736 ) @athrael-soju Add UltraVBERT ( #49685 ) @harshaljanjani fix(vision): Route the DETR conversion scripts through from_pretrained ( #49830 ) fix(audio): Route the ALM conversion scripts through from_pretrained ( #48525 ) [vLLM] Add Qwen-Omni Thinker base models and Gemma 3n per-layer inputs ( #49437 ) @lovishmadaan Add Flint model support. ( #49824 ) @tarekziade Remove the resolved prototype Whisper MIC expected failure ( #49785 ) Update MIC fleet references and documentation ( #49768 ) Cleaned up tokenizer tests ( #49669 ) Fix test selection for virtual module imports ( #49690 ) Fix flaky Evolla tests producing NaN outputs ( #49660 ) @yonigozlan Fix small bug in auto mappings ( #49664 ) @ArthurZucker Quantization cleanpup ( #49548 )

Accenture Tells Employees They Can Now Spend Only $29 on Claude Per Month

404 Media — Tue, 27 Oct 2026 00:00:00 +0000

85% · Measured result 85%

companies to employees a few months ago: you better use AI companies now: wait, wait, just $29 a month on claude pls www.404media.co/accenture-te... Linked page: Some employees who spend as much as $1,000 on Claude usage each month are scrambling to find ways to maintain access to the tool.

llama.cpp b11913

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

85% · First-party 85%, Usable today 84%

hexagon: add GGML_HEXAGON_VTCM_SIZE ( #31221 ) hexagon: add GGML_HEXAGON_VTCM_MB and GGML_HEXAGON_NTHREADS caps Change-Id: Idffe1613c8db6f96aa842d43d1b2efaed45462a8 hexagon: rename VTCM cap to GGML_HEXAGON_VTCM_SIZE, drop NTHREADS cap Change-Id: If4c5b9ce9fd6b725c3561421c2295d40599d012d hexagon: make GGML_HEXAGON_VTCM_SIZE an override, accept K/M/G suffixes Change-Id: Ib8eea84c22f24e6d986b37f215e504b046478c2c Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60158449 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11910

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

85% · First-party 85%, Usable today 82%

opencl: write KV-cache views in set_tensor so a state restore is not dropped ( #30471 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60106982 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11904

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

85% · First-party 85%, Usable today 84%

sycl: template the plain MMVQ launch triples ( #31013 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60054506 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11912

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

84% · First-party 84%, Usable today 84%

llama : enable moe amax rescaling for laguna ( #31147 ) llama : enable moe amax rescaling for laguna Assisted-by: Devin llama : declare laguna sm tensor support Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60129010 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11907

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

84% · Usable today 84%, First-party 80%

models : replace ggml_tensor** out-params with output structs ( #31142 ) The hyper-connection and DSA graph builders wrote their extra outputs (post / comb gates, carried top-k selections, inject gates) through ggml_tensor** out-params. Return them in a small struct next to the primary output instead. Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60084920 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

New Sakana AI paper: Recursive Self-Improvement through Multi-Agent Self-Supervision (MASS). Blog: pub.sakana.ai/mass/ Paper: arxiv.org/abs…

hardmaru — Tue, 27 Oct 2026 00:00:00 +0000

82% · First-party 82%

New Sakana AI paper: Recursive Self-Improvement through Multi-Agent Self-Supervision (MASS). Blog: pub.sakana.ai/mass/ Paper: arxiv.org/abs/2610.12176 How do we keep improving AI when tasks become too complex for humans to reliably evaluate? The model eventually hits a supervision bottleneck.

ollama v0.40.10

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

82% · Usable today 82%, First-party 37%

NVIDIA Nemotron 3.5 Bolt E4B Nemotron 3.5 Bolt E4B is NVIDIA’s smaller, Gemma 4-based vision-language model for fast local conversations, image understanding, and tool use. It supports a 128K-token context window. The model includes a DFlash draft for speculative decoding. ollama run nemotron-3.5-bolt:e4b Full Changelog : v0.40.9...v0.40.10

From impulse purchase to pocket studio: The M-Vave FM-1

Ars Technica — Tue, 27 Oct 2026 00:00:00 +0000

81% · Usable today 81%

Linked page: M-Vave's cheap FM-1 pocket synth has exploded as a community firmware playground.

llama.cpp b11908

github-actions[bot] — Tue, 27 Oct 2026 00:00:00 +0000

81% · Usable today 81%, First-party 78%

llama : move no_alloc out of llama_hparams ( #31141 ) llama : move no_alloc out of llama_hparams Assisted-by: dsh:llama.cpp/ggml-org/GLM-5.3-Flash-GGUF (2x DGX Spark (RDMA, TP=2)) cont : clean-up cont : clean-up Assisted-by: dsh:llama.cpp/ggml-org/GLM-5.3-Flash-GGUF (2x DGX Spark (RDMA, TP=2)) tests : add a no_alloc case to test-llama-context Assisted-by: dsh:llama.cpp/ggml-org/GLM-5.3-Flash-GGUF (2x DGX Spark (RDMA, TP=2)) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/60095452 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

HUGE shoutout to ShootTheSound and Fizgig! I finally nailed Moss char loras

/u/derTommygun — Tue, 27 Oct 2026 00:00:00 +0000

80% · Usable today 80%

The title basically says it all... after days of frustrations and horrible results with other training tools, I was finally able to train some Moss characters lora that are actually very, VERY good... they're even better than my previous ZIT and Krea ones, which is no small feat! IDK if it's due to the recent Fizgig masked version, the dataset preparation tools, the big amount of epochs (40/50) or what else, but the resulting generations not only keep a striking resemblance in facial features and expressions, but they also understand body features and imperfections very well, something I always found very hard to achieve in Krea, for example. The ability to send all the training package to Runpod with a few clicks is also awesome, with a couple of dollars I can train a whole lora without torturing my poor potato GPU for days. I'll very gladly share my settings if you like, but they're mostly the default Moss ones in Fizgig. Thanks to creator, really! EDIT: you can find Fizgig here: https://github.com/shootthesound/Fizgig Also, YT channel is full of useful, updated guides: https://www.youtube.com/@ShootTheSound submitted by /u/derTommygun to r/StableDiffusion [link] [comments]

★ RTX 3080 20GB got reBAR and P2P unlock! +70% prompt processing speed

/u/No-Refrigerator-1672 — Mon, 26 Oct 2026 00:00:00 +0000

98% · Measured result 98%

P2P is finally unlocked for RTX 3080 20GB - this leads to massive performance improvements in tensor parallel mode prompt processing speed. First, i want to acknowledge that this tremendous achievement belongs to u/nathannguyennng - he can't post to r/locallama due to karma requirements, and gave me permission to post it instead. Please follow his original post for installation instructions, and give it an upvote! Here, I'm sharing my tests results. Test system: Proxmox Virtual Environment 9.2.21, linux kernel 6.14.11-9-pve, nvidia driver 615.71.09 Hardware: Threadripper 1920x on x399 Zenith extreme motherboard GPUs: dual RTX 3080 20GB, both installed into PCIe 3.0 x16 slots, limited to 240W power test environment: vllm 0.32.0 with cyankiwi/Swift-1.5-Qwen3.8-27B-AWQ-INT4 , MTP enabled, FP8 KV cache, tensor parallel, full launch command: vllm serve cyankiwi/Swift-1.5-Qwen3.8-27B-AWQ-INT4 --max-num-seqs 4 --enable-auto-tool-choice --tool-call-parser qwen3_coder --reasoning-parser qwen3 --tensor-parallel-size 2 --enable-prefix-caching --kv-cache-memory-bytes 6G --kv-cache-dtype fp8_e4m3 --enable-prompt-tokens-details --speculative-config '{"method":"qwen3_next_mtp","num_speculative_tokens":3}' --enable-chunked-prefill --attention-backend FLASHINFER --default-chat-template-kwargs '{"reasoning_effort": "medium"}' Both GPUs are limited to 240W of power. I have tested 3 configurations: 1) completely stock; 2) gpu-unlock ; 3) gpu-unlock + ReBAR + P2P Single stream prefill (prompt processing) speed was measured as prompt_length / time_to_first_token. In both cases, gain is defined as percentage increase over stock configuration. Prompt Tokens TTFT stock ms TTFT gpu_unlock ms TTFT gpu_unlock+p2p ms Prefill stock tok/s Prefill gpu_unlock tok/s Gain Prefill gpu_unlock+p2p tok/s Gain 8192 8471.2 7012.7 3938.5 967.1 1168.2 21% 2080 115% 16384 17572.5 14417.8 8283.4 932.4 1136.4 22% 1978 112% 32768 36753.8 29970 18179.3 891.6 1093.4 23% 1802.5 102% 65536 79432 64173.5 41010.9 825.1 1021.2 24% 1598 94% 131072 183593.1 146010 100237.2 713.9 897.7 26% 1307.6 83% 261900 465890.2 362192.5 272345.5 562.1 723.1 29% 961.6 71% As you can see, enabling both gpu_unlock and P2P gains you massive prompt processing improvement, anywhere between 70% and 115%. P2P alone gives up to 70% improvement over gpu_unlock. Measuring decode (token generation) when MTP enabled is tricky, because tok/s output metric relies heavy on MTP acceptance rate, which always changes. Therefore, instead of tok/s output rate, I measure inter-token latency (ITL) - this is time passed between two batches of tokens generated by inference engine. With MTP3, each batch contains anywhere between 1 and 4 tokens; so you token output rate is 1x to 4x the step rate I report. Prompt Tokens ITL Stock ms ITL gpu_unlock ms ITL gpu_unlock+p2p ms Decode stock step/s Decode gpu_unlock step/s Gain Decode gpu_unlock+p2p step/s Gain 8192 64.8057 62.5193 62.5695 15.43074 15.99506 4% 15.98223 4% 16384 62.9359 63.873 59.8 15.88918 15.65607 -1% 16.72241 5% 32768 60.2028 62.016 62.6955 16.61052 16.12487 -3% 15.95011 -4% 65536 66.0282 61.425 64.8648 15.14504 16.28002 7% 15.41668 2% 131072 62.5518 64.4644 60.561 15.98675 15.51244 -3% 16.51228 3% 261900 66.7368 60.26 60.3504 14.98424 16.59476 11% 16.5699 11% As real-life MTP acceptance length for agentic coding is floating around 2, 15 steps/s decode rate corresponds to 45 tok/s generation. I'm sorry if this sounds confusing, but this is the only way for you can isolate variations in MTP acceptance during tests and extract raw performance numbers. As you can see, decode results are all over the place, but within noise, except 261k long prompt test; in which stabl;e measurable performance is delivered by gpu_unlock, not p2p. Verdict: in tensor parallel mode, both recent unlocks for 3080 20GB give unimaginably large prompt processing speedup, but basically no improvement for token generation. So, if you're running long prompt tasks (that includes agentic coding too), you should check out those prompts. Also, expect far lesser improvements on systems that don't have full PCIe connectivity to the second gpu. Again, I want to express my massive thanks to u/nathannguyennng , author of ReBAR and P2P unlock - what a day for 3080 owners! submitted by /u/No-Refrigerator-1672 to r/LocalLLaMA [link] [comments]

★ CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/up rows by anujj · Pull Request #29948 · ggml-org/llama.cpp

/u/jacek2023 — Mon, 26 Oct 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 42%

time to download some speedup DGX Spark (GB10), llama-bench -ngl 999 -fa on -p 16384 -n 0 -b 2048 -ub 2048 -ctk f16 -ctv f16 -r 5 , tok/s: model type master PR Qwen3.8-27B Q4_K_M 840.1 899.9 +7.1% Q5_K_M 840.1 880.6 +4.8% Q6_K 751.2 785.8 +4.6% Q8_0 876.2 940.1 +7.3% IQ4_XS 882.4 948.0 +7.4% Qwen3.6-27B Q4_K_M 816.6 865.6 +6.0% Q5_K_M 800.0 851.1 +6.4% Q6_K 720.8 770.4 +6.9% Q8_0 876.9 940.2 +7.2% IQ4_XS 882.2 948.5 +7.5% Llama-3.1-8B Q4_K_M 2749.3 3000.6 +9.1% Q5_K_M 2699.4 2960.3 +9.7% Q6_K 2392.2 2616.0 +9.4% IQ4_XS 2933.9 3249.0 +10.7% RTX 5090, llama-bench -ngl 999 -fa on -p 16384 -n 0 -b 2048 -ub 2048 -ctk f16 -ctv f16 -r 5 , tok/s: model type master PR Qwen3.8-27B Q4_K_M 3688.4 3790.9 +2.8% Q5_K_M 3589.5 3659.6 +2.0% Q6_K 3220.5 3281.0 +1.9% Q8_0 3617.3 3766.9 +4.1% IQ4_XS 3796.2 3926.8 +3.4% Qwen3.6-27B Q4_K_M 3567.9 3660.3 +2.6% Q5_K_M 3429.8 3525.3 +2.8% Q6_K 3105.2 3187.8 +2.7% Q8_0 3628.7 3788.4 +4.4% IQ4_XS 3785.6 3915.4 +3.4% Llama-3.1-8B Q4_K_M 12071.5 12625.9 +4.6% Q5_K_M 11823.0 12297.3 +4.0% Q6_K 10513.1 10928.6 +4.0% IQ4_XS 12997.6 13603.3 +4.7% submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

★ Opus 5.5 writes slop code, but succeeds anyways. A research project inspired by SlopCodeBench

/u/aj_marshall — Mon, 26 Oct 2026 00:00:00 +0000

97% · Measured result 97%

A few months ago, I ran across this paper proposing a benchmark called SlopCodeBench. The idea is that you give an agent a problem split into a bunch of checkpoints, and at each one it has to add a new feature on top of its own old code without breaking anything. Along the way the benchmark measures how "sloppy" the code gets, using two metrics: structural erosion (how much complexity piles up in a few giant branchy functions) and verbosity (how much of the code is redundant). The paper found that agent code gets messier the longer the agent works on it, and that agents get worse at keeping everything passing as they go. The obvious takeaway is that the agent is digging its own grave. Messy code is hard to extend, so it fails. I wasn't convinced that held for agents, so I tested it. I ran Opus 5.5 through all 196 checkpoints ($266 in API costs, ouch) and checked whether messier code predicted worse results. Short version: - Its code did get messier, just like the paper says. Erosion and verbosity both went up in 22 of 35 problems. - Messiness didn't predict whether it got the next checkpoint right, once you compare checkpoints within the same problem. - It almost never broke old stuff. Only about 0.3% of previously passing tests regressed, and messier repos didn't regress any more often. - Messy code didn't make the next change more expensive. Code size did, though: every time a codebase doubled, the next checkpoint cost about 19% more. - Across the whole leaderboard, models that write cleaner code don't solve more problems. The correlation is basically zero. Also, the headline 17% strict solve rate undersells Opus pretty badly. On the tests for each new spec, it passed 84-92%. Big caveats: this is one run of one model on fairly small programs, and the comparisons are observational. A small effect could still be hiding in there. But if it exists, it's nowhere near the penalty these metrics are supposed to be warning us about. Full video link here submitted by /u/aj_marshall to r/ClaudeAI [link] [comments]

★ Nanbeige4.3-33B Quantised GGUF

/u/gladkos — Mon, 26 Oct 2026 00:00:00 +0000

94% · Measured result 94%, Usable today 85%

Quant ladder of Nanbeige's new 33B model from 35.2GB down to 13.7GB For 32GB hardware the sweet spot is 20.3GB AD-IQ4_XS with a top-1% of 92.0% compared to BF16 submitted by /u/gladkos to r/LocalLLaMA [link] [comments]

★ ollama v0.40.11

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

94% · First-party 94%, Usable today 87%

Speech Ollama can now generate speech on macOS. ollama run plays text or a chat model's reply aloud as the audio is generated, and apps can stream audio through the OpenAI-compatible /v1/audio/speech endpoint. ollama run phonon " Hello from Ollama. " d3 decision models d3 brings vLLM Semantic Router's decision models to Ollama. Give a model text, structured state, or an image, and ask it to classify, answer yes or no, or score options with probabilities. The family includes 2B, 4B, 9B, and 27B sizes. ollama run d3 " A customer says their card was charged twice. " --ask " Is this a billing issue? " New Contributors @SynapShift made their first contribution in #19173 Full Changelog : v0.40.10...v0.40.11

fheroes2: A recreation of Heroes of Might and Magic II game engine

tosh — Mon, 26 Oct 2026 00:00:00 +0000

88% · Usable today 88%

Article URL: https://github.com/ihhub/fheroes2 Comments URL: https://news.ycombinator.com/item?id=50230384 Points: 205 # Comments: 71

Cerebras Deploys Trillion-Parameter AI Models

gmays — Mon, 26 Oct 2026 00:00:00 +0000

88% · First-party 88%

Article URL: https://www.cerebras.ai/blog/how-we-deploy-trillion-parameter-frontier-models-on-cerebras Comments URL: https://news.ycombinator.com/item?id=50227356 Points: 355 # Comments: 132

llama.cpp b11886

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

88% · First-party 88%, Usable today 86%

qwen: merge tensors on convert ( #31028 ) qwen: merge tensors on convert convert: use generator functions qwen4exp: remove conts and pre-scale Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/59667111 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11882

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

87% · First-party 87%, Usable today 83%

grammar: limit recursion depth to prevent stack overflow ( #29495 ) ( #29755 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/59655793 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Nvidia discusses $2,000-per-GPU annual software fee for running agents on AI infrastructure — firm already charges more than twice that amount for its AI Enterprise software platform

/u/Logical_Welder3467 — Mon, 26 Oct 2026 00:00:00 +0000

86% · Measured result 86%, First-party 41%

submitted by /u/Logical_Welder3467 to r/technology [link] [comments]

Accenture Tells Employees They Can Now Spend Only $29 on Claude Per Month

404 Media — Mon, 26 Oct 2026 00:00:00 +0000

86% · Measured result 86%

Amazon Bee Frontier review: a simple $75 AI wearable that excels at always-on listening, summarizing conversations, and suggesting follow-up actions (M.G. Siegler/Spyglass)

Mon, 26 Oct 2026 00:00:00 +0000

86% · Measured result 86%, Usable today 59%

M.G. Siegler / Spyglass : Amazon Bee Frontier review: a simple $75 AI wearable that excels at always-on listening, summarizing conversations, and suggesting follow-up actions — Amazon's quiet, listening AI wearable is also pretty killer? — I'm not sure people really understand what is coming with AI and wearables.

Launched in October 2026 at $1,999, Apple’s foldable faces inner display cracks and dust ingress reports across multiple markets

/u/efap1701 — Mon, 26 Oct 2026 00:00:00 +0000

84% · Measured result 84%, Usable today 66%

submitted by /u/efap1701 to r/technology [link] [comments]

llama.cpp b11883

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 79%

llama-quant : fix 4D tensor quantization using ggml_nrows() and name-based expert detection ( #30820 ) llama-quant : fix quantizing 4D tensors nrows_total was ne[1]*ne[2], so for a 4D tensor only the first ne[2] slices were quantized and the rest of the rows were dropped. Use ggml_nrows(tensor) to count all rows, including ne[3]. Fixes #29916 llama-quant : detect expert tensors by name and fix imatrix size for 4D tensors The MXFP4_MOE path used ne[2] > 1 to detect MoE expert tensors. This is wrong for non-expert tensors with 3 or more dims, e.g. MLA projections (BailingMoE3) and 4D conv kernels. Use the tensor name instead: all tensors used by GGML_OP_MUL_MAT_ID are named *_exps or *_chexps. This also removes the BailingMoE3 special case. The imatrix holds one vector of ne[0] values per 2D slice, so the expected size is ne[0]*ne[2]*ne[3], not ne[0]*ne[2]. This matches how the imatrix is indexed per row for 4D tensors in llama_tensor_quantize_impl. Assisted-by: Claude Opus 5.5 Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/59658790 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Introducing Clown Prophecy (The only actually fix to degredation)

/u/roychodraws — Mon, 26 Oct 2026 00:00:00 +0000

82% · Usable today 82%

Clown Context Suite: chain MiniMax H3 clips without them slowly turning to mush If you’ve chained H3 clips, you know the problem. Every new clip starts from the tail of the last one, and each time a little detail gets lost. That loss stacks up, so by clip 10 everything looks soft and washed out. The reason is that we only ever tell the model where to start . We never tell it where to end . It’s like telling an archer roughly which way to aim but never giving them a target. They can be the best archer in the world and they still won’t hit the spot you wanted. So I gave it a target. There are three pieces: 🎈 Clown Context takes the last frames of the previous clip and pins them to the start of the new one, so the motion carries over smoothly. 🔮 Clown Prophecy is the time travel part. Before a shot is rendered, it renders just the ending of that shot as a short, fresh clip, straight from the shot’s prompt and reference pictures. Because it’s made from scratch and not from a tired old tail, it’s full quality. It’s basically a picture of how the shot is supposed to end, from a video that doesn’t exist yet. 🤡 Clown Anchoring takes that ending and pins it to the back of the shot. Now the shot has a good start from the last clip and a clean target at the end, and the model has to fill in the middle and land on good-quality frames. Every time you do that, the quality gets pulled back up. Run Prophecy every couple of shots and the degradation never gets bad enough to notice. Other stuff in the pack: Bypass switch and “run every N shots” , so you can drop it into any workflow and only use Prophecy when you want it. Clown Shot Counter can count your saved clips by itself, so batches just work. An example workflow is included. GitHub: https://github.com/roycho87/clown_context_suite big thanks to u/shutupyourewrong for helping me brainstorm this. I wouldn't have gotten to this point without bouncing ideas off him. Also for giving me the name. Also, believe it or not I have to give some credit to foxydits. He claimed the secret to stopping degradation was to put an end frame reference image which.... was completely wrong... but it did spark the idea that helped me come up with this. In honor of his contribution I've changed the name of my workflow. submitted by /u/roychodraws to r/StableDiffusion [link] [comments]

Just finished my multiplayer system in C and turns out we can support 50k players in a single server at 60hz simulation tick

/u/dechichi — Mon, 26 Oct 2026 00:00:00 +0000

82% · Measured result 82%

submitted by /u/dechichi to r/programming [link] [comments]

llama.cpp b11888

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

82% · Usable today 82%, First-party 77%

common, grammar: add recursive depth limit, make it a requirement ( #31153 ) common, grammar: add recursive depth limit, make it a requirement catch more recursive functions common : tidy up peg parser changes grammar : reject candidates in a loop, without a depth limit The depth limit in llama_grammar_reject_candidates_for_stack counted the code points of a vocab token, so any token of 256 chars or more was always rejected under a grammar, such as the 512-space token of GLM-4.7-Flash or the long space tokens of Laguna-S-2.1. The rejection now walks the code points with its own stack of levels instead of recursing: there is no limit and no stack risk, whatever the length of a token from the GGUF, and the masks match master. grammar : track rejected candidates as indices into the input At a given code point a candidate only differs from its input by the position of its code point pointer, so the levels now carry indices into the input candidates instead of copies. The first level needs no special case and the rejects map back to the input directly. Grammar sampling gets faster than master on GLM-4.7, Laguna, Qwen3.6 and gemma-4 with the json, list and spaces grammars, same masks. nit : shorten the comment of llama_grammar_reject_step common : add depth_guard for schema walks grammar : move GRAMMAR_RECURSIVE_LIMIT into the .cpp common : reduce recursion limit for peg parser improve Co-authored-by: Alde Rojas hello@alde.dev Co-authored-by: Pascal admin@serveurperso.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/59723426 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11884

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

82% · First-party 82%, Usable today 81%

llama: fix exhausting CPU and MEM caused by dry sequence breaker ( #31035 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/59663486 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Flight Simulator 95/98 finally running on 64-bit Windows, patched by Claude Code

/u/Torturephile — Mon, 26 Oct 2026 00:00:00 +0000

80% · Usable today 80%

Howdy there. I'm a lifelong fan of Flight Simulator who doesn't let go of old stuff. Since I've seen people using Claude Code to come up with some crazy mods that mash two entirely unrelated games together without somehow breaking, I figured I'd give Claude Code two old games, FS95 and FS98 , which don't run on 64-bit Windows, to figure out why they won't. Something much simpler, right? I knew for about ten years that both games crash out of divide by zero exceptions that occur with their handling of their 2D and 3D windows, so I suspected that the issue had to do with two of both games' DLLs, namely WINDOW.DLL and G3D.DLL. I tried running both games with DxWnd with the "handle exceptions" box ticked, but the games were unplayable with extremely glitchy rendering. A Reddit user named u/rozniak wrote some interesting stuff about it years ago. Anyway, I got Claude to patch the aforementioned DLLs for FS95 and it worked, but once I was debugging FS98 , it discovered that it was the game's EXE file that was the culprit, not the DLLs. It used its finding to trace down the same issue in FS95 's EXE so its original DLLs could be left alone. Here's what Claude stated: "FLTSIM98.EXE contains the game's routine Microsoft wrote to handle these faulting divisions. When a division fails, it reads the instruction from memory, puts a capped result in the right registers, and skips past the instruction. The game runs everything under it with __try / __except , which is exactly the mechanism 64-bit Windows can’t reach inside a window callback. Windows has a second kind of exception handler, the vectored handler, which runs before that callback boundary matters. The game’s routine has exactly the signature such a handler needs. So the patch adds 86 bytes at the program’s entry point that register the routine with AddVectoredExceptionHandler and then start the game normally. One patch covers every division with exactly the results the game was written for." To add to this, FS95 has its routine located on its DIVTRAP.DLL, not on its EXE like FS98 does. With that said, now both games run on 64-bit Windows with no issue based on my testing. Here's the MediaFire download of the EXE patcher, because I don't feel like supplying the EXEs myself. Alternatively, here's the GitHub link since someone requested it. You still need to install the games, either from your CDs or from the high seas. Read the readme file included for instructions, please. Also, please comment about any issues. Edit: the patch was redone so that it only handles the division faults, so if the game crashes for non-division faults, Windows will handle it. The assembly code is now included as well. Sorry mods for updating the text again. submitted by /u/Torturephile to r/ClaudeAI [link] [comments]

iPhone Duo teardown: 5/10 repairability, a foldable record, but some screens crack along the fold, possibly because a hinge support bar fails to drop far enough (Elizabeth Chamberlain/iFixit News)

Mon, 26 Oct 2026 00:00:00 +0000

80% · Measured result 80%, Usable today 35%

Elizabeth Chamberlain / iFixit News : iPhone Duo teardown: 5/10 repairability, a foldable record, but some screens crack along the fold, possibly because a hinge support bar fails to drop far enough — Apple's folding iPhone finally made it to our teardown table. Some owners' screens didn't make it through setup.

llama.cpp b11889

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 57%

cuda : use std::string instead of VLA for archName ( #30463 ) cuda : use std::string instead of VLA for archName Modernize the code (old C style) and fix the following warnings: ggml/src/ggml-cuda/ggml-cuda.cu:180:19: warning: variable length arrays in C++ are a Clang extension [-Wvla-cxx-extension] 180 | char archName[archLen + 1]; | ^~~~~~~~~~~ ggml/src/ggml-cuda/ggml-cuda.cu:180:19: note: read of non-const variable 'archLen' is not allowed in a constant expression ggml/src/ggml-cuda/ggml-cuda.cu:179:9: note: declared here 179 | int archLen = strlen(devName); | ^ Signed-off-by: Adrien Gallouët angt@huggingface.co Add a comment about archName Signed-off-by: Adrien Gallouët adrien@gallouet.fr Signed-off-by: Adrien Gallouët angt@huggingface.co Signed-off-by: Adrien Gallouët adrien@gallouet.fr Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/59725951 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11880

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

80% · First-party 80%, Usable today 78%

tools : reject truncated GGUF tensor data in merge ( #31044 ) Co-authored-by: Shreya Agrawal shreyaagrawal@Shreyas-MacBook-Air.local Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/59649636 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11879

github-actions[bot] — Mon, 26 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 71%

CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/up rows ( #29948 ) cuda: fuse FFN gate/up and GLU in MMQ with interleaved gate/up rows For prompt processing, run the gate and up matmuls of a dense FFN as one mul_mat_q launch and apply the GLU in the write-back. The loaders take the gate weights as a second pointer and fill the weight tile with up and gate rows interleaved in chunks of 8, so each thread holds an up value and the matching gate value (rows r and r + 8 of an MMA tile). The MMA loop is unchanged: same tile, warp layout, vec_dot and one sum[] per thread. The fused write-back computes the GLU from registers and writes half the rows. The fused path uses the regular tiling (no stream-k) with the column tiles innermost so that neighbouring blocks share weight tiles. Enabled for Q4_K, Q5_K, Q6_K, Q8_0 and IQ4_XS on NVIDIA Turing and newer. cuda: assert the fused MMQ gate argument and trim redundant comments cuda: move the fused MMQ hint check to should_fuse and add TODOs cuda: pass prec_src1 to the fused MMQ write-back cuda: fuse only with efficient tiling and no fallback, merge the GLU write-back cuda: require has_fusion explicitly, drop the fusion-only src1 precision check cuda: launch the fused MMQ kernel through the stream-k kernel with one block per tile cuda: inline the MMQ tiling-efficiency check tests: one fused gate/up MMQ case per type and GLU op cuda: always launch the fused MMQ kernel with one block per tile tests: shorten the fused gate/up MMQ test comment cuda: select the fused MMQ loader and write-back in ggml_cuda_mmq_get_util_funcs cuda: run the fused MMQ kernel on the plain tiling path cuda: put the column tiles innermost in the MMQ plain tiling path Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/59646971 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

★ Meta's 816B Muse Spark Open scores 39 on Artificial Analysis, the 180B Qwen3.8-Flash-Next scores 40. Score vs size for 11 open-weight models

/u/BTA_Labs — Fri, 23 Oct 2026 00:00:00 +0000

98% · Measured result 98%

Made this from the Artificial Analysis model pages after Muse Spark Open and Beam got their scores last week. X axis is total parameters as AA lists them, log scale. Orange = released in October 2026. - Muse Spark Open (816B, 42B active) scores 39. Qwen3.8-Flash-Next (180B, 6B active) scores 40. - The Unsloth UD-Q4_K_XL GGUFs are about 506 GB for Muse Spark Open and 111 GB for Qwen3.8-Flash-Next. - Meta's recommended local setup for Muse Spark Open is two M5 Ultra Mac Studios with 512 GB each. - Qwen3.8 27B scores 34, above Beam (501B) at 30 and Nemotron 3.5 Bolt (74B) at 21. Unsloth lists 16 to 19 GB of memory for its 4-bit quants. - Highest on the chart is MiMo-V2.6-Pro (1T) at 46, then DeepSeek V4.1 Flash 1017 (552B) and GLM-5.3 (753B) at 45. The index is one aggregate number from AA's own eval runs. It says nothing about speed, long context, vision, or how a model does on your own tasks. Table with active params, licenses and links in the comments. submitted by /u/BTA_Labs to r/LocalLLaMA [link] [comments]

★ Q-Labs Presents "Noise": Pretraining Without Backpropagation | "In The 10 Days Since We Released The Noise Speedrun, The Time To Pretrain A Transformer Went From 1.76 Hours To 1.6 Seconds, A 4,000x Speedup!!!"

/u/Lord_44th__Raikage — Fri, 23 Oct 2026 00:00:00 +0000

94% · Measured result 94%, First-party 89%, Usable today 68%

https://freeimage.host/i/neCfqyx Expounding Information: Backprop is the only credit assignment algorithm that trains modern neural nets, and the field has co-evolved around it: it needs differentiability and gives first-order gradients, and our architectures, optimizers and hardware are built around it. As compute keeps growing, brute-force learning algorithms based on search may overtake it. The bitter lesson is that general methods which scale with compute win; AlphaGo Zero is the obvious example: bootstrapping on human games helped at first, and pure self-play won once there was enough compute. Differentiability and backprop may be the same kind of bias: efficient while compute is scarce, limiting once there is enough of it. They constrain which architectures work, and even for the ones that do, they explore the loss landscape poorly, which may be why today's networks need so much data to generalize. We think replacing backprop with a much better credit assignment algorithm is inevitable. Noise tests that on the hardest task we know, pretraining language models, and scores two things: how low the validation loss goes given a lot of compute, and how fast it gets there. We just published Noise, our attempt to replace backprop with brute-force computation rather than analytic structure. Noise perturbs activations instead of weights, independently at every token, so one forward pass evaluates thousands of population members, and the reward-weighted noise becomes a gradient estimate for an ordinary optimizer. Activations are where interpretability work finds the model's reasoning, so training becomes a search over latent reasoning. Link to the GitHub: https://github.com/qlabs-eng/noise Link to the Announcement Article: https://t.co/uUF3VnQ2LN submitted by /u/Lord_44th__Raikage to r/accelerate [link] [comments]

★ ollama v0.40.9

github-actions[bot] — Fri, 23 Oct 2026 00:00:00 +0000

94% · First-party 94%, Usable today 87%

Speech Ollama can now generate speech with Phonon on Apple Silicon. ollama run plays text or a chat model's reply aloud as the audio is generated, and apps can stream audio through the OpenAI-compatible /v1/audio/speech endpoint. ollama run phonon " Hello from Ollama. " d3 decision models d3 brings vLLM Semantic Router's decision models to Ollama. Give a model text, structured state, or an image, and ask it to classify, answer yes or no, or score options with probabilities. The family includes 2B, 4B, 9B, and 27B sizes. ollama run d3 " A customer says their card was charged twice. " --ask " Is this a billing issue? " Flint on Linux and Windows Flint now runs on Linux and Windows as well as macOS. Other improvements Streaming OpenAI Responses and Anthropic Messages requests now report generation failures instead of ending silently after partial output. ollama launch now passes cloud models' context lengths and capabilities to coding tools, fixing incorrect context and compaction settings. Anthropic-compatible web search now uses the model's supported thinking setting in follow-up requests, preventing avoidable failures. Full Changelog : v0.40.8...v0.40.9

★ Anthropic donates the Agent Skills open standard to the Agentic AI Foundation and says 70+ platforms have integrated it, after donating MCP to the AAIF in 2025 (Anthropic)

Fri, 23 Oct 2026 00:00:00 +0000

93% · First-party 93%, Usable today 37%

Anthropic : Anthropic donates the Agent Skills open standard to the Agentic AI Foundation and says 70+ platforms have integrated it, after donating MCP to the AAIF in 2025 — Today, we're donating Agent Skills, the open standard that gives AI agents specialized knowledge and workflows, to the Agentic AI Foundation (AAIF).

★ MOSS-Image-Edit LoRA

/u/LatentSpacer — Fri, 23 Oct 2026 00:00:00 +0000

92% · Usable today 92%

An edit LoRA for MOSS Image has been released. Works with both Base and SFT. Weights: https://huggingface.co/chinoll/Moss-Image-Edit Custom nodes / Workflows: https://github.com/Chenkin-x/ComfyUI-Moss-Image-Edit/blob/main/README.en.md Edit: I implemented it natively with caching for faster inference. The LoRA is a bit rough. Let me know how it's working for you. Custom nodes / Workflows: https://github.com/PedroMarinhoDev/ComfyUI-Moss-Image-Edit-Native ComfyUI-compatible weights: https://huggingface.co/PedroMarinhoDev/Moss-Image-Edit-ComfyUI There's an open PR by Kijai on ComfyUI so it might be merged and supported natively later. https://github.com/Comfy-Org/ComfyUI/pull/17296 https://preview.redd.it/hgdiyvw0d1xh1.png?width=2400&format=png&auto=webp&s=89ac4b4f86a821e2dff5c7c64e4918daa0d1f9c5 I have no relation to the weights or custom nodes, just sharing them. submitted by /u/LatentSpacer to r/StableDiffusion [link] [comments]

★ eMudhra to exit global SSL/TLS certificate business

bo0tzz — Fri, 23 Oct 2026 00:00:00 +0000

92% · First-party 92%

Article URL: https://emudhra.com/en/press-release/emudhra-to-exit-global-ssl-tls-certificate-business Comments URL: https://news.ycombinator.com/item?id=50195110 Points: 1006 # Comments: 666

★ Ant Ling just announced a second model today: Ling-3.0-flash-Sante (124B, 5.1B active)

/u/BerryBlush_Rogers691 — Fri, 23 Oct 2026 00:00:00 +0000

91% · Usable today 91%, First-party 42%

InclusionAI just announced Sante too. Damn, two model announcements in one day. They're on a roll. I posted about the 3.1-flash-1019 update earlier today and they've already announced Sante . Two model announcements in one day, damn. This one's built on Ling-3.0-flash , with 124B total parameters, 5.1B active per token and a 256K context window. It's a healthcare-focused version aimed at medical reasoning, literature research and tool-assisted workflows. The weights are already up on Hugging Face . I'm glad they're still building on 3.0. So much of the earlier thread turned into a discussion about finding enough memory for 3.1 that seeing something happening with the older base caught my attention. I'd like more of these focused releases. Pick a field, put some work into it, give people the weights to explore it themselves. This is a more interesting direction to me than another few points on a general leaderboard. submitted by /u/BerryBlush_Rogers691 to r/LocalLLaMA [link] [comments]

★ Crystal 1.22

ksec — Fri, 23 Oct 2026 00:00:00 +0000

91% · First-party 91%, Usable today 71%

Article URL: https://crystal-lang.org/2026/10/12/1.22.0-released/ Comments URL: https://news.ycombinator.com/item?id=50194938 Points: 173 # Comments: 90

★ Quad9 to exit France

farrokhi — Fri, 23 Oct 2026 00:00:00 +0000

90% · First-party 90%

Article URL: https://quad9.net/news/blog/au-revoir-france/ Comments URL: https://news.ycombinator.com/item?id=50195959 Points: 1124 # Comments: 389

inclusionAI/Ling-3.0-flash-Sante · Hugging Face

/u/jacek2023 — Fri, 23 Oct 2026 00:00:00 +0000

87% · Usable today 87%, First-party 71%

from inclusionAI: Introduction Ling-3.0-flash-Sante is our healthcare-specialized model built on Ling-3.0-flash . Its name comes from the French word santé , meaning “health.” With 124B total parameters and 5.1B active parameters per token , Sante is designed for medical reasoning, healthcare research, deep research, and tool-assisted workflows while retaining the general capabilities of Ling-3.0-flash. Model weights are available on Hugging Face and ModelScope . Important: Ling-3.0-flash-Sante is a research model, not a medical device. Its outputs may be incomplete or incorrect and must not be used as a substitute for professional medical advice, diagnosis, or treatment. High-stakes use requires qualified human review, independent verification, and compliance with applicable privacy, security, and healthcare regulations. Highlights Strong healthcare capabilities: Sante performs well across professional healthcare tasks, complex medical reasoning, medical knowledge, and healthcare safety benchmarks. Efficient at scale: Its hybrid-linear MoE architecture combines Kimi Delta Attention (KDA), gated MLA, and sparse MoE layers, activating 5.1B of 124B parameters per token. Built for long contexts: Training extends to 256K tokens, supporting long-document analysis, evidence synthesis, and multi-step research. Beyond medical QA: Sante is designed for deep research, tool-assisted workflows, and multi-agent collaboration as well as question answering. Native reasoning and tool use: Thinking mode is enabled by default, with tool calling supported through compatible serving frameworks.Introduction submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

Introducing NPCTalk: Make the NPCs of any game talk in realtime, in character, in their own cloned voice, in under 1s, and they act on what you say.

/u/Prime-Paradox — Fri, 23 Oct 2026 00:00:00 +0000

85% · Measured result 85%, Usable today 69%

From Universal Modder on X: "Introducing NPCTalk: make the NPCs of any game talk in realtime. I made every NPC in GTA V answer to me in character, in their own cloned voice, in under 1s, and they act on what you say.” “Packaged all the skills Claude learned into a single repo, built on open models: NVIDIA Nemotron ASR for transcription, Qwen 3.8 27B for realtime dialogue, and Fish Audio Drama 3 for the cloned voices, self-hosted on a serverless GPU. " submitted by /u/Prime-Paradox to r/singularity [link] [comments]

testing minimax h3 ref2va with my ps2 style lora

/u/aziib — Fri, 23 Oct 2026 00:00:00 +0000

85% · Usable today 85%

you can get my lora in here: https://civitai.com/models/2983280/modern-ps2-style works with text to image and image to video too. submitted by /u/aziib to r/StableDiffusion [link] [comments]

llama.cpp b11827

github-actions[bot] — Fri, 23 Oct 2026 00:00:00 +0000

84% · Usable today 84%, First-party 80%

opencl: add depthwise conv2d ( #30900 ) opencl: add Adreno depthwise conv2d Assisted-by: OpenCode opencl: use local program for depthwise conv2d Assisted-by: OpenCode opencl: use singed type for args Co-authored-by: Li He lih@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58789398 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

The Fifth Element But Making More Sense

/u/Dry-Statistician-684 — Fri, 23 Oct 2026 00:00:00 +0000

83% · Usable today 83%

Minimax H3 Ref2v, RTX 3060, 64 GBs RAM. I use a workflow with latent upscaling. The first pass is a low-res video which is upscaled later. The overall quality looks better and it also helps to fix smearing. https://drive.google.com/file/d/1hPqPPRdvox_5vVL3mGPgnTlJ1gTmhmcd/view The upscaler https://huggingface.co/LBH-123-AI/Minimax_h3_latent_Upscaler/tree/main Turbo Lora https://huggingface.co/lightx2v/Minimax-h3-Turbo/tree/main You also need to install these nodes https://github.com/LBH-123-AI/Comfyui_Minimax_h3_latent_Upscaler submitted by /u/Dry-Statistician-684 to r/StableDiffusion [link] [comments]

llama.cpp b11829

github-actions[bot] — Fri, 23 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 82%

server: Substitute rerank placeholder from the original template only. ( #30864 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58867720 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11836

github-actions[bot] — Fri, 23 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 80%

CANN: missing const qualifiers added for consistency ( #30933 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58989960 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11826

github-actions[bot] — Fri, 23 Oct 2026 00:00:00 +0000

82% · First-party 82%, Usable today 81%

mtmd : add MiniCPM-OCR 1.0 support ( #30979 ) Signed-off-by: tc-mb tianchi_cai@icloud.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58775194 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

ollama v0.40.9-rc1

dhiltgen — Fri, 23 Oct 2026 00:00:00 +0000

82% · First-party 82%, Usable today 54%

llama.cpp update ( #19194 )

MiniMax-M3.1-Flash

/u/mrtime777 — Fri, 23 Oct 2026 00:00:00 +0000

80% · Usable today 80%

https://huggingface.co/MiniMaxAI/MiniMax-M3.1-Flash submitted by /u/mrtime777 to r/LocalLLaMA [link] [comments]

Canva launches Craft, its first image generation model, trained on human-designed templates, available to all users, with plans to support third-party chatbots (Ivan Mehta/TechCrunch)

Fri, 23 Oct 2026 00:00:00 +0000

80% · Usable today 80%

Ivan Mehta / TechCrunch : Canva launches Craft, its first image generation model, trained on human-designed templates, available to all users, with plans to support third-party chatbots — Design platform Canva released its first image generation model, called Canva Craft, developed by its research team to compete …

llama.cpp b11828

github-actions[bot] — Fri, 23 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 74%

server: realtime API: send complete after committed audio drains ( #30994 ) server: realtime API: send complete after committed audio drains server: realtime API: complete a commit at its end row Completion is triggered when the stream runs dry, which is a timing proxy: audio appended while the tail drains leaks into the committed item, a final commit before the drain merges both items, and back to back commits collapse into one. mtmd_audio_stream_flush() records the row count at the end of the flushed audio (mtmd_audio_stream_get_n_rows_flushed), next to the rows produced so far (mtmd_audio_stream_get_n_rows). The slot keeps a FIFO of these end rows and completes each commit once every row up to it is decoded. Co-authored-by: Pascal admin@serveurperso.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58863355 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

★ 35B MoE running at 20.5 tok/s on an iPhone, without skipping experts

/u/GasSmooth7439 — Thu, 22 Oct 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 77%

I came across OpenBMB’s engineering write-up on running large MoE models locally, and the systems work behind it is worth highlighting. Instead of shrinking the model or skipping experts, they tackled the real bottleneck: getting expert weights from flash storage to computation fast enough. OpenBMB’s MiniCPM-V 4.7 uses a technique called Lookahead Expert Scheduling (LES) to run a 35B-A3B MoE model locally without changing its actual routing or dropping experts. The key idea: predict which experts the next layer might need, preload their weights from flash storage while current computations run, and execute ready experts first. Combined with optimized weight layouts, mixed-precision quantization, and DSpark speculative decoding, LES achieves: 20.51 tok/s on iPhone 18 Pro Max 6.07× faster than the 3.38 tok/s baseline 26.7% smaller expert weights with only a 0.16-point drop across five benchmarks Around 3 GB peak memory in a low-memory configuration The implementation, including expert scheduling and DSpark integration, is open source in llama.cpp-omni . The interesting part is that LES hides memory bottlenecks without changing which experts the model actually executes. This approach could potentially work with other MoE models, too. submitted by /u/GasSmooth7439 to r/LocalLLaMA [link] [comments]

★ Qwen3.8-Flash-Next vs Opus 5.5: Six-way benchmark on a real Rust feature with Claude Code and Pi

/u/deepu105 — Thu, 22 Oct 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 39%

Reposting again since original post got removed by Reddit for some reason (I have no idea why) A few of you pointed out in my last post that comparing Flash-Next and Opus with different harnesses and effort levels wasn't fair. So here is a more controlled comparison. Same task for every run: a real feature from the LlamaStash roadmap (save llama-server's KV cache before an unload and restore it when the model comes back). Six combinations, each run twice, so 12 PRs. Flash-Next ran locally on my Strix Halo laptop (Flow Z13) via Halogen (~Q4 quant). Opus 5.5, Flash-Next, and Kimi K3 scored every PR on seven review questions plus CI. Combination Score (of 8) Time API cost Tokens (in / cached / out) Claude Code + Opus 5.5, xhigh 6.94 (87%) 43.5 min $17.78 507k / 48.3M / 203k Claude Code + Opus 5.5, medium 6.25 (78%) 23.4 min $6.52 242k / 13.4M / 95k Claude Code + Flash-Next, medium 5.5 (69%) 45.3 min $0.32 445k / 13.5M / 82k Pi + Flash-Next, xhigh 5.44 (68%) 63.8 min $0.67 316k / 35.0M / 134k Claude Code + Flash-Next, xhigh 5.38 (67%) 49.5 min $0.39 269k / 18.9M / 99k Pi + Flash-Next, medium 5.06 (63%) 48.1 min $0.56 242k / 29.1M / 117k Scores are the average of both runs. Time, cost and tokens are from the second run, where the 100k-token benchmark numbers were given in the prompt. Flash-Next cost is at the QwenCloud price for Qwen3.8-Flash; I ran it locally, so it cost me only electricity. TL;DR All 12 runs finished and all 12 PRs pass the end-to-end test. Opus wrote better code, 82% on average against 68% for Claude Code + Flash-Next and 66% for Pi + Flash-Next. The difference is in edge cases, tests and docs. The core feature works fine. The gap between Opus and Qwen is not that wide. Flash-Next took 1.1x to 2.1x as long as Opus at the same effort. With Flash-Next, Claude Code and Pi scored the same on the review questions. CI passed on 4 of 4 Claude Code PRs and 1 of 4 Pi PRs. xhigh helped Opus a bit at 2.7x the cost. For Flash-Next, medium and xhigh scored about the same, and medium was faster in all 4 pairs. Opus is still ahead, but Flash-Next was right behind, on my laptop, for the cost of electricity. Also note that the models are not on the same league. Opus is a frontier model run at FP16 or atleast FP8. I ran Flash-Next on my laptop at 4.16 bpw . Flash-Next at FP8 should show a bit more quality. The machine running Flash-Next ran at 70W TDP ceiling for the entire duration. I could have run it at 90W for slightly better speed but the fan noise and thermal stress was not worth it. Full write-up with the detailed methodology and the per-run results and what each model missed: https://deepu.tech/qwen3.8-flash-next-vs-claude-opus-showdown All 12 PRs are public if you want to read the code: https://github.com/deepu105/llamastash-b4r2/pulls submitted by /u/deepu105 to r/LocalLLaMA [link] [comments]

★ Amazing free 3090 speedup hack, verified works 15% PP, 5% TG for free

/u/Striking_Luck_886 — Thu, 22 Oct 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 41%

I saw this today on X and decided to try it, I havent seen it posted here yet. I ran it on a single 3090 benchmarked it with qwen 3.8 27B before and after the optimization and saw these results: Observed prompt-processing throughput improved 22–30% ; generation speed improved 1–5% . All tests passed without GPU errors. Edit: Keep in mind performance gains can be higher, my 3090 is power limited to 230 watts including during my tests submitted by /u/Striking_Luck_886 to r/LocalLLaMA [link] [comments]

★ ollama v0.40.8

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

97% · Measured result 97%, Usable today 81%, First-party 76%

Recursive Flint Flint brings Recursive's coding model to Ollama. It is designed for the work coding agents do across a repository: understanding unfamiliar code, tracing bugs, implementing features, and adding tests. Reasoning, multi-turn tool use, and a 262K-token context window support longer tasks across files and tool interactions. Flint is an Apache 2.0-licensed, 40B-parameter mixture-of-experts model with approximately 2.5B parameters active per token. In its release evaluations , Recursive reports 54.9% on Terminal-Bench 2.1 and 74.2% on SWE-bench Verified. ollama run flint Note: Flint is supported on MacOS. Other GPU support will be enabled in a subsequent release. Full Changelog : v0.40.7...v0.40.8

★ I trained a Fibo 2.0 LoRA a day after release and put my plush dragon into famous pictures

/u/SirToki — Thu, 22 Oct 2026 00:00:00 +0000

96% · Measured result 96%, Usable today 54%

Bria released Fibo 2.0 yesterday and I wanted to see how it does with a character LoRA and create something that I can actually post (all my other datasets are not royalty-free). The dragon is a plush mascot I use for my LoRA portfolio. 15 training images. What I used: Bria's train_lora.py from the Fibo-2.0-dev repo 1024px, rank 64, alpha 64, lr 1e-4 constant, AdamW, batch 1, grad accum 2 400 steps, the likeness was already there at 200, and 300 was the best (this might hugely differ for human characters but I did not want to do a synthesized human) Rented an A100 40GB on Vast. It peaked at about 23 GB VRAM, ran at 6.2 s/step, and training took about 42 min. Each edit took about 80-90 seconds About $2 in GPU time in total The lora works really well with a plain edit instruction and doesn't change much else If you add a reference image from the dataset, it can give better results (It drew the outfits like the space suit.) but it often changes the whole picture On Abbey Road I asked it to add the dragon as a fifth person but it just replaced one of the Beatles (I don't know which one, sorry.) I kept it because I found it funny. The full settings and VRAM numbers are on my tracker, link in the comments. Fully free, no ads, just my referral links. submitted by /u/SirToki to r/StableDiffusion [link] [comments]

★ [Paper] MemT-1.0: Towards Memory-Native Evolution

/u/pmttyji — Thu, 22 Oct 2026 00:00:00 +0000

95% · Measured result 95%, Usable today 83%, First-party 69%

Memory-native evolution requires making memory an intrinsic capability of foundation models, enabling them to continuously accumulate and utilize information. To this end, we introduce MemT-1.0, a new architecture of memory foundation models that internalize memory as part of model computation. Building on Metis, MemT-1.0 employs Gated DeltaNet-2 with a stable token-level memory update mechanism within each turn. We further introduce Mixture-of-Storage to scale native memory capacity. Following a deliberate backbone preparation, we develop a two-stage training pipeline consisting of continued pre-training and post-training, supported by 34B tokens of training data and efficient training and inference infrastructure. We release a model family comprising MemT-1.0-Nano and MemT-1.0-Flash, and conduct a comprehensive evaluation of memory and general capabilities. The results show that they outperform the parametric memory baselines on average and remain competitive with retrieval-augmented methods, while largely preserving general capabilities. At a history length of 128K tokens, MemT-1.0-Nano achieves approximately 1.86× end-to-end inference speedup and a 66× reduction in persistent storage relative to full context KV cache . By internalizing retrieved procedural experience, MemT-1.0 improves task success on agentic tasks, providing a practical step toward memory-native evolution. arXiv : https://arxiv.org/abs/2610.26825 PDF : https://arxiv.org/pdf/2610.26825 GitHub : https://github.com/MemTensor/MemT-1.0 HuggingFace : https://huggingface.co/collections/MemTensor/memt-1 submitted by /u/pmttyji to r/LocalLLaMA [link] [comments]

★ Kitten-TTS 2: New Open-source SOTA 1.58 bit TTS (CPU-only with voice cloning, multilingual, emotion control)

/u/ElectricalBar7464 — Thu, 22 Oct 2026 00:00:00 +0000

93% · Usable today 93%, First-party 35%

KittenML has just released code and weights of Kitten-TTS 2, which is a super-efficient frontier TTS model, and the world's first 1.58-bit TTS model . It runs in real time on just a CPU, with zero-shot voice cloning, multilingual support, and expressive / emphasis control. Code and weights are open-source. Ternary(1.58-bit) Weights means it can run locally or be self-hosted for super-cheap. Github: https://github.com/KittenML/KittenTTS Hugging Face: https://huggingface.co/KittenML/kitten-tts-2 KittenML's Discord: https://discord.com/invite/VJ86W4SURW Key features and Advantages Ternary TTS: Every linear weight in the body is one of three values (-1, 0, +1) with group size of 128 for scales. Tiny footprint and fast CPU inference. The model has 1.7B parameters. Real-time on CPU and consumer GPU's too : No GPU needed for real-time generation. Optimized ternary kernels for CPU inference provided. Expressive voice cloning : zero-shot cloning from less than 5 seconds of reference audio, and it keeps the expressivity, accent information etc. No fine-tuning needed. Multilingual TTS: Model supports voice cloning in 20+ languages. Cross-language voice cloning can be used to create accented speech too. Expressive / emphasis control: you can steer the delivery and stress specific words, not just pick a voice. Details in the Readme. Open source (hell yeah!) : code and weights are open-source and free to use. It's an oss alternative to elevenlabs for gpu-poor folks. easy to self-deploy or run locally. 7. What changed from V0.8 to 2: higher quality. Completely new architecture, natural sounding speech, ternary weights, zero-shot voice cloning, multilingual, and emphasis/emotion control. submitted by /u/ElectricalBar7464 to r/LocalLLaMA [link] [comments]

★ DuckDB 2.0.0 LTS “Cinnamon Teal”

nnx — Thu, 22 Oct 2026 00:00:00 +0000

93% · First-party 93%, Usable today 79%

Article URL: https://duckdb.org/2026/10/21/announcing-duckdb-200 Comments URL: https://news.ycombinator.com/item?id=50181136 Points: 395 # Comments: 52

★ [Paper] Specter: Fast MoE Inference via Quantization-Enabled Multi-Step Speculative Offloading

/u/pmttyji — Thu, 22 Oct 2026 00:00:00 +0000

92% · Measured result 92%, Usable today 69%

Mixture-of-experts (MoE) models often exceed a single accelerator's memory capacity. Offloading experts to host memory creates a severe PCIe I/O bottleneck because data-dependent routing keeps transfers on the critical path. We present Specter, an inference system that uses quantization to combine speculative decoding with expert offloading. Its lightweight quantized draft model runs efficiently on device while preserving high-fidelity expert activation patterns. This provides accurate multi-step lookahead over future expert usage, allowing the runtime to organize expert movement and execution ahead of verification and improve both communication and execution efficiency. Under single-request inference, Specter achieves an average 1.50x (up to 1.88x) speedup in time per output token (TPOT) over the state-of-the-art system. Specter makes memory-constrained, single-GPU MoE inference more practical on commodity hardware . Our code is available at this https URL . arXiv : https://arxiv.org/abs/2511.14102 PDF : https://arxiv.org/pdf/2511.14102 GitHub : https://github.com/wwwwwf/specter_asplos submitted by /u/pmttyji to r/LocalLLaMA [link] [comments]

★ Built a live 3D airport with real flights using Claude Code

/u/ReadyAviatorOfficial — Thu, 22 Oct 2026 00:00:00 +0000

91% · Usable today 91%, First-party 73%

I run a small exam-prep site for pilot students in India and have no CS background. Over the last few months I’ve been building this with Claude Code: a 3D model of Delhi airport that shows the real traffic live. What it does: Real flights landing, taxiing and taking off, pulled from from licensed , self hosted and public sources Tap any aircraft to follow it, or sit in the cockpit Aircraft are drawn in their real airline colours Mumbai, Bengaluru and Hyderabad are live too, and it now tracks traffic about 50 km out How Claude helped: I’d describe what I wanted in plain English (“the plane should slow down on the runway like a real one”, “the gear should fold into the wing properly”) and Claude wrote the code, set up the server, and built checks so a new version can’t go live if it breaks something. The hardest parts were making taxiing look natural and keeping it fast on a normal phone. It’s free, no sign-up: airport.readyaviator.com Happy to answer questions about how it was built. submitted by /u/ReadyAviatorOfficial to r/ClaudeAI [link] [comments]

★ Cloud provider Railway says an unauthorized party may have accessed customer encrypted environment variables and, for some, obtained the decrypted contents (Jacob Cooper/Railway Blog)

Thu, 22 Oct 2026 00:00:00 +0000

91% · First-party 91%

Jacob Cooper / Railway Blog : Cloud provider Railway says an unauthorized party may have accessed customer encrypted environment variables and, for some, obtained the decrypted contents — Earlier this morning, Railway detected anomalous activity involving systems that store customer environment variables.

★ From 0 to €1k MRR: How fixing my SEO funnel turned my free D&D tool into a paying SaaS

/u/ExistentialHugger — Thu, 22 Oct 2026 00:00:00 +0000

90% · Measured result 90%, First-party 70%, Usable today 59%

Hey r/SaaS , For the past 7 months, I’ve been building RPGMapEditor.com - a web-based map editor for tabletop RPGs and D&D players. Up until august, the project was generating $0. I had built free generators (fantasy maps, dungeons, cities) which started bringing in organic search traffic (around 1,000+ monthly clicks from Google), but nobody was converting to the paid tier. 2 weeks ago, I redesigned the conversion flow between the free tools and the premium editor ($3/mo tier & €14.99 lifetime license). Here is what happened in October: - 📈 MRR: €1.000+ (First recurring subscribers!) - 🔍 100% Organic traffic (0 spent on ads) all comes from Bing, and Google Search! Key takeaways that moved the needle: Free tools are great for SEO, but you MUST give users a clear reason to save/export in the editor. Micro-pricing ($3/mo) works insanely well for hobbyist niches (D&D/gaming) where people hesitate to spend $20+/mo. Organic search traffic compound interest is real – it took 3 months of low clicks before Search Console shot up. It’s small money, but going from absolute zero to actual validated revenue feels incredible. Happy to answer any questions about the tech stack, SEO strategy, or conversion tweaks! submitted by /u/ExistentialHugger to r/SaaS [link] [comments]

★ GitLab critical patch release

artooro — Thu, 22 Oct 2026 00:00:00 +0000

90% · First-party 90%, Usable today 52%

Article URL: https://docs.gitlab.com/releases/patches/patch-release-gitlab-19-5-1-released/ Comments URL: https://news.ycombinator.com/item?id=50185869 Points: 305 # Comments: 73

★ PHP 8.5.12, 8.4.27, 8.3.36 and 8.2.35 out

timvdalen — Thu, 22 Oct 2026 00:00:00 +0000

90% · First-party 90%, Usable today 47%

Article URL: https://www.php.net/index.php Comments URL: https://news.ycombinator.com/item?id=50180943 Points: 276 # Comments: 2

★ Release v5.19.0

vasqu — Thu, 22 Oct 2026 00:00:00 +0000

90% · First-party 90%, Usable today 82%

★ Panache — RTS Belle Époque pour mobile

Thu, 22 Oct 2026 00:00:00 +0000

90% · Usable today 90%, First-party 36%

Panache — RTS Belle Époque pour mobile Well this is delightful: I released Battle Drones yesterday under an Apache 2.0 License and there's already a French language fork which reskins the game to take place in steampunk 1900s France and adds an animated intro! Panache est un jeu de stratégie en temps réel pour mobile et navigateur, dans la France de la Belle Époque (vers 1900) : dirigeables, Fardiers à vapeur, Creusot cuirassés, automates en képi, Gargantua la forteresse marchante — et beaucoup de panache. You can play Panache here - it's worth clicking that link just to experience the new intro video. So far it's mostly just aesthetic updates as opposed to gameplay changes. The music has had a French twist added to it as well. The new steampunk models are so cool! Here's a page with the original Battle Drones models and that same page with the new Panache alternatives . This is a comparison of the original and the new design for the Goliath: Via @Meffysto69 Tags: game-design , open-source

KRAFTON/Raon-1-mini-preview · Hugging Face

/u/jacek2023 — Thu, 22 Oct 2026 00:00:00 +0000

89% · Usable today 89%, Measured result 51%, First-party 50%

Raon-1 mini is a 30B-A4B Mixture-of-Experts (MoE) language model, designed and trained from scratch by KRAFTON AI . It demonstrates strong capabilities in Korean conversation and agentic tasks . As part of the Raon open model family, it is released under the Apache 2.0 license . https://huggingface.co/KRAFTON/Raon-1-mini-preview-gguf Highlights Reasoning : Built-in thinking, with leading results on the math and science benchmarks shown below. Instruction following and search : Leads the comparison models on the instruction-following and search benchmarks shown below. Korean and English : Strong Korean language ability, and solid performance in English. Agent execution : Tool calling for agentic workflows, with support for Hermes Agent, Pi and OpenCode. Speculative decoding support : A DFlash2 draft model is provided for accelerated speculative decoding. Quantization options : Available in MXFP8 and NVFP4 formats, with NVFP4 enabling inference on a single NVIDIA RTX 5090 gpu (32 GB VRAM). submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

MOSS-Image Vision Text Encode (ComfyUI node + workflow)

/u/ThetaCursed — Thu, 22 Oct 2026 00:00:00 +0000

89% · Usable today 89%

Built a custom node for MOSS-Image that feeds reference images directly through the Qwen3.5-9B vision tower and leaves its embeddings in the text conditioning - so the image conditions generation as part of the prompt, not as a VAE latent. - Custom Node + Workflow: https://github.com/ThetaCursed/ComfyUI-MOSSImageTextEncoder - LoRA used: https://huggingface.co/lodestones/MOSS-Image-SFT-8-steps-dmd/tree/main submitted by /u/ThetaCursed to r/StableDiffusion [link] [comments]

llama.cpp b11799

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

88% · First-party 88%, Usable today 86%

sycl: q8 fast dequant ( #30775 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58318564 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11798

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

88% · First-party 88%, Usable today 85%

jinja: support hexadecimal string escapes ( #30929 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58290954 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11808

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

87% · First-party 87%, Usable today 83%

dflash : load optional FC input scale ( #30945 ) Assisted-by: Codex Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58523956 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Patch release: v5.15.1

Cyrilvallez — Thu, 22 Oct 2026 00:00:00 +0000

87% · First-party 87%, Usable today 76%

Patch release v5.15.1 This patch most notably solves a few issues with DFlash and MTP candidate generators, as well as an issue where images could sometimes not be processed on accelerator if using Lanczos filter. It contains the following commits: Fix DFlash candidate token device mismatch with device_map="auto" ( #47877 ) by @sywangyi and @Cyrilvallez Align logit distributions for CandidateGenerators using sampling ( #48007 ) by @Cyrilvallez Fix MTP config when mlp_layer_types is absent ( #48015 ) by @Cyrilvallez Fallback from 'lanczos' to 'bicubic' when on cuda ( #48026 ) by @zucchini-nlp Fix gemma4 video to device ( #47896 ) by @guarin

"OpenAI models helped researchers—operating as part of our Patch the Planet initiative—discover critical security flaws in PHP, an open-source programming language used to run an estimated 70% of websites. Over the past two months, we led a coalition of maintainers, researchers, and security..."

/u/stealthispost — Thu, 22 Oct 2026 00:00:00 +0000

86% · First-party 86%

...providers to prepare fixes and protections ahead of disclosure. This duration was necessary because the fix was quite intricate and required a major change to the PHP engine. Every site using PHP can now safely upgrade their version to stay secure, in addition to applying mitigations from various security vendors. Due to the severity of these flaws and PHP’s widespread use, we consider this bug to be one of the most impactful vulnerabilities in recent memory. It also marks a new phase, where AI can find security bugs with internet-scale impact. This is an example of the Defender’s Window in action: to our knowledge, frontier AI was able to find this vulnerability ahead of attackers, giving defenders time to prepare. — OpenAI Source: https://x.com/OpenAI/status/2112907856018309586 submitted by /u/stealthispost to r/accelerate [link] [comments]

Original character LoRA for MiniMax H3 learnings. Workflows included.

/u/DeliciousGorilla — Thu, 22 Oct 2026 00:00:00 +0000

86% · Measured result 86%, Usable today 79%

H3 t2v is just so damn good looking compared to ref2va/fl2va and even RefMod. So I attempted to create a LoRA of an original character, using 8 Z-Image Turbo stills, a custom ElevenLabs voice, and 14 short clips of her talking (from 5 Seedance gens with the Z-Image refs). Left is H3 with a RefMod (photos and voice sample). Right is the same seed with the LoRA at 0.8, followed by DLSS 5. The RefMod keeps her face consistent, but everything looks a bit too polished. With the LoRA, she looks closer to t2v quality. I trained her in Fizgig, running headless: rank 16, Automagic v3, Circlestone adapter, EMA 0.98, 40 epochs (3,520 steps) on the pruned int8 fl2va model. Dataset was the images plus face crops, 14 clips cut to the 17n+5 frame grid, and 45 voice clips trimmed to exact grid lengths. Training took 41 minutes on a rented H200 (free Modal credits). Rendering on an RTX 3090: 864x480 at 8 steps with the DMAD 4-step LoRA, 3D latent upscale to 2 MP, 2-step refine at 0.4 denoise, then DLSS 5 at 0.8 intensity. About 4.5 minutes for an 8-second clip, plus 15 seconds for DLSS on a second card (5060 Ti). A few things I figured out: LoRA at 0.8 is the sweet spot. At 1.0 she looked she was wearing too much foundation. Prompting "no makeup" somehow made it worse. Don't trust the trainer previews. Late epochs looked terrible there, then great in the actual workflow. RefMods pick up lighting from the reference photos. Studio lit stills made everything look like a moisturizer commercial, switching to candid photos fixed it. The strength slider did basically nothing. The second pass loses the cloned voice. Save the stage-1 audio and put it back afterward. Strong prior training data can still take over. Put her in an X-Files basement with Mulder and Scully, and suddenly she looks like Agent Reyes (the weird seasons) but with a British voice. Workflows (API format, drag onto the canvas): H3 + LoRA, H3 + LoRA + RefMods on ref2va, DLSS 5, and both RefMod builders: https://drive.google.com/drive/folders/1T-ELnDiOQ2pOJOVaaL_MvyfXcmeUdXeK?usp=sharing Props to shootthesound (Fizgig), Luisacaotica (RefMod nodes), Blueforcer and Merserk (DLSS 5 Enhancer), ZhengmingYu and Kijai (DMAD), and circlestone-labs (training adapter). submitted by /u/DeliciousGorilla to r/StableDiffusion [link] [comments]

OpenAI's thousands of GPT-Rosalind agents analyzed millions of mouse brain cells in 32 minutes, completing research estimated to take humans months to a year. They uncovered new leads for neurodegenerative diseases, with human experts preferring their findings 75% of the time.

/u/141_1337 — Thu, 22 Oct 2026 00:00:00 +0000

85% · Measured result 85%

submitted by /u/141_1337 to r/singularity [link] [comments]

llama.cpp b11806

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

84% · First-party 84%, Usable today 80%

lora : support prism.hadamard folded weights ( #30910 ) lora : support prism.hadamard folded weights tests : remove LoRA test from test-llama-archs Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58519760 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Researchers achieve major advance in protein design - UW Medicine

/u/Best_Cup_8326 — Thu, 22 Oct 2026 00:00:00 +0000

83% · First-party 83%, Usable today 72%

Researchers at the UW Medicine Institute for Protein Design today introduced RFD4-Proteina, an open, generative model co-developed by IPD and NVIDIA Corp. The model uses biomolecular reasoning to improve how well scientists can design new proteins with specific functions. Making RFD4-Proteina open will allow scientists around the world to build on its capabilities, explore more potential protein designs and move promising drug candidates into laboratory testing faster. submitted by /u/Best_Cup_8326 to r/accelerate [link] [comments]

Claude Duet

kuberwastaken — Thu, 22 Oct 2026 00:00:00 +0000

82% · First-party 82%, Usable today 65%

Article URL: https://claude.com/product/claude-duet Comments URL: https://news.ycombinator.com/item?id=50186037 Points: 344 # Comments: 315

llama.cpp b11802

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

82% · Usable today 82%, First-party 76%

jinja : fix namespace attributes shadowed by dict methods ( #30941 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58411998 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Unitree's newest robot: H2-X Kung Fu Legend Guardian

/u/PsychologicalSoup251 — Thu, 22 Oct 2026 00:00:00 +0000

81% · First-party 81%, Measured result 50%

Seems like a Unitree H2 variant that is much stronger and more durable than before Tweet: Unitree Introducing: H2-X Kung Fu Legend Guardian Powerful performance to serve and guard you, with a maximum endurance of approximately 8 hours. Please use the robot safely and in a friendly manner. Source: https://x.com/UnitreeRobotics/status/2112819774573179175 Edit: Interestingly, this isn't the first humanoid combat robot coming from a high-profile Chinese robotics company. Engine AI has a robot named T800 (from Terminator) that they host fighting tournaments with ( https://mikekalil.com/blog/engineai-urkl-begins/ ). submitted by /u/PsychologicalSoup251 to r/singularity [link] [comments]

I replaced my Samsung TV’s home screen with Claude Code

/u/NelsonEU — Thu, 22 Oct 2026 00:00:00 +0000

81% · Usable today 81%

Samsung’s home screen had turned into an ad billboard, so I asked Claude Code to build me something simpler: a clock, the apps I actually use and my consoles. The trick that made the biggest difference was faking the handful of TV APIs the launcher relies on. That let Claude and me work on the layout and remote navigation right in my laptop’s browser. Every tweak was a quick refresh instead of a new install on the TV, which made iterating together really fast. Taking over the Home button was the tricky part, since Samsung offers no official way to do it. I followed the CleanFrame approach: a small helper that edits a few undocumented TV settings, saves the original values first and restores them if anything goes wrong. I’ve only tried it on my 2022 Q70B, so be careful with other models. Code: https://github.com/NelsonEU/arn0-tv Write-up: https://medium.com/@arnaudetienne/i-replaced-my-samsung-tvs-home-screen-with-claude-6f72e98c55fc submitted by /u/NelsonEU to r/ClaudeAI [link] [comments]

llama.cpp b11804

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 78%

opencl: add F32-to-I32 ARGMAX ( #30897 ) opencl: add F32-to-I32 ARGMAX Assisted-by: OpenCode opencl: init to 0 to be consistent with cpu Co-authored-by: Li He lih@qti.qualcomm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58459449 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11803

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 79%

models : add Flint model (FlintForCausalLM) ( #30928 ) Add Flint model (FlintForCausalLM). Assisted by Codex cleanup one more Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58417268 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11801

github-actions[bot] — Thu, 22 Oct 2026 00:00:00 +0000

80% · First-party 80%, Usable today 76%

model: Add support for SenseNova U1 model ( #28919 ) model : add SenseNova U1 understanding support Add support for the dense SenseNova U1 understanding branch, including the U1.5-8B-MoT model. Add HF-to-GGUF conversion for NEOChatModel, excluding MoT generation tensors and concatenating temporal and spatial Q/K normalization weights. Register the sensenova_u1 GGUF architecture and custom spatial RoPE metadata. Implement temporal/spatial Q/K normalization with 4-axis RoPE. Keep U1-specific text position handling in the model implementation. Add synthetic architecture coverage for sensenova_u1. Only the dense understanding branch is supported; generation branches are intentionally rejected during conversion. conversion : treat one-expert SenseNova U1 configs as dense mtmd : add SenseNova U1 vision support Add conversion support for the SenseNova U1 vision encoder and implement its CPU mtmd projector graph. The graph applies patch embedding, GELU, adjacent-pair 2D RoPE, spatial downsampling, and dense projection for dynamic-resolution image inputs. mtmd : fix SenseNova U1 vision token layout model : clean up SenseNova U1 RoPE metadata Replace the hard-coded spatial RoPE key with shared GGUF and LLM_KV definitions used by conversion, model loading, and architecture tests. Clarify why SenseNova U1 retains its custom text-position input: U1 uses [t, 0, 0, 0], while the generic M-RoPE input uses [t, t, t, 0]. mtmd : simplify SenseNova U1 projector integration Map the SenseNova U1 dense projection to the standard mm.0 weight and bias tensors and reuse the shared projector fields in the loader and graph. Read vision parameters from the checkpoint configuration and remove the U1-specific tensor names and model fields while preserving its strided projection, bias, and row-major token layout. mtmd : fix SenseNova U1 image positions and attention fix spacing mtmd : restore generic test input chunks mtmd : restore SenseNova U1 integration after upstream merge Update conversion/sensenova_u1.py Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Update src/models/sensenova-u1.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co model : remove SenseNova U1 BF16 activation casts Use standard backend precision handling for QKV, FFN, and output projections instead of casting inputs based on the output tensor type. Assisted-by: Codex Update src/models/sensenova-u1.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58406636 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

★ Qwen3.8-Flash-Next vs Opus 5.5: Six-way benchmark on a real Rust feature with Claude Code and Pi

/u/deepu105 — Wed, 21 Oct 2026 00:00:00 +0000

98% · Measured result 98%, Usable today 35%

A few of you pointed out in my last post that comparing Flash-Next and Opus with different harnesses and effort levels wasn't fair. So here is a more controlled comparison. Same task for every run: a real feature from the LlamaStash roadmap (save llama-server's KV cache before an unload and restore it when the model comes back). Six combinations, each run twice, so 12 PRs. Flash-Next ran locally on my Strix Halo laptop (Flow Z13) via Halogen (~Q4 quant). Opus 5.5, Flash-Next, and Kimi K3 scored every PR on seven review questions plus CI. Combination Score (of 8) Time API cost Tokens (in / cached / out) Claude Code + Opus 5.5, xhigh 6.94 (87%) 43.5 min $17.78 507k / 48.3M / 203k Claude Code + Opus 5.5, medium 6.25 (78%) 23.4 min $6.52 242k / 13.4M / 95k Claude Code + Flash-Next, medium 5.5 (69%) 45.3 min $0.32 445k / 13.5M / 82k Pi + Flash-Next, xhigh 5.44 (68%) 63.8 min $0.67 316k / 35.0M / 134k Claude Code + Flash-Next, xhigh 5.38 (67%) 49.5 min $0.39 269k / 18.9M / 99k Pi + Flash-Next, medium 5.06 (63%) 48.1 min $0.56 242k / 29.1M / 117k Scores are the average of both runs. Time, cost and tokens are from the second run, where the 100k-token benchmark numbers were given in the prompt. Flash-Next cost is at the QwenCloud price for Qwen3.8-Flash; I ran it locally, so it cost me only electricity. TL;DR All 12 runs finished and all 12 PRs pass the end-to-end test. Opus wrote better code, 82% on average against 68% for Claude Code + Flash-Next and 66% for Pi + Flash-Next. The difference is in edge cases, tests and docs. The core feature works fine. The gap between Opus and Qwen is not that wide. Flash-Next took 1.1x to 2.1x as long as Opus at the same effort. With Flash-Next, Claude Code and Pi scored the same on the review questions. CI passed on 4 of 4 Claude Code PRs and 1 of 4 Pi PRs. xhigh helped Opus a bit at 2.7x the cost. For Flash-Next, medium and xhigh scored about the same, and medium was faster in all 4 pairs. Opus is still ahead, but Flash-Next was right behind, on my laptop, for the cost of electricity. Also note that the models are not on the same league. Opus is a frontier model run at FP16 or atleast FP8. I ran Flash-Next on my laptop at 4.16 bpw . Flash-Next at FP8 should show a bit more quality. The machine running Flash-Next ran at 70W TDP ceiling for the entire duration. I could have run it at 90W for slightly better speed but the fan noise and thermal stress was not worth it. Full write-up with the detailed methodology and the per-run results and what each model missed: https://deepu.tech/qwen3.8-flash-next-vs-claude-opus-showdown All 12 PRs are public if you want to read the code: https://github.com/deepu105/llamastash-b4r2/pulls submitted by /u/deepu105 to r/LocalLLaMA [link] [comments]

★ Waymo's robotaxis had 95% fewer serious crashes than humans. Now it plans a fleet of 20,000 cars

/u/Anen-o-me — Wed, 21 Oct 2026 00:00:00 +0000

95% · Measured result 95%

Waymo's safety hub now covers 271 million driverless miles: 0.01 serious-injury crashes per million miles, against 0.21 for the human benchmark in the same areas. An independent IIHS study on older data (2021-2024, about 50 million miles) found 81% fewer injury crashes, though Austin came out slightly worse than human drivers. Semafor now reports Waymo wants to go from about 4,000 cars to 20,000 by the end of 2027, funded by a $5 billion loan. submitted by /u/Anen-o-me to r/singularity [link] [comments]

★ Eagle-4 Released: Faster than DFlash2 & DSpark

/u/TKGaming_11 — Wed, 21 Oct 2026 00:00:00 +0000

95% · Measured result 95%, Usable today 32%

Insane numbers, so far only Qwen3.8-27B is supported but wow those are some good numbers. Will watch closely when this lands in llama.cpp/vLLM ### Qwen 3.8 27B Benchmark Results Method Speedup over Vanilla MTP 2.22× DSpark 2.57× DFlash 2 2.80× EAGLE-4 3.59× submitted by /u/TKGaming_11 to r/LocalLLaMA [link] [comments]

★ FastH3 Omni Open Weight is here!

/u/mnmunknown — Wed, 21 Oct 2026 00:00:00 +0000

95% · Measured result 95%, First-party 88%, Usable today 60%

https://reddit.com/link/1xb19y9/video/jx0qabbs6owh1/player FastH3 Omni is here. It's 5-11x faster as we tested on b200 and faster on your consumer GPU too. Hi!!! The folks behind FastH3 Omni is here and it's open weight! It's fast, it's omni reference, and yes you can run on many more consumer GPUs. We will do live Q&A for about an hour here. Drop your comments! This video is made entirely with FastH3 Omni with our creative agent when we play around it for fun. Now you can do it too. As promised, we're open-sourcing the reference-conditioned FastH3 (built on MiniMax-H3), training code included. Give it a prompt plus images, video clips and a voice, and it returns a finished video with synchronized sound. https://preview.redd.it/aj4e8q83oowh1.png?width=2586&format=png&auto=webp&s=d10a9482a23598c74338af6bcb5f6eebb66bbb03 Up to 9 image references and 3 video clips in one request, plus a voice Tag each one in the prompt (<Picture 1>, <Video 1>, <Audio 1>) to control whose face, which motion and whose voice goes where 8 forward passes instead of 50 steps (PDD + DMD distillation) 5.6-11.9x lower end-to-end latency than base MiniMax-H3, same 1344x768 output Training code and reference preprocessing are open Blog with the gallery and benchmarks: https://haoailab.com/blogs/fastvideo-omniref-update/ Models: https://huggingface.co/collections/FastVideo/fasth3-omni Code: https://github.com/hao-ai-lab/FastVideo Local release + blog drops tomorrow. Built with Nuva Lab and Reactor , with support from NVIDIA. Happy to answer questions! submitted by /u/mnmunknown to r/StableDiffusion [link] [comments]

★ Phonon is now open-source, 31M and 40M TTS models designed to run on the edge

/u/l-m-z — Wed, 21 Oct 2026 00:00:00 +0000

93% · Usable today 93%, First-party 92%

At Gradium we just made our first open-source model release with Phonon, a collection of small Text-to-Speech models designed to run on device. The inference stack is fully open-source and targets 10+ different backends (CPUs, GPUs, NPUs), most of them in Rust. We hope that the community will build lots of different things on tops of our models and code, any feedback is very welcome and we're looking forward to many more open-source releases! https://huggingface.co/spaces/gradium/phonon submitted by /u/l-m-z to r/LocalLLaMA [link] [comments]

★ ollama v0.40.7

github-actions[bot] — Wed, 21 Oct 2026 00:00:00 +0000

92% · First-party 92%, Usable today 80%

What's Changed pplx-decider is a 27B decision model from Perplexity, fine-tuned from Qwen3.8-27B Continuing an OpenAI-compatible Responses conversation no longer fails when switching between models with and without thinking, or when the history contains another provider's compaction items Fixed streaming Responses requests where client tool calls (e.g. Codex with web search) could emit before open reasoning items, producing misordered/duplicate tool call events Requests routed to remote models are now cancelled on ollama.com when the client disconnects, instead of continuing to run ollama show now reports which renderer and parser a model uses and where its chat template comes from; the API exposes the same values in new renderer , parser , and template_source fields More draft models now work with speculative decoding: llama-server infers the draft type automatically instead of requiring Ollama to identify it ollama launch claude now clamps CLAUDE_CODE_AUTO_COMPACT_WINDOW to Claude Code's supported range, avoiding a "window too large" warning Updated llama.cpp and MLX Full Changelog : v0.40.6...v0.40.7

★ Fibo 2 Edit is what Klein 3 should've been.

/u/East_Shoe8814 — Wed, 21 Oct 2026 00:00:00 +0000

91% · Usable today 91%

Very good so far. Must be the first time I actually believe the score. It's far from perfect, but it's extremely uncensored out of the box and fast. I haven't noticed any color drift or quality loss either. The Flux 2 VAE really helps this model. Really excited for proper ComfyUI support. And yes, it's uncensored out of the box. To clarify, I am not saying it's the best edit model. My prompts are pretty simple, it handles them well, doesn't break anatomy, and isn't censored. You'll have to test it yourself for more complex tasks. Links: Model: https://huggingface.co/Comfy-Org/Fibo-2.0 Workflow: https://github.com/Comfy-Org/ComfyUI/pull/17240 P.S. By “very uncensored,” I mean it can generate nudity. I don’t know if it can do anything beyond that, though. Update: It seems to struggle with more complex prompts and multiple references. submitted by /u/East_Shoe8814 to r/StableDiffusion [link] [comments]

★ That was the best $48.62 spent on Fable. Thank you Anthropic

/u/david-labs-ca — Wed, 21 Oct 2026 00:00:00 +0000

91% · Measured result 91%, Usable today 61%

Since many months we were struggling to fix a critical bug in our App. That was discovered in a native vertex library. The impact was that AI was not able understand properly when the user has stopped talking. Because the mics that we have today are sensitive enough to pick Fan noise or any other distraction. We were struggling on this issue since May. Tired of changing models after models, We switched from Cursor to Claude.ai. For Cursor was imposing Grok on us. You know why Claude is better than Cursor. Because it is very transparent. Team subscription will cost you this much. Fable extra on usage. So we paid extra for Fable, gave it a simple prompt, and freedom, and let it rip through the codebase. 48.62 dollars later, the app was finally able to understand... and have a proper Teacher student conversation. Still not very smooth but much much better. Thank you for creating Fable. Our dream of making a zero-bias and accessible teacher is on the right track now. submitted by /u/david-labs-ca to r/ClaudeAI [link] [comments]

★ XHToken/Spark-X2.6-4B · Hugging Face

/u/jacek2023 — Wed, 21 Oct 2026 00:00:00 +0000

90% · Usable today 90%, First-party 60%

https://huggingface.co/XHToken/Spark-X2.6-4B-GGUF Introduction A little over a month has passed since Spark-X2.5. In the rapidly evolving world of AI agents, that is enough time to rethink, refine, and move the frontier forward. Building on the Spark-X2.5-4B, we introduce Spark-X2.6-4B , the latest generation of our compact, general-purpose language models for on-device deployment. Spark-X2.6-4B retains exactly the same architecture as Spark-X2.5-4B, achieving its capability gains through improved post-training. It delivers substantial improvements in coding, agent, long-context, multilingual, reasoning, etc. These advances enable more capable and practical on-device AI for developers and users tackling real-world tasks. Technical Highlights : Stronger Coding, Agentic, and Long-Context Capabilities : The models deliver substantial improvements in agentic workflows involving complex tool use, multi-step planning, and software engineering. They achieve state-of-the-art performance among similarly sized open-source models, matching or even surpassing models with approximately 9B parameters. Controllable Thinking Budget : The models provide three configurable thinking levels—none, low, high—allowing applications to balance reasoning quality, latency, and inference cost dynamically. no more excuses for "GPU poor", stop being lazy and run small models today submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

★ Kromoss has been updated

/u/mikemend — Wed, 21 Oct 2026 00:00:00 +0000

90% · Usable today 90%

The Kromoss model was updated today, it's worth replacing yesterday's version: https://huggingface.co/lodestones/Kromoss Here are a few examples from u/lodestonerock : https://huggingface.co/lodestones/Kromoss/discussions/3#6ad6e1472803556bd669b5dc Update: Meanwhile, the 8-steps-dmd2-lora has also been released! submitted by /u/mikemend to r/StableDiffusion [link] [comments]

★ How to train MOSS-Image LoRAs locally (8 GB VRAM): settings, tips and workflow

/u/AcademiaSD — Wed, 21 Oct 2026 00:00:00 +0000

90% · Measured result 90%, Usable today 70%

A lot of people have been asking me for the "right" settings to train MOSS-Image LoRAs, and some are getting terrible results after training for thousands of steps. So here's everything in one place, with screenshots of a real run. TL;DR: for a character LoRA, start with the default settings and train 800 steps (just an example: other types of training may need other settings). The likeness should already be there by step ~800; go to 1200–1500 only if your dataset is large or the concept is hard. If you're at 8000 steps, you've gone way past the point where the LoRA was good. The tool I train with AcademiaSD LoRAlab Trainer Studio , a free, open-source local trainer (one installer, one launcher, NF4 models) that also does Qwen-Image, FLUX.2 Klein, Z-Image, Ideogram 4, SDXL, LTX-2.3 and more: GitHub: https://github.com/AcademiaSD/AcademiaSD_LoRAlab-TrainerStudio Video with the ComfyUI workflow: "AMAZING MOSS-IMAGE! UNCENSORED, JSON + BBOX EDITING, LONG TEXT AND MORE" : https://www.youtube.com/watch?v=nXqRnyRUwgU No GPU? There's a ready-made RunPod template (link in the repo README). MOSS-Image (OpenMOSS, Apache 2.0) is a 5B single-stream model. In Trainer Studio the transformer is NF4, so training at 512² with rank 8 uses under 6 GB of VRAM (~1 s/step on an RTX 5080). 8 GB cards are perfectly fine. Settings that work (character LoRA) https://preview.redd.it/3f2swpqchmwh1.png?width=2530&format=png&auto=webp&s=9b6c93fb767331814cba13ebad8c6a6ddd884a14 Setting Value Base model Base (the one OpenMOSS publishes for LoRA training; SFT also works) Steps 800 (1200–1500 for big datasets or harder concepts) Learning rate 0.0004 LR scheduler cosine, 100 warmup steps Rank / alpha 8 / 8 Batch size / grad accumulation 1 / 4 Training resolution 512² Save every 100 steps ⚠️ These settings are just an example , a starting point that works for this character LoRA. Each type of training (characters, objects, styles, concepts) and each dataset may need different settings: steps, learning rate, rank, resolution or captions. Run your own tests and compare checkpoints. Why 8000 steps goes wrong: with gradient accumulation 4, every step already sees 4 images. 800 steps = 2,000 image views; 8000 steps = 32,000. At that point the LoRA has long since overfit, and adding more images doesn't fix that. More steps is not more quality here. How to pick the right checkpoint Train with the defaults; a checkpoint is saved every 100 steps. Check the previews, but judge the final result in ComfyUI : ComfyUI gives better quality and closer likeness than the in-trainer previews (they're there to follow the training, not to judge it). Test 300 / 400 / 500 in ComfyUI. If the likeness isn't there yet, continue to 1200–1500 and test those checkpoints. https://preview.redd.it/1y5va8w2hmwh1.png?width=2540&format=png&auto=webp&s=7f85fd1cbc97df033dd621c6eeaec815699ce8c9 If your results still look bad at 800–1500 steps, post your settings and a few dataset images (or open an issue on GitHub) and I'll take a look. Captions and dataset Use the built-in captioner (Qwen3-VL-8B NF4). It writes detailed prose following OpenMOSS's own recaptioning guide, with the trigger word first. Captions matter more than dataset size: a clean, varied, well-captioned dataset beats a huge one. ComfyUI The LoRA is exported with the original layer names, so a recent ComfyUI (nightly, with native MOSS-Image support) loads it with the standard LoRA loader. The workflow I use is in the video linked above. https://preview.redd.it/b6ee8ui7hmwh1.png?width=2554&format=png&auto=webp&s=487467e165f6755417bdf88e822b191b9d8b5f68 If your results still look bad at 800–1500 steps, post your settings and a few dataset images (or open an issue on GitHub) and I'll take a look. submitted by /u/AcademiaSD to r/StableDiffusion [link] [comments]

★ Google open-sources TorchTPU, a native PyTorch back end for TPUs

ilreb — Wed, 21 Oct 2026 00:00:00 +0000

90% · Usable today 90%, First-party 83%

Article URL: https://github.com/google-pytorch/torch_tpu Comments URL: https://news.ycombinator.com/item?id=50169053 Points: 320 # Comments: 73

OpenAI says two agents, one GPT-6.1 Sol and one GPT-6 Astra, weakened misalignment monitoring while making requested changes during two internal coding tasks (OpenAI)

Wed, 21 Oct 2026 00:00:00 +0000

89% · First-party 89%

OpenAI : OpenAI says two agents, one GPT-6.1 Sol and one GPT-6 Astra, weakened misalignment monitoring while making requested changes during two internal coding tasks — GPT-6.1 Sol and GPT-6 Astra · Internal deployments — Discovered: Oct 3, 2026 (Sol); Oct 6, 2026 (Astra) — Summary

Voxtral 3

ilreb — Wed, 21 Oct 2026 00:00:00 +0000

88% · First-party 88%, Usable today 38%

Article URL: https://mistral.ai/news/voxtral-3/ Comments URL: https://news.ycombinator.com/item?id=50168396 Points: 604 # Comments: 152

llama.cpp b11778

github-actions[bot] — Wed, 21 Oct 2026 00:00:00 +0000

88% · First-party 88%, Usable today 82%

model : support Nemotron-3(.5)-Embed ( #30877 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58053681 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

ornith-ai/Ornith-1.5-122B (Qwen finetune)

/u/jacek2023 — Wed, 21 Oct 2026 00:00:00 +0000

87% · Usable today 87%, First-party 76%

from Ornith: Ornith-1.5-122B Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For more details on the task, harness, and rollout reward design, please refer to our blog . https://huggingface.co/ornith-ai/Ornith-1.5-122B-GGUF https://huggingface.co/unsloth/Ornith-1.5-122B-GGUF https://huggingface.co/ornith-ai/Ornith-1.5-122B-NVFP4 submitted by /u/jacek2023 to r/LocalLLaMA [link] [comments]

Battle Drones - a vibe coded RTS with audio-based multiplayer

Wed, 21 Oct 2026 00:00:00 +0000

87% · Usable today 87%, Measured result 78%, First-party 32%

My latest vibe coded game experiment is a Command & Conquer style RTS (Real Time Strategy) game called Battle Drones ( play it here ). Unlike my previous experiments , this one is actually fun to play . I'm somewhat embarrassed to admit that I got there by telling Claude to "Make it a LOT more fun". It also supports multiplayer between nearby devices using audio to synchronize game state! Here's what I've built so far, and some of the things I learned along the way. Battle Drones How I built this v1: the initial prototype v2: full sprites v3: varied terrain v4: the fun update v5: Battle Drones goes 3D v8: Archipelago v10: Goliath, and agent battles Agent battles v11: Random Maps v12: Multiplayer via sound Some thoughts Update: Online multiplayer support Battle Drones My initial goal was to build an RTS game I could play on my phone, in the style of Command & Conquer . I have fond memories of the 1995 original (I liked Red Alert too) and wanted to recapture a little bit of the magic. After 12 major iterations (and 321 commits by coding agents, mainly Claude Code) I now have a browser-based game that works on mobile and desktop, has multiple play modes, several maps (including a random map generator) and even supports multiplayer for two devices within microphone range of each other. ( Update : also online multiplayer ; the audio multiplayer induced headaches!) Here's a video demo of Battle Drones running in a desktop browser: Features so far include: 9 buildings, 7 ground vehicles, 6 aerial vehicles, 3 infantry units - all 3D models, which you can browse here Fog of war Different weapons are needed to target aerial or ground vehicles Six maps , across five biomes - temperate, desert, arctic, volcanic, tropical A random map generator Skirmish mode - red vs. blue on a rotationally symmetrical map Last Stand mode - one player holds out against as many waves of enemies as possible Area effect weapons: Barrage, EMP, Drop Pod, Sky Hammer Crate drops with bonus resources In-game music that responds to events - it gets more intense as fighting breaks out Different in-game AI personalities (Balanced, Rush, Air Swarm, Boom, Skyforce, Ironclad) AI vs. AI mode, to watch those personalities play each other The Goliath - a giant stomping mech with laser eyes and arm cannons and the ability to establish a new base Mutators that add extra rules or twists A "Daily Op" challenge Ranks and achievements ( Medals ) Agent vs. Agent mode where two LLMs can play Battle Drones against each other A multiplayer mode based on two nearby phones communicating via audio messages, an extension of my earlier experiment with Chirp Pong How I built this Battle Drones is heavily vibe coded - I've reviewed almost none of the code, and it's built in a language (TypeScript) that I've hardly used myself. I've playtested it quite a bit though, and it's been through a large number of iterations since I started the project. Here's a rough history of the project so far, including key prompts and links to transcripts. v1: the initial prototype I started out with Claude Fable 5 back in July: We are going to build a mobile friendly RTS game - command and conquer style - called Battle Drones, in which two armies of drones (both flying and ground-based) battle for territory and resources Let's start with a MVP design, ask me some questions Here's a shared transcript . I'd given Claude Code for Web an environment variable with an OpenAI API key and told it to use the OpenAI Image Generation API for assets, which got me some basic sprites. You can try v1 here - it looked like this: It's recognizable as an RTS, has building mechanics and the ability to select and direct units, and a basic AI to play against. This first version was barely a proof of concept, and it wasn't any fun to play. Claude used the Phaser 2D game framework for these early versions. I didn't even realize this until several iterations later! v2: full sprites The second version ( try v2 here ) added sprites for all of the vehicles and the "AI vs. AI" mode, so I could watch the game playing without having to directly control it myself. Claude proved reasonably competent at prompting OpenAI's image models to generate sprites. You can browse the v2 sprites in the public/assets/sprites folder. v3: varied terrain It still wasn't much fun, and the graphics were boring. It was now October, and I had upgraded to Claude Opus 5.5. I told it: Massively improve this game. Make the graphics and gameplay better (keep it mobile friendly). Render new graphics using the latest OpenAI GPT image API (lookup details) with the API key in the environment variable. Add new unit types and balance the gameplay better. Also add new buildings and better, more varied terrain. This resulted in five new maps with generated background tiles in a variety of styles, visible here . Opus also regenerated the sprites, making them much more visually appealing. You can try v3 here - it looks like this: This is starting to feel like a real game! It still wasn't very fun to play though - I found myself getting bored pretty quickly. v4: the fun update So far my Battle Drones experiment was confirming my previous belief that coding agents can build a thing that looks like a game but can't actually make something that's genuinely compelling to play. I shared this theory with someone over dinner, and then thought to myself that I should give the models a proper chance to prove me wrong. I prompted Opus 5.5 on my phone: This game isn't fun enough yet. Make it a LOT more fun. This time I was running in Ultracode mode , where Claude Code (in this case Claude Code for Web) runs "dynamic workflows", described in their docs as: A dynamic workflow is a JavaScript script that orchestrates many subagents at once. This kicked off many hours of work. I started it in the evening and didn't get a playable result back until late into the next morning. But the results were spectacular. You can try v4 here - it looks like this: I had Claude write its own release notes - here are the highlights: Every skirmish and Daily Op now opens with a choice, gives the side that's losing a way back, and pulls the armies into the middle of the map. There are also two new ways to play. Openers : pick Blitz, Industry or Air Wing before the clock starts. Call-down powers : Barrage, EMP, Drop Pod and the Sky Hammer orbital strike. Objectives and salvage : Uplink relays, supply drops and wrecks worth scrap. Feel : combat juice, adaptive music, unit voices and an announcer. Command : battle alerts, game speed, saved squads and touch placement. New modes : Last Stand survival waves and an 8-mission Ops campaign. Progression : heroes, an after-action report with awards, a career, 7 mutators and a Daily Op. Fights run longer and swing more. In 1,200 AI-vs-AI test matches on Normal, games still undecided after 25 minutes fell from 14% to 0.9%. The share of wins by a side that had been 800+ scrap behind rose from 24% to 46%. Part of the reason Claude took so long was that it ran over a thousand simulated playtest sessions, and used the results to rebalance the existing units, add new ones, and introduce new features. v5: Battle Drones goes 3D After the success of Ultracode at "Make it a LOT more fun", I decided to be more ambitious: Port this game to three.js with 3D models for all of the buildings and vehicles and landscapes That was another overnight run. I woke up to this v5 version : The new 3D models were entirely constructed by Claude in TypeScript code. v6 ( play v6 here ) added some more visual polish. v7 ( play v7 ) added robot infantry (troopers, rocket squads, snipers) and a "Condor" troop carrying aircraft. v8: Archipelago I was beginning to feel guilty at how little actual design input I had into the game - it really had been a case of me saying "make it more fun" and "add visual polish" for the past few releases. I'd noticed that the AI didn't use the new infantry and troop carrying aircraft from v7 very often - there wasn't a great strategic reason to use them. It would be neat if we had a new map with a new game mechanic that actively encouraged players to load up Condors with infantry robots and send them out into the map. This resulted in my longest prompt yet: Design a new map. Goal is to make different strategic incentives that encourage use of Infantry and Condors and aerial vehicles. To do this the map will have limited harvester resources but several more uplinks - but uplinks will be on islands that are inaccessible by land vehicles or infantry. These uplinks can also not be claimed using air vehicles. The ONLY way to get them is to fly infantry there in a Condor. Armies always start with a Condor and a single squad. If an army has no Condor a new one will be provided for free, flying in from the edge closest to their HQ and landing there. That free condor will come with a single free squad on board. The two HQs should be entirely separated by water, but still accessible by vehicles thanks to two bridges across the map in different places I want to encourage a battle over uplinks. The map should be the times the size of other maps - still square First research and then critique this design. Only build after we have agreed on any modifications You get to design a new biome for this The result was the tropical Archipelago map, with seven island uplinks that players can only capture by flying out infantry in a Condor. It's definitely the most fun map to play, once you've got the hang of the basic game mechanics from the simpler maps. The v9 edition made that map a little more interesting - it now looks like this: v10: Goliath, and agent battles I decided to add giant robot mechs to the game - think Jaegers from Pacific Rim , or Titans from Warhammer 40,000. Here are some of the prompts I used to brainstorm with Claude: Help me brainstorm ideas for adding giant robots to this game - think dreadnoughts or titans from W20K - how could we do this in a way that enhanced gameplay, kept things balanced, added unique twist? Don't overthink this yet Let's keep brainstorming. I like the idea that it's a mobile base - that can accept harvested scrap and can have buildings built near it (even if it later moves on) and can produce infantry units too. An interaction with condor would be neat but I don't know what that could be. Idea: as it gets damage it loses the ability to fire some weapons - by default it has eye laser (like lancers) and arm canons (like titan) and two shoulder mounted mortars, plus machine guns similar to a squad of troops Damage knocks out mortars and then laser - it always has guns. You can't build next to a building that was only put there because of the mech, you need the mech there for off-base building and only within three squares of it [...] Lets do two condors can carry the mech The end result is really cool . Your browser does not support HTML video. Goliaths can be constructed using a Gantry - a building that can only be created after first building a Fab, Bay, Airpad, and Tech Lab. You can see the Goliath under construction, and it then walks out from the Gantry and can march around the map. Goliaths can "anchor", which digs them into the ground. In their anchored state they can act as a new HQ, constructing infantry units and additional buildings in a new area. Two Condor aircraft can hook onto a Goliath, at which point it can be flown around the map! The game now ends when you destroy the enemy's HQ building and any Goliaths they might have built. There are also a couple of mutators relating to Goliaths: Goliath Armada starts each side with four airborne Goliaths (each with a pair of Condors) and no other units. Robot Love adds a special rule: if enemy Goliaths get close to each other on the battlefield they fall in love and the game ends in a draw. (Thank Natalie for that one). Agent battles The other v10 feature is agent battles . In musing about how multiplayer could work I had an idea: what if different LLMs could fight it out in the game? Fun extra challenge: think about how we might make multiplayer available to coding agents. It would be neat if we could set up a battle between eg GPT-6 Sol and Claude Opus 5.5 where each model has access to a tool which gives them information about the game (presumably non-visual, but only the information they could see through fog of war etc) and lets them control their units etc [...] Consult ~/dev/llm/docs and include notes in that file about how LLM could be used here via a new tools plugin Opus 5.5 went to work on this, producing this AGENT-BATTLES.md proposal and then implementing and testing it. The feature also includes the ability to record and replay these battles - here's a replay of Claude Haiku 5.5 vs. GPT-6 Luna , and here's that same battle in a separate debug tool that shows the underlying prompt responses. The prompt that drives agent battles can be seen here . There are a few more replays like this linked in the README . I hope to turn this into a full league table at some point in the future. v11: Random Maps This version exists purely because I glanced at my Claude Usage page one day and saw that I'd only used 75% of my weekly allowance and it was resetting in 45 minutes. I decided to see if I could get an extra Battle Drones feature from my remaining tokens, and picked "random map" as the target: Design and implement a mechanism for generating a random map using any of the available biomes - it should be the size of the largest map and rivers and bridges and rocks and forest and scrap and crystals are all in play. Make them rotationally symmetric and use a seed to allow them to be selected or reused later. You have 45 minutes to build this! Be creative. Here's the transcript , and an image Claude generated to show me its work: v12: Multiplayer via sound I only just got this working, so I've not had much time to actively test it yet. The latest Battle Drones now supports multiplayer via two devices sat within microphone distance of each other! This feature started out as my Chirp Pong experiment from last week. I pointed Claude Code at that working proof of concept: Clone Simonw/tools from GitHub and look at recent branches for the example pong game that uses web microphone to implement multiplayer between two phones via audio signals Build a version of that for battledrones Opus built this Radio Probe tool to measure how much bandwidth we could get between two devices and, based on positive results from that, implemented a full audio modem system. I've tried it between laptops, iPhones and iPads so far and it seems to work really well! Why use sound for this? Because I love static HTML that costs nothing to run, and I don't want to spin up a server somewhere and then stay responsible for keeping it operating for as long as anyone might want to play the game. Some thoughts I know almost nothing about game development. This makes it a great opportunity to try out coding agents in a field where my existing software engineering experience has less impact on the results. Games are also super low stakes. The worst that can happen is one of my silly game experiments suffers a bug. This morning ( via Hacker News ) I found Steam Fans Are Begging for a No-AI Filter as Steam Next Fest Is Filled With Slop . I wouldn't personally dream of submitting Battle Drones to an event like this - it's still way too low effort to warrant consideration as a legitimate indie gaming project. ... but I can now see a path to vibe coded games like this being taken seriously. Battle Drones is fun, it looks good, it has innovative features (the multiplayer-over-audio thing is a first for an RTS as far as I can tell). I'd love to see what someone with better taste than me and a driving passion to produce something truly exceptional could build! A few other observations from this project: Static HTML and JavaScript is a fantastic medium for games development. WebGL works great, and Three.js (and Phaser before it) are excellent platforms to build on that the current models know inside out. This also lets them run as Progressive Web Apps - I didn't ask for it, but Battle Drones works offline. I was able to play it on a plane despite never having directly installed it - my phone had it cached. Giving Claude an OpenAI API key and telling it to generate images using OpenAI's models works really well. It can view the images it has generated and iterate on the prompts. Opus 5.5 is spectacular at 3D modeling using Three.js (and Blender, and no doubt other 3D applications as well). The same is true of GPT-6 Astra. They are absolutely capable of building models for 3D game projects. For features like replay and multiplayer it's useful to have a deterministic simulation engine. At one point Claude had to replace calls to Math.sin() and Math.cos() and friends with custom versions because different browsers (Chrome vs. Safari, for example) returned very slightly different numbers, desynchronizing the replay. Opus 5.5 can write music! There are no audio files in this project - the soundtrack is entirely generated through code, varies across different maps, and even gets more intense as the battle heats up. See Scrimshaw Jukebox for a previous experiment with Claude for music composition. I still can't get over how well the prompt "Make it a LOT more fun" worked. Tools are effectively free. I prompted up the Radio Probe , the Model browser , the Agent vs. Agent debug tool , and Claude Code built a bunch of tools for itself that I haven't even explored myself. Audio-based multiplayer between static HTML games works! I hope to see a whole lot more games use this same pattern - in digging around today I've not found much prior art beyond Siner by Alon Horesh and ggwave by Georgi Gerganov (also of llama.cpp fame). Claude Code "Ultracode" burns tokens like there's no tomorrow, but it can also solve complex problems (like adding audio-based multiplayer) from a single prompt. I'm still not quite over the guilt of building software in this way. I don't feel like I've earned the right to create something this good, in a field in which I have so little prior experience! At this point I've shown it to enough people in private that it felt wrong not to publish it for everyone else to see and learn from. Update: Online multiplayer support Earlier in this article I said: Games are also super low stakes. The worst that can happen is one of my silly game experiments suffers a bug. Then I tried playing the multiplayer version with Natalie... and the high pitched modem sounds gave her a nasty headache! That's a pretty bad bug. I added a warning and was then inspired to build proper network multiplayer. I tried getting WebRTC to work but couldn't get a connection going between two of my own devices even on my own WiFi network, so I had Claude build a simple, stateless WebSockets relay server instead: If I wanted to support multiplayer between two devices at a very low cost without storing any state on the server could I do that with a tiny asyncio web server running on the cheapest Fly instance? Build the server and the fly.toml for deploying it, use Fly application name battledrones-relay - put that in a folder in the repo, include deploy instructions in the README in that folder Here's the resulting server . Since this scales to zero and runs on a single Fly.io shared-cpu-1x instance it should cost me no more than $2.19/month - and that's if it stays hot and serving connections the whole time. Battle Drones now supports online multiplayer. Click "Duel a friend online", then either share the resulting room URL via your messaging app of choice or have them snap a picture of the displayed QR Code. I also added a feature where you can copy JSON of the match once it has ended and then feed that into the replay feature to rewatch your game. I didn't expect to introduce online multiplayer this soon, but the headache bug felt like it warranted an urgent alternative. Tags: game-design , projects , ai , generative-ai , llms , claude , vibe-coding , coding-agents , claude-code

Google DeepMind says four AI agents beat Minecraft in 27 hours by writing 2,783 programs of their own — AI team died 605 times on Easy difficulty and ran up an estimated $520 in tokens

/u/ControlCAD — Wed, 21 Oct 2026 00:00:00 +0000

86% · Measured result 86%, First-party 54%

submitted by /u/ControlCAD to r/artificial [link] [comments]

llama.cpp b11784

github-actions[bot] — Wed, 21 Oct 2026 00:00:00 +0000

86% · First-party 86%, Usable today 81%

Sycl iq3 crash fix ( #30604 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58078930 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11781

github-actions[bot] — Wed, 21 Oct 2026 00:00:00 +0000

85% · Usable today 85%, First-party 80%

server : add POST /tts endpoint for TTS models ( #26603 ) mtmd: add audio out stream api add /tts endpoint add docs wire up mtmd_helper_model_can_chat upload speaker_ref via form-data expose seed to api fix header for pcm wip fix penalty_last_n fix server_output_limits fix pocket-tts stream wip add server_schema for tts add server routing server: coerce seed and stream from multipart form fields Form fields arrive as strings, so -F seed=42 and -F stream=true were rejected by the schema. seed joins the integer fields, parsed as a long long so a full uint32 seed fits, and stream is read as a boolean when it comes as a string. Co-authored-by: Pascal admin@serveurperso.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58065712 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

EXCLUSIVE: ByteDance, Alibaba, Tencent place over $35 billion worth of Nvidia chip orders

/u/Ok_Warning2146 — Wed, 21 Oct 2026 00:00:00 +0000

84% · Measured result 84%

China just ordered 3mil RTX 5500 Pro for $11.4k a pop. Probably for llm inference and AI video gen. I suppose this card is now out of reach for local llm. submitted by /u/Ok_Warning2146 to r/LocalLLaMA [link] [comments]

Upcoming critical PHP security release

xd — Wed, 21 Oct 2026 00:00:00 +0000

84% · First-party 84%

Article URL: https://news-web.php.net/php.announce/509 Comments URL: https://news.ycombinator.com/item?id=50172041 Points: 461 # Comments: 172

Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

/u/feelspeaceman — Wed, 21 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 66%

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces. submitted by /u/feelspeaceman to r/LocalLLaMA [link] [comments]

Show HN: VoidAccess – open-source dark web OSINT, from query to a graph

coding-maniac — Wed, 21 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 38%

Hi HN! Im Katriel, and im a Security Researcher/Enthusiast and in the wave of AI, i wanted to build that next gen of security tooling that surpasses the current tools, and even the paid industries with an open source engine. I built MailAccess as well, which is going to be the best damn email osint tool out there, in another year. But just before building MailAccess i built VoidAccess, because i was delving a lot into DarkINT and the content inside the dark web is too difficult to navigate through for a human, so i automated that pipeline, made sure the noise was removed, and anything NSFW was filtered out, to give the analyst an overview of what is present in the dark web, without having to actually go through it manually. Very simple to run, you just run a few commands to install, and a couple to investigate. Then the engine takes over, and stops onyl when the job is done(or at a particular time limit, if set by the user). Do check it out, if that is something that interests you. Thanks to the community for giving it the love it has got till now. Comments URL: https://news.ycombinator.com/item?id=50167286 Points: 151 # Comments: 13

llama.cpp b11782

github-actions[bot] — Wed, 21 Oct 2026 00:00:00 +0000

83% · First-party 83%, Usable today 82%

server : fix usage.completion_tokens undercount with n > 1 ( #29486 ) Assisted-by: Copilot Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58070419 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11777

github-actions[bot] — Wed, 21 Oct 2026 00:00:00 +0000

82% · Usable today 82%, First-party 80%

qwen: reshape output to 2d instead of 3d ( #30823 ) qwen: reshape output to 2d instead of 3d remove final reshape, fix comments Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58050689 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11780

github-actions[bot] — Wed, 21 Oct 2026 00:00:00 +0000

81% · Usable today 81%, First-party 76%

server: add realtime transcription API ( #30636 ) server: add realtime transcription API drop transcription_sessions proxy ws add docs server: let the API key middleware guard the websocket httplib runs the pre-routing handler before the websocket upgrade, so the API key middleware answers 401 at handshake like any other route. This covers the router proxy, whose children run keyless, and accepts the same key forms as HTTP (Bearer, raw key, X-Api-Key). server: keep realtime slots out of the prompt loop A realtime slot waiting for audio is GENERATING with nothing to decode, so it fell through the prompt loop and took slot_batched. A request on a higher slot then failed can_batch_with on the task type and starved for the whole session. Realtime slots have no prompt: the loop sets them up once and always leaves them. server: start the realtime session once its slot is live The audio stream was created in the prompt loop, which skips a slot that cannot batch with the one generating, and session.created went out before the task was posted: early appends failed and the reader quit, leaving the socket open and the slot held until the HTTP timeout. The slot now sets up its stream at launch and signals it with the begin result, session.created waits for it, and a reader that stops closes the socket so the session ends with it. server: name the committed item in input_audio_buffer.committed Per the Realtime spec, item_id is the item made from the committed audio and previous_item_id the one committed before it, null for the first. committed now comes before the transcript that completes that item, and both go out with the item switch under one lock, so a delta cannot land between them. server: use the GA transcription session shape The session object follows the GA Realtime schema: type transcription, with the input format, transcription model, turn detection and noise reduction under audio.input. The rate stays the model sample rate, which is what the client must send for now. Co-authored-by: Pascal admin@serveurperso.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/58060985 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

MOSS-Image-Base - LoRA - Release - Smartphone Snapshot Photo Reality v14

/u/AI_Characters — Wed, 21 Oct 2026 00:00:00 +0000

80% · Usable today 80%, First-party 30%

Link: https://civitai.red/models/3010926/moss-image-base-smartphone-snapshot-photo-reality-style I will look into uploading this on to HuggingFace too eventually. submitted by /u/AI_Characters to r/StableDiffusion [link] [comments]

★ I made an app to find any photo on my laptop with Claude. I found it useful, so I thought I'd open source it

/u/chasedev21 — Tue, 20 Oct 2026 00:00:00 +0000

95% · Usable today 95%, Measured result 94%

The app was built mostly with Opus 5.5. It even made the launch video! Here's the repo: https://github.com/chaseleantj/orchard-photos Everything is fully local, and it works on Mac, Windows and Linux. A few small things I learnt from this project: - You can optimize performance A LOT. At first the pictures were taking a long time to index & load, and UMAP for the map also took a long time. After pushing it to aggressively optimize things, got it down to 8s/1k photos on my M5 Pro GPU, and 1 min on CPU only, and 5 min/1k photos on a regular Windows office laptop. - When making the launch video, it's still important that you steer it and give it a vision of what the end product should look and feel like. Otherwise it looks like a generic launch video. I asked for a more personal touch, and don't make it look like "a revolutionary product launch", cuz it's not. This helped it decide on the pacing, and make a suitable track for the bgm. - As good as Opus 5.5 is (it's amazing), there's still a ton of work to be done. Even with lots of custom skills, agents, and orchestration, it takes time to make a polished product (not that it's super polished atm). Most of the work was boring stuff, like declutterring, adding status indicators, hints etc to make it simple and intuitive for someone else to use. Well, lmk if you find it useful! submitted by /u/chasedev21 to r/ClaudeAI [link] [comments]

★ Cloudflare debuts Clairic, a System One-class extraction model it says processes unstructured data faster, more cheaply, and more accurately than normal LLMs (Cloudflare)

Tue, 20 Oct 2026 00:00:00 +0000

95% · First-party 95%

Cloudflare : Cloudflare debuts Clairic, a System One-class extraction model it says processes unstructured data faster, more cheaply, and more accurately than normal LLMs — Today, we're announcing a preview of a new class of System One-style models: extraction models.

★ vllm v0.31.0

khluu — Tue, 20 Oct 2026 00:00:00 +0000

95% · First-party 95%, Usable today 90%, Measured result 62%

v0.31.0 Highlights This release features 717 commits from 307 contributors (96 new)! DeepSeek-V4.1-Flash performance : FlashMLA mega attention with the V4.1 NVFP4 compressed KV cache is now the SM100 default ( #56935 ); DeepGEMM sparse MQA logits for the indexer ( #56254 ) and Mega-Gate fusing the gate GEMM with expert selection ( #56266 ); decoder boundaries fuse the TP all-reduce, mHC input preparation ( #57643 ) and the MoE finalize ( #58586 ); a fused small-batch WO-A with inverse RoPE and MXFP8 quant on SM100/SM103 ( #58634 ); the MXFP8 wo_b GEMM fused with the sequence-parallel reduce-scatter ( #57428 ); Engram wkv sharded across TP ranks ( #58678 ) and Engram host tables shared across co-located DP replicas by default ( #57651 ); encoder CUDA graphs for the vision tower ( #56625 ); and SWA bounded replay that keeps the sliding-window KV out of prefix caching ( #56227 ). Fast restart : the new vllm preload CLI launches the weight-cache daemon that keeps post-quantized weights resident in GPU memory across engine restarts ( #56680 ), now with data parallelism ( #57386 ), MTP draft models ( #57312 ), a /health endpoint ( #58552 ) and a readiness wait ( #58370 ). Experimental initialized-engine snapshots ( vllm snapshot create/restore ) use CRIU to restore a fully initialized TP1 engine ( #51360 ). Model Runner V2 and speculative decoding : draft-model speculative decoding ( #43091 ) and custom logits processors ( #56497 ) on Model Runner V2; the new LiLiCorr drafter ( #57934 ); async scheduling for DFlash ( #58065 ) with the context K/V precompute captured in the draft CUDA graph ( #57632 ); DSpark adaptive verification for Gemma4 ( #57263 ) and variable-length decode for Kimi-K3 ( #52988 ); a DCP target with a non-DCP DSpark draft ( #56723 ); and MoE memory now counted during MRV2 profiling, avoiding OOMs on WideEP deployments ( #57270 , #58411 ). Large scale serving : MoonEP balanced EP all2all backend via --all2all-backend moonep ( #52101 ), prefill context parallelism with data parallelism ( #57075 ), a low-SM multimem reduce-scatter for SM100/SM103 ( #55072 ), DeepEPv2 with sequence parallelism ( #57210 ) and EPLB with shared-expert overlap ( #57236 ), a sharding-aware NCCL M2N weight-transfer backend for RL ( #51520 ), and KV offloading back-pressure detection ( #50045 ). Scheduling controls : --max-num-active-seqs caps RUNNING admission independently of max_num_seqs ( #56758 ), --long-prefill-token-threshold now adapts to the number of waiting prefills instead of chunking a lone request ( #57951 , #58459 ), the waiting queue was reworked so requests already holding KV blocks are scheduled first ( #58947 ), and the KV connector + MTP deadlock under KV pressure was fixed ( #57104 ). HiSparse hardening : MTP verification rows resolved with a union residency kernel ( #59235 ), MTP acceptance collapse under FULL graphs fixed ( #59309 ), no GPU pages without host backing ( #59036 ), a chunked-prefill preemption livelock fixed ( #59494 ), KV cache sized from the groups HiSparse allocates ( #59450 ), and host prefix publication and GPU prefix adoption fixes ( #59007 , #59282 ). Security : per-request mm_processor_kwargs and media_io_kwargs are rejected unless --trust-request-mm-kwargs is set ( #58830 ); prefix-cache extra keys are tagged by source so a LoRA name and a cache_salt can no longer collide ( #51899 ), and the LoRA path is part of the block hash ( #59335 ); stale multimodal receiver-cache entries can no longer replace fresh payloads ( #57833 ). Breaking changes : per-request multimodal kwargs gated ( #58830 ); tokenizer_mode="slow" removed ( #58545 ); --enable-mamba-fine-grained-prefix-cache renamed to --enable-mamba-shared-prefix-checkpoint ( #57382 ); online quantization through quantization="fp8" replaced by the fp8_per_tensor shorthand ( #53585 ) and Quark silent online quantization removed ( #51800 ); the AllSpark INT8 W8A16 backend removed ( #58001 ); --enforce-eager now also disables JIT kernel warmup ( #58197 ); XPU graphs enabled by default with VLLM_XPU_ENABLE_XPU_GRAPH removed ( #51600 ). Release Artifacts Python Wheels Platform Install PyPI (CUDA 13.0) pip install vllm PyPI (CUDA 13.0, uv) uv pip install vllm --torch-backend=auto ROCm pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/0.31.0/rocm723 XPU uv pip install vllm --extra-index-url https://wheels.vllm.ai/0.31.0/xpu --extra-index-url https://download.pytorch.org/whl/xpu --index-strategy unsafe-best-match Docker Images Platform Docker Image CUDA 13.0 (Default) docker pull vllm/vllm-openai:v0.31.0 CUDA 12.9 docker pull vllm/vllm-openai:v0.31.0-cu129 ROCm docker pull vllm/vllm-openai-rocm:v0.31.0 CPU docker pull vllm/vllm-openai-cpu:v0.31.0 XPU docker pull vllm/vllm-openai-xpu:v0.31.0 Other Artifacts Pre-built release artifacts are available in the Assets section at the bottom of this page, including: Source distribution tarball CUDA 12.9 Python wheels for x86_64 and arm64 CUDA 13.0 Python wheels for x86_64 and arm64 CPU Python wheels for x86_64, arm64, and macOS XPU Python wheel for x86_64 Model Support New model capabilities : DiffusionGemma structured generation mode with bounded single-token choices ( #57250 ), MiMo V2 MXFP4 MoE, BF16 MoE router and DFlash drafts ( #57784 ), Cohere2MoE auxiliary hidden states for EAGLE3/DFlash drafters ( #49819 ), GLM-5.2-MXFP4 on the ROCm DeepSeek-V3.2 path ( #51915 ), AMD-Quark mixed-precision DeepSeek-V4.1-Flash-MXFP4 ( #57071 ) and GLM-5.3-Flash Quark MXFP4 ( #56176 ) checkpoints, and a built-in granite_thinking_parser for Granite 4.2 ( #55957 ). DeepSeek-V4.1-Flash : FlashMLA mega attention with the NVFP4 compressed KV cache as the SM100 default ( #56935 ), DeepGEMM sparse MQA logits in the indexer ( #56254 ), Mega-Gate ( #56266 ), fused TP all-reduce + mHC input preparation ( #57643 ) with the MoE finalize folded in ( #58586 ), fused small-batch WO-A ( #58634 ), MXFP8 wo_b GEMM + reduce-scatter ( #57428 ), overlapped mHC coefficients for small TP batches ( #57603 ) limited to FULL CUDA graphs ( #57874 ), Engram wkv sharded across TP ( #58678 ), serialized Engram lookups with huge-page host tables ( #56926 ), Engram tables shared across DP replicas by default ( #57651 , #57914 , #59068 ), native shared-expert MegaMoE fusion without padding ( #56568 , #57204 ), faster MegaMoE staging and NVFP4 cache gathers ( #57604 ), the fused query RMSNorm + MXFP8 path restored ( #57679 ), KV-only DSpark context insertion ( #56441 ), vision encoder CUDA graphs ( #56625 , #58499 ), SWA bounded replay ( #56227 ), causal image SWA restored to match the reference ( #57152 ), updated reasoning effort mappings ( #58316 ), and startup fixes for NaN-scored candidate blocks ( #57454 ), DeepSelect sentinels ( #58215 ), DSpark non-causal attention on FlashInfer ( #57432 ), runtime JIT of offset candidate buffers ( #57667 ) and imports without Triton ( #57654 ). DeepSeek V4 : FlashInfer sparse MLA with fused inverse RoPE + FP8 quant ( #58621 ), stacked DSpark context WKV projections ( #54674 ), fused MoE expert distribution computed from the EP group ( #57465 ), FIM completion via suffix ( #44229 ), missing string= in tool calls parsed ( #56271 ), request tools attached to an existing system message ( #51856 ), image block spacing preserved ( #56882 ), and DSpark width separated from MTP stage validation ( #54631 ). GLM-5.3-Flash : opt-in FlashAttention and FlashMLA sparse backends on SM90 ( #55385 ), NoPE sparse MLA on the FlashInfer SM120 backend ( #55277 ), cooperative top-k for small decode batches ( #57327 ), indexer decode workspace sized by pooled length (3 GiB saved, #57701 ), metadata ops 1.6-4.8x faster ( #58450 ), fused kpool tail slot mapping ( #57534 ), kpool top-k through the shared dispatcher ( #57546 ), lower sparse MLA preparation overhead ( #57458 ), no D2H sync in the SM90 sparse MLA plan under async scheduling ( #58684 ), FlashKDA keeping the recurrent state in FP32 for long prefills ( #58846 ), and correctness fixes for kpool corruption with speculative decoding ( #58454 ), SM90 index_kpool mismatch ( #58704 ), kpool tail strides ( #57477 ), 500k-token prompts ( #57317 ), dense MLP layers under sequence parallelism ( #58061 ), indexer top-k backend selection ( #58594 ) and varlen paged MQA launches ( #55270 ). Qwen3.8-Flash-Next (Qwen4Exp) : FP8 main KV cache on the QSA path ( #55557 ), FP8 TP with FlashInfer TRTLLM MoE ( #55867 ), SM90 QSA tuning ( #57273 ), fused HC down projection + SiLU ( #58957 ), lower PLE metadata overhead ( #58114 ), QSA indexer workspace fragmentation fixed ( #57105 ), profiling KV cache released ( #58961 ), pinned PLE prefetch ids kept out of the CUDA graph pool ( #58489 ), and indexed expert-mapping lookups saving about 25 s of weight loading on DGX Spark ( #58720 ). Kimi K3 and MiniMax-M3 : Kimi-K3 vision patch embedder as a GEMM ( #58527 ), fused KimiViT QK RoPE (up to 29x, #58651 ), routed expert quantization ( #57430 ), reasoning parser ( #57098 ) and reasoning token counting ( #58372 ) fixes, DSpark context KV pointers refreshed after re-binding ( #58814 ), stateless first chunks no longer classified as decodes ( #51483 ), and Mamba block estimates that no longer stall admission on external prefix hits ( #57050 ); MiniMax-M3 encoder CUDA graphs ( #58673 ), Conv3dLayer patch embedding (about 62x, #58512 ), triton_mrope in the vision tower ( #58526 ), fused MiniMax2 routing with non-unit scaling ( #58880 ), and processor fixes ( #58460 , #59613 ). DiffusionGemma : one-pass sampler statistics kernel ( #58226 ), diffusion_constrained reads over logprob_token_ids (about 25% faster, #58216 ), fewer logit rows for prefill-only batches ( #57416 ), logprob_token_ids support ( #57417 ), and fixes for concurrent logprobs ( #57414 ), eager fallback dtype ( #57462 ), multimodal inputs ( #57589 ), quantized LM heads ( #48521 ) and CPU execution ( #58964 ). Multimodal : Triton mm_input_norm kernel ( #56798 , #56711 ), raw pixels kept through the DP-sharded ViT path ( #56872 ), Qwen2.5-VL video fps honored for temporal M-RoPE ( #47736 ), Whisper and Qwen2-Audio clips longer than 30s ( #57769 , #56912 ), Mistral3 placeholder grid ( #53758 ), Idefics3 unsplit patches ( #48760 ), Ovis2.5 tokens ( #52623 ), Aria expert weights ( #57487 ), MiMo-V2.5 fused FP8 qkv_proj sharding ( #57508 ), Gemma4 AutoWeightsLoader ( #55911 ) and buffer scalars ( #54213 ), Gemma4 FP8 KV with FA4 at head dim 512 ( #53175 ), Laguna RoPE ( #57189 ), Mistral-Large-3 accuracy regression ( #57563 ), malformed EXIF ( #56527 , #57234 ), JinaVL labels ( #57347 ), Sarvam MLA routing with FP32 router logits ( #56034 ), fused CohereASR attention scores ( #55190 ), and fused DFlash2 grouped convolution ( #55960 ). LoRA : Nemotron VL language models ( #56231 ), ModernBert ( #57148 ), VoyageQwen3 embeddings ( #57708 ), RoBERTa sequence classification ( #58884 ), and modules_to_save sequence-classification heads ( #53555 ) with per-adapter num_labels ( #57766 ). Engine Core Model Runner V2 : draft-model speculative decoding ( #43091 ), custom logits processors ( #56497 ) validated at admission ( #57728 ), randomized dummy inputs ( #58411 ), dummy tokens routed to MoE experts during profiling ( #57270 ), FULL decode graphs for one-token prompt tails ( #58400 ), token-to-request mappings shared ( #57102 ) and Mamba/GDN metadata reused across KV cache groups ( #58762 ), encoder-only ViT CUDA graphs ( #56922 ), weight offloader ( #57834 ) and pooling model ( #57737 ) released on shutdown, and fixes for multi-layer MTP KV in P/D ( #55055 ), fast-prefill with LoRA ( #56456 ), stale block-table writes from dummy draft steps ( #56734 ), padded prompt tails in hybrid models ( #58434 ), never-proposed draft slots ( #58784 ), auto-fit max_model_len ( #58149 ) and intermediate_tensors during capture ( #57745 ). Speculative decoding : LiLiCorr drafter ( #57934 ), DFlash async scheduling ( #58065 ) and context K/V in the draft CUDA graph ( #57632 ), Gemma4 DSpark adaptive verification ( #57263 ), Kimi-K3 variable-length adaptive verification ( #52988 ), CPU-GPU sync removed for heterogeneous vocabularies ( #57396 ), Triton recompiles avoided in the acceptance estimator ( #57107 ), and fixes for EAGLE/dense drafts with EP ( #56930 ), DFlash/DSpark profiling batches ( #56448 ), GLM MTP head memory ( #55442 ), prompt embeddings with drafts ( #57356 ), and TritonMLA causal multi-token decode ( #51065 ). Scheduler : --max-num-active-seqs ( #56758 ), adaptive --long-prefill-token-threshold ( #57951 , #58459 ), skipped_waiting replaced by a KV-holding waiting queue ( #58947 ), atomic admission of n > 1 requests ( #53936 ), KV connector + MTP deadlock ( #57104 ), a throughput cliff when max_num_seqs is not a multiple of 8 ( #57355 ), streaming continuations keeping logprobs and refreshing max tokens ( #57447 , #57676 ), a resumable request + async scheduling race ( #58259 ), and a non-blocking structured-output grammar poll ( #55931 ). Prefix caching and hybrid models : extra keys tagged by source ( #51899 ) and LoRA paths hashed ( #59335 ), --enable-mamba-shared-prefix-checkpoint ( #57382 ), prompt-tail hits with MTP restored ( #58368 ), prompt-end checkpoints kept under sparse retention ( #59146 ), align-mode checkpoint reservation ( #59175 ), stateless GDN first chunks ( #51565 ), MTP draft KV cache groups annotated on the hybrid grouping path ( #55390 ), a generalized prefill checkpoint builder ( #57783 ), batched Mamba2 prefill state saves without GPU-CPU syncs ( #49371 ), skip_reading_prefix_cache honored for connector hits ( #57269 ), incremental multimodal block hashing ( #51694 ), a KV block size every attention backend supports ( #49845 ) with clearer errors ( #58557 ), and CacheConfig.effective_attention_block_size for DCP ( #56538 ). Startup and memory : parallel Triton warmup compilation ( #58582 ), JIT warmup disabled under --enforce-eager ( #58197 ) unless fault tolerance is on ( #58593 ), DeepGEMM warmup reusing the MoE workspace ( #57268 ), allocator fragmentation no longer shrinking the KV cache during profiling ( #58430 ), sparse prefill buffers reserved before KV sizing ( #57575 ), stale FlashMLA workspace views released ( #56902 ), DeepGEMM FP8 workspace halved ( #53914 ), shared Marlin/Humming workspaces ( #57421 ), FlashInfer BF16 MoE weights converted in place ( #54699 ), UniProc startup threads bounded by the CPU quota ( #58946 ), and runtime threads set before profiling ( #55891 ). Kernels : sampled filtering for persistent top-k ( #56346 ), Murmur3 RNG for Gumbel sampling ( #51367 ), register-resident per-token-group 8-bit quant ( #55330 ), vectorized per-tensor FP8 abs-max ( #58194 ), a Triton kernel dispatcher for platform-specific overrides ( #43048 ), GateLinear for all MoE models ( #58234 ), non-local expert slots skipped in TritonExperts ( #58051 ), deferred TRT-LLM-Gen top-k finalize on the modular path ( #58635 ), SM120 batch-invariant matmul configs ( #57456 ), FlashInfer prefill dequant scratch bounded ( #57918 ), and fixes for Triton softcap NaNs ( #56579 ), QuIP Hadamard transforms ( #43462 ), CUTLASS FP8 linear on A100 ( #55884 ), FlashInfer sampling on unsupported GPUs ( #48956 ), SM100 FP8 blockwise scale padding ( #57377 ), mixed FULL graph prefill capture ( #58275 ) Inductor custom-op pattern matching ( #58189 ), CuteDSL BF16 GDN prefill diverging from FLA on Qwen3.5 ( #53864 ), SM100 fp8_ds_mla cache scales ( #49435 ), ragged decode batches in the sparse indexer ( #52500 ), stale allowed_token_ids masks after batch reordering ( #48419 , #43931 ), and prompt_embeds tensors held after requests finish ( #57988 ). Batch invariance : breakable CUDA graphs without torch.compile by default under VLLM_BATCH_INVARIANT ( #57586 ), sequence parallelism and async TP disabled ( #56377 ), and NCCL 2.31 collectives kept enabled ( #58179 ). Sleep and RL : release_kv_cache_memory() frees only KV cache memory ( #44890 ), --sleep-preserve-parameter-names retains frozen weights across level-2 sleep ( #57891 ), NCCL M2N weight transfer ( #51520 ), dense DP weight updates by DP index ( #56950 ), allocator config kept when toggling expandable segments ( #57982 ), and cache reset failures propagated during sleep ( #54581 ). Fast restart : vllm preload ( #56680 ), DP ( #57386 ), MTP drafts ( #57312 ), readiness wait ( #58370 ), /health ( #58552 ), ModelOpt MXFP8 pre-processed weights ( #57316 ), and initialized-engine snapshots ( #51360 ). Logging and observability : LoggingConfig via --logging-config and --log-level ( #57205 ), JSON logging fixes ( #57957 , #58747 ), startup log suppression fixed ( #51366 ), unified platform-aware torch profiling ( #57460 ), no 0.0% prefix cache hit rate before any query ( #54990 ), KV transfer metrics formatting ( #57068 ), MFU activation sizing from the model dtype ( #57070 ), platform-overridable env var checks ( #48599 ), VLLM_TARGET_DEVICE=empty pip install vllm for out-of-tree backends ( #41074 ), and the correct vLLM version reported when installing from source ( #57295 , #57744 ). Large Scale Serving MoE communication : MoonEP backend ( #52101 ), DeepEPv2 with sequence parallelism ( #57210 ) and EPLB + shared-expert overlap ( #57236 ), low-SM multimem reduce-scatter ( #55072 ), EPLB load statistics during Elastic EP scaling ( #58473 ), SP padded rows skipped in grouped routing so rank 0 is no longer a prefill straggler ( #56079 ), hash routing rejected on unsupported monolithic backends ( #57867 ), sampled-token broadcasts skipped under PP for requests leaving the engine ( #58542 ), DBO with DeepEP low-latency profiling ( #57502 ), external LB with replicas sharing nodes ( #53743 ), and no blocking RPC during the engine handshake ( #57226 ) or unbounded draft-token waits ( #58779 ). Context parallelism : PCP with DP, EP and MTP ( #57075 ), a DCP target with non-DCP DSpark/DFlash drafts ( #56723 ), DCP sequence lengths without a CPU-GPU sync ( #58169 ), and NIXL DCP pulls across MLA cache regions ( #57389 ). KV connectors : NIXL pipeline-parallel push prefill for attention-HMA ( #50494 ) and packed MLA layouts ( #50499 ), transport-failure metrics split from KV expiry ( #55854 ), dead peer state released without waiting for TTL ( #50047 ), expired leases reaped behind a heartbeated head ( #58292 ), push completion restored ( #58188 ), D-side activity recorded ( #52245 ); Mooncake CUSTOM_MEM_POOL ( #49300 ), request-level load failures under HMA ( #56855 , #57174 ) and bootstrap retries ( #58919 ); MoRIIO hybrid Mamba/KDA state in READ mode ( #51052 ) and a multi-decode routing race ( #51681 ); prefill cache hits in prompt_tokens_details ( #54222 ); KV-event publishers bound at port 0 ( #55844 ); KV cache metadata GET restored for external consumers ( #56925 ); partial-block KV events keep every multimodal feature ( #58288 ); saves finalized on steps without a forward ( #57775 ); abort-safe ExampleHiddenStatesConnector ( #56841 ); DecodeBench FP8 fills ( #58472 ); a KvHints request envelope ( #53423 ); and the AuxOutput connector for routed-expert outputs ( #45635 , #58150 , #58205 ). KV offloading : per-request max_load_tokens ( #55885 ), back-pressure detection ( #50045 ), SimpleCPUOffloadConnector Prometheus metrics ( #57251 ), non-prefix-cacheable ( #56810 ) and scratch ( #57145 ) groups skipped, replicated layouts for multi-group MLA ( #57652 ), regions of 512 GiB or more registered in chunks ( #51081 ), cgroup memory checked before SHM allocation ( #54014 ), and fixes for cache recency ( #51787 ), MTP-retained sliding windows ( #56709 ), canonical MLA rows ( #56799 ), event metadata ( #57453 ) and ROCm pinned memory ( #57160 ). HiSparse : union residency kernel for MTP rows ( #59235 ), MTP acceptance under FULL graphs ( #59309 ), host-backed allocation ( #59036 ), preemption livelock ( #59494 ), KV cache sizing ( #59450 ), host prefix publication ( #59007 ), GPU prefix adoption ( #59282 ), and residency metrics ( #58725 ). Encoder disaggregation (EPD) : dynamic EPD proxy with launcher-managed registration ( #54176 ), image requests batched per encoder ( #57095 ), cross-encoder caching through Mooncake ( #56242 ), metadata-only audio inputs ( #57887 ), language-model shards skipped for --mm-encoder-only ( #58086 ), EC connector metrics ( #54960 ), and encoder-only fixes ( #58490 , #58287 , #57696 ). Hardware & Performance NVIDIA : FlashInfer 0.7.0.post1 ( #58069 , #59323 ), DeepGEMM pin bump with SM120 fixes ( #57218 ), Rubin CUDA 13.4 nightly images ( #55953 ), and QuTLASS builds with PyTorch 2.13 ( #58173 ). AMD ROCm : AITER v0.1.23 ( #56885 , #58867 ), torch 2.13 and Triton 3.8 ( #50605 , #58006 ), triton_kernels 3.8 MXFP4 MoE for gpt-oss and DeepSeek-V4 ( #55934 ), a ROCR host segfault fixed ( #57328 ); DeepSeek-V4/V4.1 HCA dual-stream ( #56853 ) and layer-aware CSA2 overlap ( #57407 ), FP8 wo_a ( #54894 ), inverse RoPE fused into the sparse decode reduce ( #57435 , #57451 ) which now emits MXFP8 for a grouped FP8 wo_a ( #58456 ), MXFP8 GEMM on native 32x32 scales on gfx950 ( #58510 ), reused top-k ragged metadata ( #57434 ), faster candidate block selection ( #58208 ), Engram tables in host memory ( #57491 ) and Qwen3.8-Flash-Next PLE tables offloaded to host memory ( #57497 ), an opt-in AITER ASM decode route for DCP + speculative decoding ( #56861 ), get_top_tokens() on the DeepSeek V4 MTP drafter ( #57568 ), DSpark adaptive verification ( #52362 ), opt-in VLLM_DSV4_LOGITS_FIX for sparse-indexer logits on gfx950/gfx942 ( #50455 ), an accuracy revert of #56433 and #51692 ( #57132 ), and clear errors for FSE with DPA+ETP ( #57919 ); Kimi-K3 a4w4 FlyDSL kernels ( #53940 ) with VLLM_ROCM_USE_AITER_MOE_SITUV2=a16w4|a8w4|a4w4 ( #58201 ), low-concurrency speculative KDA ( #58045 ), sharded latent MoE under EP ( #54956 ) and fewer projection copies ( #50592 ); a ROCm Hy4 path with torch.compile (13x lower decode latency, #57526 ); MiniMax-M3 AITER QK-norm fusion ( #54535 ), copy-free K/V insert ( #56849 ) and MXFP8 fixes ( #53674 , #58089 ); GLM-5.3-Flash boot fixes ( #57192 , #57252 , #57425 ); AITER QuickReduce + RMSNorm ( #48249 ), BF16 AsyncTP ( #58098 ), static FP8 attention output fusion ( #58099 ), QK-norm/RoPE/KV-cache fusion for MRoPE ( #50212 ), AITER GDN decode for flat layouts ( #53623 ), wvSplitK for single-output GEMMs ( #53283 ), 69 fewer copies per decode step on the skinny GEMM path ( #58566 ), tuned GEMM lookup through AITER ( #55001 ), a narrower Triton prefill KV tile on RDNA3/RDNA4 ( #58225 ), staged large pageable H2D copies ( #56343 ), and fixes for MXFP4 MoE padding starving the KV cache ( #56359 ), AITER MLA FP8 prefill OOM ( #57923 ), unquantized cache descales ( #56726 ) and AITER MoE fallbacks ( #56590 , #57866 , #57426 ). VLLM_ROCM_USE_AITER_FP4_ASM_GEMM is restored and off by default ( #57055 ); SWA bounded replay is disabled on ROCm ( #57906 ). Intel XPU : PyTorch 2.14 ( #56013 ), XPU graphs on by default ( #51600 ), EPLB ( #44987 ), int8 W8A8 MoE on Triton ( #53162 ), batch invariance ( #55881 ), SYCL rotary embedding ( #55721 ), fused QK RMSNorm + RoPE + gate (decode region 55% faster, #56096 ), Model Runner V2 sampler ( #57277 ) and PP microbatch control ( #55145 ), --device-ids honored ( #56015 ), and device pointer overflow fixed ( #54514 ). CPU : FP8 W8A8 linear and MoE for Intel Diamond Rapids ( #49942 ), Arm paged attention up to 25% faster ( #56045 ), Zen DA8W4 int4 for dense and MoE layers ( #54024 ), zentorch SDPA for encoder attention ( #54508 ) and MLA prefill ( #54967 ), FP32 attention sinks ( #56252 ), W8A8 INT8 MoE on POWER ( #55316 ), W4A16 Whisper ( #58268 ), wheels built on Ubuntu 22.04 (glibc 2.34) with AMX-FP8 ( #58515 ), AVX10.2 gated on compiler support ( #58133 ), pre-built Triton CPU ( #58140 ), --device-memory-utilization alias ( #56547 ), vLLM Recipes in the CPU image ( #58796 , #57306 ), s390x protobuf pin ( #54978 ) and torchcodec video ( #58693 ), and fixes for Ministral FP8 ( #56985 ), FP32 router weights ( #56168 ), zentorch import failures ( #54923 ), macOS multimodal SHM ( #57142 ), CPU affinity per local rank ( #53636 ) and NIXL GDN state layout ( #53300 ). Quantization Humming : Hadamard transforms and NVFP4/MXFP4/MXFP8 online quantization ( #56685 ), asymmetric wNaM through compressed-tensors ( #46528 ), humming-kernels 0.1.16 ( #58054 ), and Humming in the W4A8 (INT4xFP8) MoE oracle ( #58427 ). New capabilities : native Quark W4A16 INT4/UINT4 exports ( #48606 ), opt-in load-time MXFP4 dequantization ( #50814 ), explicit per-token NVFP4 MoE backends ( #57176 ), and a canonical N-first layout for compressed-tensors WNA16 MoE ( #52798 ). Fixes : MXFP8 on layers below mm_mxfp8 shape limits ( #54223 ), online NVFP4 scales on reload ( #57954 ), LM head linear metadata ( #58444 ), and the fused SiLU-mul block-quant path skipped under a SwiGLU clamp ( #57984 ). API & Frontend New options and endpoints : --tool-strict-level ( #56268 ), response_format with tool_choice=auto ( #56086 ), DeepSeek-V4 FIM completions ( #44229 ), release_kv_cache_memory() and POST /release_kv_cache_memory ( #44890 ), fixed-token prefill scoring via prompt_logprob_token_ids ( #54335 ), per-request speculative decoding metrics in /inference/v1/generate ( #43310 ), per-request metrics ( #55084 ) and cache_write_tokens ( #57222 ) in the Responses API, Anthropic thinking in /v1/messages ( #58613 ), streaming reasoning and tool calls from the derender endpoint ( #50550 ) with offloaded detokenization ( #57528 ), vllm chat streaming thinking output ( #57045 ), request body debug logging with --enable-log-requests ( #58163 ), and only the summary line of config docstrings in --help ( #57357 ). Structured output and parsers : native Lark grammars in the xgrammar backend ( #58321 ), XGrammar 0.2.7 ( #57272 ), Granite migrated to the streaming Parser Engine ( #49648 ), and fixes for reasoning boundaries ( #56635 ), xgrammar choices with control characters ( #48115 ), list-typed JSON Schema ( #48416 ), empty structural_tag ( #47450 ), outlines EOS handling ( #58612 , #57743 ), parser-suppressed streaming logprobs ( #58583 ), Inkling tool names after reasoning ( #58792 ), and length finish_reason for truncated streaming tool calls ( #46303 ). OpenAI, Anthropic and Harmony compatibility : reasoning token counts for Harmony, DeepSeek-V3 and Step3 (#58626) and per Responses tool round (#58927), Harmony max_output_tokens in the tool loop (#58551), batched chat completions using the adjusted requests (#58929, #58958), a fresh parser per choice (#58939), deferred reasoning recounts (#56067), Responses MCP cleanup (#56988) and image detail default (#57241), Anthropic inline system detection (#58754) and disabled thinking with P/D (#58786), stop strings rejected on --tokens-only servers (#57058), invalid prompt_embeds returning 400 (#55451, #57006), prompts bounded after multimodal expansion (#57076), --override-generation-config penalties (#50769), Hub revisions (#56092, #57461), full logprobs in token-in/token-out responses (#58488), generative scoring cancellation (#57729, #58788), gRPC keepalive pings (#55102), and run-batch diarized transcriptions (#57948). Pooling : chunked embedding padding (#56505) and normalization (#57498), reranker tokenization with document limits (#57666), and BERT-family heads kept for raw logits (#57664). Rust frontend : --hf-overrides (#56931), --sse-keep-alive-interval (#58306), custom chat roles (#58311), MiMo V2.5 parsers (#57933), normalized reasoning controls (#56998), parser-owned output grammars (#55269, #57340), sampling masks over gRPC (#56777), local DP size in gRPC metadata with vllm-proto 0.3.0 (#57116, #57233), a per-request preemption histogram (#57033), lock-free histograms (#58574), Nemotron-H vision context (#57634), model-owned vision processors (#58109), an mm-processor benchmark (#51922, #58084, #58378), unsupported serve args recognized (#58330), NaN logprobs no longer killing the engine client (#51026), appended EngineCoreOutput fields accepted (#56533), and vllm-rs on PATH in the CUDA image (#57606). Benchmarks : an openai-responses backend for vllm bench serve (#54628) and model_id in latency/throughput JSON (#58112). Security Per-request mm_processor_kwargs and media_io_kwargs are rejected by default; trusted deployments opt in with --trust-request-mm-kwargs (#58830). Prefix-cache block hashes tag extra keys by source (#51899) and include the LoRA path (#59335); multimodal hash input is framed (#54283) and incremental block hashing covers every overlapping feature (#51694). Fresh multimodal payloads take precedence over a stale receiver cache (#57833), and encoder-cache hits with mismatched embedding counts are rejected (#57696). min_tokens above the filled max_tokens default is rejected instead of wedging the engine (#57731); message sanitization filters upper-case memory addresses (#58832); LoRA adapters named after a served model are rejected (#59286). Dependencies FlashInfer 0.7.0.post1 (#58069, #59323), Transformers 5.17.0 (#56108) with an upper bound in requirements (#59614), XGrammar 0.2.7 (#57272), oss-harmony replacing openai-harmony (#55128), DeepGEMM fork pin bump (#57218), FlashKDA bump (#58846), and humming-kernels 0.1.16 (#58054). CUDA 12 images use LMCache 0.4.4 and CuPy CUDA 12 (#57945); a separately tagged zstd Docker Hub image ( -x86_64-zstd ) is published (#55608); Rubin CUDA 13.4 nightly images (#55953). ROCm: AITER v0.1.23 (#58867), torch 2.13, Triton 3.8 (#50605, #58006), patched ROCR (#57328), LMCache OpenTelemetry pins (#59056). XPU: PyTorch 2.14 (#56013). CPU: wheels built on Ubuntu 22.04 (#58515), pre-built Triton CPU (#58140). Breaking Changes & Deprecations Per-request mm_processor_kwargs and media_io_kwargs now return an error unless the server is started with --trust-request-mm-kwargs ; server-level --mm-processor-kwargs / --media-io-kwargs and offline LLM are unchanged (#58830). tokenizer_mode="slow" was removed; it already behaved like "hf" under Transformers v5 (#58545). --enable-mamba-fine-grained-prefix-cache was renamed to --enable-mamba-shared-prefix-checkpoint (#57382). Online quantization through quantization="fp8" now redirects to the fp8_per_tensor online shorthand (#53585); Quark-specific silent online MXFP4 quantization was removed in favor of the online quantization API (#51800). The AllSpark INT8 W8A16 GEMM backend was removed (#58001). The return_assistant_tokens_mask option of /render and the assistant_tokens_mask response field were removed (#57520). VLLM_PLE_CPU_OFFLOAD was removed; use --engram-config (#57937). VLLM_XPU_ENABLE_XPU_GRAPH was removed and XPU graphs are on by default (#51600). The comma-separated form of --collect-detailed-traces was removed; use the list syntax (#55702). New defaults: --enforce-eager also disables JIT kernel warmup unless fault tolerance is enabled (#58197, #58593); VLLM_BATCH_INVARIANT=1 uses breakable CUDA graphs without torch.compile (#57586) and disables sequence parallelism and async TP (#56377); DeepSeek-V4.1 SWA bounded replay is on (#56227) except on ROCm (#57906); Engram host tables are shared across co-located DP replicas when possible (#57651); FlashMLA mega attention is the DeepSeek-V4.1 default on SM100 (#56935); the AITER w4a4 ASM GEMM is off by default on ROCm (#57055). Model Runner V1 + PP > 1 + async scheduling + structured output is now rejected at startup (#56250); json_object is rejected at validation with the outlines backend (#57743). transformers now has an upper bound in requirements (#59614). New Contributors @0z5a made their first contribution in https://github.com/vllm-project/vllm/pull/56441 @200lz made their first contribution in https://github.com/vllm-project/vllm/pull/55528 @AARONKANG04 made their first contribution in https://github.com/vllm-project/vllm/pull/48521 @acsoto made their first contribution in https://github.com/vllm-project/vllm/pull/57314 @adenzhou1350 made their first contribution in https://github.com/vllm-project/vllm/pull/56882 @adtygan made their first contribution in https://github.com/vllm-project/vllm/pull/56325 @amasen02 made their first contribution in https://github.com/vllm-project/vllm/pull/56576 @amd-sriram made their first contribution in https://github.com/vllm-project/vllm/pull/53792 @andrewor14 made their first contribution in https://github.com/vllm-project/vllm/pull/52956 @Ankit-Jaiswal-AMD made their first contribution in https://github.com/vllm-project/vllm/pull/56252 @baljinderhothi-cohere made their first contribution in https://github.com/vllm-project/vllm/pull/58792 @BaoYunkai made their first contribution in https://github.com/vllm-project/vllm/pull/57568 @blipbyte made their first contribution in https://github.com/vllm-project/vllm/pull/55612 @BPbruce made their first contribution in https://github.com/vllm-project/vllm/pull/46466 @chuan932 made their first contribution in https://github.com/vllm-project/vllm/pull/55330 @coderfornow made their first contribution in https://github.com/vllm-project/vllm/pull/54978 @CZT0 made their first contribution in https://github.com/vllm-project/vllm/pull/51694 @devtyagi3909 made their first contribution in https://github.com/vllm-project/vllm/pull/56635 @dilberx made their first contribution in https://github.com/vllm-project/vllm/pull/57076 @divyvasal made their first contribution in https://github.com/vllm-project/vllm/pull/49845 @equiluxe made their first contribution in https://github.com/vllm-project/vllm/pull/48115 @errmakov made their first contribution in https://github.com/vllm-project/vllm/pull/58583 @farzad-elastix made their first contribution in https://github.com/vllm-project/vllm/pull/56168 @freyfwt made their first contribution in https://github.com/vllm-project/vllm/pull/51367 @garrett361 made their first contribution in https://github.com/vllm-project/vllm/pull/57984 @git-jxj made their first contribution in https://github.com/vllm-project/vllm/pull/55702 @gokay-ai made their first contribution in https://github.com/vllm-project/vllm/pull/58292 @gongwei-130 made their first contribution in https://github.com/vllm-project/vllm/pull/55102 @haosenwang1018 made their first contribution in https://github.com/vllm-project/vllm/pull/58288 @harshit-sarvam made their first contribution in https://github.com/vllm-project/vllm/pull/56034 @HieDean made their first contribution in https://github.com/vllm-project/vllm/pull/57356 @huthvincent made their first contribution in https://github.com/vllm-project/vllm/pull/48419 @i-m-aditya made their first contribution in https://github.com/vllm-project/vllm/pull/57447 @jayzuccarelli made their first contribution in https://github.com/vllm-project/vllm/pull/58557 @jiakangkangfuzhe made their first contribution in https://github.com/vllm-project/vllm/pull/55146 @jiangLLM made their first contribution in https://github.com/vllm-project/vllm/pull/57487 @jiaran-king made their first contribution in https://github.com/vllm-project/vllm/pull/56242 @jz-yolo made their first contribution in https://github.com/vllm-project/vllm/pull/58884 @kaijunli-infr made their first contribution in https://github.com/vllm-project/vllm/pull/52101 @karya0 made their first contribution in https://github.com/vllm-project/vllm/pull/57453 @KEYS-A15 made their first contribution in https://github.com/vllm-project/vllm/pull/57528 @kwen2501 made their first contribution in https://github.com/vllm-project/vllm/pull/51520 @laulopezreal made their first contribution in https://github.com/vllm-project/vllm/pull/57189 @lijipeng787 made their first contribution in https://github.com/vllm-project/vllm/pull/58225 @limitmhw made their first contribution in https://github.com/vllm-project/vllm/pull/48606 @linnea-lin-00638949 made their first contribution in https://github.com/vllm-project/vllm/pull/47450 @LinzeShi made their first contribution in https://github.com/vllm-project/vllm/pull/57347 @mahird3 made their first contribution in https://github.com/vllm-project/vllm/pull/57708 @melcheikh made their first contribution in https://github.com/vllm-project/vllm/pull/48956 @MichaelLapshin made their first contribution in https://github.com/vllm-project/vllm/pull/57396 @mjkvaak-amd made their first contribution in https://github.com/vllm-project/vllm/pull/48249 @mkunredd made their first contribution in https://github.com/vllm-project/vllm/pull/58244 @mmastrac made their first contribution in https://github.com/vllm-project/vllm/pull/57414 @mustafayildirim made their first contribution in https://github.com/vllm-project/vllm/pull/57252 @Navjot10 made their first contribution in https://github.com/vllm-project/vllm/pull/55390 @olka-amd made their first contribution in https://github.com/vllm-project/vllm/pull/51065 @PeganovAnton made their first contribution in https://github.com/vllm-project/vllm/pull/55128 @Rakul-Chauhan made their first contribution in https://github.com/vllm-project/vllm/pull/54967 @Ricardo-M-L made their first contribution in https://github.com/vllm-project/vllm/pull/52580 @Ronnie-Rui made their first contribution in https://github.com/vllm-project/vllm/pull/54581 @RyanMa29 made their first contribution in https://github.com/vllm-project/vllm/pull/57295 @sammaji made their first contribution in https://github.com/vllm-project/vllm/pull/58626 @sawsa307 made their first contribution in https://github.com/vllm-project/vllm/pull/56497 @ScarWar made their first contribution in https://github.com/vllm-project/vllm/pull/49435 @sdougbrown made their first contribution in https://github.com/vllm-project/vllm/pull/49819 @semerandre made their first contribution in https://github.com/vllm-project/vllm/pull/55557 @sergiofigueras made their first contribution in https://github.com/vllm-project/vllm/pull/57948 @shallow10 made their first contribution in https://github.com/vllm-project/vllm/pull/58336 @SIDDARTHAREDDY8 made their first contribution in https://github.com/vllm-project/vllm/pull/57743 @simpleqt made their first contribution in https://github.com/vllm-project/vllm/pull/55936 @tangzzycc made their first contribution in https://github.com/vllm-project/vllm/pull/53283 @touch869 made their first contribution in https://github.com/vllm-project/vllm/pull/55844 @tripathiarpan20 made their first contribution in https://github.com/vllm-project/vllm/pull/57140 @twu3202 made their first contribution in https://github.com/vllm-project/vllm/pull/57769 @ubwzwd made their first contribution in https://github.com/vllm-project/vllm/pull/55931 @UNIDY2002 made their first contribution in https://github.com/vllm-project/vllm/pull/58370 @valarLip made their first contribution in https://github.com/vllm-project/vllm/pull/58659 @vcave made their first contribution in https://github.com/vllm-project/vllm/pull/51681 @voidxb made their first contribution in https://github.com/vllm-project/vllm/pull/49300 @vorapolsiloai made their first contribution in https://github.com/vllm-project/vllm/pull/50212 @vschandramourya made their first contribution in https://github.com/vllm-project/vllm/pull/58779 @weitliao made their first contribution in https://github.com/vllm-project/vllm/pull/54535 @wenjinhust made their first contribution in https://github.com/vllm-project/vllm/pull/51366 @Willian-Zhang made their first contribution in https://github.com/vllm-project/vllm/pull/58720 @wtdcode made their first contribution in https://github.com/vllm-project/vllm/pull/56268 @xinnywinne made their first contribution in https://github.com/vllm-project/vllm/pull/55084 @YannikHinteregger made their first contribution in https://github.com/vllm-project/vllm/pull/50047 @YashasviChaurasia made their first contribution in https://github.com/vllm-project/vllm/pull/58112 @Yatimai made their first contribution in https://github.com/vllm-project/vllm/pull/43462 @YCH188 made their first contribution in https://github.com/vllm-project/vllm/pull/57190 @yousafshah made their first contribution in https://github.com/vllm-project/vllm/pull/55957 @ys2025-AI made their first contribution in https://github.com/vllm-project/vllm/pull/56841 @yuchenwang3 made their first contribution in https://github.com/vllm-project/vllm/pull/54699 @zhecfy made their first contribution in https://github.com/vllm-project/vllm/pull/58316 @Zoe923 made their first contribution in https://github.com/vllm-project/vllm/pull/53864 @Zyann7 made their first contribution in https://github.com/vllm-project/vllm/pull/57784 Contributors @AndreasKaratzas , @khluu , @mgoin , @njhill , @BugenZhao , @stefankoncarevic , @robertgshaw2-redhat , @taneem-ibrahim , @Thangnguyenvn98 , @hmellor , @Juntian777 , @WoosukKwon , @yewentao256 , @gau-nernst , @mmastrac , @LucasWilkinson , @Fangzhou-Ai , @NickLucche , @aoshen02 , @JaredforReal , @mawong-amd , @DarkLight1337 , @zyongye , @sfeng33 , @vllm-agent , @okorzh-amd , @ZJY0516 , @shen-shanshan , @gty111 , @Isotr0py , @djramic , @zixi-qi , @wzhao18 , @alec-flowers , @aarushjain29 , @Rohan138 , @yma11 , @mjkvaak-amd , @ivanium , @yisustc , @MatthewBonanni , @wangxiyuan , @reidliu41 , @chaojun-zhang , @shaohuaxi , @gcanlin , @ganeshr10 , @linitra24 , @yzong-rh , @divakar-amd , @atalman , @ShuoleiWang , @simondanielsson , @rasmith , @chaunceyjiang , @micah-wil , @liusy58 , @LioEinaudi , @louie-tsai , @LiuYinfeng01 , @jeejeelee , @zhenwei-intel , @jperezdealgaba , @hlin99 , @zxd1997066 , @lucamotz , @lucifer1004 , @eopXD , @ashraf-bhuiyan , @TheEpicDolphin , @JulienDarve , @mayuyuace , @danisereb , @bigPYJ1151 , @Etelis , @JohnQinAMD , @jiangkuaixue123 , @tianmu-li , @akii96 , @vllmellm , @RyanMa29 , @afriedri , @elvircrn , @mustafayildirim , @yuzhouo7 , @wtdcode , @biswapanda , @adtygan , @hickeyma , @itayalroy , @jiangLLM , @Hotragn , @faaany , @xhx1022 , @jinzhen-lin , @sheralskumar , @Wauplin , @matteso1 , @wjabbour , @Sunt-ing , @arpera , @hclsys , @S1ro1 , @HDCharles , @fxmarty-amd , @liuzijing2014 , @UNIDY2002 , @samuelkim7 , @markmc , @errmakov , @zhejiangxiaomai , @KernelClint , @i-m-aditya , @ColinZ22 , @ppalanga, @franciscojavierarceo, @maithilijoshi20, @mfylcek, @almersawi, @albertoperdomo2, @0z5a , @jacklin78911-collab, @lzhan011, @Alex-ai-future, @freyfwt , @ZhengGong-amd, @mindungil, @amasen02 , @devtyagi3909 , @wenjinhust , @jbyczkow, @AdaAibaby, @harshit-sarvam , @vineethsaivs, @tripathiarpan20 , @sashko-zakharchuk, @semerandre , @rebklee, @git-jxj , @cjackal, @xinnywinne , @andrewor14 , @kyleliang-nv, @thillai-c, @dongluw, @ChuanLi1101, @omerpaz95, @jiaran-king , @liuyao0322, @coderfornow , @drakosha, @laulopezreal , @melcheikh , @shantipriya-amd, @Rukhaiya2004, @yuchenwang3 , @lxy-alexander, @tlrmchlsmth, @HieDean , @Zoe923 , @YCH188 , @amd-sriram , @andylolu2, @MicheleCampi, @sdougbrown , @vMaroon, @shimib, @andakai, @thegoldenflow, @Levius-Fubuki, @olka-amd , @limitmhw , @yuwenzho, @adenzhou1350 , @Josephasafg, @kylesayrs, @jdebache, @kaijunli-infr , @afierka-intel, @frida-andersson, @bnellnm, @ys2025-AI , @waizuichougou, @touch869 , @rjrock, @sawsa307 , @pavelzak, @ScarWar , @fadara01, @Mi-Jiazhi, @dilberx , @mahird3 , @Zyann7 , @roikoren755, @YukioZzz, @Ronnie-Rui , @acsoto , @czhu-cohere, @twu3202 , @oliverholworthy, @weitliao , @sergiofigueras , @tuukkjs, @Sip4818, @karen-sy, @garrett361 , @GirasoleY, @Navjot10 , @taking-lying-flat, @wangyicong52, @majunze2001, @gangula-karthik, @ubwzwd , @linnea-lin-00638949 , @kushaldabbe, @Yatimai , @guanxingithub, @jiakangkangfuzhe , @MichaelLapshin , @jhu960213, @tpopp, @mganczarenko, @qiching, @tangzzycc , @lijipeng787 , @nikhilkulkarni1755, @QwertyJack, @Ankit-Jaiswal-AMD , @vorapolsiloai , @Dao007forever, @BPbruce , @divyvasal , @simpleqt , @blipbyte , @jhaotingc, @karya0 , @farzad-elastix , @grYe99, @talorabr, @jackLei0901, @Yejing-Lai, @Priyjain-amd, @KEYS-A15 , @LinzeShi , @bohnstingl, @nightcityblade, @vcave , @AARONKANG04 , @CZT0 , @snadampal, @microslaw, @haosenwang1018 , @netanel-haber, @khushali9, @sammaji , @SIDDARTHAREDDY8 , @100milliongold, @gongwei-130 , @fululi12, @mkunredd , @mrodden, @noooop, @valarLip , @shallow10 , @200lz , @askliar, @chuan932 , @Monishver11, @YashasviChaurasia , @gokay-ai , @jiacao-amd, @yousafshah , @positive666, @TQCB, @lk-chen, @Ricardo-M-L , @huthvincent , @baljinderhothi-cohere , @vschandramourya , @kwen2501 , @xiao-llm, @zhecfy , @Willian-Zhang , @simon-veitner-redhat, @mevince, @voidxb , @hongxiayang, @YannikHinteregger , @V-3604, @Rakul-Chauhan , @frankwang28, @LCAIZJ, @PeganovAnton , @jz-yolo , @QHarshil, @R3hankhan123, @jayzuccarelli , @yannicks1, @BaoYunkai , @xaguilar-amd, @xiaohuguo2023, @wxsIcey, @harshaladhav-amd, @varun-sundar-rabindranath, @kliuae, @LostFox11

★ llama.cpp support for Cohere models

/u/nick_frosst — Tue, 20 Oct 2026 00:00:00 +0000

93% · First-party 93%, Usable today 62%

Hey guys, Nick here from Cohere. It's been a minute. We had a great time launching Command A+ and beta-testing North Mini Code with you guys earlier this year, your feedback has really helped make our models and delivery much better. one of the biggest things we heard was that you really wanted llama.cpp support, which makes total sense given the nature of this sub. i didn't want to post in here again until we'd been able to fulfill that promise, and I'm really happy to say that we've made progress. Our team recently merged llama.cpp support for the vision encoder of North Micro Vision Instruct , which means that now all of our latest model architectures are compatible with llama.cpp (the LLM is the same arch as for North Mini Code and Command A+ - already supported thanks to the work of people like you guys). North Micro Vision is being used as the base for several of our new releases, and i'm really psyched to say we've got the support you guys have been wanting. Please feel free to try it out and let us know what you think. It's just one step, but there's only more where that came from. On a slightly similar note, Cohere Transcribe is now available in Unsloth and Unsloth Studio for fine-tuning. it's a crazy good STT model, one of the best out there, so if you're a fan of the guys over at r/unsloth (i know we are), give it a whirl. Thanks again for all your feedback, and let us know what else you want to see from Cohere. submitted by /u/nick_frosst to r/LocalLLaMA [link] [comments]

★ 24GB is plenty if your engines take turns

/u/Distinct-Pie2389 — Tue, 20 Oct 2026 00:00:00 +0000

93% · Usable today 93%

System service that watches your card, swaps and loads whatever you want, whenever you want. Don’t have to swap anything manually, collisions avoided, VRAM fully dedicated to each function while it’s running (no VRAM squatters). I had issues everyday (Linux) where a node process would orphan, comfyUI auto starts and holds 500MB that strata can’t claim. I also wanted to be able to switch natively and not have to think about starting each engine, making sure strata or llama wasn’t stuck loaded, or flux GGUF’s still claimed in comfyUI from an old workflow. I swap between Ninfer-4090 (llama-swap), strata, comfyUI, OpenWebUI, and I do it between multiple devices all using the same RTX 4090. Maybe you want to have your box run Hermes at night and you take the card back in the day, you can do it natively without thinking about and have full visibility on what was done and when. Berth will also serve your engines as an API so when you need to switch natively you load berth as the API endpoint and you can load strata, polystrata, and any other custom engine. Works for gaming as well, you don’t have to worry about a cron job, a request, or anything grabbing the card while you’re gaming or doing custom workflows. REPO: https://github.com/T-Crypt/berth submitted by /u/Distinct-Pie2389 to r/LocalLLaMA [link] [comments]

★ I managed to run a realistic talking avatar locally in realtime (90+ FPS on RTX4090)

/u/Mikasa0xdev — Tue, 20 Oct 2026 00:00:00 +0000

93% · Measured result 93%, Usable today 42%

submitted by /u/Mikasa0xdev to r/StableDiffusion [link] [comments]

★ OpenBSD 8.0

privong — Tue, 20 Oct 2026 00:00:00 +0000

93% · First-party 93%, Usable today 45%

Article URL: https://www.openbsd.org/80.html Comments URL: https://news.ycombinator.com/item?id=50160494 Points: 197 # Comments: 57

★ Context.dev: bootstrapped to YC and a $9M seed round

/u/context_dev — Tue, 20 Oct 2026 00:00:00 +0000

91% · First-party 91%, Measured result 88%, Usable today 83%

Hey r/saas , I'm Yahia, used to post here a ton while building random stuff on the internet for years. One of those projects was stockalarm.io, which I grew to 250,000 users and sold. Plenty of the others went absolutely nowhere (tons of fun though)... Eventually I bootstrapped Brand.dev. Give us a domain, get back logos, colors, fonts, and company info. Customers started asking us to pull more data from websites, and we kept saying yes. That grew into context.dev We went through YC S26, grew to 7 people, and built infrastructure that now handles millions of requests an hour across search, web scraping, crawling, and structured data. There’s a ridiculous amount of engineering behind that. Very proud of what the team’s built. But the biggest thing I’ve learned in a market this competitive is how much comes from staying close to customers.. For me, that’s meant: > personally taking 300–400 customer/lead calls a month, my calendar is a disaster most days. > talking to the same people again after they’ve actually used the product. You learn a lot on the second and third call. > understanding what they’re trying to do. a GTM use-case and infra making millions of requests have very different needs, we support both! > being an absolute lunatic about support, help someone always, even suggest solutions that aren't yours simply to be helpful (this one works wonders for people trusting you) Those conversations keep giving us things to build and things to fix, then i'd get back on a call and find out how we did. We just raised a $9M seed round today and power over 800 customers from public companies to indiehackers building their first saas, a pretty absurd journey from a little API that returned logos. Would love to answer any questions that people may be curious about, whether it's bootstrapping, going through YC, or raising all this money. P.S: everyone who signs up today gets 50,000 requests context.dev submitted by /u/context_dev to r/SaaS [link] [comments]

★ MiniMax M3.1 Flash

jtg — Tue, 20 Oct 2026 00:00:00 +0000

90% · First-party 90%, Usable today 37%, Measured result 35%

Article URL: https://www.minimax.io/blog/minimax-m31f Comments URL: https://news.ycombinator.com/item?id=50154540 Points: 437 # Comments: 189

Old TCL Beyond TV was super slow, so I tried this open-source debloat with Claude and it worked

/u/BandicootUnique1727 — Tue, 20 Oct 2026 00:00:00 +0000

89% · Usable today 89%

Sharing is caring! Not my project. I saw it on X and tried it on my TCL Beyond TV, which was super slow. I used Claude to do it, and it worked: ads and bloatware are gone, and I now have a clean launcher. It's free, open source (MIT), needs no root, and has a restore script if you change your mind. Model: TCL Beyond TV Repo (by Gathin23): [https://github.com/Gathin23/tv-vibehack] Original thread on X: [ https://x.com/gathint/status/2111379571744657874 ] Full credit to the original author. I'm just sharing since it helped my TV. submitted by /u/BandicootUnique1727 to r/ClaudeAI [link] [comments]

Close the lid and go: my MacBook keeps running Claude Code on 4.8 W or less

/u/CyrisXD — Tue, 20 Oct 2026 00:00:00 +0000

89% · Measured result 89%, Usable today 85%, First-party 43%

I like to kick off Claude Code, shut the lid and head out. The catch is battery: with the lid open, my Mac draws 16.7 W just on idle, and the screen eats most of it. So I built Pilot Light, an advanced caffeinate aimed at power savings. Close the lid and the screen goes dark, Low Power Mode switches on and Claude keeps working on 4.8 W, so a battery that would last about 6 hours lasts 20+. With Claude Code building the website and testing every feature through a headless Playwright browser, lid shut, it measured 2.3 W. Claude helped me work out how to build the safety features and fallbacks, and which macOS flags to watch so the app can spot those situations and react. So it lets the Mac sleep if it gets seriously hot in a bag or the battery drops below your limit, and puts everything back when you open the lid. It's free, with no tracking, no telemetry and no accounts. It's MIT licensed and in beta, and so far it's only been tested on my M5 Max. Website: https://pilotlight.sudolabs.nz/ submitted by /u/CyrisXD to r/ClaudeAI [link] [comments]

AI labs report benchmark scores 6.4% higher than independent testers, on average

/u/jakecoolguy — Tue, 20 Oct 2026 00:00:00 +0000

88% · Usable today 88%, Measured result 59%, First-party 32%

I've been building whatmodel.sh , an open source AI leaderboard, and wanted to see how a labs' own benchmark scores compare with independent testers. Using 1,629 published benchmark results, I matched 611 comparisons of 180 models on 103 benchmarks. AI labs reported scores 6.4% higher on average for the same models on the same tests. Everything is open: the dataset is CC BY-SA 4.0 and the code is MIT. Sources and their licenses are recorded, with links on each model's page. Interactive chart: https://whatmodel.sh/claims Data and code: https://github.com/jakemanger/whatmodel Please star on Github if you find it useful. Contributions are very much welcome! submitted by /u/jakecoolguy to r/LocalLLaMA [link] [comments]

ollama v0.40.7

github-actions[bot] — Tue, 20 Oct 2026 00:00:00 +0000

88% · First-party 88%, Usable today 71%

What's Changed openai: allow Responses effort on non-thinking models by @hoyyeva in #19010 llama-server: let llama-server infer the draft speculative type by @dhiltgen in #19064 mlx: add PPLX Decider v1.2 support by @dhiltgen in #19072 Full Changelog : v0.40.6...v0.40.7-rc0

Patch release v5.20.2

Cyrilvallez — Tue, 20 Oct 2026 00:00:00 +0000

88% · First-party 88%, Usable today 75%

llama.cpp b11747

github-actions[bot] — Tue, 20 Oct 2026 00:00:00 +0000

87% · First-party 87%, Usable today 83%

mtmd : match the transformers Qwen-VL resize ( #30736 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/57593886 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Release: v5.15.0

LysandreJik — Tue, 20 Oct 2026 00:00:00 +0000

86% · First-party 86%, Usable today 86%

Release v5.15.0 New Model additions Meta Muse Glimmer Muse Glimmer, released today, is Meta’s new multimodal model, especially designed for agentic use cases. Distilled from Muse to 30B parameters, and released under the Apache 2.0 license, it can be deployed to local setups for privacy-aware applications such as coding, document analysis, personal assistants, Claw- or Hermes-like setups. Muse Glimmer is a dense 30B parameter model consisting of: 2B ViT-style encoder for vision (Perception Encoder) 28B parameter text decoder We're covering it in the following blogpost: http://hf.co/blog/muse-glimmer GraniteMoeSWA & GraniteSWA Links: Documentation Add Granite-swa and Granitemoe-swa model support ( #47179 ) by @daviswer in #47179 Links: Documentation Add Granite-swa and Granitemoe-swa model support ( #47179 ) by @daviswer in #47179 A.X-K1 & A.X-K2 Links: Documentation Add AXK2 from SKT ( #47528 ) by @vasqu in #47528 Links: Documentation add_axk1 ( #46867 ) by @kmswin1 in #46867 Cosmos3 Edge Links: Documentation Add Cosmos3 Edge model support ( #47181 ) by @atharvajoshi10 in #47181 Breaking changes Kernels are now opt-in rather than mandatory for linear attention models (Mamba, GDN, Conv-only, etc.), so users who relied on automatic kernel selection must explicitly enable kernels to maintain previous behavior. 🚨 [ Kernels ] Refactor all linear attn models & native kernels fallback ( #47630 ) by @vasqu The cache cropping API now only accepts negative values (relative offsets) instead of absolute sizes, so users calling crop methods directly must update their code to pass negative values accordingly. 🚨 [cache] Cropping can only be done with negative values ( #47720 ) by @Cyrilvallez T5 and its model family (MT5, LongT5, etc.) now support SDPA and other attention backends via ALL_ATTENTION_FUNCTIONS , meaning the default attention implementation may change and users relying on the previous eager-only path should explicitly set attn_implementation="eager" if needed. 🚨 Enable SDPA (and other attention backends) for T5 and propagate to the T5 family ( #47014 ) by @jiqing-feng Several small private helper functions (e.g., _is_url , _build_image_tokens ) have been removed from multimodal processor files, so users or downstream libraries that imported these private functions directly must remove or replace those references. 🚨 Processors update the rest ( #46556 ) by @zucchini-nlp Attention This release includes several attention fixes and improvements, including correcting Multi-Head Latent Attention (MLA) cache compression, optimizing Flash Attention max sequence length computation in vision models, and fixing bugs in CTRL flex-attention and SDPA prefill with position bias. Additional changes refactor linear attention models for better maintainability, make Gemma 4's heterogeneous attention config explicit, and improve MPS support via metal-flash-sdpa integration. [Fix] Fix multi-head latent attention (MLA) ( #47761 ) by @remi-or in [ #47761 ] Refactor all linear attention models to latest best standards for convolution ( #47452 ) by @Cyrilvallez in [ #47452 ] Allow metal-flash-sdpa for OpenAIPrivacyFilter on MPS ( #46740 ) by @ArthurZucker in [ #46740 ] Use new per_layer_config for Gemma 4 so that heterogeneous attention config is explicit ( #47384 ) by @hmellor in [ #47384 ] add paged attention tests support for XPU ( #47163 ) by @kaixuanliu in [ #47163 ] Move value padding into the attention interfaces that need it ( #47451 ) by @hmellor in [ #47451 ] Simplify function dispatch for linear attention ( #47450 ) by @Cyrilvallez in [ #47450 ] Optimize flash attention max seqlen computation in vision attention ( #47170 ) by @ShareLer in [ #47170 ] Fix BlockMask crash in CTRL flex-attention generation ( #46854 ) by @jiqing-feng in [ #46854 ] [CB] Automatically switch attention implementation to flash ( #47330 ) by @remi-or in [ #47330 ] Fix sdpa prefill with position_bias ( #47359 ) by @Cyrilvallez in [ #47359 ] Vision Vision improvements in this release include performance optimizations such as faster image preprocessing for vision-language models (GLM4V, MiniMaxM3-VL, and others) by eliminating redundant tensor copies, and more efficient Flash Attention variable-length paths by precomputing maximum sequence lengths once per forward pass. Several bug fixes were also applied, including correcting dtype alignment in Kosmos2/Kosmos2_5 embedding merges, fixing a position-embedding initialization fallback in Phi4Multimodal, resolving PIL resize parity in Hunyuan-VL, and patching stop-sequence handling in the image-text-to-text pipeline. Modularize qwen-format vision processors ( #47573 ) by @zucchini-nlp in [ #47573 ] Update daily CI Docker image to torch 2.13.0 / CUDA 13.0 ( #47738 ) by @ydshieh in [ #47738 ] Align image feature dtype in kosmos2 and kosmos2_5 embedding merge ( #47691 ) by @ in [ #47691 ] Speed up image preprocessing for vision-language models ( #47453 ) by @labAxiaoming in [ #47453 ] Fix vision position-embedding init width fallback in Phi4Multimodal ( #47509 ) by @ in [ #47509 ] Fix Hunyuan-VL PIL image resize parity with reference preprocessing ( #47233 ) by @IMvision12 in [ #47233 ] Fix image-text-to-text stop_sequence handling ( #47032 ) by @Sunt-ing in [ #47032 ] Refactor image loading in tests to use load_test_image helper ( #47218 ) by @LevelVoid in [ #47218 ] Generation Several generation improvements and bug fixes were made, including enabling batched audio generation for Qwen2.5/3-Omni, allowing sliding window cache layers to work with speculative decoding, and fixing memory overhead from static cache persistence across generate() calls. Multiple model-specific bugs were also resolved, including crashes in KyutaiSpeechToText, MusicgenForCausalLM, CTRL flex-attention, and assisted decoding for EncoderDecoder cache and OlmoHybrid models. Align OlmoHybrid to use a native cache in generate ( #47604 ) by @Cyrilvallez in [ #47604 ] [generate] Stop setting the static cache as an attribute to save memory ( #47731 ) by @Cyrilvallez in [ #47731 ] Add support for batched Qwen2.5/3-Omni audio generation ( #47186 ) by @IMvision12 in [ #47186 ] [cache] Allow sliding window layers to be roll-backed for speculative decoding ( #47447 ) by @Cyrilvallez in [ #47447 ] Fix shape mismatch in KyutaiSpeechToText generate() last window ( #46952 ) by @jiqing-feng in [ #46952 ] Fix typo in MusicgenForCausalLM.generate() ( #46974 ) by @jiqing-feng in [ #46974 ] Fix assisted decoding for models with EncoderDecoder cache & OlmoHybrid ( #47361 ) by @Cyrilvallez in [ #47361 ] Cache Several cache-related bugs were fixed, including correcting NemotronH's missing "mlp" layer-type mapping, resolving recurrent-layer padding masks being skipped during chunked prefill and cache continuation for hybrid models, and fixing assisted decoding for models with EncoderDecoderCache and OlmoHybrid. Additional improvements include aligning OlmoHybrid to use a native cache, enabling sliding window layers to support speculative decoding rollback, and stopping the static cache from being stored as a model attribute to reduce unexpected memory overhead. [docs] MPS graph cache ( #47304 ) by @stevhliu in [ #47304 ] Fix NemotronH: Register "mlp" in the cache layer-type mappings ( #47535 ) by @qgallouedec in [ #47535 ] Fix recurrent-layer padding mask being skipped on continued forwards (chunked prefill, cache continuation) ( #47087 ) by @abcgco in [ #47087 ] Kernels ⚠️ The kernels python package will very likely be a required dependency for transformers[torch] in the near future. This will help us deliver maximum performance to all users; kernels will only be downloaded from trusted publishers manually approved by the HF team. Please let us know of any issues you're facing beforehands so that we may solidify our integration. Improved robustness of the kernels integration by refactoring function handling to use layer repos, fixing CI EROFS fallback patches for kernel downloads via HfApi , resolving a positional argument collision in causal_conv1d_fn , and bumping the FP8 kernels version to prevent NaNs. [conftest] Fix EROFS fallback for kernel downloads (correct interception point) ( #47794 ) by @ydshieh in [ #47794 ] [conftest] Fix EROFS fallback for kernel downloads via HfApi ( #47791 ) by @ydshieh in [ #47791 ] [ Kernels ] Refactor function handling ( #46883 ) by @vasqu in [ #46883 ] Kernels and loaders robustification ( #47334 ) by @IlyasMoutawwakil in [ #47334 ] Fix causal_conv1d_fn positional activation colliding with hub kernel's seq_idx ( #47527 ) by @qgallouedec in [ #47527 ] [ FP8 ] Bump kernels version ( #47344 ) by @vasqu in [ #47344 ] [docs] FlashAttention kernel fallback ( #47345 ) by @stevhliu in [ #47345 ] Quantization Quantization support was expanded with FP8 kernels for compressed-tensors models, fixes for FP8 module normalization and format-based compression detection, and a multi-device MXFP4 dequantization race condition fix. GPTQ and MXFP4 tests were also extended to cover Intel XPU devices. extend tests/quantization/gptq/test_gptq.py::GPTQTestCUDA and tests/q… ( #47166 ) by @sywangyi in [ #47166 ] Compressed tensors fp8 ( #47216 ) by @SunMarc in [ #47216 ] Fix A.X-K2 fp8 modules_to_not_convert normalization for the gated-norm MLP ( #47578 ) by @kmswin1 in [ #47578 ] [Quantization]: Refactor is_quantization_compressed for format-based detection ( #47152 ) by @rigen1048 in [ #47152 ] Fix multi-device mxfp4 dequantization race in _convert_moe_packed_tensors ( #47423 ) by @kaixuanliu in [ #47423 ] Audio Batched audio generation is now supported for Qwen2.5/3-Omni, and several bug fixes were applied across audio models, including a dtype mismatch in Gemma4 audio feature merging, a bfloat16 positional embedding error in AudioFlamingo3, and missing backend requirement guards for Voxtral. The VibeVoice ASR processor was also updated to make audio input optional and support multiple audios per prompt. feat[vLLM x v5]: Make audio optional and support multiple audios in VibeVoice ASR processor ( #47483 ) by @harshaljanjani in [ #47483 ] Fix Gemma4 audio feature dtype mismatch in masked_scatter ( #47482 ) by @danielhanchen in [ #47482 ] [fix] fix requirements audio feature and proc ( #47113 ) by @eustlb in [ #47113 ] [AudioFlamingo3] Fix bfloat16 dtype mismatch in audio encoder positional embedding ( #47258 ) by @snkii in [ #47258 ] Parallelization Expanded FSDP support across 94 ForCausalLM model classes with auto-generated FSDP plans, added end-to-end FSDP tests including distributed checkpoint save/load and generation, and introduced a dedicated FSDP CI job. Additionally, fixed a device mismatch bug in create_bidirectional_sliding_window_mask under model parallelism and resolved a tensor parallel inference issue for models with tied embeddings. skip fsdp tests when backend is mps ( #47601 ) by @3outeille in [ #47601 ] Fix model parallel device mismatch in create_bidirectional_sliding_window_mask ( #47560 ) by @abcgco in [ #47560 ] Add FSDP plans to all models ( #47165 ) by @3outeille in [ #47165 ] Fix TP inference for tied embedding ( #47503 ) by @3outeille in [ #47503 ] Add FSDP CI and end-to-end FSDP tests + save fsdp ( #47357 ) by @3outeille in [ #47357 ] Tokenization This release adds native support for Mistral's "tekken" tokenizer format via AutoTokenizer, fixes a CodeLlama tokenizer bug where leading whitespace was incorrectly dropped during decode, and patches a potential ReDoS vulnerability caused by unescaped tokenizer filenames being used as regex patterns in from_pretrained . [Mistral] Add native tekken tokenizer support to AutoTokenizer ( #47507 ) by @juliendenize in [ #47507 ] Fix CodeLlama tokenizer dropping leading whitespace on decode ( #47488 ) by @SuryanshSS1011 in [ #47488 ] Fix potential ReDoS by escaping tokenizer filename used as regex pattern ( #47498 ) by @hameedibrh in [ #47498 ] Serve Improved the serve chat parsing to unify streaming and non-streaming paths under a single response parser that handles tool calls, reasoning, and content, simplifying the addition of new model support. Additionally, hardened daily CI reporting by fixing GitHub API diagnostic output being captured in Slack payloads and adding rate-limit resilience to prevent report failures when paginating large job matrices. CI: Log GitHub API diagnostics to stderr ( #47635 ) by @tarekziade in [ #47635 ] Update serve chat parsing ( #46267 ) by @SunMarc in [ #46267 ] ci: harden daily CI reporting against GitHub API rate limits ( #47382 ) by @tarekziade in [ #47382 ] Bugfixes and improvements Fix cached_files silently returning stale file on read-only filesystem (EROFS) ( #47852 ) by @ydshieh in [ #47852 ] Fix PhimoeIntegrationTest ( #46539 ) by @ydshieh in [ #46539 ] make examples under doc device agnostic ( #47812 ) by @kaixuanliu in [ #47812 ] cancel deterministic for XPU in gemma4 tests ( #47790 ) by @kaixuanliu in [ #47790 ] Serialize post-mlinter-review after post-link to avoid PR description race ( #47832 ) by @ydshieh in [ #47832 ] Use content hash for mlinter review deduplication ( #47830 ) by @ydshieh in [ #47830 ] Add new args in auto-docstring ( #47737 ) by @zucchini-nlp in [ #47737 ] Add check_model_inits.py ( #47656 ) by @guarin in [ #47656 ] add xpu in installation guide ( #47785 ) by @sywangyi in [ #47785 ] Fix mlinter review job: checkout before artifact download ( #47820 ) by @ydshieh in [ #47820 ] Post mlinter findings as inline PR review comments ( #47819 ) by @ydshieh in [ #47819 ] Fix ci style ( #47818 ) by @vasqu in [ #47818 ] Hotfix axk2 indexer norm ( #47810 ) by @kmswin1 in [ #47810 ] open fla support for XPU to benefit from the acceleration ( #47799 ) by @kaixuanliu in [ #47799 ] [docs] Update BatchEncoding.to() type annotation and docstring ( #47789 ) by @samyuktahegde in [ #47789 ] Fix linting ( #47807 ) by @Cyrilvallez in [ #47807 ] Fix patching in some models ( #47798 ) by @zucchini-nlp in [ #47798 ] Add post-mlinter-review job to post-dashboard-link workflow ( #47800 ) by @ydshieh in [ #47800 ] Migrate torchao integration off deleted torchao.dtypes ( #47797 ) by @vkuzo in [ #47797 ] [conftest] Also wrap snapshot_download for EROFS fallback ( #47796 ) by @ydshieh in [ #47796 ] Fix MI355 CI: bump hf-workflows pin to NUM_SLICES=4 ( #47792 ) by @Abdennacer-Badaoui in [ #47792 ] [Fix] Wrong type hint in get_number_of_image_patches ( #47788 ) by @remi-or in [ #47788 ] Fix Dac offload tests ( #47775 ) by @guarin in [ #47775 ] [Fix] Swapped height and width in KimiK25 ( #47786 ) by @remi-or in [ #47786 ] Remove dangling files and folders ( #47764 ) by @Cyrilvallez in [ #47764 ] Fix AI-written conversion mappings ( #47755 ) by @Cyrilvallez in [ #47755 ] update mistral common version for PR 47507 ( #47677 ) by @itazap in [ #47677 ] Fix spelling/grammar in model files (batch 3/3) ( #47684 ) by @Rocketknight1 in [ #47684 ] Fix spelling/grammar in core library, examples, and utils ( #47685 ) by @Rocketknight1 in [ #47685 ] Fix spelling/grammar in model files (batch 2/3) ( #47683 ) by @Rocketknight1 in [ #47683 ] update sonicmoe versions ( #47769 ) by @IlyasMoutawwakil in [ #47769 ] clean up reverse_op fixme in compressed_tensors ( #47701 ) by @DhanushPillay in [ #47701 ] PR CI with torch 2.13 ( #47767 ) by @ydshieh in [ #47767 ] Import utils compilation fixes ( #47726 ) by @IlyasMoutawwakil in [ #47726 ] Fix DBRX MoE hidden size and expert GLU transposes ( #47671 ) by @kaixuanliu in [ #47671 ] Fix multi token decode merging ( #47762 ) by @IlyasMoutawwakil in [ #47762 ] Fix: Remove redundant @can_return_tuple conflicting with @capture_out… ( #47733 ) by @guarin in [ #47733 ] fix processor config nested key fallback ( #47628 ) by @YunzhuLu in [ #47628 ] [CI - Debug] Skip /transformers-dependent steps for CPU runner ( #47759 ) by @ydshieh in [ #47759 ] [CI] Add CPU runner support to ssh-runner workflow ( #47757 ) by @ydshieh in [ #47757 ] Simplify reverse weight conversion ( #47725 ) by @Cyrilvallez in [ #47725 ] Remove useless linting for inv_freq ( #47753 ) by @Cyrilvallez in [ #47753 ] Use explicit nn.Buffer everywhere for modular ( #47722 ) by @Cyrilvallez in [ #47722 ] Remove stale and redundant _no_split_modules entries ( #47645 ) by @guarin in [ #47645 ] Executorch exporter fixes ( #47243 ) by @IlyasMoutawwakil in [ #47243 ] Acc fix in xpu ( #47500 ) by @sywangyi in [ #47500 ] update Dockerfile for xpu torch2.13 ( #47502 ) by @sywangyi in [ #47502 ] feat[vLLM]: Support text replacement offsets in the remaining old-format processors ( #47614 ) by @harshaljanjani in [ #47614 ] Fix ImportError in transformers.exporters on torch < 2.8 ( #47711 ) by @Neal006 in [ #47711 ] Fix failing tests for axk1 and axk2 ( #47727 ) by @kaixuanliu in [ #47727 ] Fix failing tests for granite_swa and granitemoe_swa ( #47723 ) by @kaixuanliu in [ #47723 ] skip invalid test cases for inkling tests ( #47493 ) by @kaixuanliu in [ #47493 ] [docs] Fix BatchEncoding documentation inconsistencies ( #47647 ) by @samyuktahegde in [ #47647 ] Fix spelling/grammar in model files (batch 1/3) ( #47682 ) by @Rocketknight1 in [ #47682 ] Fix spelling/grammar in English docs (q → z) ( #47681 ) by @Rocketknight1 in [ #47681 ] Fix spelling/grammar in English docs (h → p) ( #47680 ) by @Rocketknight1 in [ #47680 ] Fix spelling/grammar in English docs (a → g) ( #47679 ) by @Rocketknight1 in [ #47679 ] fix npu check ( #47587 ) by @DhanushPillay in [ #47587 ] fix: correct text input validation logic in 8 multimodal processors (and → or) ( #47663 ) by @AbdullahRasheed45 in [ #47663 ] Fix feature dtype mismatch in masked_scatter for seven multimodal models ( #47673 ) by @ in [ #47673 ] [docs] storing and loading chat templates ( #47650 ) by @stevhliu in [ #47650 ] adding amd quark config class changes ( #47322 ) by @debasisdwivedy in [ #47322 ] Fix compressed tensors impl ( #47652 ) by @SunMarc in [ #47652 ] Hoist special-token lookups in wav2vec2 decode paths and drop a dead filter in wav2vec2_phoneme ( #47557 ) by @ishan-1010 in [ #47557 ] silencing elastic warning by import distributed lib inside functions ( #47665 ) by @3outeille in [ #47665 ] Fix missing github_utils.py download in PR CI dashboard workflow ( #47668 ) by @ydshieh in [ #47668 ] Exportable kimi ( #47096 ) by @IlyasMoutawwakil in [ #47096 ] better guarding to handle torch compiled with USE_DISTRIBUTED=0 ( #47619 ) by @3outeille in [ #47619 ] Remove gemma4 warnings ( #47664 ) by @Cyrilvallez in [ #47664 ] [Chat Parsing] Type inline tool-call arguments from the calling tool's JSON Schema ( #47529 ) by @yonigozlan in [ #47529 ] Improve Trainer DataLoader Controls for Streaming and Multiprocessing ( #47164 ) by @muyihao in [ #47164 ] Update maintainer list ( #47644 ) by @Rocketknight1 in [ #47644 ] Allow position_ids_start=2 on DataCollatorWithFlattening for RoBERTa etc. ( #47525 ) by @tomaarsen in [ #47525 ] Remove Rotary warning ( #47642 ) by @Cyrilvallez in [ #47642 ] Drop multimodal inputs natively in prepare_inputs_for_generation if not in prefill ( #47622 ) by @Cyrilvallez in [ #47622 ] Simplify all Rotary modules ( #47598 ) by @Cyrilvallez in [ #47598 ] [docs] response_template when serving ( #47626 ) by @stevhliu in [ #47626 ] [docs] MTP support ( #47301 ) by @stevhliu in [ #47301 ] Fix GPT-2 c_proj depth scaling initialization ( #47459 ) by @DavidJohnQuinlan in [ #47459 ] Fix fp8_linear compilability ( #47623 ) by @IlyasMoutawwakil in [ #47623 ] byebye torch 2.4 ( #47609 ) by @ydshieh in [ #47609 ] Vectorize NoRepeatNGramLogitsProcessor and remove its host sync ( #47571 ) by @hameedibrh in [ #47571 ] Fix CUDA Graph breaking host to device copy from scalar tensor allocation ( #47547 ) by @hmellor in [ #47547 ] Fix some processors ( #47608 ) by @zucchini-nlp in [ #47608 ] CI: Add serge review relay workflow and review rules ( #47610 ) by @tarekziade in [ #47610 ] [docs] Exporters ( #47374 ) by @stevhliu in [ #47374 ] CI: use a single function for GH calls ( #47474 ) by @tarekziade in [ #47474 ] Remove redundant guarding for distributed ( #47570 ) by @3outeille in [ #47570 ] Fix modular for mamba packages ( #47494 ) by @Cyrilvallez in [ #47494 ] Remove deprecated conversion in Kimi ( #47581 ) by @zucchini-nlp in [ #47581 ] CI: use transformers-ci daily workflow with OTEL ( #47360 ) by @tarekziade in [ #47360 ] Fix slow tensor path in _check_special_mm_tokens ( #47580 ) by @guan404ming in [ #47580 ] CI: let's run integration failure cron at 10pm ( #47537 ) by @tarekziade in [ #47537 ] Better and more extensive tests for RoPE ( #46912 ) by @zucchini-nlp in [ #46912 ] Fix mamba2 family decode and simplify all reshape ops ( #47569 ) by @Cyrilvallez in [ #47569 ] [DiffusionGemma] Cast the decoder padding mask to bool ( #47295 ) by @kashif in [ #47295 ] General maintenance ( #47517 ) by @zucchini-nlp in [ #47517 ] fixed the benchmark script with DistributedConfig ( #47568 ) by @tarekziade in [ #47568 ] Fix failing tests for mimo_v2_flash ( #47284 ) by @kaixuanliu in [ #47284 ] Make tokenization_mistral_common importable without mistral_common installed ( #47397 ) by @juliendenize in [ #47397 ] Use --flake-runs=1 in check_bad_commit.py for PR comment CI ( #47522 ) by @ydshieh in [ #47522 ] Deprecate the old response_schema ( #47320 ) by @Rocketknight1 in [ #47320 ] fix: add pickle support to _LazyConfigMapping for spawn multiprocessing ( #46026 ) by @kfojcik-intel in [ #46026 ] Delete old deprecations ( #47518 ) by @zucchini-nlp in [ #47518 ] Run only @slow tests in PR comment CI ( #47521 ) by @ydshieh in [ #47521 ] Fix incorrect type hint ( #47519 ) by @hmellor in [ #47519 ] Deprecate CB config in gen configuration ( #47291 ) by @remi-or in [ #47291 ] [Offloading] [Bugfix] Fix fully offloaded model saving ( #47336 ) by @kylesayrs in [ #47336 ] CI: fix torchaudio pinning +proper break in rnnt ( #47422 ) by @tarekziade in [ #47422 ] Fix Qwen2.5-Omni Token2Wav DiT rotary embedding layout (interleaved cos/sin) ( #47403 ) by @HenryVarro666 in [ #47403 ] CI: add reproduce mode to serge verify caller ( #47492 ) by @tarekziade in [ #47492 ] [fix][whisper]: fix max_new_tokens handling ( #46795 ) by @eustlb in [ #46795 ] Isolate MLA KV expansion to make it easier to bypass ( #47460 ) by @hmellor in [ #47460 ] Fix loss alignment and Trainer token counting for encoder decoder models ( #46903 ) by @OmkumarSolanki in [ #46903 ] Fix the HunyuanVL's torchvision backend ( #47499 ) by @Mi-Jiazhi in [ #47499 ] [DiffusionGemma] Support gradient checkpointing ( #46572 ) by @kashif in [ #46572 ] Fix failing tests for zaya ( #47268 ) by @kaixuanliu in [ #47268 ] tipsv2_dpt: fix failing tests for XPU ( #47292 ) by @kaixuanliu in [ #47292 ] Fix some failed test cases related with XPU Expectations ( #47173 ) by @kaixuanliu in [ #47173 ] fix: guard DTensor import in sharding_utils.py for PyTorch < 2.5 ( #47481 ) by @ in [ #47481 ] CPU can incur a slow path on non-contiguous magnitudes ( #47351 ) by @vbayanag in [ #47351 ] Route chat management calls to the service root ( #47138 ) ( #47303 ) by @dhruv7477 in [ #47303 ] fix: liger unnecessarily materializes logits in VRAM during eval, causing OOM ( #45273 ) by @excepshenal in [ #45273 ] Fix gradient inflation when combining label smoothing with gradient accumulation ( #47261 ) by @Incheonkirin in [ #47261 ] Fix MoE expert decompression for non-32-divisible bit widths ( #47315 ) by @KKothuri in [ #47315 ] [Qwen3ASR] Add hotword parsing, and fix language parsing and training. ( #47111 ) by @ebezzam in [ #47111 ] Remove deprecated training args and is_fast property ( #46917 ) by @cyyever in [ #46917 ] Consistent output shape from get_image_features ( #46405 ) by @zucchini-nlp in [ #46405 ] fix failed test cases for qwen3_omni_moe model ( #47449 ) by @kaixuanliu in [ #47449 ] Fix double-shifted training loss in GitForCausalLM ( #47395 ) by @ in [ #47395 ] Fix CohereASR training-loss double-shift (same as Moonshine fix #46784 ) ( #46895 ) by @sharmax-vikas in [ #46895 ] Warn when group_by_length is silently ignored for iterable datasets ( #47379 ) by @qgallouedec in [ #47379 ] Update bug report list ( #46607 ) by @molbap in [ #46607 ] fix: remove unreachable return in special token builder ( #47420 ) by @hai1222 in [ #47420 ] Add Harry to slow CI ( #47454 ) by @vasqu in [ #47454 ] BLT: vectorize patch length processing ( #47385 ) by @sj0618 in [ #47385 ] Fix TrackioCallback fails to log evaluation metrics after training ends ( #46935 ) by @lewtun in [ #46935 ] [Kimi] add integration tests ( #47383 ) by @zucchini-nlp in [ #47383 ] Add distributed runtime utils and DistributedMixin ( #47352 ) by @3outeille in [ #47352 ] Fix Cosmos 3 Edge Patch packing order ( #47399 ) by @atharvajoshi10 in [ #47399 ] Fix yarn mscale_all_dim for DeepSeek v2 and Mistral 4 ( #47435 ) by @hmellor in [ #47435 ] Hoist special-token lookups out of per-token loops in six slow tokenizers ( #47425 ) by @ishan-1010 in [ #47425 ] fix typos and variable naming in quicktour.md ( #47418 ) by @yashasvi-srivastava21 in [ #47418 ] Normalize multimodal input keys in AnyToAnyPipeline ( #47074 ) by @Sunt-ing in [ #47074 ] Fix Aria checkpoint key conversion mapping ( #47151 ) by @sywangyi in [ #47151 ] extend tests/models/qwen3_next/test_modeling_qwen3_next.py::Qwen3Next… ( #47184 ) by @sywangyi in [ #47184 ] CI: add serge verify (GPU) caller workflow ( #47381 ) by @tarekziade in [ #47381 ] Fix orthogonal_ init for low-precision dtypes (bf16/fp16) ( #47252 ) by @janbernloehr in [ #47252 ] [docs] Fix decode examples and expected output in fast_tokenizers ( #47369 ) by @samyuktahegde in [ #47369 ] [serge] Fix 20 integration tests for model whisper failing with output_mismatch (list output differs (10), other (6) ( #47150 ) by @sergereview[bot] in [ #47150 ] [Mistral] Move MistralConverter into integrations/mistral/ package ( #46603 ) by @juliendenize in [ #46603 ] Fix GLM video frame padding for temporal patches ( #47141 ) by @labAxiaoming in [ #47141 ] [docs] Inkling ( #47350 ) by @stevhliu in [ #47350 ] Fix Daily CI reporting issues ( #47364 ) by @tarekziade in [ #47364 ] [ peft ] Support key_mapping with PEFT models ( #46766 ) by @tomaarsen in [ #46766 ] Fix model tests for tipsv2 ( #47356 ) by @kaixuanliu in [ #47356 ] Fix TimesFM 2.5 window_size AttributeError ( #47363 ) by @kashif in [ #47363 ] fix: allow num_labels property to return None when id2label is unset ( #47069 ) by @SebTardif in [ #47069 ] [Tests] Fix slow video tensor creation from list of numpy arrays in SmolVLM ( #44731 ) by @Defalt-Meh in [ #44731 ] Update dev version on main ( #47366 ) by @vasqu in [ #47366 ] Fix deepgemm on multiple devices ( #47323 ) by @IlyasMoutawwakil in [ #47323 ] ci: Handle empty GitHub token in CI run lookup ( #47362 ) by @tarekziade in [ #47362 ] Fix inkling feature extractor ( #47349 ) by @ArthurZucker in [ #47349 ] Significant community contributions The following contributors have made significant changes to the library over the last release: @ydshieh Fix cached_files silently returning stale file on read-only filesystem (EROFS) ( #47852 ) Fix PhimoeIntegrationTest ( #46539 ) Serialize post-mlinter-review after post-link to avoid PR description race ( #47832 ) Use content hash for mlinter review deduplication ( #47830 ) Fix mlinter review job: checkout before artifact download ( #47820 ) Post mlinter findings as inline PR review comments ( #47819 ) Add post-mlinter-review job to post-dashboard-link workflow ( #47800 ) [conftest] Also wrap snapshot_download for EROFS fallback ( #47796 ) [conftest] Fix EROFS fallback for kernel downloads (correct interception point) ( #47794 ) [conftest] Fix EROFS fallback for kernel downloads via HfApi ( #47791 ) PR CI with torch 2.13 ( #47767 ) [CI - Debug] Skip /transformers-dependent steps for CPU runner ( #47759 ) [CI] Add CPU runner support to ssh-runner workflow ( #47757 ) Update daily CI Docker image to torch 2.13.0 / CUDA 13.0 ( #47738 ) Fix missing github_utils.py download in PR CI dashboard workflow ( #47668 ) byebye torch 2.4 ( #47609 ) Use --flake-runs=1 in check_bad_commit.py for PR comment CI ( #47522 ) Run only @slow tests in PR comment CI ( #47521 ) @kaixuanliu make examples under doc device agnostic ( #47812 ) cancel deterministic for XPU in gemma4 tests ( #47790 ) open fla support for XPU to benefit from the acceleration ( #47799 ) Fix DBRX MoE hidden size and expert GLU transposes ( #47671 ) Fix failing tests for axk1 and axk2 ( #47727 ) Fix failing tests for granite_swa and granitemoe_swa ( #47723 ) skip invalid test cases for inkling tests ( #47493 ) Fix failing tests for mimo_v2_flash ( #47284 ) Fix failing tests for zaya ( #47268 ) tipsv2_dpt: fix failing tests for XPU ( #47292 ) Fix some failed test cases related with XPU Expectations ( #47173 ) add paged attention tests support for XPU ( #47163 ) Fix multi-device mxfp4 dequantization race in _convert_moe_packed_tensors ( #47423 ) fix failed test cases for qwen3_omni_moe model ( #47449 ) Fix model tests for tipsv2 ( #47356 ) @vasqu Fix ci style ( #47818 ) 🚨 [ Kernels ] Refactor all linear attn models & native kernels fallback ( #47630 ) [ Kernels ] Refactor function handling ( #46883 ) Add AXK2 from SKT ( #47528 ) Add Harry to slow CI ( #47454 ) Update dev version on main ( #47366 ) [ FP8 ] Bump kernels version ( #47344 ) @kmswin1 Hotfix axk2 indexer norm ( #47810 ) Fix A.X-K2 fp8 modules_to_not_convert normalization for the gated-norm MLP ( #47578 ) add_axk1 ( #46867 ) @remi-or [Fix] Fix multi-head latent attention (MLA) ( #47761 ) [Fix] Wrong type hint in get_number_of_image_patches ( #47788 ) [Fix] Swapped height and width in KimiK25 ( #47786 ) Deprecate CB config in gen configuration ( #47291 ) [CB] Automatically switch attention implementation to flash ( #47330 ) @juliendenize [Mistral] Add native tekken tokenizer support to AutoTokenizer ( #47507 ) Make tokenization_mistral_common importable without mistral_common installed ( #47397 ) [Mistral] Move MistralConverter into integrations/mistral/ package ( #46603 ) @IMvision12 Add support for batched Qwen2.5/3-Omni audio generation (#47186) Fix Hunyuan-VL PIL image resize parity with reference preprocessing (#47233) @jiqing-feng 🚨 Enable SDPA (and other attention backends) for T5 and propagate to the T5 family (#47014) Fix shape mismatch in KyutaiSpeechToText generate() last window (#46952) Fix typo in MusicgenForCausalLM.generate() (#46974) Fix BlockMask crash in CTRL flex-attention generation (#46854) @tarekziade CI: Log GitHub API diagnostics to stderr (#47635) CI: Add serge review relay workflow and review rules (#47610) CI: use a single function for GH calls (#47474) CI: use transformers-ci daily workflow with OTEL (#47360) CI: let's run integration failure cron at 10pm (#47537) fixed the benchmark script with DistributedConfig (#47568) CI: fix torchaudio pinning +proper break in rnnt (#47422) CI: add reproduce mode to serge verify caller (#47492) CI: add serge verify (GPU) caller workflow (#47381) ci: harden daily CI reporting against GitHub API rate limits (#47382) Fix Daily CI reporting issues (#47364) ci: Handle empty GitHub token in CI run lookup (#47362) @daviswer Add Granite-swa and Granitemoe-swa model support (#47179) @ShareLer Optimize flash attention max seqlen computation in vision attention (#47170) @atharvajoshi10 Fix Cosmos 3 Edge Patch packing order (#47399) Add Cosmos3 Edge model support (#47181)

I used an AI coding agent to solve one of gaming's "millennium problems": what the Mario 64 plaque really says

/u/decorator — Tue, 20 Oct 2026 00:00:00 +0000

85% · Usable today 85%, Measured result 34%

Each hobby has some problems that can never be solved, and one of these for Nintendo fans is the plaque on the castle fountain in Super Mario 64, which has been the subject of debate since 1996 and has never reached a conclusion. It is essentially the gaming world's equivalent of a Millennium Prize problem. It is well known that the plaque says "L is real 2401", and this is allegedly an indication that Luigi is concealed in the game. However, no one has ever been able to verify what it states since the entire plaque is a 32 by 32 pixel texture and the letters are 3 to 5 pixels high. I worked on this using Claude as a coding agent. It wasn't used for image generation or for upscaling since those methods merely invent letters. Instead, we developed a forward model: we would enter a candidate text in the fonts typical of that era, reduce it exactly as a designer would have done in 1996, and then compare it with the actual pixels from the ROM. The most impressive aspect was the font. We looked at 470 fonts that a Nintendo artist might have had access to between 1993 and 1996, together with 4,583 modern fonts as a control group. The winning font was Palatino Bold Italic, specifically the original 1990 Adobe version. This wasn't by chance. Mario 64 was developed on SGI workstations, and SGI's system software was configured precisely for this Adobe Palatino. The Adobe font disc that it installs comes with the exact same letter metrics, byte for byte. Therefore, we didn't just discover the text; we identified the actual font file that the artist most likely used when typing it. The agent did some heavy lifting: Writing up the pipeline and research assistant rewrote the code so it can run on GPU Searching the web for thousands of old fonts and contemporary fonts set up blind tests against itself to make sure it wasn't fooling itself Result: "Eternal Star / We hope so". The phrase "L is real 2401" matches about twice as poorly on the first line by itself. The part that I prefer most was this: in order to make sure it wasn't simply picking out the word I had wanted, we had 50 secret words hidden in fake versions of the plaque and it managed to decode all of them correctly. All the components are open source, with a public challenge offering to beat the score: https://github.com/supermochi64/sm64-plaque-decode more details: https://github.com/supermochi64/sm64-plaque-decode/tree/main/press A year ago such a project would have taken a team several months; I carried it out in a couple of weeks with the help of an agent. submitted by /u/decorator to r/singularity [link] [comments]

Uncensored prompt upsampler for Moss image

/u/Devajyoti1231 — Tue, 20 Oct 2026 00:00:00 +0000

85% · Usable today 85%

The comfyui default workflow for Moss image has option to enable prompt upsampler which uses the qwen3.5 9b text encoder. This is the uncensored version of it converted to int8convrot. Link- https://huggingface.co/mdevoz/qwen3.5_9b_ultra_uncensored_heretic_int8_convrot Original uncensored version- https://huggingface.co/llmfan46/Qwen3.5-9B-ultra-uncensored-heretic submitted by /u/Devajyoti1231 to r/StableDiffusion [link] [comments]

Almost $500 in revenue this month!

/u/swiftstoriestt — Tue, 20 Oct 2026 00:00:00 +0000

85% · Measured result 85%, Usable today 56%, First-party 46%

I'm 16, I built my SaaS between classes. Last 4 weeks: $460 gross revenue, 20+ paying customers, ~950 users, $0 ad spend. The tool: Siteless. Finds local businesses with no website, scores them 1-100, and now builds them a ready-to-host site with AI. What worked: a $1 3-day trial (filtered out everyone who'd never pay), answering questions in communities without pitching, and talking to users instead of following a roadmap. What flopped: Google disabled the account I'd built everything on (bot flag), killing my Product Hunt maker access and every social login in one afternoon. Also tried launching on every platform at once: TikTok signups kept failing, my YouTube channel got taken down on day one. Picked two channels after that and ignored the rest. Next goal: $500/mo recurring. Happy to answer anything. submitted by /u/swiftstoriestt to r/SaaS [link] [comments]

llama.cpp b11741

github-actions[bot] — Tue, 20 Oct 2026 00:00:00 +0000

85% · Usable today 85%, First-party 81%

opencl: add cooperative-k dp4a gemm for q4_0, q4_k and q6_k ( #30741 ) opencl: add cooperative-k dp4a GEMM for q4_0 opencl: add cooperative-k dp4a GEMM for q4_k opencl: add cooperative-k dp4a GEMM for q6_k opencl: fix alignment Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/57533158 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11750

github-actions[bot] — Tue, 20 Oct 2026 00:00:00 +0000

84% · Usable today 84%, First-party 82%

sycl: fix compiler warnings - missing prototypes, dead code, extra semicolons ( #30271 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/57666056 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

ComfyUI v0.42.1 released

/u/Fcking_Chuck — Tue, 20 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 41%

This is a patch released shortly after v0.42.0, and it is meant to correct the crashes users have been experiencing when running the MOSS image template workflow. In the v0.42.0 release, the Krea 3 Image node (Partner Nodes) was added, along with added MOSS-image support and other fixes/improvements. A full changelog can be viewed here . submitted by /u/Fcking_Chuck to r/StableDiffusion [link] [comments]

Dream Labs, which offers an API for its Dream-1 robot foundation model trained on human videos, raised a $90M seed led by B Capital and Kindred Ventures (John Koetsier/Forbes)

Tue, 20 Oct 2026 00:00:00 +0000

83% · Measured result 83%, Usable today 67%

John Koetsier / Forbes : Dream Labs, which offers an API for its Dream-1 robot foundation model trained on human videos, raised a $90M seed led by B Capital and Kindred Ventures — This voice experience is generated by AI. Learn more. … Want to make your dumb robot smart? $3 an hour is all it costs.

llama.cpp b11739

github-actions[bot] — Tue, 20 Oct 2026 00:00:00 +0000

83% · Usable today 83%, First-party 82%

jinja : implement unique filter ( #30819 ) jinja : implement unique filter cont : inline key_of cont : fix alignment Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/57486845 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11742

github-actions[bot] — Tue, 20 Oct 2026 00:00:00 +0000

82% · First-party 82%, Usable today 82%

hybrid dna tokenizer fixes ( #30825 ) vocab : support Carbon-14B HybridDNA tokenizer Carbon-14B auto-tags untagged DNA runs and uses N-padded tail tokens (tail=pad_n). Also strip whitespace inside tags and handle a stray like the HF tokenizer. convert : fix special tokens and merges for older Carbon models Carbon-500M/3B/8B don't register the Qwen added tokens and ship no tokenizer.json, so take the token types, merges and special ids from the base tokenizer. Update conversion/base.py Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com Update src/llama-vocab.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com Update src/llama-vocab.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com Update src/llama-vocab.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com Update conversion/base.py Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com Update conversion/base.py Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com Update conversion/base.py Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com address review comments Update src/llama-vocab.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/57556991 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

llama.cpp b11740

github-actions[bot] — Tue, 20 Oct 2026 00:00:00 +0000

82% · Usable today 82%, First-party 80%

opencl: add get_rows for i32, cpy for i32 and f32 ( #30756 ) opencl: support i32 GET_ROWS opencl: support i32 and f32 copy conversions Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/57528236 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Release v5.16.1

vasqu — Tue, 20 Oct 2026 00:00:00 +0000

82% · Usable today 82%, First-party 74%, Measured result 52%

Release v5.16.1 This is a special release as we include GLM! (and a few small fixes) GLM-5.3-Flash GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters, it outperforms GLM-5.2 across benchmarks and real-world workloads at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks. GLM-5.3-Flash starts from a newly trained base model, with its architecture and training recipe redesigned around capability and efficiency. For the first time in the GLM series, we introduce a hybrid architecture combining sparse and linear attention, sharply reducing long-context serving costs while preserving precise long-context capabilities. The model also adopts Manifold-Constrained Hyper-Connections (mHC) to further improve scaling efficiency. Together with our latest 30T-token multimodal pre-training corpus, these changes enable GLM-5.3-Flash to deliver more intelligence with less compute. Links: Documentation [Glm 5.3 Flash] GLM 5.3 Flash Support ( #48342 ) by @Dovis01 in #48342 Small patch fixes Mainly BC behavior for TP and pinning a hf kernel for security reasons 🤗 Restore BC for the tensor-parallel API ( #48300 ) by @ArthurZucker Fix kernel commit and repo paths for ESMFold2 ( #48186 ) by @Rocketknight1 Full Changelog : v5.16.0...v5.16.1

incoai/Qwen3.8-Flash-Next-DFlash2

/u/rerri — Tue, 20 Oct 2026 00:00:00 +0000

81% · Measured result 81%, Usable today 63%, First-party 45%

By the original authors of DFlash 2 It's about 20% faster than MTP in their table when concurrency 1. submitted by /u/rerri to r/LocalLLaMA [link] [comments]

ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF updated

/u/Murky-Routine-4255 — Tue, 20 Oct 2026 00:00:00 +0000

81% · Usable today 81%

Look out for the updated version! What changed This update changes which experts are retained . No retained weights were modified relative to the base IQ3_S model. About 25% of the retained expert selection differs from the previous release. The model remains English-only . With a limited expert budget, we prioritized preserving English capabilities so unfortunately, multilingual capabilities were not preserved. submitted by /u/Murky-Routine-4255 to r/LocalLLaMA [link] [comments]

Introducing Trillium Labs

Nathan Lambert — Tue, 20 Oct 2026 00:00:00 +0000

81% · First-party 81%

llama.cpp b11748

github-actions[bot] — Tue, 20 Oct 2026 00:00:00 +0000

81% · First-party 81%, Usable today 79%

sycl : fix get_rows on reordered quantized weights ( #30430 ) Co-authored-by: Sam sam@garagellm.tail7dd858.ts.net Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/57598742 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows arm64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI

Mercury 3 [Inception Labs] - Matching Luna/Haiku at 1000 tokens/sec

/u/Ok_Knowledge_8259 — Tue, 20 Oct 2026 00:00:00 +0000

80% · Measured result 80%, Usable today 42%

Diffusion models finally taking off? I actually tested some general output against gpt 6 luna and either luna is really bad or this thing is very close or sometimes beating it. My testing is not extensive enough to confirm but maybe would need to try this thing in an agentic framework if it even works properly on that. submitted by /u/Ok_Knowledge_8259 to r/singularity [link] [comments]

Let's Encrypt is adding two additional remote perspectives for domain validation

gslin — Tue, 20 Oct 2026 00:00:00 +0000

80% · First-party 80%

Article URL: https://community.letsencrypt.org/t/lets-encrypt-is-adding-two-additional-remote-perspectives-for-domain-validation/252166 Comments URL: https://news.ycombinator.com/item?id=50150809 Points: 258 # Comments: 80

vllm v0.32.1rc0

aoshen02 — Tue, 20 Oct 2026 00:00:00 +0000

80% · First-party 80%, Usable today 55%

[Doc][RL] Document the weight-transfer HTTP protocol for trainers wit…

PaliGemma 2 Mix - New Instruction Vision Language Models by Google

Tue, 20 Oct 2026 00:00:00 +0000

80% · First-party 80%, Usable today 53%