Day-zero support is part of the model

OS Twitter / X Recap

MiniMax M3.1 Flash and day-zero serving

• MiniMax opens M3.1 Flash weights MiniMax describes a 428B-parameter MoE with 23B active parameters and publishes agent-benchmark scores. The architecture and scores are publisher claims; the collected post does not establish independent reproduction. @MiniMax_AI ↗
• vLLM ships a native serving path vLLM says day-zero support includes NVFP4 KV cache, NVFP4 MoE weights and DSpark speculative decoding. That is concrete integration scope, not a claim that every deployment configuration has been validated. @vllm_project ↗
• SGLang reports latency and concurrent throughput The project reports more than 1,000 tok/s batch-one decode, roughly 100K total tok/s per GPU on an AgentX trace with 96 sessions, and a 2.15× single-request MegaKernel gain. All figures remain project-reported. @sgl_project ↗
• Production support is feeding upstream Inferact says it serves M3.1 Flash alongside MiniMax capacity, auto-tunes against live traffic and upstreams its day-zero vLLM engineering. The operational and SLA claims come from the partner announcement. @inferact ↗

Evaluation and open stewardship

• Coding Agent Index 2.0 changes the test surface Artificial Analysis replaces DeepSWE with FrontierCode v1.1, revises SWE-Atlas-QnA grading and evaluates 290 tasks across software engineering, terminal use and repository Q&A. Rankings remain benchmark-provider results. @ArtificialAnlys ↗
• OpenEnv moves toward neutral governance A Hugging Face contributor says OpenEnv is being given to the Agentic AI Foundation under the Linux Foundation, making RL environments—not only model interfaces—part of the shared open stack. @ben_burtenshaw ↗
• Ming-3.0-tts puts a 0.5B model near the top of one arena Artificial Analysis says the MIT-licensed model is the only sub-1B entry in the top three of any of its TTS leaderboards and compares it with models 7–70× larger. This is one provider’s controlled arena. @ArtificialAnlys ↗
• AI Toolkit adds Fibo 2.0 support Ostris reports that AI Toolkit now supports Bria Fibo 2.0. The collected post confirms the integration announcement but does not provide compatibility or performance detail. @ostrisai ↗

OS Reddit Recap

r/LocalLLaMA, r/Qwen_AI and r/DeepSeek — deployment economics

• Cached input dominates one agent-cost calculator An r/DeepSeek author models 200 daily steps, 150K-token contexts and 90% cache hits, producing estimates from $12.83/month for DeepSeek V4.1 Flash to $439.92 for Kimi K3. The assumptions are editable, not observed bills. hdhxbdhdh ↗
• One Java-agent user reports a 4× usage gap A separate r/DeepSeek post says MiniMax M3.1 consumed four times the usage of DeepSeek V4.1 Flash in that user’s multi-agent software work. No logs or controlled workload were collected. LinsaFTW ↗
• Worker behavior can outweigh raw tokens per second A one-run Atomic Agent comparison held planner, task, quant and hardware mostly fixed. Flint finished in 7:36 with six fixes, while the author says faster-on-paper Nemotron generated about five times more tokens and needed many more edits. GapNew4766 ↗
• An AMD test reports 2.24× lower end-to-end time On an RX 7900 XT, a Swift-1.5 Qwen3.8-27B MQ4 build with MTP finished six Rust coding tasks in 237 seconds versus 530 for llama.cpp Q4_K_S. This is an author benchmark on one card and workload. Queasy_Asparagus69 ↗

Training, memory and small-model efficiency

• A 4-bit QLoRA stack publishes its memory and timing Training Factory’s author reports Qwen3.8-27B CQ 4-bit at 18 GB, 25.5 GiB peak PyTorch allocation and roughly 15 seconds per steady optimizer step on an A40. Quant quality and training results remain author-reported. textclf ↗
• ThinkingCap trades about one point for fewer reasoning tokens The release reports 38.5% fewer thinking tokens across six benchmarks, with average accuracy 88.8% versus 89.8% for base Qwen3.8-Flash-Next. BF16, FP8, NVFP4 and GGUF weights are listed as public. BottleCapAI ↗
• MemT gets an ExLlamav3 execution path A contributor implemented MemT-1.0-Nano in an ExLlamav3 fork and TabbyAPI, using a /commit command to retain selected facts while clearing conversation context. The base model predates this window; the new evidence is the runtime path. Unstable_Llama ↗
• A partial DFlash conversion shows workload-dependent gains Using stock llama.cpp plus small converter patches, an author reports Ling-3.0-tiny rising from 78.8 to 84.8 tok/s for prose and 79.0 to 127.2 for Python. The test drops UBTree selector tensors and is explicitly small. Barni275 ↗

Edge speech, vision and image workflows

• SteerTTS packages a full speech stack into 11.84 MB The release post says weights, voices, text frontend and Python runtime total 11.84 MB, using a 9.25M-parameter int4 acoustic model and a 6.2M-parameter distilled int4 vocoder. Quality claims remain project-reported. Working_Hat5120 ↗
• A small invoice test favors a 9B local vision model Across 17 scorable Croatian bills on an M4 Pro, one app developer reports qwen3.5:9b and qwen3-vl:8b-instruct each at 15/17, with the 9B path faster. The author discloses a paid app and a single-machine sample. yodin1 ↗
• A ComfyUI node couples noise to diversify batches The open-source node claims more within-batch diversity without extra sampling steps or models and includes workflows for SD1.5, SDXL and FLUX.1-schnell. The mechanism is released; quality was not independently assessed. Current-Ad-198 ↗
• One EdenLive test separates backgrounds from moving objects On an RTX 5090, a user found static backgrounds convincing but moving game objects unstable, using about 23 GiB and 4:46 for two segments. Compilation and CUDA Graphs were disabled, so timing is not an official comparison. Easy-Race6938 ↗

OS Discord Recap

Unsloth

• Unsloth commits to a GGUF path, but it is not released yet An Unsloth team member says the project will make MiniMax M3.1 Flash GGUFs work. Treat this as roadmap evidence, not a downloadable artifact. Mike [UnAI],  Server Tag: UnAI UnAI Team ↗

Nous Research

• Hermes proposals attach provenance to learned skills Two proposed PRs make /learn record skill sources and make hermes skills check flag changed sources; a separate /correct concept remains only proposed. CI approval was still needed in the captured message. sahil_ss9 [NOUS],  Server Tag: NOUS NOUS ↗
• A profile rename fix adds chat recovery A maintainer note says renamed profiles keep local chats and a migrate-identity command can recover chats from an earlier rename. The captured status is a P2 fix note, not a public release announcement. Bear [NOUS],  Server Tag: NOUS NOUS ↗
• Dynamic context work reports a 40% token saving A contributor says a work-in-progress context engine is saving roughly 40% of tokens for smaller contexts and may ship independently first. No benchmark configuration or release artifact was attached. GhostBear [NOUS],  Server Tag: NOUS NOUS ↗
• LCM-X enters the Hermes plugin catalog Its maintainer says the agent-memory plugin is now in the catalog and is seeking contributors. The referenced ranking is not reproduced in the captured message. ElectricSheep-⚡🐑 ↗

EleutherAI

• Researchers challenge a short nGPT efficiency test Participants argue that one epoch over 30M tokens and a target loss of 4.2 cannot establish real-world convergence, noting a method may improve quickly before stalling. This is methodological discussion, not a reproduced counter-benchmark. trombocyt ↗ · woog ↗

Hugging Face

Other primary-source items

Ollama 0.40.9

• Ollama adds streaming speech on Apple Silicon Phonon can generate audio through ollama run or the OpenAI-compatible /v1/audio/speech endpoint. The release also switches from prerelease to GA checkpoint format. github-actions[bot] ↗
• Decision models become a local primitive Ollama brings vLLM Semantic Router’s d3 family in 2B, 4B, 9B and 27B sizes, accepting text, structured state or images to classify, answer yes/no or score options. github-actions[bot] ↗
• Streaming failures stop ending silently The release says OpenAI Responses and Anthropic Messages streams now report generation failures after partial output, and coding tools receive correct cloud-model context and capability metadata. github-actions[bot] ↗

llama.cpp integration fixes

• Qwen DFlash no longer aborts on hyper-connection inputs Build b11822 collapses hc-wide residual streams before exposing requested layer inputs, matching the drafter’s expected two-dimensional shape instead of aborting on the first request. github-actions[bot] ↗
• Intel XMX work targets speculative verification and short batches Build b11821 refactors multi-column quantized matrix paths for 2–8 speculative tokens and 9–80 prompt tokens, adds a fused gate/up kernel, and fixes NaNs when row counts were not multiples of four. github-actions[bot] ↗
• Realtime audio commits get explicit boundaries Build b11828 records flushed-audio end rows and completes each queued commit only after its own rows drain, preventing later appended audio or back-to-back commits from merging. github-actions[bot] ↗
• MiniCPM-OCR 1.0 lands in the multimodal path Build b11826 adds MiniCPM-OCR 1.0 support to llama.cpp’s multimodal subsystem. The feed confirms support but does not include an accuracy or speed evaluation. github-actions[bot] ↗
• SYCL adds graph record and replay Build b11830 announces graph recording and replay for the SYCL backend. The retained release item contains no benchmark, so performance impact is not asserted. malsbat ↗

Research on efficiency and evaluation

• Low-bit n-gram tables target a new memory wall The paper reports four-bit tables preserving more than 99% of validation-loss improvement in smaller experiments and saving 47–55% of table memory on DeepSeek V4.1 Flash and Qwen3.8 Flash-Next, with under 1.2% perplexity increase. Stephen Chung ↗ · Analysis
• An agent turns corpus debugging into executable tests On 26.5M Slovak FineWeb2 documents, three runs found seven candidate issues; native-speaker review supported six. The largest detected content farm covered 1,408,437 documents, or 5.32%. Marek Šuppa ↗ · Analysis
• A simple classifier beats prompted LLMs on one ticket-routing study With wrong routing costed at five times triage, TF-IDF plus logistic regression reduced test cost from 0.763 to 0.472 and wrong routes from 15.3% to 3.5%; the strongest prompted configuration reached 0.477 accuracy. Sachin Gupta ↗ · Analysis
• Thought pruning optimizes the probability that at least one path works The paper directly targets Pass@k when choosing which partial reasoning traces to continue, balancing predicted quality with diversity. Results are author-reported research, not a production release. Mahdi Salmani ↗ · Analysis