Generative AI

KV Cache Compression Race: TurboQuant vs OSCAR vs EpiCache

KV Cache Compression Race: TurboQuant vs OSCAR vs EpiCache

Large-scale linguistic models (LLMs) face a memory problem unrelated to model weights. During decoding, transformers store key and value (KV)…
OpenAI Releases LifeSciBench, a 750-Task Benchmark Grading AI Models in Real Life Science Research with an Expertly Authored Rubric

OpenAI Releases LifeSciBench, a 750-Task Benchmark Grading AI Models in Real Life Science Research with an Expertly Authored Rubric

Most biological benchmarks ask small, fact-based questions with clean answers. Scientists weigh incomplete evidence and make decisions. OpenAI released LifeSciBench…
NVIDIA SkillSpector Guide: Scans AI Skills for Security Risks with static analysis and SARIF reports

NVIDIA SkillSpector Guide: Scans AI Skills for Security Risks with static analysis and SARIF reports

print("Batch scanning the whole corpus (static-only)...n") summary_rows = [] all_findings = [] for skill in SKILLS: res = scan(skill, use_llm=False,…
Vercel Releases Eve: An Open Framework for AI Agents Where Each Agent Is a List of Force-Mapped Files

Vercel Releases Eve: An Open Framework for AI Agents Where Each Agent Is a List of Force-Mapped Files

Vercel is released the nightan open source framework for building, running, and scaling agents. The project is published as an…
MiniMax Sparse Attention (MSA): Two-Branch Block-Sparse Attention Trained on 109B-Parameter MoE with a 3T-Token Budget

MiniMax Sparse Attention (MSA): Two-Branch Block-Sparse Attention Trained on 109B-Parameter MoE with a 3T-Token Budget

MiniMax released MSA (MiniMax Sparse Attention), a sparse attention method built specifically on Grouped Query Attention (GQA). Target one bottleneck:…
Meet Qwen-RobotSuite: Three Embodied AI Models for VLA Manipulation, Video World Modeling, and Navigation

Meet Qwen-RobotSuite: Three Embodied AI Models for VLA Manipulation, Video World Modeling, and Navigation

The Qwen team has released three embodied AI models, grouped as Qwen-Robot-Suite. The three are Qwen-RobotManip, Qwen-RobotWorld, and Qwen-RobotNav. Each…
Building an End-to-End Sentiment Analysis Pipeline with Scikit-LLM

Building an End-to-End Sentiment Analysis Pipeline with Scikit-LLM

In this article, you will learn how to build an end-to-end sentiment analysis pipeline using Scikit-LLM and open-source large language…
Hermes Agent Adds Asynchronous Subagents, So the Delegated Task No Longer Blocks the Parent Dialog

Hermes Agent Adds Asynchronous Subagents, So the Delegated Task No Longer Blocks the Parent Dialog

Nous Research posted a change to Hermes Agent. Its agent tool can now use subagents equally. According to the announcement,…
Back to top button