In a significant move to enhance safety in AI systems, developers have created a multi-layered safety filter aimed at protecting large language models from various attacks. This innovative approach combines several techniques, including semantic similarity analysis, rule-based pattern detection, intent classification powered by a language model, and anomaly detection. The goal is to build a … Read more

NVIDIA has just launched a new model called Nemotron-Nano-3-30B-A3B-NVFP4. This model is designed to run a 30 billion parameter reasoning model using a special 4-bit format known as NVFP4. What’s impressive is that it maintains accuracy similar to a higher precision baseline called BF16. The new model uses a unique architecture that combines a Mamba2 … Read more

Researchers at the Allen Institute for AI (AI2) have unveiled a new family of coding agents called SERA, which stands for Soft Verified Efficient Repository Agents. This innovative approach aims to enhance coding efficiency by utilizing supervised training and synthetic data, making it possible to tackle larger closed systems. SERA is the first model in … Read more

Robbyant, the AI unit from Ant Group, has made a significant leap in the world of interactive simulations by open-sourcing a new tool called LingBot-World. This large-scale world model allows for the creation of interactive environments that can generate videos while responding to user actions in real time. This innovation is particularly exciting for applications … Read more

Microsoft has unveiled its latest innovation, the Maia 200, an in-house AI accelerator designed to enhance inference capabilities in Azure datacenters. This new chip aims to improve the efficiency and cost-effectiveness of generating tokens for large language models and other reasoning tasks. The Maia 200 combines specialized computing power, a sophisticated memory structure, and a … Read more

Google DeepMind has unveiled a new tool called AlphaGenome, expanding its research capabilities beyond protein folding. This innovative model aims to map DNA sequences to biological functions, marking a significant advancement in genomics. Unlike traditional methods that treat DNA as mere text, AlphaGenome analyzes windows of 1,000,000 base pairs of raw DNA to predict how … Read more

Tencent Hunyuan has made a significant move by open-sourcing HPC-Ops, a library designed for operators in large language model (LLM) inference. This library is aimed at improving how these models run on NVIDIA GPUs. By focusing on low-level CUDA kernels, HPC-Ops enhances core operations like Attention and Grouped GEMM, making it easier for developers to … Read more

A new tutorial has emerged showcasing how to build advanced AI systems using Haystack, a framework designed for creating intelligent agents. This implementation focuses on a practical and cohesive setup that demonstrates how AI can manage decision-making, execute tasks, and maintain control flow in a structured manner. The goal is to illustrate how sophisticated agent … Read more

Clawdbot is making waves as a new open-source personal AI assistant that you can run on your own hardware. This innovative tool connects large language models from companies like Anthropic and OpenAI to various practical applications, including messaging apps, files, and smart home devices. The best part? You maintain control over the orchestration layer, keeping … Read more

GitHub has announced the launch of the GitHub Copilot SDK, a new programmable software development kit that allows developers to integrate the same technology that powers GitHub Copilot CLI into their applications. This SDK is currently in technical preview and offers a way to embed an execution loop that can plan, execute commands, and edit … Read more