Attention is all you profile
The series “Profiling in PyTorch” is meant to make you comfortable reading profiler traces and tables. In Part 1 we profiled basic math operations like addition and multiplication. We saw…
-
-
Introducing Gemini Omni
Last year, Nano Banana brought Gemini’s intelligence to image generation and editing. Since then, it’s helped millions of people restore old photos, design from sketches and visualize ideas in ways…
-
RL without TD learning – The Berkeley Artificial Intelligence Research Blog
In this post, I’ll introduce a reinforcement learning (RL) algorithm based on an “alternative” paradigm: divide and conquer. Unlike traditional methods, this algorithm is not based on temporal difference (TD)…
-
How Open Models Are Driving AI Research
Every year, the International Conference on Machine Learning (ICML) reveals where thousands of AI researchers have decided to put their work. This year’s accepted papers reveal a clear direction: open…
-
A Brief Overview of Gender Bias in AI
AI models reflect, and often exaggerate, existing gender biases from the real world. It is important to quantify such biases present in models in order to properly address and mitigate…
-
Nous Research's NousCoder-14B is an open-source coding model landing right in the Claude Code moment
Nous Research, the open-source artificial intelligence startup backed by crypto venture firm Paradigm, released a new competitive programming model on Monday that it says matches or exceeds several larger proprietary…
-
Meta Superintelligence Labs Releases Muse Spark 1.1: A Multimodal Reasoning Model for Agentic Tasks on Meta Model API
Today, Meta Superintelligence Labs released Muse Spark 1.1. Alongside it, Meta opened a public preview of the Meta Model API. That second part is the structural change. Meta’s models previously…
-
LLM Orchestration Frameworks Compared: LangChain vs. LlamaIndex vs. Raw API Calls
In this article, you will learn how LangChain, LlamaIndex, and raw API calls each solve a different layer of the LLM application stack, and how to choose among them based…
-
Behind the Scenes of Distributed Training and Why Your GPU Wiring Matters as Much as Your Strategy
is straightforward. You load the weights, load the data, and wait for it to finish. For most models, that’s fine, and the only real cost is time. When the wait…
-
Native-speed vLLM transformers modeling backend
TL;DR: The transformers vLLM backend is now as fast (or faster) than custom vLLM implementations for many LLM architectures. Model authors can automatically leverage their transformers implementations to get ultra…
