byline-ava-brooks

ai-agents-2-2

Benchmarks are Not Enough: RAMP for Runtime Assessing of Agentic Models in Production Systems

LLM agents are rapidly evolving from coding assistants into autonomous software engineering systems. However, existing evaluation methodologies remain largely centered on static, isolated, and short-horizon benchmarks th...

• 

Ava Brooks

26 May 2026 · 1 min read

ai-agents-2-2

Code2Math: Can Your Code Agent Effectively Evolve Math Problems Through Exploration?

As large language models (LLMs) advance their mathematical capabilities toward the IMO and research level, the scarcity of challenging, high-quality problems has become a significant bottleneck for training, evaluation a...

• 

Ava Brooks

3 Mar 2026 · 1 min read

ai-agents-2-2

A Comprehensive Empirical Evaluation of Agent Frameworks on Code-centric Software Engineering Tasks

Unlike traditional automation tools or static LLM-based systems, agents combine decision-making and tool utilization to accomplish complex tasks, showing great potential in software engineering. However, existing studies...

• 

Ava Brooks

2 Nov 2025 · 1 min read

ai-agents-2-2

SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents

Coding agents powered by large language models have shown impressive capabilities in software engineering tasks, but evaluating their performance across diverse programming languages and real-world scenarios remains chal...

• 

Ava Brooks

11 Apr 2025 · 1 min read

ai-agents-2-2

ReAct: Synergizing Reasoning and Acting in Language Models

Core thought-action-observation loop design used in many modern agents.

• 

Ava Brooks

7 Oct 2022 · 1 min read