Terry Yue Zhuo

ice-score

[EACL 2024] ICE-Score: Instructing Large Language Models to Evaluate Code

llm-benchmark

A list of LLM benchmark frameworks.

DataAug4Code

Source Code Data Augmentation for Deep Learning: A Survey.

PyArmadillo

PyArmadillo: an alternative approach to linear algebra in Python

X-Repo2Run

X-Repo2Run: Configuraing Multilingual Docker Environment via Code Agent

harbor

Harbor is a framework for running agent evaluations and creating and using RL environments.

CTF-Dojo

Training Language Model Agents to Find Vulnerabilities with CTF-Dojo

harbor-datasets

llm_api_misuse

terminal-bench

A benchmark for LLMs on complicated tasks in the terminal

terminal-bench-datasets

test-runner

test-runner