open source code

Code, datasets, and benchmarks released alongside our research.

DeepSynth

ICLR 2026
AI agentsbenchmarkinformation synthesis

A benchmark of 120 real-world tasks testing whether AI agents can gather, combine, and reason over information from multiple sources.

Formal Mathematical Reasoning

autoformalisationtheorem provingLean 4

Bridging natural language mathematics and machine-verifiable proofs through autoformalisation.

DRIFT

ICLR 2026

Decompose, Retrieve, Illustrate, then Formalize Theorems, retrieving premises for sub-components of informal statements.

TopoAlign

EMNLP 2026

Aligning code to math via topological decomposition, unlocking code repositories as training data for Math LLMs.

Conjecturing

arXiv 2025

ConjectureBench and Lean-FIRe, treating conjecturing as a distinct step of formal mathematical reasoning.

LeanFlow

A Python interface for Lean 4.

DReSD

ACL Findings 2025
speculative decodingdense retrievalefficiency

Dense Retrieval for Speculative Decoding, using approximate nearest neighbour search over contextualised token embeddings.

SparsePO

EMNLP Findings 2025
preference optimisationalignment

Controlling preference alignment of LLMs via sparse token-level masks over KL divergence and reward.

Text-to-Code MRPT

EACL 2024
code generationpre-training

Text-to-code generation with modality-relative pre-training.

HumanRankEval

NAACL 2024
evaluationconversational assistants

Automatic evaluation of LMs as conversational assistants.