Percy Liang

13

Papers

551

Total Citations

Papers (13)

Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Large Language Models as Analogical Reasoners

On the Learnability of Watermarks for Language Models

BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments

Benchmarking and Improving Generator-Validator Consistency of Language Models

Model Equality Testing: Which Model is this API Serving?

Establishing Best Practices in Building Rigorous Agentic Benchmarks

Reliable and Efficient Amortized Model-based Evaluation

Position: In-House Evaluation Is Not Enough. Towards Robust Third-Party Evaluation and Flaw Disclosure for General-Purpose AI

MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation

Position: A Safe Harbor for AI Evaluation and Red Teaming

Position: On the Societal Impact of Open Foundation Models

Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Models