publications

*: equal contribution

2025

  1. NAACL
    MatViX: Multimodal Information Extraction from Visually Rich Articles
    Ghazal Khalighinejad, Sharon Scott, Ollie Liu, Kelly L Anderson, and 3 more authors
    2025
    arXiv Website
  2. Preprint
    METAGENE-1: Metagenomic Foundation Model for Pandemic Monitoring
    Ollie Liu, Sami Jaghouar, Johannes Hagemann, Shangshang Wang, and 3 more authors
    arXiv preprint arXiv:2501.02045, 2025
    arXiv Code Website

2024

  1. Preprint
    Euclid: Supercharging Multimodal LLMs with Synthetic High-Fidelity Visual Descriptions
    Jiarui Zhang, Ollie Liu, Tianyu Yu, Jinyi Hu, and 1 more author
    arXiv preprint arXiv:2412.08737, 2024
    Code Website
  2. Preprint
    Game-theoretic LLM: Agent Workflow for Negotiation Games
    Wenyue Hua, Ollie Liu, Lingyao Li, Alfonso Amayuelas, and 8 more authors
    arXiv preprint arXiv:2411.05990, 2024
    arXiv
  3. COLM
    IsoBench: Benchmarking Multimodal Foundation Models on Isomorphic Representations
    Deqing Fu*, Ghazal Khalighinejad*, Ruohao Guo*, Ollie Liu*, and 4 more authors
    In The First Conference on Language Modeling, 2024
    arXiv Website
  4. ICLR
    DeLLMa: Decision Making Under Uncertainty with Large Language Models
    Ollie Liu*, Deqing Fu*, Dani Yogatama, and Willie Neiswanger
    In The Thirteenth International Conference on Learning Representations, 2024
    arXiv Code Slides Website

2023

  1. NAACL
    On Retrieval Augmentation and the Limitations of Language Model Training
    Ting-Rui Chiang, Xinyan Velocity Yu, Joshua Robinson, Ollie Liu, and 2 more authors
    In 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics, 2023
    arXiv
  2. ICLR
    Interpretable Diffusion via Information Decomposition
    Xianghao Kong*, Ollie Liu*, Han Li, Dani Yogatama, and 1 more author
    In The Twelfth International Conference on Learning Representations, 2023
    arXiv Code
  3. NeurIPS
    How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model
    Michael Hanna, Ollie Liu, and Alexandre Variengien
    In Thirty-seventh Conference on Neural Information Processing Systems, 2023
    arXiv Code
  4. EMNLP
    Approximating CKY with Transformers
    Ghazal Khalighinejad, Ollie Liu, and Sam Wiseman
    In Findings of the Association for Computational Linguistics: EMNLP 2023, Dec 2023
    arXiv