publications

*: equal contribution

2024

  1. Preprint
    A Foundation Model for Metagenomic Sequences
    Ollie Liu, Sami Jaghouar, Johannes Hagemann, and 2 more authors
    In Foundation Models for Science Workshop at NeurIPS 2024, 2024
  2. COLM
    IsoBench: Benchmarking Multimodal Foundation Models on Isomorphic Representations
    Deqing Fu*, Ghazal Khalighinejad*, Ollie Liu*, and 4 more authors
    In The First Conference on Language Modeling, 2024
    arXiv Website
  3. Preprint
    DeLLMa: Decision Making Under Uncertainty with Large Language Models
    Ollie Liu*, Deqing Fu*, Dani Yogatama, and 1 more author
    arXiv preprint arXiv:2402.02392, 2024
    arXiv Code Slides Website

2023

  1. NAACL
    On Retrieval Augmentation and the Limitations of Language Model Training
    Ting-Rui Chiang, Xinyan Velocity Yu, Joshua Robinson, and 3 more authors
    In 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics, 2023
    arXiv
  2. ICLR
    Interpretable Diffusion via Information Decomposition
    Xianghao Kong*, Ollie Liu*, Han Li, and 2 more authors
    In The Twelfth International Conference on Learning Representations, 2023
    arXiv Code
  3. NeurIPS
    How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model
    Michael Hanna, Ollie Liu, and Alexandre Variengien
    In Thirty-seventh Conference on Neural Information Processing Systems, 2023
    arXiv Code
  4. EMNLP
    Approximating CKY with Transformers
    Ghazal Khalighinejad, Ollie Liu, and Sam Wiseman
    In Findings of the Association for Computational Linguistics: EMNLP 2023, Dec 2023
    arXiv