publications

*: equal contribution

2024

  1. A Foundation Model for Metagenomic Sequences
    Ollie Liu, Sami Jaghouar, Johannes Hagemann, and 2 more authors
    In Foundation Models for Science Workshop at NeurIPS 2024, 2024
  2. IsoBench: Benchmarking Multimodal Foundation Models on Isomorphic Representations
    Deqing Fu*, Ghazal Khalighinejad*, Ollie Liu*, and 4 more authors
    In The First Conference on Language Modeling, 2024
  3. DeLLMa: Decision Making Under Uncertainty with Large Language Models
    Ollie Liu*, Deqing Fu*, Dani Yogatama, and 1 more author
    arXiv preprint arXiv:2402.02392, 2024

2023

  1. NAACL
    On Retrieval Augmentation and the Limitations of Language Model Training
    Ting-Rui Chiang, Xinyan Velocity Yu, Joshua Robinson, and 3 more authors
    In 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics, 2023
  2. Interpretable Diffusion via Information Decomposition
    Xianghao Kong*, Ollie Liu*, Han Li, and 2 more authors
    In The Twelfth International Conference on Learning Representations, 2023
  3. How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model
    Michael Hanna, Ollie Liu, and Alexandre Variengien
    In Thirty-seventh Conference on Neural Information Processing Systems, 2023
  4. Approximating CKY with Transformers
    Ghazal Khalighinejad, Ollie Liu, and Sam Wiseman
    In Findings of the Association for Computational Linguistics: EMNLP 2023, Dec 2023