Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models

Levy M.*, Jacoby A.*, & Goldberg Y.

Published in Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, 2024

Analysis of the impact of input length on the reasoning performance of large language models, using new, simple tasks unseen during the training of the models.

* Equal contribution

• Outstanding Paper Award at ACL 2024
• Oral Presentation at ACL 2024
• Flash Talk at Israel Data Science and AI Initiative 3rd Annual Conference