Multi-task, Multilingual, Multi-modal Language Generation
Multi3Generation

Publications

The publications listed are based upon work from COST Action CA18231, supported by COST (European Cooperation in Science and Technology).
COST is a funding agency for research and innovation networks.

Open Research Europe collection: Advances in Natural Language Generation

This collection is accepting article submissions related to natural language generation.

  • Parcalabescu, Letitia, Michele Cafagna, Lilitta Muradjan, Anette Frank, Iacer Calixto, and Albert Gatt. VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 8253-8280. 2022. https://aclanthology.org/2022.acl-long.567

  • Yongxin Zhou, François Portet, Fabien Ringeval. Effectiveness of French Language Models on Abstractive Dialogue Summarization Task. LREC 2022, Jun 2022, Marseille, France. hal-03727214

  • Yongxin Zhou, Fabien Ringeval, and François Portet. 2023. A Survey of Evaluation Methods of Generated Medical Textual Reports. In Proceedings of the 5th Clinical Natural Language Processing Workshop, pages 447–459, Toronto, Canada. Association for Computational Linguistics.

  • Ilker Kesen, Andrea Pedrotti, Mustafa Dogan, Michele Cafagna, Emre Can Acikgoz, Letitia Parcalabescu, Iacer Calixto, Anette Frank, Albert Gatt, Aykut Erdem, Erkut Erdem. ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models. The Twelfth International Conference on Learning Representations (ICLR 2024), May 2024. Paper, Arxiv, Website, Codebase, PDF.

  • Adrian Cosma. RoCode: A Dataset for Measuring Code Intelligence from Problem Definitions in Romanian. Result of the STSM at Universitat Politècnica de València. It was accepted at The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), May 2024. Arxiv link, Github, Huggingface Dataset

  • Rigoni, Davide, Desmond Elliott, and Stella Frank. Cleaner Categories Improve Object Detection and Visual-Textual Grounding. In Image Analysis: 23rd Scandinavian Conference, SCIA 2023, Sirkka, Finland, April 18–21, 2023, Proceedings, Part I, pp. 412-442. Cham: Springer Nature Switzerland, 2023. Article, Preprint Link, Conference Link, Code link

  • Grazina Korvel, Alkiviadis Katsalis, Konstantinos Diamantaras, Elena Lloret. Enrich Knowledge Graphs and Test Pre-trained Language Models in Graph2seq Tasks. The 13th Conference “Data Analysis Methods for Software Systems” December 1 – 3, 2022, in Druskininkai, Lithuania

  • Anabela Barreiro, José de Souza, Albert Gatt, Mehul Bhatt, Elena Lloret, Aykut Erdem, Dimitra Gkatzia, Helena Moniz, Irene Russo, Fabio Kepler, Iacer Calixto, Marcin Paprzycki, François Portet, Isabelle Augenstein and Mirela Alhasani. Multi3Generation: Multitask, Multilingual, Multimodal Language Generation. In Macken, Rufener, Van den Bogaert, Daems, Tezcan, Vanroy, Fonteyne, Barrault, Costa-jussà, Kemp, Pilos, Declercq, Koponen, Forcada, Scarton, Moniz (eds.) Proceedings of the 23rd Annual Conference of the European Association for Machine Translation, p. 345–346 Ghent, Belgium, June 2022.

  • L. Parcalabescu, A. Gatt, A. Frank and I. Calixto (2021). Seeing past words: Testing the cross-modal capabilities of pretrained V&L models on counting tasks. In: Beyond Language: Multimodal Semantic Representations Workshop (MMSR) 2021.

  • H. Alberts, T. Huang, Y. Deshpande, Y. Liu, K. Cho, C. Vania, I. Calixto (2021). VisualSem: A high-quality knowledge graph for vision and language. In: Multilingual Representation Learning Workshop (MRL) 2021.

  • J. Suchan, M. Bhatt, S. Vardarajan (2021). Commonsense Visual Sensemaking for Autonomous Driving: On Generalised Neurosymbolic Online Abduction Integrating Vision and Semantics. In: Artificial Intelligence Journal (AIJ), October 2021, Volume 299.

  • M. Cafagna, K. van Deemter and A. Gatt (2021). What Vision-Language models ‘see’ when they see scenes. arXiv preprint arXiv:2109.07301

  • M. Sercan Amac , Semih Yagcioglu, Aykut Erdem, and Erkut Erdem. Procedural Reasoning Networks for Understanding Multimodal Procedures, In 23rd Conference on Computational Natural Language Learning (CoNLL) Link to paper

  • J. Phang, I. Calixto, PM. Htut, Y. Pruksachatkun, H. Liu, C. Vania, K. Kann, SR. Bowman (2020). English intermediate-task training improves zero-shot cross-lingual transfer too. In AACL 2020. Link to paper

  • V. Milewski , MF. Moens and I. Calixto (2020). Are scene graphs good enough to improve image captioning? In: AACL 2020. Link to paper

  • Ales Zamuda, Elena Lloret . Optimizing Data Driven Models for Summarization as Parallel Tasks, Journal of Computational Science, Vol. 42, April 2020. Link to paper

  • Ozan Caglayan, Menekse Kuyu, Mustafa Sercan Amac, Pranava Madhyastha, Erkut Erdem, Aykut Erdem and Lucia Specia. Cross-lingual Visual Pre-training for Multimodal Machine Translation, Conference of the European Chapter of the Association for Computational Linguistics (EACL 2021), Short Papers, 2021. Link to paper

  • Begum Citamak, Ozan Caglayan, Menekse Kuyu, Erkut Erdem, Aykut Erdem, Pranava Madhyastha, Lucia Specia. MSVD-Turkish: A Comprehensive Multimodal Video Dataset for Integrated Vision and Language Research in Turkish, Machine Translation, Vol. 35, 265-288. Link to paper

  • Emre Boran, Aykut Erdem, Nazli Ikizler-Cinbis, Erkut Erdem, Pranava Madhyastha, Lucia Specia. Leveraging auxiliary image descriptions for dense video captioning, Pattern Recognition Letters, Vol. 146, June 2021. Link to paper

  • Rob van der Goot, Ahmet Üstün, Alan Ramponi, Ibrahim Sharaf and Barbara Plank. Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP. In EACL 2021. Received EACL 2021 oustanding paper award (demo track) Link to paper

  • Iacer Calixto, Alessandro Raganato, Tommaso Pasini, Wikipedia Entities as Rendezvous across Languages: Grounding Multilingual Language Models by Predicting Wikipedia Hyperlinks, Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Link to paper

  • Liesbeth Allein, Isabelle Augenstein, Marie-Francine Moens, Time-aware evidence ranking for fact-checking, Journal of Web Semantics. Link to paper

Other outputs / achievements

    • D. Gosko, A. Znotins, I. Skadina, N. Gruzitis, G. Nespore-Berzkalne, Domain Expert Platform for Goal-Oriented Dialog Collection Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL): System Demonstrations, 2021

    • R. P. Ramos, P. Pereira, H. Moniz, J. P. Carvalho and B. Martins, “Retrieval Augmentation for Deep Neural Networks”, 2021 International Joint Conference on Neural Networks (IJCNN), 2021, pp. 1-8, doi: 10.1109/IJCNN52387.2021.9533978.  Link to paper

    • Mustafa Sercan Amac, Semih Yagcioglu, Aykut Erdem, Erkut Erdem: Procedural Reasoning Networks for Understanding Multimodal Procedures. CoNLL 2019: 441-451. Link t paper, DOI: 10.18653/v1/K19-1041

    • Anabela Barreiro, Cristina Mota, Jorge Baptista, Lucília Chacoto, Paula Carvalho. Linguistic Resources for Paraphrase Generation in Portuguese – A Lexicon-Grammar Approach. Language Resources and Evaluation. 56, pages1–35 (2022) Link to paper

    • D. Gosko, A. Znotins, I. Skadina, N. Gruzitis, G. Nespore-Berzkalne. Domain Expert Platform for Goal-Oriented Dialog Collection. Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL): System Demonstrations, 2021

    • Mille, S., Ferreira, T.C., Belz, A. and Davis, B., 2021, August. Another PASS: A Reproduction Study of the Human Evaluation of a Football Report Generation System. In Proceedings of the 14th International Conference on Natural Language Generation (pp. 286-292). Link to paper

    • Ferreira, T.C., Vaz, H., Davis, B. and Pagano, A., 2021, August. Enriching the E2E dataset. In Proceedings of the 14th International Conference on Natural Language Generation (pp. 177-183). Link to paper

    • Davis, B., Graham, Y., Kelleher, J. and Sripada, Y., 2020, December. Proceedings of the 13th International Conference on Natural Language Generation. In Proceedings of the 13th International Conference on Natural Language Generation. Link to paper

Skip to content