Multi-task, Multilingual, Multi-modal Language Generation
Publications
Grazina Korvel, Alkiviadis Katsalis, Konstantinos Diamantaras, Elena Lloret. Enrich Knowledge Graphs and Test Pre-trained Language Models in Graph2seq Tasks. The 13th Conference “Data Analysis Methods for Software Systems” December 1 – 3, 2022, in Druskininkai, Lithuania
Anabela Barreiro, José de Souza, Albert Gatt, Mehul Bhatt, Elena Lloret, Aykut Erdem, Dimitra Gkatzia, Helena Moniz, Irene Russo, Fabio Kepler, Iacer Calixto, Marcin Paprzycki, François Portet, Isabelle Augenstein and Mirela Alhasani. Multi3Generation: Multitask, Multilingual, Multimodal Language Generation. In Macken, Rufener, Van den Bogaert, Daems, Tezcan, Vanroy, Fonteyne, Barrault, Costa-jussà, Kemp, Pilos, Declercq, Koponen, Forcada, Scarton, Moniz (eds.) Proceedings of the 23rd Annual Conference of the European Association for Machine Translation, p. 345–346 Ghent, Belgium, June 2022.
L. Parcalabescu, A. Gatt, A. Frank and I. Calixto (2021). Seeing past words: Testing the cross-modal capabilities of pretrained V&L models on counting tasks. In: Beyond Language: Multimodal Semantic Representations Workshop (MMSR) 2021.
H. Alberts, T. Huang, Y. Deshpande, Y. Liu, K. Cho, C. Vania, I. Calixto (2021). VisualSem: A high-quality knowledge graph for vision and language. In: Multilingual Representation Learning Workshop (MRL) 2021.
J. Suchan, M. Bhatt, S. Vardarajan (2021). Commonsense Visual Sensemaking for Autonomous Driving: On Generalised Neurosymbolic Online Abduction Integrating Vision and Semantics. In: Artificial Intelligence Journal (AIJ), October 2021, Volume 299.
M. Cafagna, K. van Deemter and A. Gatt (2021). What Vision-Language models ‘see’ when they see scenes. arXiv preprint arXiv:2109.07301
M. Sercan Amac , Semih Yagcioglu, Aykut Erdem, and Erkut Erdem. Procedural Reasoning Networks for Understanding Multimodal Procedures, In 23rd Conference on Computational Natural Language Learning (CoNLL) Link to paper
J. Phang, I. Calixto, PM. Htut, Y. Pruksachatkun, H. Liu, C. Vania, K. Kann, SR. Bowman (2020). English intermediate-task training improves zero-shot cross-lingual transfer too. In AACL 2020. Link to paper
V. Milewski , MF. Moens and I. Calixto (2020). Are scene graphs good enough to improve image captioning? In: AACL 2020. Link to paper
Ales Zamuda, Elena Lloret . Optimizing Data Driven Models for Summarization as Parallel Tasks, Journal of Computational Science, Vol. 42, April 2020. Link to paper
Ozan Caglayan, Menekse Kuyu, Mustafa Sercan Amac, Pranava Madhyastha, Erkut Erdem, Aykut Erdem and Lucia Specia. Cross-lingual Visual Pre-training for Multimodal Machine Translation, Conference of the European Chapter of the Association for Computational Linguistics (EACL 2021), Short Papers, 2021. Link to paper
Begum Citamak, Ozan Caglayan, Menekse Kuyu, Erkut Erdem, Aykut Erdem, Pranava Madhyastha, Lucia Specia. MSVD-Turkish: A Comprehensive Multimodal Video Dataset for Integrated Vision and Language Research in Turkish, Machine Translation, Vol. 35, 265-288. Link to paper
Emre Boran, Aykut Erdem, Nazli Ikizler-Cinbis, Erkut Erdem, Pranava Madhyastha, Lucia Specia. Leveraging auxiliary image descriptions for dense video captioning, Pattern Recognition Letters, Vol. 146, June 2021. Link to paper
Rob van der Goot, Ahmet Üstün, Alan Ramponi, Ibrahim Sharaf and Barbara Plank. Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP. In EACL 2021. Received EACL 2021 oustanding paper award (demo track) Link to paper
Iacer Calixto, Alessandro Raganato, Tommaso Pasini, Wikipedia Entities as Rendezvous across Languages: Grounding Multilingual Language Models by Predicting Wikipedia Hyperlinks, Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Link to paper
Liesbeth Allein, Isabelle Augenstein, Marie-Francine Moens, Time-aware evidence ranking for fact-checking, Journal of Web Semantics. Link to paper
D. Gosko, A. Znotins, I. Skadina, N. Gruzitis, G. Nespore-Berzkalne, Domain Expert Platform for Goal-Oriented Dialog Collection Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL): System Demonstrations, 2021
R. P. Ramos, P. Pereira, H. Moniz, J. P. Carvalho and B. Martins, “Retrieval Augmentation for Deep Neural Networks”, 2021 International Joint Conference on Neural Networks (IJCNN), 2021, pp. 1-8, doi: 10.1109/IJCNN52387.2021.9533978. Link to paper
Mustafa Sercan Amac, Semih Yagcioglu, Aykut Erdem, Erkut Erdem: Procedural Reasoning Networks for Understanding Multimodal Procedures. CoNLL 2019: 441-451. Link t paper, DOI: 10.18653/v1/K19-1041
Anabela Barreiro, Cristina Mota, Jorge Baptista, Lucília Chacoto, Paula Carvalho. Linguistic Resources for Paraphrase Generation in Portuguese – A Lexicon-Grammar Approach. Language Resources and Evaluation. 56, pages1–35 (2022) Link to paper
D. Gosko, A. Znotins, I. Skadina, N. Gruzitis, G. Nespore-Berzkalne. Domain Expert Platform for Goal-Oriented Dialog Collection. Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL): System Demonstrations, 2021
Mille, S., Ferreira, T.C., Belz, A. and Davis, B., 2021, August. Another PASS: A Reproduction Study of the Human Evaluation of a Football Report Generation System. In Proceedings of the 14th International Conference on Natural Language Generation (pp. 286-292). Link to paper
Ferreira, T.C., Vaz, H., Davis, B. and Pagano, A., 2021, August. Enriching the E2E dataset. In Proceedings of the 14th International Conference on Natural Language Generation (pp. 177-183). Link to paper
Davis, B., Graham, Y., Kelleher, J. and Sripada, Y., 2020, December. Proceedings of the 13th International Conference on Natural Language Generation. In Proceedings of the 13th International Conference on Natural Language Generation. Link to paper
