Hello! I am a Ph.D student in the School of Computer Science and Informatics at Cardiff University, co-advised by Jose-camacho Collados and Steven Schockaert. I study relational knowledge representation in language model and application of language models in tasks such as named-entity recognition (eg. T-NER, TweetNER7) and question generation (eg. AutoQG). I also study NLP on social media, and I am a part of TweetNLP, where I am developing the core library.
NEWS: I will be joining Google Research as a research intern from June 2023.
Representative Papers (see full publication):
- Asahi Ushio, Jose Camacho-Collados, and Steven Schockaert
Distilling Relation Embeddings from Pre-trained Language Models
Proceedings of EMNLP 2021 Main Conference [pdf] [code] [slide] [acl anthology] [arxiv] [demo]
- Asahi Ushio, Luis Espinosa-Anke, Steven Schockaert, and Jose Camacho-Collados
BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?
Proceedings of ACL-IJCNLP 2021 Main Conference [pdf] [code] [slide] [acl anthology] [arxiv]
Open Source Projects:
- T-NER: A python library to facilitate named-entity-recognition fine-tuning, evaluation, and inference via API.
- AutoQG: Web application to run multi-lingual question generation models.
- TweetNLP: A python library of comprehensive NLP solutions tailored for Twitter.
- KEX: A python library of modern graph-based keyphrase extraction.
In 2021, I did research internships at Amazon supervised by Danushka Bollegala, and Snapchat co-supervised by Francesco Barbieri, Vítor Silva Sousa, and Leonardo Neves. Before joining Cardiff University, I had been a full-time research engineer at Cogent Labs from 2018 to 2020. Aside from NLP, I spend some time on the research of computational art (WikiART Face).