Hello! I am a Ph.D student in the School of Computer Science and Informatics at Cardiff University, co-advised by Jose-camacho Collados and Steven Schockaert. I study relational knowledge representation in language model and application of language models in tasks such as named-entity recognition (eg. T-NER, TweetNER7) and question generation (eg. AutoQG). I also study NLP on social media, and I am a part of TweetNLP, where I am developing the core library.

NEWS: I will be joining Google Research as a research intern from June 2023.

Representative Papers (see full publication):

• Asahi Ushio, Jose Camacho-Collados, and Steven Schockaert
  Distilling Relation Embeddings from Pre-trained Language Models
  Proceedings of EMNLP 2021 Main Conference [pdf] [code] [slide] [acl anthology] [arxiv] [demo]
• Asahi Ushio, Luis Espinosa-Anke, Steven Schockaert, and Jose Camacho-Collados
  BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?
  Proceedings of ACL-IJCNLP 2021 Main Conference [pdf] [code] [slide] [acl anthology] [arxiv]

Open Source Projects:

• T-NER: A python library to facilitate named-entity-recognition fine-tuning, evaluation, and inference via API.
• AutoQG: Web application to run multi-lingual question generation models.
• TweetNLP: A python library of comprehensive NLP solutions tailored for Twitter.
• KEX: A python library of modern graph-based keyphrase extraction.

In 2021, I did research internships at Amazon supervised by Danushka Bollegala, and Snapchat co-supervised by Francesco Barbieri, Vítor Silva Sousa, and Leonardo Neves. Before joining Cardiff University, I had been a full-time research engineer at Cogent Labs from 2018 to 2020. Aside from NLP, I spend some time on the research of computational art (WikiART Face).