I am a Ph.D student in the School of Computer Science and Informatics at Cardiff University, co-advised by Jose-camacho Collados and Steven Schockaert. I study natural language processing (NLP), focusing on language model probing and application of language model in tasks such as named-entity recognition (NER) and question generation (QG). In 2021, I did research internships at Amazon supervised by Danushka Bollegala, and Snapchat co-supervised by Francesco Barbieri, Vítor Silva Sousa, and Leonardo Neves. Before joining Cardiff University, I had been a full-time research engineer at Cogent Labs from 2018 to 2020.
Representative Papers (see full publication):
- Asahi Ushio, Jose Camacho-Collados, and Steven Schockaert
Distilling Relation Embeddings from Pre-trained Language Models
Proceedings of EMNLP 2021 Main Conference [pdf] [code] [slide]
- Asahi Ushio, Luis Espinosa-Anke, Steven Schockaert, and Jose Camacho-Collados
BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?
Proceedings of ACL-IJCNLP 2021 Main Conference [pdf] [code] [slide]
As part of my research activity, I create web services hosting the models analyzed/proposed in my study (T-NER, AutoQG). Those apps are all developed by my own (infrastructure, backend, frontend, etc). Finally, aside from NLP, I spend some time on the research of computational art (WikiART Face). Also, I love prototyping my ideas as open-source software. Please have a look my project page or github to check my fun works!