Toward a Better Understanding of Relational Knowledge in Language Models

In this talk, I explained our recent papers related to relational knowledge representation. The pitch was in Japanese and recoded video is made available in this link.

• Distilling Relation Embeddings from Pretrained Language Models
• BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?