A Short Introduction of Modern Speech Foundation Models
Research Talk, Cardiff NLP Summer Workshop, Cardiff, UK
This is an invited talk at 3rd Cardiff NLP Summer Workshop about a short survey of modern speech foundation models.
Talks and Presentations
Representing Relational Knowledge with Language Models
Research Talk, PhD Viva, Cardiff, UK
This is the presentation for my PhD viva (thesis is available here)
TweetNLP: Text Analytic Package for Social Media
Research Talk, PyDATA Bristol, Bristol, UK
This is an invited talk at PyData Bristol about tweetnlp, a python library for social media analysis.
Toward a Better Understanding of Relational Knowledge in Language Models
Research Seminar, UCL NLP meetup, London, UK (Remote)
This is an invited talk at UCL NLP Meetup about relational knowledge representation of language models including the following papers.
Toward a Better Understanding of Relational Knowledge in Language Models
Research Seminar, NLP colloquium (Japanese), Tokyo, Japan (Remote)
This is an invited talk at NLP Colloquium about relational knowledge representation of language models including the following papers.
Relational Knowledge and Language Models
Research Seminar, Cardiff NLP Reading Group, Cardiff, UK
This is a talk at an internal research group in CardiffNLP, which focuses on a few recent studies in the area of commonsense & relational knowledge probing of pretrained language models. Following papers are covered in this talk:
Metric Perspective of Stochastic Optimizers
Research Seminar, Keio University Research Seminar, Tokyo, Japan
This talk gives a high-level overview for the major classes of stochastic optimizers from the perspective of the model parameter space. The talk covers following algorithms:
- Quasi-Newton Methods: Finite-Difference (SGD-QN, AdaDelta, VSGD), Extended Gauss-Newton (KSD, SMD, HF), LBFGS (LBFGS, RES)
- Natural Gradient Type: Natural Gradient, TONGA
- Root Mean Square Type: AdaGrad, RMSProp, Adam