Page Not Found
Page not found. Your pixels are in another canvas.
Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
About Me
About me
Page not in menu
This is a page not in th emain menu
Posts
Future Blog Post
Published:
This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.
Blog Post number 4
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 3
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 2
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 1
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
projects
publications
talks
Metric Perspective of Stochastic Optimizers
Published:
This talk gives a high-level overview for the major classes of stochastic optimizers from the perspective of the model parameter space. The talk covers following algorithms:
- Quasi-Newton Methods: Finite-Difference (SGD-QN, AdaDelta, VSGD), Extended Gauss-Newton (KSD, SMD, HF), LBFGS (LBFGS, RES)
- Natural Gradient Type: Natural Gradient, TONGA
- Root Mean Square Type: AdaGrad, RMSProp, Adam
Relational Knowledge and Language Models
Published:
This is a talk at an internal research group in CardiffNLP, which focuses on a few recent studies in the area of commonsense & relational knowledge probing of pretrained language models. Following papers are covered in this talk:
Toward a Better Understanding of Relational Knowledge in Language Models
Published:
This is an invited talk at NLP Colloquium about relational knowledge representation of language models including the following papers.
Toward a Better Understanding of Relational Knowledge in Language Models
Published:
This is an invited talk at UCL NLP Meetup about relational knowledge representation of language models including the following papers.
TweetNLP: Text Analytic Package for Social Media
Published:
This is an invited talk at PyData Bristol about tweetnlp, a python library for social media analysis.
Representing Relational Knowledge with Language Models
Published:
This is the presentation for my PhD viva (thesis is available here)
A Short Introduction of Modern Speech Foundation Models
Published:
This is an invited talk at 3rd Cardiff NLP Summer Workshop about a short survey of modern speech foundation models.