Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

About Me

Posts

Future Blog Post

less than 1 minute read

Published:

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

Blog Post number 4

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 2

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 1

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

projects

publications

talks

Metric Perspective of Stochastic Optimizers

Published:

In this talk, I explain several major stochastic optimizers from the perspective of the metric, that is the definition of the parameter space of the model. This talk covers algorithms such as

  • Quasi-Newton Method Type
    • Finite-Difference Method: SGD-QN, AdaDelta, VSGD
    • Extended Gauss-Newton: KSD, SMD, HF
    • LBFGS: Stochastic LBFGS, RES
  • Natural Gradient Type: Natural Gradient, TONGA
  • Root Mean Square Type: AdaGrad, RMSProp, Adam

Relational Knowledge and Language Models

Published:

In this talk, I explain a few recent studies in the area of commonsense & relational knowledge probing of pretrained language models. Following papers are covered in this talk:

  • Petroni, et al. “Language models as knowledge bases?” 2019
  • Jiang, et al. “How can we know what language models know?” 2019
  • Bouraoui, et al. “Inducing relational knowledge from BERT.” 2019

teaching