Recent Posts

New Techniques in Language Modeling

  3 minute read

A brief overview of various techniques in recent language model (LM) literatures including AWD LM, the use of cache, dynamic evaluation, other memory-based n...

Preparations for DS/AI/ML/Quant

  5 minute read

A short list of resources and topics covering the essential quantitative tools for data scientists, AI/machine learning practitioners, quant developers/resea...

Exponential-Min and Gumbel-Max

  2 minute read

Exponential-min and Gumbel-max tricks for sampling from a multinomial distribution by taking the argmin and argmax.

Brief Survey of Generative Models

  5 minute read

A high-level summary of various generative models including Variational Autoencoders (VAE), Generative Adverserial Networks (GAN), and their notable extentio...

EM Algorithm

  9 minute read

A quick walk-through of Expectation-Maximization (EM) algorithm.