Posts by Year


Exponential-Min and Gumbel-Max

  3 minute read

Exponential-min and Gumbel-max tricks for sampling from a multinomial distribution by taking the argmin and argmax.

Back to Top ↑


Recent Progress in Language Modeling

  3 minute read

A brief overview of various techniques in recent language model (LM) literatures including AWD LM, the use of cache, dynamic evaluation, other memory-based n...

Preparations for DS/AI/ML/Quant

  5 minute read

A short list of resources and topics covering the essential quantitative tools for data scientists, AI/machine learning practitioners, quant developers/resea...

Recent Progress in NVI

  less than 1 minute read

A literature survey of recent papers on Neural Variational Inference (NVI) and its application in topic modeling.

Back to Top ↑


Brief Survey of Generative Models

  5 minute read

A high-level summary of various generative models including Variational Autoencoders (VAE), Generative Adverserial Networks (GAN), and their notable extentio...

EM Algorithm

  9 minute read

A quick walk-through of Expectation-Maximization (EM) algorithm.

Back to Top ↑