[Deep learning] Recent development of Generative Adversarial Networks (GANs)

Introduction of cGANs, pix2pix, and Cycle GANs

In this post, I would like to discuss the recent development in GANs.

Conditional GANs (cGANs)

The original GANs trains the generator and discriminator with no supplementary information. Therefore, Conditional GANs(cGANs)[5] adds some condition constraints to GANs such that the model is more capable of handling different contextual information.

The structure of cGANs from the original paper from the original paper

From the above figure in the original paper[5], both the generator and discriminator in cGANs include the additional condition y. For example, the paper shows that cGANs trained from MNIST images (database of handwritten digits) with its digit labels. The updated objective function is as follow:

Image by the author

After the foundation of cGAN, there was a popular paper, ”Image style transfer using convolutional neural networks”[3], which introduced the application of style transfer by GANs. Later, there were several GANs methods for domain transfer, such as ix2pix GANs, Cycle GANs, Perceptual Adversarial Networks and Star GANs etc. In…