CNN

Concept

Image Convolution

../_images/image_convolution.png

Weighting Sharing

Receptive Field

VGG

Pooling

  1. downscale
  2. small translation-invariance

Downscale

  1. resize
  2. stride
  3. pooling
    1. max pooling
    2. avg pooling

Stride vs pooling

stride pooling
computation less 4 times more computation+pooling operate
propagation bad better

Upscale / Up-sampling

used for 1. reverse downscale, 2. increase resolution
usually required for pix 2 pix application, e.g. segmentation, super-resolution

Methods

  1. resize
    resampling and interpolation
  2. deconvolution Deconvnet
  3. PixelShuffle