Creative Commons license VAADER Reading Group #5 / Joseph Faye / Dense-Gated Blocks, towards layers relationships in densely connected blocks

March 19, 2021
Duration: 00:46:39
Number of views 13
Number of favorites 0

ResNet, Highway networks to DenseNet, adding more inter-layer connections besides the direct connection in adjacent layers, emerged as popular approaches to strengthen feature propagation among different layers.  However, dense connections cause much redundancy especially in the case of DenseNet.  Another aspect is that for many dense connections from previous layers, the role played by the mainstream module is unclear. To address these issues, authors introduce a gating mechanism, inspired by SENeT to model the layer relationships in densely connected blocks.

Tags: deep learning informatique