Loading...
 

2022 Neural Networks Architecture

Program

  1. 2022-09-29 Introduction
    • Neural Networks review. Deep Learning. Types of neurons. Feed-forward networks. Backpropagation. DL frameworks. Theano. AutoDiff. TensorFlow. Torch. JAX.
  2. 2022-10-03 Popular Network Architectures
    • Multi-task learning. Siamese Networks. Generative Adversarial Networks (GAN). Style Transfer. Disentangled Representation Learning.
  3. 2022-10-06 Structure Learning Networks
    • Hopfield Networks. RBMs. SOMs. Autoencoders. VAE.
  4. 2022-10-11 Convolution Networks
    • CNNs. DL image processing. YOLO. Retina-Net. SpineNet.
  5. 2022-10-13 Recurrent Networks
    • RNNs. Training by unrolling. Internal memory, access and update LSTMs. GRUs. Encoder/Decoder. Attention in Encoder/Decoder systems.
  6. 2022-10-18 Transformer Networks
    • Attention is all you need. Transformers. BERT. GPT. T5. Pretraining. Transfer learning. Zero-shot and few shot learning.
  7. 2022-10-20 Graph Processing Networks
    • Graph processing architectures. Local vs. global. GNNs. DGCNNs. GCN. MPNN.
  8. 2022-10-25 Multimedia Processing Networks
    • Multimedia processing architectures. VQA. NMNs. Hierarchical co-attention. Dall-e. ImageGen.
  9. 2022-10-27 Neural Architecture Search
    • NAS. NEAT. GDAS.


Official appointment: https://drive.google.com/file/d/12_vNbdNIgWDwbpUYLBGUVMo1o6wxkLPC/view

Promotional material: https://twitter.com/pabloduboue/status/1568014064022097924

Seminar Papers

AR
(1) O-Net: A Novel Framework With Deep Fusion of CNN and Transformer for Simultaneous Segmentation and Classification. Front. Neurosci., 02 June 2022. Sec. Brain Imaging Methods.

https://doi.org/10.3389/fnins.2022.876065

GHB
(2) Deep embedded self-organizing maps for joint representation learning and topology-preserving clustering. December 2021. Neural Computing and Applications 33(24):1-31.

https://DOI.org/10.1007/s00521-021-06331-w

MDA
(3) YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors CoRR, 6 Jul 2022.

https://doi.org/10.48550/arXiv.2207.02696

JL
(4) End-to-End Object Detection with Transformers ECCV 2020.

https://doi.org/10.1007/978-3-030-58452-8_13

MJdLDR
(5) Discovering Symbolic Models from Deep Learning with Inductive Biases NeurIPS 2020. https://dl.acm.org/doi/abs/10.5555/3495724.3497186
CDF
(6) Detection of tailings dams using high-resolution satellite imagery and a single shot multibox detector in the Jing–Jin–Ji region, China Remote Sensing 12.16 (2020): 2626

https://doi.org/10.3390/rs12162626

AMF
(7) Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search CoRR, 7 Mar 2020.

https://doi.org/10.48550/arXiv.2003.11613

PGC
(8) TinyKG: Memory-Efficient Training Framework for Knowledge Graph Neural Recommender Systems RecSys '22.

https://doi.org/10.1145/3523227.3546760

GF
(9) Fatigue damage detection of aerospace-grade aluminum alloys using feature-based and feature-less deep neural networks Machine Learning with Applications. Volume 7, 15 March 2022.

https://doi.org/10.1016/j.mlwa.2021.100247

SMC
(10) Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding CoRR, 23 May 2022.

https://doi.org/10.48550/arXiv.2205.11487

JIP
(11) Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting Proc. AAAI. July 2019.

https://doi.org/10.1609/aaai.v33i01.3301922

MMG
(12) EfficientDet: Scalable and Efficient Object Detection Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 10781-10790.

https://doi.org/10.48550/arXiv.1911.09070

MG
(13) Neural SDEs as Infinite-Dimensional GANs Proc. MLR. 2021.

https://doi.org/10.48550/arXiv.2102.03657