1. 2022-09-29 Introduction
    • Neural Networks review. Deep Learning. Types of neurons. Feed-forward networks. Backpropagation. DL frameworks. Theano. AutoDiff. TensorFlow. Torch. JAX.
  2. 2022-10-03 Popular Network Architectures
    • Multi-task learning. Siamese Networks. Generative Adversarial Networks (GAN). Style Transfer. Disentangled Representation Learning.
  3. 2022-10-06 Structure Learning Networks
    • Hopfield Networks. RBMs. SOMs. Autoencoders. VAE.
  4. 2022-10-11 Convolution Networks
    • CNNs. DL image processing. YOLO. Retina-Net. SpineNet.
  5. 2022-10-13 Recurrent Networks
    • RNNs. Training by unrolling. Internal memory, access and update LSTMs. GRUs. Encoder/Decoder. Attention in Encoder/Decoder systems.
  6. 2022-10-18 Transformer Networks
    • Attention is all you need. Transformers. BERT. GPT. T5. Pretraining. Transfer learning. Zero-shot and few shot learning.
  7. 2022-10-20 Graph Processing Networks
    • Graph processing architectures. Local vs. global. GNNs. DGCNNs. GCN. MPNN.
  8. 2022-10-25 Multimedia Processing Networks
    • Multimedia processing architectures. VQA. NMNs. Hierarchical co-attention. Dall-e. ImageGen.
  9. 2022-10-27 Neural Architecture Search
    • NAS. NEAT. GDAS.

Official appointment:

Promotional material:

Seminar Papers

(1) O-Net: A Novel Framework With Deep Fusion of CNN and Transformer for Simultaneous Segmentation and Classification. Front. Neurosci., 02 June 2022. Sec. Brain Imaging Methods.

(2) Deep embedded self-organizing maps for joint representation learning and topology-preserving clustering. December 2021. Neural Computing and Applications 33(24):1-31.

(3) YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors CoRR, 6 Jul 2022.

(4) End-to-End Object Detection with Transformers ECCV 2020.

(5) Discovering Symbolic Models from Deep Learning with Inductive Biases NeurIPS 2020.
(6) Detection of tailings dams using high-resolution satellite imagery and a single shot multibox detector in the Jing–Jin–Ji region, China Remote Sensing 12.16 (2020): 2626

(7) Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search CoRR, 7 Mar 2020.

(8) TinyKG: Memory-Efficient Training Framework for Knowledge Graph Neural Recommender Systems RecSys '22.

(9) Fatigue damage detection of aerospace-grade aluminum alloys using feature-based and feature-less deep neural networks Machine Learning with Applications. Volume 7, 15 March 2022.

(10) Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding CoRR, 23 May 2022.

(11) Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting Proc. AAAI. July 2019.

(12) EfficientDet: Scalable and Efficient Object Detection Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 10781-10790.

(13) Neural SDEs as Infinite-Dimensional GANs Proc. MLR. 2021.