Program
- 2022-09-29 Introduction
- Neural Networks review. Deep Learning. Types of neurons. Feed-forward networks. Backpropagation. DL frameworks. Theano. AutoDiff. TensorFlow. Torch. JAX.
- 2022-10-03 Popular Network Architectures
- Multi-task learning. Siamese Networks. Generative Adversarial Networks (GAN). Style Transfer. Disentangled Representation Learning.
- 2022-10-06 Structure Learning Networks
- Hopfield Networks. RBMs. SOMs. Autoencoders. VAE.
- 2022-10-11 Convolution Networks
- CNNs. DL image processing. YOLO. Retina-Net. SpineNet.
- 2022-10-13 Recurrent Networks
- RNNs. Training by unrolling. Internal memory, access and update LSTMs. GRUs. Encoder/Decoder. Attention in Encoder/Decoder systems.
- 2022-10-18 Transformer Networks
- Attention is all you need. Transformers. BERT. GPT. T5. Pretraining. Transfer learning. Zero-shot and few shot learning.
- 2022-10-20 Graph Processing Networks
- Graph processing architectures. Local vs. global. GNNs. DGCNNs. GCN. MPNN.
- 2022-10-25 Multimedia Processing Networks
- Multimedia processing architectures. VQA. NMNs. Hierarchical co-attention. Dall-e. ImageGen.
- 2022-10-27 Neural Architecture Search
- NAS. NEAT. GDAS.
Official appointment: https://drive.google.com/file/d/12_vNbdNIgWDwbpUYLBGUVMo1o6wxkLPC/view
Promotional material: https://twitter.com/pabloduboue/status/1568014064022097924
Seminar Papers
- AR
- (1) O-Net: A Novel Framework With Deep Fusion of CNN and Transformer for Simultaneous Segmentation and Classification. Front. Neurosci., 02 June 2022. Sec. Brain Imaging Methods.
https://doi.org/10.3389/fnins.2022.876065
- GHB
- (2) Deep embedded self-organizing maps for joint representation learning and topology-preserving clustering. December 2021. Neural Computing and Applications 33(24):1-31.
https://DOI.org/10.1007/s00521-021-06331-w
- MDA
- (3) YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors CoRR, 6 Jul 2022.
https://doi.org/10.48550/arXiv.2207.02696
- JL
- (4) End-to-End Object Detection with Transformers ECCV 2020.
https://doi.org/10.1007/978-3-030-58452-8_13
- MJdLDR
- (5) Discovering Symbolic Models from Deep Learning with Inductive Biases NeurIPS 2020. https://dl.acm.org/doi/abs/10.5555/3495724.3497186
- CDF
- (6) Detection of tailings dams using high-resolution satellite imagery and a single shot multibox detector in the Jing–Jin–Ji region, China Remote Sensing 12.16 (2020): 2626
https://doi.org/10.3390/rs12162626
- AMF
- (7) Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search CoRR, 7 Mar 2020.
https://doi.org/10.48550/arXiv.2003.11613
- PGC
- (8) TinyKG: Memory-Efficient Training Framework for Knowledge Graph Neural Recommender Systems RecSys '22.
https://doi.org/10.1145/3523227.3546760
- GF
- (9) Fatigue damage detection of aerospace-grade aluminum alloys using feature-based and feature-less deep neural networks Machine Learning with Applications. Volume 7, 15 March 2022.
https://doi.org/10.1016/j.mlwa.2021.100247
- SMC
- (10) Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding CoRR, 23 May 2022.
https://doi.org/10.48550/arXiv.2205.11487
- JIP
- (11) Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting Proc. AAAI. July 2019.
https://doi.org/10.1609/aaai.v33i01.3301922
- MMG
- (12) EfficientDet: Scalable and Efficient Object Detection Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 10781-10790.
https://doi.org/10.48550/arXiv.1911.09070
- MG
- (13) Neural SDEs as Infinite-Dimensional GANs Proc. MLR. 2021.