Is the Meta-Learning Idea Able to Improve the Generalization of Deep Neural Networks on the Standard Supervised Learning?
Auto-TLDR; Meta-learning Based Training of Deep Neural Networks for Few-Shot Learning
Similar papers
MetaMix: Improved Meta-Learning with Interpolation-based Consistency Regularization
Yangbin Chen, Yun Ma, Tom Ko, Jianping Wang, Qing Li
Auto-TLDR; MetaMix: A Meta-Agnostic Meta-Learning Algorithm for Few-Shot Classification
Abstract Slides Poster Similar
Generalization Comparison of Deep Neural Networks Via Output Sensitivity
Mahsa Forouzesh, Farnood Salehi, Patrick Thiran
Auto-TLDR; Generalization of Deep Neural Networks using Sensitivity
Norm Loss: An Efficient yet Effective Regularization Method for Deep Neural Networks
Theodoros Georgiou, Sebastian Schmitt, Thomas Baeck, Wei Chen, Michael Lew
Auto-TLDR; Weight Soft-Regularization with Oblique Manifold for Convolutional Neural Network Training
Abstract Slides Poster Similar
Meta Soft Label Generation for Noisy Labels
Auto-TLDR; MSLG: Meta-Learning for Noisy Label Generation
Abstract Slides Poster Similar
Complementing Representation Deficiency in Few-Shot Image Classification: A Meta-Learning Approach
Xian Zhong, Cheng Gu, Wenxin Huang, Lin Li, Shuqin Chen, Chia-Wen Lin
Auto-TLDR; Meta-learning with Complementary Representations Network for Few-Shot Learning
Abstract Slides Poster Similar
Meta Learning Via Learned Loss
Sarah Bechtle, Artem Molchanov, Yevgen Chebotar, Edward Thomas Grefenstette, Ludovic Righetti, Gaurav Sukhatme, Franziska Meier
Auto-TLDR; meta-learning for learning parametric loss functions that generalize across different tasks and model architectures
Channel Planting for Deep Neural Networks Using Knowledge Distillation
Kakeru Mitsuno, Yuichiro Nomura, Takio Kurita
Auto-TLDR; Incremental Training for Deep Neural Networks with Knowledge Distillation
Abstract Slides Poster Similar
MaxDropout: Deep Neural Network Regularization Based on Maximum Output Values
Claudio Filipi Gonçalves Santos, Danilo Colombo, Mateus Roder, Joao Paulo Papa
Auto-TLDR; MaxDropout: A Regularizer for Deep Neural Networks
Abstract Slides Poster Similar
A Close Look at Deep Learning with Small Data
Auto-TLDR; Low-Complex Neural Networks for Small Data Conditions
Abstract Slides Poster Similar
WeightAlign: Normalizing Activations by Weight Alignment
Xiangwei Shi, Yunqiang Li, Xin Liu, Jan Van Gemert
Auto-TLDR; WeightAlign: Normalization of Activations without Sample Statistics
Abstract Slides Poster Similar
Can Data Placement Be Effective for Neural Networks Classification Tasks? Introducing the Orthogonal Loss
Brais Cancela, Veronica Bolon-Canedo, Amparo Alonso-Betanzos
Auto-TLDR; Spatial Placement for Neural Network Training Loss Functions
Abstract Slides Poster Similar
Meta Generalized Network for Few-Shot Classification
Wei Wu, Shanmin Pang, Zhiqiang Tian, Yaochen Li
Auto-TLDR; Meta Generalized Network for Few-Shot Classification
Improving Batch Normalization with Skewness Reduction for Deep Neural Networks
Pak Lun Kevin Ding, Martin Sarah, Baoxin Li
Auto-TLDR; Batch Normalization with Skewness Reduction
Abstract Slides Poster Similar
ARCADe: A Rapid Continual Anomaly Detector
Ahmed Frikha, Denis Krompass, Volker Tresp
Auto-TLDR; ARCADe: A Meta-Learning Approach for Continuous Anomaly Detection
Abstract Slides Poster Similar
Knowledge Distillation Beyond Model Compression
Fahad Sarfraz, Elahe Arani, Bahram Zonooz
Auto-TLDR; Knowledge Distillation from Teacher to Student
Abstract Slides Poster Similar
Task-based Focal Loss for Adversarially Robust Meta-Learning
Yufan Hou, Lixin Zou, Weidong Liu
Auto-TLDR; Task-based Adversarial Focal Loss for Few-shot Meta-Learner
Abstract Slides Poster Similar
Learning to Prune in Training via Dynamic Channel Propagation
Shibo Shen, Rongpeng Li, Zhifeng Zhao, Honggang Zhang, Yugeng Zhou
Auto-TLDR; Dynamic Channel Propagation for Neural Network Pruning
Abstract Slides Poster Similar
Pose-Robust Face Recognition by Deep Meta Capsule Network-Based Equivariant Embedding
Fangyu Wu, Jeremy Simon Smith, Wenjin Lu, Bailing Zhang
Auto-TLDR; Deep Meta Capsule Network-based Equivariant Embedding Model for Pose-Robust Face Recognition
Adaptive Noise Injection for Training Stochastic Student Networks from Deterministic Teachers
Yi Xiang Marcus Tan, Yuval Elovici, Alexander Binder
Auto-TLDR; Adaptive Stochastic Networks for Adversarial Attacks
Revisiting the Training of Very Deep Neural Networks without Skip Connections
Oyebade Kayode Oyedotun, Abd El Rahman Shabayek, Djamila Aouada, Bjorn Ottersten
Auto-TLDR; Optimization of Very Deep PlainNets without shortcut connections with 'vanishing and exploding units' activations'
Abstract Slides Poster Similar
Iterative Label Improvement: Robust Training by Confidence Based Filtering and Dataset Partitioning
Christian Haase-Schütz, Rainer Stal, Heinz Hertlein, Bernhard Sick
Auto-TLDR; Meta Training and Labelling for Unlabelled Data
Abstract Slides Poster Similar
On the Information of Feature Maps and Pruning of Deep Neural Networks
Mohammadreza Soltani, Suya Wu, Jie Ding, Robert Ravier, Vahid Tarokh
Auto-TLDR; Compressing Deep Neural Models Using Mutual Information
Abstract Slides Poster Similar
TAAN: Task-Aware Attention Network for Few-Shot Classification
Auto-TLDR; TAAN: Task-Aware Attention Network for Few-Shot Classification
Abstract Slides Poster Similar
Rethinking Experience Replay: A Bag of Tricks for Continual Learning
Pietro Buzzega, Matteo Boschini, Angelo Porrello, Simone Calderara
Auto-TLDR; Experience Replay for Continual Learning: A Practical Approach
Abstract Slides Poster Similar
Fine-Tuning DARTS for Image Classification
Muhammad Suhaib Tanveer, Umar Karim Khan, Chong Min Kyung
Auto-TLDR; Fine-Tune Neural Architecture Search using Fixed Operations
Abstract Slides Poster Similar
P-DIFF: Learning Classifier with Noisy Labels Based on Probability Difference Distributions
Wei Hu, Qihao Zhao, Yangyu Huang, Fan Zhang
Auto-TLDR; P-DIFF: A Simple and Effective Training Paradigm for Deep Neural Network Classifier with Noisy Labels
Abstract Slides Poster Similar
Softer Pruning, Incremental Regularization
Linhang Cai, Zhulin An, Yongjun Xu
Auto-TLDR; Asymptotic SofteR Filter Pruning for Deep Neural Network Pruning
Abstract Slides Poster Similar
E-DNAS: Differentiable Neural Architecture Search for Embedded Systems
Javier García López, Antonio Agudo, Francesc Moreno-Noguer
Auto-TLDR; E-DNAS: Differentiable Architecture Search for Light-Weight Networks for Image Classification
Abstract Slides Poster Similar
Dynamic Multi-Path Neural Network
Yingcheng Su, Yichao Wu, Ken Chen, Ding Liang, Xiaolin Hu
Auto-TLDR; Dynamic Multi-path Neural Network
Graph-Based Interpolation of Feature Vectors for Accurate Few-Shot Classification
Yuqing Hu, Vincent Gripon, Stéphane Pateux
Auto-TLDR; Transductive Learning for Few-Shot Classification using Graph Neural Networks
Abstract Slides Poster Similar
Filter Pruning Using Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks
Auto-TLDR; Hierarchical Group Sparse Regularization for Sparse Convolutional Neural Networks
Abstract Slides Poster Similar
Rethinking of Deep Models Parameters with Respect to Data Distribution
Shitala Prasad, Dongyun Lin, Yiqun Li, Sheng Dong, Zaw Min Oo
Auto-TLDR; A progressive stepwise training strategy for deep neural networks
Abstract Slides Poster Similar
Efficient Online Subclass Knowledge Distillation for Image Classification
Maria Tzelepi, Nikolaos Passalis, Anastasios Tefas
Auto-TLDR; OSKD: Online Subclass Knowledge Distillation
Abstract Slides Poster Similar
Hcore-Init: Neural Network Initialization Based on Graph Degeneracy
Stratis Limnios, George Dasoulas, Dimitrios Thilikos, Michalis Vazirgiannis
Auto-TLDR; K-hypercore: Graph Mining for Deep Neural Networks
Abstract Slides Poster Similar
Slimming ResNet by Slimming Shortcut
Donggyu Joo, Doyeon Kim, Junmo Kim
Auto-TLDR; SSPruning: Slimming Shortcut Pruning on ResNet Based Networks
Abstract Slides Poster Similar
Improving Model Accuracy for Imbalanced Image Classification Tasks by Adding a Final Batch Normalization Layer: An Empirical Study
Veysel Kocaman, Ofer M. Shir, Thomas Baeck
Auto-TLDR; Exploiting Batch Normalization before the Output Layer in Deep Learning for Minority Class Detection in Imbalanced Data Sets
Abstract Slides Poster Similar
HFP: Hardware-Aware Filter Pruning for Deep Convolutional Neural Networks Acceleration
Fang Yu, Chuanqi Han, Pengcheng Wang, Ruoran Huang, Xi Huang, Li Cui
Auto-TLDR; Hardware-Aware Filter Pruning for Convolutional Neural Networks
Abstract Slides Poster Similar
How Does DCNN Make Decisions?
Yi Lin, Namin Wang, Xiaoqing Ma, Ziwei Li, Gang Bai
Auto-TLDR; Exploring Deep Convolutional Neural Network's Decision-Making Interpretability
Abstract Slides Poster Similar
Knowledge Distillation with a Precise Teacher and Prediction with Abstention
Auto-TLDR; Knowledge Distillation using Deep gambler loss and selective classification framework
Abstract Slides Poster Similar
Beyond Cross-Entropy: Learning Highly Separable Feature Distributions for Robust and Accurate Classification
Arslan Ali, Andrea Migliorati, Tiziano Bianchi, Enrico Magli
Auto-TLDR; Gaussian class-conditional simplex loss for adversarial robust multiclass classifiers
Abstract Slides Poster Similar
Local Clustering with Mean Teacher for Semi-Supervised Learning
Zexi Chen, Benjamin Dutton, Bharathkumar Ramachandra, Tianfu Wu, Ranga Raju Vatsavai
Auto-TLDR; Local Clustering for Semi-supervised Learning
Image Representation Learning by Transformation Regression
Xifeng Guo, Jiyuan Liu, Sihang Zhou, En Zhu, Shihao Dong
Auto-TLDR; Self-supervised Image Representation Learning using Continuous Parameter Prediction
Abstract Slides Poster Similar
Filtered Batch Normalization
András Horváth, Jalal Al-Afandi
Auto-TLDR; Batch Normalization with Out-of-Distribution Activations in Deep Neural Networks
Abstract Slides Poster Similar
Learning Sparse Deep Neural Networks Using Efficient Structured Projections on Convex Constraints for Green AI
Michel Barlaud, Frederic Guyard
Auto-TLDR; Constrained Deep Neural Network with Constrained Splitting Projection
Abstract Slides Poster Similar
Augmented Bi-Path Network for Few-Shot Learning
Baoming Yan, Chen Zhou, Bo Zhao, Kan Guo, Yang Jiang, Xiaobo Li, Zhang Ming, Yizhou Wang
Auto-TLDR; Augmented Bi-path Network for Few-shot Learning
Abstract Slides Poster Similar
Exploiting Elasticity in Tensor Ranks for Compressing Neural Networks
Jie Ran, Rui Lin, Hayden Kwok-Hay So, Graziano Chesi, Ngai Wong
Auto-TLDR; Nuclear-Norm Rank Minimization Factorization for Deep Neural Networks
Abstract Slides Poster Similar
CQNN: Convolutional Quadratic Neural Networks
Auto-TLDR; Quadratic Neural Network for Image Classification
Abstract Slides Poster Similar
Neuron-Based Network Pruning Based on Majority Voting
Ali Alqahtani, Xianghua Xie, Ehab Essa, Mark W. Jones
Auto-TLDR; Large-Scale Neural Network Pruning using Majority Voting
Abstract Slides Poster Similar