Channel Planting for Deep Neural Networks Using Knowledge Distillation
Kakeru Mitsuno,
Yuichiro Nomura,
Takio Kurita
![Responsive image](/icpr/media/video_thumbnails/11791.jpg)
Auto-TLDR; Incremental Training for Deep Neural Networks with Knowledge Distillation
Similar papers
Filter Pruning Using Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks
![Responsive image](/icpr/media/video_thumbnails/10969.jpg)
Auto-TLDR; Hierarchical Group Sparse Regularization for Sparse Convolutional Neural Networks
Abstract Slides Poster Similar
Compact CNN Structure Learning by Knowledge Distillation
Waqar Ahmed, Andrea Zunino, Pietro Morerio, Vittorio Murino
![Responsive image](/icpr/media/video_thumbnails/11662.jpg)
Auto-TLDR; Knowledge Distillation for Compressing Deep Convolutional Neural Networks
Abstract Slides Poster Similar
E-DNAS: Differentiable Neural Architecture Search for Embedded Systems
Javier García López, Antonio Agudo, Francesc Moreno-Noguer
![Responsive image](/icpr/media/video_thumbnails/11428.jpg)
Auto-TLDR; E-DNAS: Differentiable Architecture Search for Light-Weight Networks for Image Classification
Abstract Slides Poster Similar
HFP: Hardware-Aware Filter Pruning for Deep Convolutional Neural Networks Acceleration
Fang Yu, Chuanqi Han, Pengcheng Wang, Ruoran Huang, Xi Huang, Li Cui
![Responsive image](/icpr/media/video_thumbnails/10861.jpg)
Auto-TLDR; Hardware-Aware Filter Pruning for Convolutional Neural Networks
Abstract Slides Poster Similar
Slimming ResNet by Slimming Shortcut
Donggyu Joo, Doyeon Kim, Junmo Kim
![Responsive image](/icpr/media/video_thumbnails/11805.jpg)
Auto-TLDR; SSPruning: Slimming Shortcut Pruning on ResNet Based Networks
Abstract Slides Poster Similar
Towards Low-Bit Quantization of Deep Neural Networks with Limited Data
Yong Yuan, Chen Chen, Xiyuan Hu, Silong Peng
![Responsive image](/icpr/media/video_thumbnails/11385.jpg)
Auto-TLDR; Low-Precision Quantization of Deep Neural Networks with Limited Data
Abstract Slides Poster Similar
Fine-Tuning DARTS for Image Classification
Muhammad Suhaib Tanveer, Umar Karim Khan, Chong Min Kyung
![Responsive image](/icpr/media/video_thumbnails/11439.jpg)
Auto-TLDR; Fine-Tune Neural Architecture Search using Fixed Operations
Abstract Slides Poster Similar
Operation and Topology Aware Fast Differentiable Architecture Search
Shahid Siddiqui, Christos Kyrkou, Theocharis Theocharides
![Responsive image](/icpr/media/video_thumbnails/12051.jpg)
Auto-TLDR; EDARTS: Efficient Differentiable Architecture Search with Efficient Optimization
Abstract Slides Poster Similar
Learning to Prune in Training via Dynamic Channel Propagation
Shibo Shen, Rongpeng Li, Zhifeng Zhao, Honggang Zhang, Yugeng Zhou
![Responsive image](/icpr/media/video_thumbnails/10949.jpg)
Auto-TLDR; Dynamic Channel Propagation for Neural Network Pruning
Abstract Slides Poster Similar
Automatic Student Network Search for Knowledge Distillation
Zhexi Zhang, Wei Zhu, Junchi Yan, Peng Gao, Guotong Xie
![Responsive image](/icpr/media/video_thumbnails/11142.jpg)
Auto-TLDR; NAS-KD: Knowledge Distillation for BERT
Abstract Slides Poster Similar
Efficient Online Subclass Knowledge Distillation for Image Classification
Maria Tzelepi, Nikolaos Passalis, Anastasios Tefas
![Responsive image](/icpr/media/video_thumbnails/10958.jpg)
Auto-TLDR; OSKD: Online Subclass Knowledge Distillation
Abstract Slides Poster Similar
VPU Specific CNNs through Neural Architecture Search
Ciarán Donegan, Hamza Yous, Saksham Sinha, Jonathan Byrne
![Responsive image](/icpr/media/video_thumbnails/12065.jpg)
Auto-TLDR; Efficient Convolutional Neural Networks for Edge Devices using Neural Architecture Search
Abstract Slides Poster Similar
Feature Fusion for Online Mutual Knowledge Distillation
Jangho Kim, Minsung Hyun, Inseop Chung, Nojun Kwak
![Responsive image](/icpr/media/video_thumbnails/11417.jpg)
Auto-TLDR; Feature Fusion Learning Using Fusion of Sub-Networks
Abstract Slides Poster Similar
Is the Meta-Learning Idea Able to Improve the Generalization of Deep Neural Networks on the Standard Supervised Learning?
![Responsive image](/icpr/media/video_thumbnails/10847.jpg)
Auto-TLDR; Meta-learning Based Training of Deep Neural Networks for Few-Shot Learning
Abstract Slides Poster Similar
On the Information of Feature Maps and Pruning of Deep Neural Networks
Mohammadreza Soltani, Suya Wu, Jie Ding, Robert Ravier, Vahid Tarokh
![Responsive image](/icpr/media/video_thumbnails/11717.jpg)
Auto-TLDR; Compressing Deep Neural Models Using Mutual Information
Abstract Slides Poster Similar
A Discriminant Information Approach to Deep Neural Network Pruning
![Responsive image](/icpr/media/video_thumbnails/12036.jpg)
Auto-TLDR; Channel Pruning Using Discriminant Information and Reinforcement Learning
Abstract Slides Poster Similar
Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization
David Peter, Wolfgang Roth, Franz Pernkopf
![Responsive image](/icpr/media/video_thumbnails/12000.jpg)
Auto-TLDR; Neural Architecture Search for Keyword Spotting in Limited Resource Environments
Abstract Slides Poster Similar
Dynamic Multi-Path Neural Network
Yingcheng Su, Yichao Wu, Ken Chen, Ding Liang, Xiaolin Hu
![Responsive image](/icpr/media/video_thumbnails/11355.jpg)
Auto-TLDR; Dynamic Multi-path Neural Network
Distilling Spikes: Knowledge Distillation in Spiking Neural Networks
Ravi Kumar Kushawaha, Saurabh Kumar, Biplab Banerjee, Rajbabu Velmurugan
![Responsive image](/icpr/media/video_thumbnails/11406.jpg)
Auto-TLDR; Knowledge Distillation in Spiking Neural Networks for Image Classification
Abstract Slides Poster Similar
FastSal: A Computationally Efficient Network for Visual Saliency Prediction
![Responsive image](/icpr/media/video_thumbnails/11972.jpg)
Auto-TLDR; MobileNetV2: A Convolutional Neural Network for Saliency Prediction
Abstract Slides Poster Similar
Softer Pruning, Incremental Regularization
Linhang Cai, Zhulin An, Yongjun Xu
![Responsive image](/icpr/media/video_thumbnails/10857.jpg)
Auto-TLDR; Asymptotic SofteR Filter Pruning for Deep Neural Network Pruning
Abstract Slides Poster Similar
Knowledge Distillation with a Precise Teacher and Prediction with Abstention
![Responsive image](/icpr/media/video_thumbnails/11966.jpg)
Auto-TLDR; Knowledge Distillation using Deep gambler loss and selective classification framework
Abstract Slides Poster Similar
MINT: Deep Network Compression Via Mutual Information-Based Neuron Trimming
Madan Ravi Ganesh, Jason Corso, Salimeh Yasaei Sekeh
![Responsive image](/icpr/media/video_thumbnails/11876.jpg)
Auto-TLDR; Mutual Information-based Neuron Trimming for Deep Compression via Pruning
Abstract Slides Poster Similar
NAS-EOD: An End-To-End Neural Architecture Search Method for Efficient Object Detection
Huigang Zhang, Liuan Wang, Jun Sun, Li Sun, Hiromichi Kobashi, Nobutaka Imamura
![Responsive image](/icpr/media/video_thumbnails/11014.jpg)
Auto-TLDR; NAS-EOD: Neural Architecture Search for Object Detection on Edge Devices
Neural Architecture Search for Image Super-Resolution Using Densely Connected Search Space: DeCoNAS
![Responsive image](/icpr/media/video_thumbnails/11444.jpg)
Auto-TLDR; DeCoNASNet: Automated Neural Architecture Search for Super-Resolution
Abstract Slides Poster Similar
Activation Density Driven Efficient Pruning in Training
Timothy Foldy-Porto, Yeshwanth Venkatesha, Priyadarshini Panda
![Responsive image](/icpr/media/video_thumbnails/11957.jpg)
Auto-TLDR; Real-Time Neural Network Pruning with Compressed Networks
Abstract Slides Poster Similar
OCT Image Segmentation Using NeuralArchitecture Search and SRGAN
Saba Heidari, Omid Dehzangi, Nasser M. Nasarabadi, Ali Rezai
![Responsive image](/icpr/media/video_thumbnails/11645.jpg)
Auto-TLDR; Automatic Segmentation of Retinal Layers in Optical Coherence Tomography using Neural Architecture Search
Learning Sparse Deep Neural Networks Using Efficient Structured Projections on Convex Constraints for Green AI
Michel Barlaud, Frederic Guyard
![Responsive image](/icpr/media/thumbnails/0577_FI.pdf.jpg)
Auto-TLDR; Constrained Deep Neural Network with Constrained Splitting Projection
Abstract Slides Poster Similar
Knowledge Distillation Beyond Model Compression
Fahad Sarfraz, Elahe Arani, Bahram Zonooz
![Responsive image](/icpr/media/video_thumbnails/11609.jpg)
Auto-TLDR; Knowledge Distillation from Teacher to Student
Abstract Slides Poster Similar
Neuron-Based Network Pruning Based on Majority Voting
Ali Alqahtani, Xianghua Xie, Ehab Essa, Mark W. Jones
![Responsive image](/icpr/media/video_thumbnails/11223.jpg)
Auto-TLDR; Large-Scale Neural Network Pruning using Majority Voting
Abstract Slides Poster Similar
Stage-Wise Neural Architecture Search
Artur Jordão, Fernando Akio Yamada, Maiko Lie, William Schwartz
![Responsive image](/icpr/media/video_thumbnails/11086.jpg)
Auto-TLDR; Efficient Neural Architecture Search for Deep Convolutional Networks
Abstract Slides Poster Similar
Exploiting Non-Linear Redundancy for Neural Model Compression
Muhammad Ahmed Shah, Raphael Olivier, Bhiksha Raj
![Responsive image](/icpr/media/video_thumbnails/12085.jpg)
Auto-TLDR; Compressing Deep Neural Networks with Linear Dependency
Abstract Slides Poster Similar
Adaptive Noise Injection for Training Stochastic Student Networks from Deterministic Teachers
Yi Xiang Marcus Tan, Yuval Elovici, Alexander Binder
![Responsive image](/icpr/media/video_thumbnails/11793.jpg)
Auto-TLDR; Adaptive Stochastic Networks for Adversarial Attacks
Exploiting Elasticity in Tensor Ranks for Compressing Neural Networks
Jie Ran, Rui Lin, Hayden Kwok-Hay So, Graziano Chesi, Ngai Wong
![Responsive image](/icpr/media/video_thumbnails/12077.jpg)
Auto-TLDR; Nuclear-Norm Rank Minimization Factorization for Deep Neural Networks
Abstract Slides Poster Similar
Norm Loss: An Efficient yet Effective Regularization Method for Deep Neural Networks
Theodoros Georgiou, Sebastian Schmitt, Thomas Baeck, Wei Chen, Michael Lew
![Responsive image](/icpr/media/video_thumbnails/11942.jpg)
Auto-TLDR; Weight Soft-Regularization with Oblique Manifold for Convolutional Neural Network Training
Abstract Slides Poster Similar
Progressive Gradient Pruning for Classification, Detection and Domain Adaptation
Le Thanh Nguyen-Meidine, Eric Granger, Marco Pedersoli, Madhu Kiran, Louis-Antoine Blais-Morin
![Responsive image](/icpr/media/video_thumbnails/11187.jpg)
Auto-TLDR; Progressive Gradient Pruning for Iterative Filter Pruning of Convolutional Neural Networks
Abstract Slides Poster Similar
Attention Based Pruning for Shift Networks
Ghouthi Hacene, Carlos Lassance, Vincent Gripon, Matthieu Courbariaux, Yoshua Bengio
![Responsive image](/icpr/media/video_thumbnails/11345.jpg)
Auto-TLDR; Shift Attention Layers for Efficient Convolutional Layers
Abstract Slides Poster Similar
CQNN: Convolutional Quadratic Neural Networks
![Responsive image](/icpr/media/video_thumbnails/12071.jpg)
Auto-TLDR; Quadratic Neural Network for Image Classification
Abstract Slides Poster Similar
Teacher-Student Training and Triplet Loss for Facial Expression Recognition under Occlusion
Mariana-Iuliana Georgescu, Radu Ionescu
![Responsive image](/icpr/media/video_thumbnails/11122.jpg)
Auto-TLDR; Knowledge Distillation for Facial Expression Recognition under Occlusion
Rethinking of Deep Models Parameters with Respect to Data Distribution
Shitala Prasad, Dongyun Lin, Yiqun Li, Sheng Dong, Zaw Min Oo
![Responsive image](/icpr/media/video_thumbnails/11912.jpg)
Auto-TLDR; A progressive stepwise training strategy for deep neural networks
Abstract Slides Poster Similar
Compression of YOLOv3 Via Block-Wise and Channel-Wise Pruning for Real-Time and Complicated Autonomous Driving Environment Sensing Applications
Jiaqi Li, Yanan Zhao, Li Gao, Feng Cui
![Responsive image](/icpr/media/video_thumbnails/11479.jpg)
Auto-TLDR; Pruning YOLOv3 with Batch Normalization for Autonomous Driving
Abstract Slides Poster Similar
Multi-Order Feature Statistical Model for Fine-Grained Visual Categorization
Qingtao Wang, Ke Zhang, Shaoli Huang, Lianbo Zhang, Jin Fan
![Responsive image](/icpr/media/video_thumbnails/11766.jpg)
Auto-TLDR; Multi-Order Feature Statistical Method for Fine-Grained Visual Categorization
Abstract Slides Poster Similar
Speeding-Up Pruning for Artificial Neural Networks: Introducing Accelerated Iterative Magnitude Pruning
Marco Zullich, Eric Medvet, Felice Andrea Pellegrino, Alessio Ansuini
![Responsive image](/icpr/media/video_thumbnails/11320.jpg)
Auto-TLDR; Iterative Pruning of Artificial Neural Networks with Overparametrization
Abstract Slides Poster Similar
Contextual Classification Using Self-Supervised Auxiliary Models for Deep Neural Networks
Sebastian Palacio, Philipp Engler, Jörn Hees, Andreas Dengel
![Responsive image](/icpr/media/video_thumbnails/11958.jpg)
Auto-TLDR; Self-Supervised Autogenous Learning for Deep Neural Networks
Abstract Slides Poster Similar
Adversarial Knowledge Distillation for a Compact Generator
Hideki Tsunashima, Shigeo Morishima, Junji Yamato, Qiu Chen, Hirokatsu Kataoka
![Responsive image](/icpr/media/video_thumbnails/12174.jpg)
Auto-TLDR; Adversarial Knowledge Distillation for Generative Adversarial Nets
Abstract Slides Poster Similar
Selecting Useful Knowledge from Previous Tasks for Future Learning in a Single Network
Feifei Shi, Peng Wang, Zhongchao Shi, Yong Rui
![Responsive image](/icpr/media/video_thumbnails/12059.jpg)
Auto-TLDR; Continual Learning with Gradient-based Threshold Threshold
Abstract Slides Poster Similar
Stochastic Label Refinery: Toward Better Target Label Distribution
Xi Fang, Jiancheng Yang, Bingbing Ni
![Responsive image](/icpr/media/video_thumbnails/11980.jpg)
Auto-TLDR; Stochastic Label Refinery for Deep Supervised Learning
Abstract Slides Poster Similar
Beyond Cross-Entropy: Learning Highly Separable Feature Distributions for Robust and Accurate Classification
Arslan Ali, Andrea Migliorati, Tiziano Bianchi, Enrico Magli
![Responsive image](/icpr/media/video_thumbnails/12057.jpg)
Auto-TLDR; Gaussian class-conditional simplex loss for adversarial robust multiclass classifiers
Abstract Slides Poster Similar