Exploiting Non-Linear Redundancy for Neural Model Compression
Muhammad Ahmed Shah,
Raphael Olivier,
Bhiksha Raj
Auto-TLDR; Compressing Deep Neural Networks with Linear Dependency
Similar papers
HFP: Hardware-Aware Filter Pruning for Deep Convolutional Neural Networks Acceleration
Fang Yu, Chuanqi Han, Pengcheng Wang, Ruoran Huang, Xi Huang, Li Cui
Auto-TLDR; Hardware-Aware Filter Pruning for Convolutional Neural Networks
Abstract Slides Poster Similar
Neuron-Based Network Pruning Based on Majority Voting
Ali Alqahtani, Xianghua Xie, Ehab Essa, Mark W. Jones
Auto-TLDR; Large-Scale Neural Network Pruning using Majority Voting
Abstract Slides Poster Similar
On the Information of Feature Maps and Pruning of Deep Neural Networks
Mohammadreza Soltani, Suya Wu, Jie Ding, Robert Ravier, Vahid Tarokh
Auto-TLDR; Compressing Deep Neural Models Using Mutual Information
Abstract Slides Poster Similar
Learning Sparse Deep Neural Networks Using Efficient Structured Projections on Convex Constraints for Green AI
Michel Barlaud, Frederic Guyard
Auto-TLDR; Constrained Deep Neural Network with Constrained Splitting Projection
Abstract Slides Poster Similar
Activation Density Driven Efficient Pruning in Training
Timothy Foldy-Porto, Yeshwanth Venkatesha, Priyadarshini Panda
Auto-TLDR; Real-Time Neural Network Pruning with Compressed Networks
Abstract Slides Poster Similar
Learning to Prune in Training via Dynamic Channel Propagation
Shibo Shen, Rongpeng Li, Zhifeng Zhao, Honggang Zhang, Yugeng Zhou
Auto-TLDR; Dynamic Channel Propagation for Neural Network Pruning
Abstract Slides Poster Similar
A Discriminant Information Approach to Deep Neural Network Pruning
Auto-TLDR; Channel Pruning Using Discriminant Information and Reinforcement Learning
Abstract Slides Poster Similar
Progressive Gradient Pruning for Classification, Detection and Domain Adaptation
Le Thanh Nguyen-Meidine, Eric Granger, Marco Pedersoli, Madhu Kiran, Louis-Antoine Blais-Morin
Auto-TLDR; Progressive Gradient Pruning for Iterative Filter Pruning of Convolutional Neural Networks
Abstract Slides Poster Similar
Softer Pruning, Incremental Regularization
Linhang Cai, Zhulin An, Yongjun Xu
Auto-TLDR; Asymptotic SofteR Filter Pruning for Deep Neural Network Pruning
Abstract Slides Poster Similar
MINT: Deep Network Compression Via Mutual Information-Based Neuron Trimming
Madan Ravi Ganesh, Jason Corso, Salimeh Yasaei Sekeh
Auto-TLDR; Mutual Information-based Neuron Trimming for Deep Compression via Pruning
Abstract Slides Poster Similar
Slimming ResNet by Slimming Shortcut
Donggyu Joo, Doyeon Kim, Junmo Kim
Auto-TLDR; SSPruning: Slimming Shortcut Pruning on ResNet Based Networks
Abstract Slides Poster Similar
Exploiting Elasticity in Tensor Ranks for Compressing Neural Networks
Jie Ran, Rui Lin, Hayden Kwok-Hay So, Graziano Chesi, Ngai Wong
Auto-TLDR; Nuclear-Norm Rank Minimization Factorization for Deep Neural Networks
Abstract Slides Poster Similar
Speeding-Up Pruning for Artificial Neural Networks: Introducing Accelerated Iterative Magnitude Pruning
Marco Zullich, Eric Medvet, Felice Andrea Pellegrino, Alessio Ansuini
Auto-TLDR; Iterative Pruning of Artificial Neural Networks with Overparametrization
Abstract Slides Poster Similar
Compact CNN Structure Learning by Knowledge Distillation
Waqar Ahmed, Andrea Zunino, Pietro Morerio, Vittorio Murino
Auto-TLDR; Knowledge Distillation for Compressing Deep Convolutional Neural Networks
Abstract Slides Poster Similar
Filter Pruning Using Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks
Auto-TLDR; Hierarchical Group Sparse Regularization for Sparse Convolutional Neural Networks
Abstract Slides Poster Similar
Efficient Online Subclass Knowledge Distillation for Image Classification
Maria Tzelepi, Nikolaos Passalis, Anastasios Tefas
Auto-TLDR; OSKD: Online Subclass Knowledge Distillation
Abstract Slides Poster Similar
Compression Strategies and Space-Conscious Representations for Deep Neural Networks
Giosuè Marinò, Gregorio Ghidoli, Marco Frasca, Dario Malchiodi
Auto-TLDR; Compression of Large Convolutional Neural Networks by Weight Pruning and Quantization
Abstract Slides Poster Similar
Attention Based Pruning for Shift Networks
Ghouthi Hacene, Carlos Lassance, Vincent Gripon, Matthieu Courbariaux, Yoshua Bengio
Auto-TLDR; Shift Attention Layers for Efficient Convolutional Layers
Abstract Slides Poster Similar
RNN Training along Locally Optimal Trajectories via Frank-Wolfe Algorithm
Yun Yue, Ming Li, Venkatesh Saligrama, Ziming Zhang
Auto-TLDR; Frank-Wolfe Algorithm for Efficient Training of RNNs
Abstract Slides Poster Similar
Channel Planting for Deep Neural Networks Using Knowledge Distillation
Kakeru Mitsuno, Yuichiro Nomura, Takio Kurita
Auto-TLDR; Incremental Training for Deep Neural Networks with Knowledge Distillation
Abstract Slides Poster Similar
Compression of YOLOv3 Via Block-Wise and Channel-Wise Pruning for Real-Time and Complicated Autonomous Driving Environment Sensing Applications
Jiaqi Li, Yanan Zhao, Li Gao, Feng Cui
Auto-TLDR; Pruning YOLOv3 with Batch Normalization for Autonomous Driving
Abstract Slides Poster Similar
Dynamic Multi-Path Neural Network
Yingcheng Su, Yichao Wu, Ken Chen, Ding Liang, Xiaolin Hu
Auto-TLDR; Dynamic Multi-path Neural Network
Revisiting the Training of Very Deep Neural Networks without Skip Connections
Oyebade Kayode Oyedotun, Abd El Rahman Shabayek, Djamila Aouada, Bjorn Ottersten
Auto-TLDR; Optimization of Very Deep PlainNets without shortcut connections with 'vanishing and exploding units' activations'
Abstract Slides Poster Similar
Norm Loss: An Efficient yet Effective Regularization Method for Deep Neural Networks
Theodoros Georgiou, Sebastian Schmitt, Thomas Baeck, Wei Chen, Michael Lew
Auto-TLDR; Weight Soft-Regularization with Oblique Manifold for Convolutional Neural Network Training
Abstract Slides Poster Similar
Towards Low-Bit Quantization of Deep Neural Networks with Limited Data
Yong Yuan, Chen Chen, Xiyuan Hu, Silong Peng
Auto-TLDR; Low-Precision Quantization of Deep Neural Networks with Limited Data
Abstract Slides Poster Similar
Knowledge Distillation Beyond Model Compression
Fahad Sarfraz, Elahe Arani, Bahram Zonooz
Auto-TLDR; Knowledge Distillation from Teacher to Student
Abstract Slides Poster Similar
FastSal: A Computationally Efficient Network for Visual Saliency Prediction
Auto-TLDR; MobileNetV2: A Convolutional Neural Network for Saliency Prediction
Abstract Slides Poster Similar
Hcore-Init: Neural Network Initialization Based on Graph Degeneracy
Stratis Limnios, George Dasoulas, Dimitrios Thilikos, Michalis Vazirgiannis
Auto-TLDR; K-hypercore: Graph Mining for Deep Neural Networks
Abstract Slides Poster Similar
Distilling Spikes: Knowledge Distillation in Spiking Neural Networks
Ravi Kumar Kushawaha, Saurabh Kumar, Biplab Banerjee, Rajbabu Velmurugan
Auto-TLDR; Knowledge Distillation in Spiking Neural Networks for Image Classification
Abstract Slides Poster Similar
CQNN: Convolutional Quadratic Neural Networks
Auto-TLDR; Quadratic Neural Network for Image Classification
Abstract Slides Poster Similar
Generalization Comparison of Deep Neural Networks Via Output Sensitivity
Mahsa Forouzesh, Farnood Salehi, Patrick Thiran
Auto-TLDR; Generalization of Deep Neural Networks using Sensitivity
How Does DCNN Make Decisions?
Yi Lin, Namin Wang, Xiaoqing Ma, Ziwei Li, Gang Bai
Auto-TLDR; Exploring Deep Convolutional Neural Network's Decision-Making Interpretability
Abstract Slides Poster Similar
WeightAlign: Normalizing Activations by Weight Alignment
Xiangwei Shi, Yunqiang Li, Xin Liu, Jan Van Gemert
Auto-TLDR; WeightAlign: Normalization of Activations without Sample Statistics
Abstract Slides Poster Similar
Nearest Neighbor Classification Based on Activation Space of Convolutional Neural Network
Xinbo Ju, Shuo Shao, Huan Long, Weizhe Wang
Auto-TLDR; Convolutional Neural Network with Convex Hull Based Classifier
Regularized Flexible Activation Function Combinations for Deep Neural Networks
Renlong Jie, Junbin Gao, Andrey Vasnev, Minh-Ngoc Tran
Auto-TLDR; Flexible Activation in Deep Neural Networks using ReLU and ELUs
Abstract Slides Poster Similar
Not All Domains Are Equally Complex: Adaptive Multi-Domain Learning
Ali Senhaji, Jenni Karoliina Raitoharju, Moncef Gabbouj, Alexandros Iosifidis
Auto-TLDR; Adaptive Parameterization for Multi-Domain Learning
Abstract Slides Poster Similar
Self-Supervised Learning for Astronomical Image Classification
Ana Martinazzo, Mateus Espadoto, Nina S. T. Hirata
Auto-TLDR; Unlabeled Astronomical Images for Deep Neural Network Pre-training
Abstract Slides Poster Similar
Delving in the Loss Landscape to Embed Robust Watermarks into Neural Networks
Enzo Tartaglione, Marco Grangetto, Davide Cavagnino, Marco Botta
Auto-TLDR; Watermark Aware Training of Neural Networks
Abstract Slides Poster Similar
E-DNAS: Differentiable Neural Architecture Search for Embedded Systems
Javier García López, Antonio Agudo, Francesc Moreno-Noguer
Auto-TLDR; E-DNAS: Differentiable Architecture Search for Light-Weight Networks for Image Classification
Abstract Slides Poster Similar
Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization
David Peter, Wolfgang Roth, Franz Pernkopf
Auto-TLDR; Neural Architecture Search for Keyword Spotting in Limited Resource Environments
Abstract Slides Poster Similar
Adaptive Noise Injection for Training Stochastic Student Networks from Deterministic Teachers
Yi Xiang Marcus Tan, Yuval Elovici, Alexander Binder
Auto-TLDR; Adaptive Stochastic Networks for Adversarial Attacks
P-DIFF: Learning Classifier with Noisy Labels Based on Probability Difference Distributions
Wei Hu, Qihao Zhao, Yangyu Huang, Fan Zhang
Auto-TLDR; P-DIFF: A Simple and Effective Training Paradigm for Deep Neural Network Classifier with Noisy Labels
Abstract Slides Poster Similar
VPU Specific CNNs through Neural Architecture Search
Ciarán Donegan, Hamza Yous, Saksham Sinha, Jonathan Byrne
Auto-TLDR; Efficient Convolutional Neural Networks for Edge Devices using Neural Architecture Search
Abstract Slides Poster Similar
Trainable Spectrally Initializable Matrix Transformations in Convolutional Neural Networks
Michele Alberti, Angela Botros, Schuetz Narayan, Rolf Ingold, Marcus Liwicki, Mathias Seuret
Auto-TLDR; Trainable and Spectrally Initializable Matrix Transformations for Neural Networks
Abstract Slides Poster Similar
Learning Stable Deep Predictive Coding Networks with Weight Norm Supervision
Auto-TLDR; Stability of Predictive Coding Network with Weight Norm Supervision
Abstract Slides Poster Similar
Stage-Wise Neural Architecture Search
Artur Jordão, Fernando Akio Yamada, Maiko Lie, William Schwartz
Auto-TLDR; Efficient Neural Architecture Search for Deep Convolutional Networks
Abstract Slides Poster Similar
Locality-Promoting Representation Learning
Auto-TLDR; Locality-promoting Regularization for Neural Networks
Abstract Slides Poster Similar
ResNet-Like Architecture with Low Hardware Requirements
Elena Limonova, Daniil Alfonso, Dmitry Nikolaev, Vladimir V. Arlazarov
Auto-TLDR; BM-ResNet: Bipolar Morphological ResNet for Image Classification
Abstract Slides Poster Similar