Skip to content

stevenygd/WAGE.pytorch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Training and Inference with Integers in Deep Neural Networks

PyTorch implementation for the ICLR 2018 oral paper, training on CIFAR10. This is replicate from the Tensorflow repo by the paper's authors. We hope the PyTorch implementation could also help with low-precision training research.

Prerequisites

  • NVIDIA GPU + CUDA + CuDNN
  • PyTorch
  • TensorboardX
  • Tabulate
  • tqdm

Please follow the official instruction to install PyTorch and NVIDIA related prerequisites. Other things should be handled by

pip install -r requirements.txt

Train

Start training using the following scripts:

./wage.sh

Results

Averaging four seeds gives: 93.04% accuracy at 300 epochs.

Citation

If you find this paper or this repository helpful, please cite the original paper:

@inproceedings{
wu2018training,
title={Training and Inference with Integers in Deep Neural Networks},
author={Shuang Wu and Guoqi Li and Feng Chen and Luping Shi},
booktitle={International Conference on Learning Representations},
year={2018},
url={https://openreview.net/forum?id=HJGXzmspb},
} 

About

Reproduction of WAGE in PyTorch.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published