Professional Documents
Culture Documents
Pytorch
Pytorch
This is a curated list of tutorials, projects, libraries, videos, papers, books and anything related to the
incredible PyTorch. Feel free to make a pull request to contribute to this list.
Table Of Contents
1. Tabular Data
2. Tutorials
3. Visualization
4. Explainability
5. Object Detection
6. Long-Tailed / Out-of-Distribution Recognition
7. Energy-Based Learning
8. Missing Data
9. Architecture Search
10. Optimization
11. Quantization
12. Quantum Machine Learning
13. Neural Network Compression
14. Facial, Action and Pose Recognition
15. Super resolution
16. Synthetesizing Views
17. Voice
18. Medical
19. 3D Segmentation, Classification and Regression
20. Video Recognition
21. Recurrent Neural Networks (RNNs)
22. Convolutional Neural Networks (CNNs)
23. Segmentation
24. Geometric Deep Learning: Graph & Irregular Structures
25. Sorting
26. Ordinary Differential Equations Networks
27. Multi-task Learning
28. GANs, VAEs, and AEs
29. Unsupervised Learning
30. Adversarial Attacks
31. Style Transfer
32. Image Captioning
33. Transformers
34. Similarity Networks and Functions
35. Reasoning
36. General NLP
37. Question and Answering
38. Speech Generation and Recognition
39. Document and Text Classification
40. Text Generation
41. Translation
42. Sentiment Analysis
43. Deep Reinforcement Learning
44. Deep Bayesian Learning and Probabilistic Programmming
45. Spiking Neural Networks
46. Anomaly Detection
47. Regression Types
48. Time Series
49. Synthetic Datasets
50. Neural Network General Improvements
51. DNN Applications in Chemistry and Physics
52. New Thinking on General Neural Network Architecture
53. Linear Algebra
54. API Abstraction
55. Low Level Utilities
56. PyTorch Utilities
57. PyTorch Video Tutorials
58. Datasets
59. Community
60. Links to This Repository
61. To be Classified
62. Contributions
1. Tabular Data
PyTorch-TabNet: Attentive Interpretable Tabular Learning
carefree-learn: A minimal Automatic Machine Learning (AutoML) solution for tabular datasets
based on PyTorch
2. Tutorials
Official PyTorch Tutorials
Official PyTorch Examples
Practical Deep Learning with PyTorch
Dive Into Deep Learning with PyTorch
Deep Learning Models
Minicourse in Deep Learning with PyTorch
C++ Implementation of PyTorch Tutorial
Simple Examples to Introduce PyTorch
Mini Tutorials in PyTorch
Deep Learning for NLP
Deep Learning Tutorial for Researchers
Fully Convolutional Networks implemented with PyTorch
Simple PyTorch Tutorials Zero to ALL
DeepNLP-models-Pytorch
MILA PyTorch Welcome Tutorials
Effective PyTorch, Optimizing Runtime with TorchScript and Numerical Stability Optimization
Practical PyTorch
PyTorch Project Template
3. Visualization
Loss Visualization
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
SmoothGrad: removing noise by adding noise
DeepDream: dream-like hallucinogenic visuals
FlashTorch: Visualization toolkit for neural networks in PyTorch
Lucent: Lucid adapted for PyTorch
DreamCreator: Training GoogleNet models for DeepDream with custom datasets made simple
CNN Feature Map Visualisation
4. Explainability
Efficient Covariance Estimation from Temporal Data
Hierarchical interpretations for neural network predictions
Shap, a unified approach to explain the output of any machine learning model
VIsualizing PyTorch saved .pth deep learning models with netron
Distilling a Neural Network Into a Soft Decision Tree
5. Object Detection
MMDetection Object Detection Toolbox
Mask R-CNN Benchmark: Faster R-CNN and Mask R-CNN in PyTorch 1.0
YOLOv3
YOLOv2: Real-Time Object Detection
SSD: Single Shot MultiBox Detector
Detectron models for Object Detection
Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural
Networks
Whale Detector
Catalyst.Detection
Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for
Worst-Case Generalization
Invariant Risk Minimization
Training Confidence-Calibrated Classifier for Detecting Out-of-Distribution Samples
Deep Anomaly Detection with Outlier Exposure
Large-Scale Long-Tailed Recognition in an Open World
Principled Detection of Out-of-Distribution Examples in Neural Networks
Learning Confidence for Out-of-Distribution Detection in Neural Networks
PyTorch Imbalanced Class Sampler
7. Energy-Based Learning
EBGAN, Energy-Based GANs
Maximum Entropy Generators for Energy-based Models
8. Missing Data
9. Architecture Search
DenseNAS
DARTS: Differentiable Architecture Search
Efficient Neural Architecture Search (ENAS)
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
10. Optimization
AccSGD, AdaBound, AdaMod, DiffGrad, Lamb, NovoGrad, RAdam, SGDW, Yogi and more
Lookahead Optimizer: k steps forward, 1 step back
RAdam, On the Variance of the Adaptive Learning Rate and Beyond
Over9000, Comparison of RAdam, Lookahead, Novograd, and combinations
AdaBound, Train As Fast as Adam As Good as SGD
Riemannian Adaptive Optimization Methods
L-BFGS
OptNet: Differentiable Optimization as a Layer in Neural Networks
Learning to learn by gradient descent by gradient descent
11. Quantization
17. Voice
18. Medical
Medical Zoo, 3D multi-modal medical image segmentation library in PyTorch
U-Net for FLAIR Abnormality Segmentation in Brain MRI
Genomic Classification via ULMFiT
Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening
Delira, lightweight framework for medical imaging prototyping
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Medical Torch, medical imaging framework for PyTorch
TorchXRayVision - A library for chest X-ray datasets and models. Including pre-trainined models.
Dancing to Music
Devil Is in the Edges: Learning Semantic Boundaries from Noisy Annotations
Deep Video Analytics
PredRNN: Recurrent Neural Networks for Predictive Learning using Spatiotemporal LSTMs
23. Segmentation
Detectron2 by FAIR
Pixel-wise Segmentation on VOC2012 Dataset using PyTorch
Pywick - High-level batteries-included neural network training library for Pytorch
Improving Semantic Segmentation via Video Propagation and Label Relaxation
Super-BPD: Super Boundary-to-Pixel Direction for Fast Image Segmentation
Catalyst.Segmentation
Segmentation models with pretrained backbones
25. Sorting
33. Transformers
35. Reasoning
41. Translation
Open-source (MIT) Neural Machine Translation (NMT) System
58. Datasets
Worldbank Data
59. Community
Github Repository
Website
61. To be Classified
62. Contributions
You can raise an issue or submit a pull request, whichever is more convenient for you. The guideline is
simple: just follow the format of the previous bullet point.