torch-optimizer -- collection of optimizers for Pytorch
torch-optimizer torch-optimizer -- 与 optim 模块兼容的 PyTorch 优化器集合。
简单示例 import torch_optimizer as optim # model=... optimizer=optim.DiffGrad(model.parameters(), lr=0.001) optimizer.step() 安装 安装过程很简单,只需:$ pip install torch_optimizer 文档 https:// pytorch-optimizer.rtfd.io 支持的优化器 AccSGD https://arxiv.org/abs/1803.05591 AdaBound https://arxiv.org/abs/1902.09843 AdaMod https://arxiv.org/abs/1910.12249 DiffGrad https:// arxiv.org/abs/1909.11015