deng/test_dvc
deng
/
test_dvc
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
use DVC(Data Version Control) to manage a DL model training experiment
3 Commits 1 Branch 0 Tags 220 KiB
Python 100%
Go to file
deng 6bb52d95a6 update README 2023-12-30 00:09:01 +08:00
.dvc init 2023-12-28 22:06:25 +08:00
dvclive use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
env use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
utils use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
.dvcignore init 2023-12-28 22:06:25 +08:00
.gitignore use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
README.md update README 2023-12-30 00:09:01 +08:00
dvc.lock use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
dvc.yaml use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
evaluate.py use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
params.yaml use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
prepare.py use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
train.py use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00

README.md

Abstract

Attempt to use DVC, a data versioning tool, to track image classification model training with PyTorch, including data, trained model file, and used parameters. The data will be recorded and pushed to my private DVC remote via webdav🎁

Requirements

  • MacOS 13.3

Dirs

  • env
    • pt.yaml
      • conda env yaml to run this repo
  • utils
    • house pre-built functions
  • dvclive
    • training and evaluation reports generated by dvclive

Files

  • prepare.py
    • prepare materials for model training
  • train.py
    • try to train a small neural network
  • evaluate.py
    • evaluate trained model with some metrics
  • params.yaml
    • house all parameters used in experiment
tags: DVC