deng/test_dvc
deng
/
test_dvc
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
use DVC(Data Version Control) to manage a DL model training experiment
6 Commits 1 Branch 0 Tags 220 KiB
Python 100%
Go to file
deng 391c70753d fix accuracy computation 2024-01-15 21:09:58 +08:00
.dvc add dvc webdav plugin 2023-12-30 07:04:50 +08:00
dvclive fix accuracy computation 2024-01-15 21:09:58 +08:00
env add dvc webdav plugin 2023-12-30 07:04:50 +08:00
utils use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
.dvcignore init 2023-12-28 22:06:25 +08:00
.gitignore use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
README.md update README 2023-12-30 00:09:01 +08:00
dvc.lock fix accuracy computation 2024-01-15 21:09:58 +08:00
dvc.yaml add encoding to yaml loading and apply torch.no_grad to test 2024-01-04 20:42:58 +08:00
evaluate.py fix accuracy computation 2024-01-15 21:09:58 +08:00
params.yaml use resnet50 to train a cifar10 classifier 2023-12-30 00:03:36 +08:00
prepare.py add encoding to yaml loading and apply torch.no_grad to test 2024-01-04 20:42:58 +08:00
train.py fix accuracy computation 2024-01-15 21:09:58 +08:00

README.md

Abstract

Attempt to use DVC, a data versioning tool, to track image classification model training with PyTorch, including data, trained model file, and used parameters. The data will be recorded and pushed to my private DVC remote via webdav🎁

Requirements

  • MacOS 13.3

Dirs

  • env
    • pt.yaml
      • conda env yaml to run this repo
  • utils
    • house pre-built functions
  • dvclive
    • training and evaluation reports generated by dvclive

Files

  • prepare.py
    • prepare materials for model training
  • train.py
    • try to train a small neural network
  • evaluate.py
    • evaluate trained model with some metrics
  • params.yaml
    • house all parameters used in experiment
tags: DVC