Dev roberta and update CPT NEW #364

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

songzetao merged 19 commits into main from dev_roberta_and_update_CPT_NEW

Aug 11, 2022

Contributor

songzetao commented Jul 25, 2022

No description provided.

songzetao added 6 commits

July 25, 2022 13:02


          test new pr

20a8263


          update CPT


          update transformer

c2eef3e


          dev roberta

0829c14


          update README file

c93e210


          updata README file

96bbdda

This was referenced Jul 25, 2022

烂尾 pr 收集 #352

Open

Dev roberta and update CPT NEW 问题记录 #354

Closed

Ldpe2G requested a review from xiezipeng-ML

July 26, 2022 07:35

xiezipeng-ML reviewed

View reviewed changes

Contributor

xiezipeng-ML left a comment

trainning的时候这行报错，需要检查一下

models/NLP/CPT/models/bert.py

Line 266 in 96bbdda

context_layer = context_layer.view(*new_context_layer_shape)

songzetao added 2 commits

July 29, 2022 17:45


          fix bug

e42b0fd


          fix roberta bug

ba606a5

xiezipeng-ML reviewed

View reviewed changes

NLP/CPT/models/CPT.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

This comment was marked as resolved.

Sign in to view

xiezipeng-ML reviewed

View reviewed changes

NLP/Transformer/transformer/utils.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/README.md Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/CPT/models/bert.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/SST2Dataset.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/classifier_MNLI.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/classifier_MNLI.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/config.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/infer_MNLI.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/infer_MNLI.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/infer_MNLI.sh Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/infer_SST2.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/models/roberta.py Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/models/roberta.py Outdated Show resolved Hide resolved


          modify according to the review

7b076a5

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/README.md Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/README.md Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/README.md Outdated Show resolved Hide resolved


          update readme file

563f506

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/README.md Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/README.md Outdated Show resolved Hide resolved

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/roberta/train_MNLI.py Show resolved Hide resolved


          update train_MNLI.py

a1650d1

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/tokenizer/utils/logging.py Outdated Show resolved Hide resolved

Contributor

xiezipeng-ML commented Aug 6, 2022

inference部分报错：
bash infer.sh
需要检查一下

Contributor

xiezipeng-ML commented Aug 6, 2022 •

edited

Loading

models/NLP/CPT/models/CPT.py

Line 8 in a1650d1

from oneflow.nn import CrossEntropyLoss, MSELoss

MSELoss 好像没用到

models/NLP/CPT/models/CPT.py

Line 1 in a1650d1

from logging import log

log也没用到

models/NLP/CPT/models/CPT.py

Line 19 in a1650d1

加个空行

xiezipeng-ML reviewed

View reviewed changes

NLP/roberta/requirements.txt Outdated

    
              filelock==3.7.1

              huggingface_hub==0.8.1

              numpy==1.21.2

              oneflow==0.8.0+cu112

Contributor

xiezipeng-ML Aug 6, 2022

这个版本的装不上，可以改一下

Contributor

xiezipeng-ML commented Aug 6, 2022

roberta下的tokenizer的文件直接是全部从huggingface复制的。。。
这个项目依赖tokenizer的话可以导入transformers来用，这里是直接搬过来再用了

songzetao added 6 commits

August 8, 2022 09:33


          update roberta

c80c82a


          fix CPT

2993f0a


          update readme

b56c681


          update file

649ca32


          Delete empty line

b6c3dd7


          update readme

a48292c

xiezipeng-ML approved these changes

View reviewed changes

xiezipeng-ML requested a review from oneflow-ci-bot

August 11, 2022 06:53

oneflow-ci-bot and others added 2 commits

August 11, 2022 06:54


          auto format by CI

646053b


          Remove redundant dependencies

d5e1c33

songzetao merged commit b276b95 into main

Ldpe2G deleted the dev_roberta_and_update_CPT_NEW branch

August 11, 2022 07:12

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet