Commit Graph

161 Commits

Author SHA1 Message Date
yh_cc
275a4ba129 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-05-02 15:39:23 +08:00
yh_cc
4ed012bf1a 更新cache_results的测试 2022-05-02 15:39:15 +08:00
x54-729
2797c0a961 删除不必要的文件 2022-05-02 05:48:10 +00:00
x54-729
4bfb509f12 调整测试例以适应pytest;为测试例添加标签 2022-05-02 05:46:47 +00:00
yh_cc
d645e88c7f 1.增加部分padder的注释;2.修改set_backend的位置 2022-05-01 23:17:56 +08:00
MorningForest
ac61430aa1 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-05-01 17:19:50 +08:00
MorningForest
0510f31a5e 增加pytest.mark.torch or paddle标记 2022-05-01 17:19:42 +08:00
YWMditto
8ea8992a47 MERGE 2022-05-01 16:57:57 +08:00
YWMditto
26397472aa 加入了 @pytest.mark.torch 2022-05-01 16:53:46 +08:00
MorningForest
6b7b062cec Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-05-01 14:08:08 +08:00
yh_cc
9d2dc748ea merge 2022-05-01 00:33:10 +08:00
yh_cc
b38fc1136e 1.修改ProgressBart在Trainer中的一个bug;2修复pytest的bug 2022-05-01 00:32:11 +08:00
YWMditto
0500682191 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-30 21:39:35 +08:00
YWMditto
35f0593268 修改了一些测试文件的名称 2022-04-30 21:39:20 +08:00
x54-729
cf2ef2ecd7 调整测试例的backend设置 2022-04-30 13:04:55 +00:00
x54-729
b3c9819fb8 添加 __init__.py 2022-04-30 12:55:57 +00:00
x54-729
a6103f6342 重命名不需要pytest的测试文件 2022-04-30 10:51:55 +00:00
yh_cc
b3e0ebd7fc 优化了Collator 2022-04-30 17:10:03 +08:00
MorningForest
1216ac6e90 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-30 00:22:38 +08:00
MorningForest
39e199467a accuracy修改 2022-04-30 00:22:29 +08:00
yh_cc
d4dd85ed40 新设计collator 2022-04-29 22:24:46 +08:00
yh_cc
f74b9b6bec 修改所有的 validate 为 evaluate ; 移动 callback.on_train_end() 2022-04-28 16:27:17 +08:00
x54-729
f319b5bce1 torch ddp 的测试用例 2022-04-26 05:49:32 +00:00
x54-729
df109316e5 small 2022-04-26 05:33:37 +00:00
x54-729
705deeaea9 small 2022-04-26 03:35:25 +00:00
x54-729
cf65da1332 paddle 单卡测试例调整 2022-04-25 12:58:03 +00:00
x54-729
bb10410ccd torch 单卡的测试例 2022-04-25 12:57:17 +00:00
x54-729
c74da391c7 跟进paddle backend关于all_gather的改动 2022-04-20 10:27:09 +00:00
x54-729
fcc45dbf4a PaddleFleetDriver添加all_gather和broadcast_object函数 2022-04-20 10:17:19 +00:00
x54-729
1c0e331bad 完成fastnlp_paddle_all_gather和fastnlp_paddle_broadcast_object函数及测试例 2022-04-20 09:56:44 +00:00
YWMditto
3823fc557d 对 magic_argv_env_context 添加了 timeout 参数,测试函数超过一定时间后自动kill掉 2022-04-20 00:16:23 +08:00
yh_cc
368c17fe73 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-19 22:38:55 +08:00
yh_cc
aa95513055 1.merge ModelCheckPointCallback和TrainerCheckpointCallback;2.新增MoreEvaluateCallback 2022-04-19 22:38:35 +08:00
x54-729
514415e9d4 完成了paddle fleet的save load函数测试 2022-04-16 15:47:18 +00:00
x54-729
9b13fd313a small 2022-04-16 08:39:38 +00:00
x54-729
aa2f678507 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-16 07:23:18 +00:00
yh_cc
d813f31f9a 1.删除sampler中num_consumed_samples_array,转为通过batch_size等进行换算。2.在Metric中新增all_gather_object接口,方便评测 2022-04-16 15:22:44 +08:00
x54-729
6bfdb39c2f 完善paddle fleet set_dist_repro_dataloader的测试例 2022-04-16 06:42:29 +00:00
x54-729
a25a73394b Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-16 05:40:35 +00:00
x54-729
de544707d9 paddle fleet set_dist_repro_dataloader的测试例 2022-04-16 05:40:23 +00:00
yh_cc
d758a36d4a update metric的实现 2022-04-16 12:40:29 +08:00
yh_cc
048e409233 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-16 00:33:32 +08:00
yh_cc
aaa4ccc3e0 1.Metric的aggregate_when_get_metric默认值修改为None;将根据Evaluator中Sampelr的状态最终决定;2.增加fastnlp_bo_syn_context关闭fastnlp中的多卡同步操作 2022-04-16 00:32:52 +08:00
x54-729
32d8e27472 small 2022-04-15 16:10:10 +00:00
x54-729
26c80d620c paddle单卡加载fp16的测试 2022-04-15 16:01:21 +00:00
x54-729
8e9a47cf00 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-15 13:48:23 +00:00
MorningForest
a2956b697e Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-15 20:04:53 +08:00
MorningForest
665d79a3ed 增加paddle单卡的accuracy测试用例 2022-04-15 20:03:44 +08:00
yh_cc
b0db3a5998 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-15 19:31:58 +08:00
yh_cc
687db6d86a 1.torch在保存和load的时候会考虑GradScaler的保存问题; 2.新增Torch的GradientClip和Warmpup 2022-04-15 19:31:46 +08:00