Commit Graph

1967 Commits

Author SHA1 Message Date
YWMditto
ba8971fcf3 little change 2022-04-29 18:19:07 +08:00
yh_cc
f74b9b6bec 修改所有的 validate 为 evaluate ; 移动 callback.on_train_end() 2022-04-28 16:27:17 +08:00
yh_cc
b3bc58b0bb Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-28 15:12:30 +08:00
yh_cc
0043e3e89a 修复LoadeBestModelCallback的bug 2022-04-28 15:12:21 +08:00
x54-729
f319b5bce1 torch ddp 的测试用例 2022-04-26 05:49:32 +00:00
x54-729
df109316e5 small 2022-04-26 05:33:37 +00:00
x54-729
d04f49a835 修改BucketedBatchSampler batch_idx_in_epoch 的计算方式,使其在分布式条件下可以正确地反应迭代次数 2022-04-26 05:33:17 +00:00
x54-729
822df062ca 添加函数的注释 2022-04-26 05:31:45 +00:00
x54-729
705deeaea9 small 2022-04-26 03:35:25 +00:00
x54-729
cf65da1332 paddle 单卡测试例调整 2022-04-25 12:58:03 +00:00
x54-729
bb10410ccd torch 单卡的测试例 2022-04-25 12:57:17 +00:00
yh_cc
6f7bbfabca 增加部分关于evaluate_batch_step_fn的说明 2022-04-25 19:35:49 +08:00
yh_cc
7e40d98404 新增train_input_mapping 和 evaluate_input_mapping 等 2022-04-25 16:47:29 +08:00
yh_cc
6ddcedaaeb Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-24 12:09:35 +08:00
yh_cc
e85cbb067e Rich支持jupyter 2022-04-24 12:09:19 +08:00
YWMditto
711bbf469c 修改了 trainer.load_model/load 只有单卡加载的bug 2022-04-23 14:44:18 +08:00
yh_cc
1ecbdc7446 修复TopkSaver在CheckpointCallbackk中的bug;修改Saver对象,使得其方便被直接使用 2022-04-23 00:41:12 +08:00
yh_cc
b117f6170c Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-22 02:09:43 +08:00
yh_cc
ceb30937b8 更新Trainer的部分文档; 更新topk_saver文档 2022-04-22 02:09:30 +08:00
x54-729
c74da391c7 跟进paddle backend关于all_gather的改动 2022-04-20 10:27:09 +00:00
x54-729
fcc45dbf4a PaddleFleetDriver添加all_gather和broadcast_object函数 2022-04-20 10:17:19 +00:00
x54-729
1c0e331bad 完成fastnlp_paddle_all_gather和fastnlp_paddle_broadcast_object函数及测试例 2022-04-20 09:56:44 +00:00
yh_cc
6c532829c5 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-20 00:37:31 +08:00
yh_cc
6b4d4502db 修复no_sync的bug 2022-04-20 00:37:19 +08:00
YWMditto
3823fc557d 对 magic_argv_env_context 添加了 timeout 参数,测试函数超过一定时间后自动kill掉 2022-04-20 00:16:23 +08:00
yh_cc
bfa9920b16 bug fix 2022-04-19 23:08:31 +08:00
yh_cc
368c17fe73 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-19 22:38:55 +08:00
yh_cc
aa95513055 1.merge ModelCheckPointCallback和TrainerCheckpointCallback;2.新增MoreEvaluateCallback 2022-04-19 22:38:35 +08:00
x54-729
514415e9d4 完成了paddle fleet的save load函数测试 2022-04-16 15:47:18 +00:00
x54-729
cb01a661f1 BucketedBatchSampler的batch_id_in_epoch实现 2022-04-16 15:46:57 +00:00
x54-729
77f6b63ba6 paddle save函数适应新的sampler 2022-04-16 08:40:16 +00:00
x54-729
9b13fd313a small 2022-04-16 08:39:38 +00:00
x54-729
3dbb3677f0 微调 reproducible sampler 的初始化 2022-04-16 08:39:07 +00:00
x54-729
aa2f678507 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-16 07:23:18 +00:00
yh_cc
d813f31f9a 1.删除sampler中num_consumed_samples_array,转为通过batch_size等进行换算。2.在Metric中新增all_gather_object接口,方便评测 2022-04-16 15:22:44 +08:00
x54-729
6bfdb39c2f 完善paddle fleet set_dist_repro_dataloader的测试例 2022-04-16 06:42:29 +00:00
x54-729
fcd27cfc3f 添加FASTNLP_NO_SYNC相关的设置 2022-04-16 05:50:53 +00:00
x54-729
a25a73394b Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-16 05:40:35 +00:00
x54-729
de544707d9 paddle fleet set_dist_repro_dataloader的测试例 2022-04-16 05:40:23 +00:00
yh_cc
d758a36d4a update metric的实现 2022-04-16 12:40:29 +08:00
yh_cc
048e409233 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-16 00:33:32 +08:00
yh_cc
aaa4ccc3e0 1.Metric的aggregate_when_get_metric默认值修改为None;将根据Evaluator中Sampelr的状态最终决定;2.增加fastnlp_bo_syn_context关闭fastnlp中的多卡同步操作 2022-04-16 00:32:52 +08:00
x54-729
32d8e27472 small 2022-04-15 16:10:10 +00:00
x54-729
26c80d620c paddle单卡加载fp16的测试 2022-04-15 16:01:21 +00:00
x54-729
8cda30c426 small 2022-04-15 15:10:35 +00:00
x54-729
5d1ac72ec9 加载fp16时同时设置auto_cast和fp16属性 2022-04-15 14:38:29 +00:00
x54-729
262bc1a82e small 2022-04-15 14:03:08 +00:00
x54-729
8e9a47cf00 Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-15 13:48:23 +00:00
MorningForest
a2956b697e Merge branch 'dev0.8.0' of github.com:fastnlp/fastNLP into dev0.8.0 2022-04-15 20:04:53 +08:00
MorningForest
665d79a3ed 增加paddle单卡的accuracy测试用例 2022-04-15 20:03:44 +08:00