bert4torch底层训练框架,用keras风格写torch代码
APACHE-2.0 License
Bot releases are visible (Hide)
Published by Tongjilibo 3 months ago
Published by Tongjilibo 4 months ago
trainer中可调用nn.Module方法,增加AutoTrainer
Published by Tongjilibo 5 months ago
Published by Tongjilibo 6 months ago
Published by Tongjilibo 7 months ago
Published by Tongjilibo 8 months ago
fit中修改.train()逻辑较少耗时
Published by Tongjilibo 9 months ago
增加Timeit, Timeit2, timeid等时间/速度监控
Published by Tongjilibo 9 months ago
重新整理snippets, 重写save_pretrained
Published by Tongjilibo 10 months ago
Published by Tongjilibo 11 months ago
Published by Tongjilibo 12 months ago
进度条中显示已经训练的时间
Published by Tongjilibo about 1 year ago
History增加plot()方法, 增加add_module()方法,修复0.1.4的_argparse_forward的bug, 增加loss2metrics
Published by Tongjilibo about 1 year ago
增加from_pretrained和save_pretrained方法,增加log_warn_once方法,compile()中可设置成员变量,默认move_to_model_device设置为True, 增加JsonConfig,增加_argparse_forward()方便下游继承改写Trainer
Published by Tongjilibo about 1 year ago
compile()可不传参,interval不一致报warning, 去除部分self.vars, 调整move_to_model_device逻辑,DDP每个epoch重新设置随机数,save_weights()和load_weights()可以按照pretrained格式
Published by Tongjilibo about 1 year ago
代码结构调整,增加trainer.py文件,方便下游集成
Published by Tongjilibo about 1 year ago
修复DeepSpeedTrainer,修复DDP
Published by Tongjilibo about 1 year ago
增加指标平滑的SmoothMetricCallback,统一管理指标平滑的问题, 增加SKIP_METRICS,NO_SMOOTH_METRICS,ROUND_PRECISION,默认对指标会进行平滑,修改tensorboard和wandb的callback, 允许跳过nan的指标, Tensorboard可以记录gpu等系统信息
Published by Tongjilibo about 1 year ago
修复v0.1.0的bug,主要是进度条和log的标签平滑的问题
Published by Tongjilibo about 1 year ago
允许调整进度条的显示参数, 进度条和日志同步(如果进度条平滑了则日志也平滑), 自动把tensor转到model.device上, 允许打印第一个batch来检查样本