torch4keras

bert4torch底层训练框架,用keras风格写torch代码

APACHE-2.0 License

Downloads
479
Stars
74
Committers
2

Bot releases are hidden (Show)

torch4keras - 稳定版本v0.2.6 Latest Release

Published by Tongjilibo 2 months ago

  • 增加check_url_available_cached
  • 修复Timeit
torch4keras - 稳定版本v0.2.5

Published by Tongjilibo 3 months ago

小修改

  • print_table允许中文
  • 未安装torch时候仅提醒一次
torch4keras - 稳定版本v0.2.4

Published by Tongjilibo 4 months ago

trainer中可调用nn.Module方法,增加AutoTrainer

torch4keras - 稳定版本v0.2.3

Published by Tongjilibo 5 months ago

  1. 去除对torch依赖,snippets部分可用;
  2. 移动bert4torch中snippets
torch4keras - 稳定版本v0.2.2

Published by Tongjilibo 6 months ago

bug修复

  • 优化deepspeed的使用
  • 修复_prepare_inputs的bug
  • 修复断点续训SmoothMetricsCallback起点错误的bug

新增功能

  • Trainer断点续训记录batch数
  • 增加YamlConfig和IniConfig
torch4keras - 稳定版本v0.2.1.post2

Published by Tongjilibo 7 months ago

修复bug

  • 避免训练空数据集error
  • 修改run_callback=False的bug
  • 修复ddp中mix_precision和torch的ddp重名导致的bug

功能优化

  • 默认指标使用滑窗平滑,记录过去interval窗口内的平均指标
  • BaseModelDDP修改的更易用,增加init_process_group
  • mapping允许是函数(DDP训练的模型等更方便加载)

新增功能

  • 训练异常时保存权重;训练异常时候可以保存当前batch数据用于debug
  • Checkpoint的Callback增加save_on_train_end
  • 增加SystemCallback用于监控gpu, cpu,内存等占用
torch4keras - 稳定版本v0.2.0

Published by Tongjilibo 8 months ago

fit中修改.train()逻辑较少耗时

torch4keras - 稳定版本v0.1.9

Published by Tongjilibo 9 months ago

增加Timeit, Timeit2, timeid等时间/速度监控

torch4keras - 稳定版本v0.1.8

Published by Tongjilibo 9 months ago

重新整理snippets, 重写save_pretrained

torch4keras - 稳定版本v0.1.7

Published by Tongjilibo 10 months ago

  • 增加SimpleStreamFileLogger和LoggerHandler
  • 修改Logger的格式
torch4keras - 稳定版本v0.1.6.post2

Published by Tongjilibo 11 months ago

  1. 监控fit过程,有报错则发送邮件提醒;
  2. 解决torch2.0的compile冲突问题
  3. 修复clip_grad_norm的bug
torch4keras - 稳定版本v0.1.5

Published by Tongjilibo almost 1 year ago

进度条中显示已经训练的时间

torch4keras - 稳定版本v0.1.4.post2

Published by Tongjilibo about 1 year ago

History增加plot()方法, 增加add_module()方法,修复0.1.4的_argparse_forward的bug, 增加loss2metrics

torch4keras - 稳定版本v0.1.4

Published by Tongjilibo about 1 year ago

增加from_pretrained和save_pretrained方法,增加log_warn_once方法,compile()中可设置成员变量,默认move_to_model_device设置为True, 增加JsonConfig,增加_argparse_forward()方便下游继承改写Trainer

torch4keras - 稳定版本v0.1.3

Published by Tongjilibo about 1 year ago

compile()可不传参,interval不一致报warning, 去除部分self.vars, 调整move_to_model_device逻辑,DDP每个epoch重新设置随机数,save_weights()和load_weights()可以按照pretrained格式

torch4keras - 稳定版本v0.1.2.post2

Published by Tongjilibo about 1 year ago

代码结构调整,增加trainer.py文件,方便下游集成

torch4keras - 稳定版本v0.1.2

Published by Tongjilibo about 1 year ago

修复DeepSpeedTrainer,修复DDP

torch4keras - 稳定版本v0.1.1

Published by Tongjilibo about 1 year ago

增加指标平滑的SmoothMetricCallback,统一管理指标平滑的问题, 增加SKIP_METRICS,NO_SMOOTH_METRICS,ROUND_PRECISION,默认对指标会进行平滑,修改tensorboard和wandb的callback, 允许跳过nan的指标, Tensorboard可以记录gpu等系统信息

torch4keras - 稳定版本v0.1.0.post2

Published by Tongjilibo about 1 year ago

修复v0.1.0的bug,主要是进度条和log的标签平滑的问题

torch4keras - 稳定版本v0.1.0

Published by Tongjilibo about 1 year ago

允许调整进度条的显示参数, 进度条和日志同步(如果进度条平滑了则日志也平滑), 自动把tensor转到model.device上, 允许打印第一个batch来检查样本

Package Rankings
Top 14.23% on Pypi.org
Top 6.68% on Proxy.golang.org
Badges
Extracted from project README
licence GitHub release PyPI PyPI - Downloads GitHub stars GitHub Issues contributions welcome
Related Projects