chunjun

A data integration framework

APACHE-2.0 License

Stars
4K

Bot releases are hidden (Show)

chunjun - Release v1.12.8 Latest Release

Published by FlechazoW over 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/DTStack/chunjun/compare/v1.12.7...v1.12.8

chunjun - Release v1.12.7

Published by FlechazoW almost 2 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/DTStack/chunjun/compare/v1.12.6...v1.12.7

chunjun - Release v1.12.6

Published by FlechazoW about 2 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/DTStack/chunjun/compare/v1.12.5...v1.12.6

chunjun - v1.12.5

Published by FlechazoW over 2 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/DTStack/chunjun/compare/v1.12.4...v1.12.5

chunjun - v1.12.4

Published by FlechazoW over 2 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/DTStack/chunjun/compare/v1.12.3...v1.12.4

chunjun -

Published by FlechazoW over 2 years ago

Merge Commits From DTStack.

chunjun - v1.12.2

Published by FlechazoW over 2 years ago

修复已知bug;
增加inceptor插件和influxdb;

chunjun - v1.12.1

Published by FlechazoW over 2 years ago

增加binlog, logminer对ddl数据的处理;
增加doris插件;
插件bugfix;

chunjun - 1.11.0

Published by yanghuaiGit almost 4 years ago

1、FlinkX升级至1.11
2、删除kafka09插件

chunjun - 1.10.4

Published by yanghuaiGit almost 4 years ago

1、增加Kingbase插件
2、fix #301
3、fix #276
4、fix #244
5、fix 其他BUG

chunjun - 1.8.9

Published by kanata163 almost 4 years ago

1、增加Kingbase插件
2、fix #301
3、fix #276
4、fix #244
5、fix 其他BUG

chunjun - 1.10.1

Published by kanata163 about 4 years ago

1、增加Greenplum和RestApi插件
2、支持-p参数填充脚本占位符
3、BUG修复

chunjun - 1.8.7

Published by kanata163 over 4 years ago

1、增加Greenplum和RestApi插件
2、支持-p参数填充脚本占位符
3、BUG修复

chunjun - 1.8.6

Published by kanata163 over 4 years ago

文档更新

chunjun - 1.10.0

Published by kanata163 over 4 years ago

Flinkx支持Flink 1.10.0

chunjun - 1.8.5_rc2

Published by lijiangbo over 4 years ago

修复问题:
1.perjob模式提交报错

优化:
优化启动参数默认值

chunjun - 1.8.5_rc1

Published by lijiangbo over 4 years ago

chunjun - 1.8.5

Published by lijiangbo over 4 years ago

新增内容

  • 新增达梦数据库插件
  • 新增Mongodb实时采集插件
  • 新增PostgreSQL实时采集插件
  • 任务支持配置Restart Strategy

修复内容:

  • 修复读取hdfs文件很慢的问题
  • 修复Mysql实时采集任务续跑不了问题
  • 修复打包问题
chunjun - 1.8.4

Published by lijiangbo over 4 years ago

新增内容
1.编译时自动安装缺失的驱动包到本地
2.reader和writer支持分别指定并发度
3.新增插件 Cassandra
4.新增插件 Phoenix
5.新增插件 Teradata
6.新增插件 SAP Hana

修复内容:
1.直接下载源码编译报错问题

chunjun - 1.8.3

Published by lijiangbo almost 5 years ago

新功能:
1.添加clickhouse插件
2.添加PolarDB插件
3.sftp支持ssh key认证方式
4.HDFS读取插件支持文件过滤
5.插件加载方式支持shipfile模式
6.kafka插件支持除了binlog之外的其它数据源的数据
7.hdfs插件支持配置hadoop_user_name
8.hdfs插件兼容hive 1.x写入的数据文件
9.支持kafka 1.0版本
10.任务提交模式支持standalone模式
11.支持hadoop3

bugfix:
1.修复写入ftp时因flush导致的问题
2.修复hdfs插件写入parquet表时字段名称大小写问题
3.修复Sql Server自增主键写入bug
4.修复hdfs读取插件因常量字段导致数据错位的问题
5.修复写入PostgreSQL因脏数据导致数据重复的问题
6.修复分库分表插件读取bug

优化:
1.优化任务结束时指标汇总逻辑
2.hdfs读取插件优化分片创建逻辑