Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.
APACHE-2.0 License
Bot releases are visible (Hide)
99fe3048 [update][dep] Bump com.sap.cloud.db.jdbc:ngdbc from 2.20.17 to 2.21.11 (#1084)
c01e3170 [update][dep] Bump org.sonatype.plugins:nexus-staging-maven-plugin (#1083)
fb7b1f01 [update][core] Add a simplier batch process script to invoke addax in windows
6b65414d [bugfix][plugin][rdbmswriter] Fix incorrect package name
3966b367 Create CITATION.cff
50cc09c7 [update][dep] Bump org.tukaani:xz from 1.9 to 1.10 (#1077)
025eac4f [update][dep] Bump com.github.albfernandez:javadbf from 1.14.0 to 1.14.1 (#1074)
3a58b477 [update][dep] Bump poi.version from 5.2.5 to 5.3.0 (#1075)
6b67552e [docs][improve] convert starrocks logo to svg
f10eba18 Merge branch 'master' of github.com:wgzhao/addax
4ebe019e [improve][lib][rdbms] improve the split strategy, fix #1072
27782def [improve][docs] adjust logos color for dark theme
14434fec [improve][docs] Enhancing readability through emoji use
fa6bc435 [bugfix][plugin][influxdbreader] Fix incorrect package path, fix #1071
3b1b43ac [improve][docs] remove logos background
405b049a [update][github][action]Bump actions/setup-java from 4.2.1 to 4.2.2 (#1067)
d3c694a1 [bugfix][plugin][oraclewriter] Fix ora-03106 while updating clob column, fix #1030
821bc0e0 Bump com.google.code.gson:gson from 2.10.1 to 2.11.0 (#1046)
145d131c [update][doc] Add documentation build/publish guide
9cb12ca7 [maven-release-plugin] prepare for next development iteration
Published by wgzhao 5 months ago
e42ab571 (origin/master, origin/HEAD) Bump fastjson2.version from 2.0.43 to 2.0.50 (#1045)
e36708f9 [improve][plugin][hdfsreader] Refactor parquet reading method to support timestamp data type
27c57616 [improve][core] improve exception print
81801c03 [update][core] remove commons-logging
4d20cbd6 Merge remote-tracking branch 'origin/master'
6c7ea463 [update][core] remove commons-logging
0c53159d Bump org.apache.maven.plugins:maven-gpg-plugin from 3.1.0 to 3.2.4 (#1043)
07791e7f (origin/remove_commons_logging) [update][core] Add build module script for develop
1305d14d Bump org.codehaus.plexus:plexus-compiler-javac-errorprone (#1019)
14f917d6 Bump org.junit.jupiter:junit-jupiter-api from 5.10.1 to 5.10.2 (#1014)
9f0dcede Bump com.sap.cloud.db.jdbc:ngdbc from 2.19.11 to 2.20.17 (#1028)
5e258a7a Bump org.influxdb:influxdb-java from 2.23 to 2.24 (#989)
ecee5357 Bump com.moilioncircle:redis-replicator from 3.8.0 to 3.8.1 (#981)
1f2703c3 Bump softprops/action-gh-release from 1 to 2 (#1018)
33cc436f Bump actions/setup-java from 4.0.0 to 4.2.1 (#1024)
11e1ccfa Improve exception print (#1038)
8e452e4e [improve][core] disable mongodb drive monitor mass log
a13cfa59 [bugfix][reader][mongodb] read timeout with replica cluster (#1037)
48970209 [update][writer][oracle] Remove unused method
143e1072 [bugfix][writer][oracle] Fix ORA-01461 With MERGE INTO Statement And Clob Column #1030
4650d3d8 [update][plugin] Bump databend jdbc from 0.1.4 to 0.1.9
b2920421 [bugfix][lib][storage] Fix skip header logic in StorageReaderUtil.java
9c1503a4 Add ExitOnOutOfMemoryError to return 3 instead of 0 when oom occurred
b45a7ea4 Bump org.codehaus.plexus:plexus-compiler-javac from 2.8.8 to 2.14.2 (#991)
c00c877d Bump stCarolas/setup-maven from 4 to 5 (#1010)
3d7a453c Bump com.jayway.jsonpath:json-path in /plugin/reader/jsonfilereader (#1002)
bbb6b0e8 [improve][writer][doris] improve code, reduce standard log output
c41c7653 [improve][writer][doris] Refactor Doris writer plugin (#1007)
02944a8e [update][reader][jsonfile] Bump json-path from 2.8.0 to 2.9.0
8d5dfb82 [improve][reader][http] remove unused variable.
1ca5afb4 [improve][reader][hdfs] remove unused variable.
2cd981aa [improve][writer][tdengine] remove unused variable.
a9f5b5ad [improve][writer][elasticsearch] remove unused variable.
114fb7f4 [improve][reader][elasticsearch] remove unused variable.
f7119b3d [improve][writer][clickhouse] remove unused variable.
40c9ed9d [bugfix][core] remove redundant initializer for maxLogNum variable
fa2b95de [bugfix][writer][starRocks] remove the condition which is always true
3b7f919f [improve][writer][elasticsearch] use StringBuilder to replace string concat
fa63fb8a [improve][reader][cassandra] add element type for container class
a981417d [improve][writer][starRocks] use lambda to replace Anonymous function
442e97a6 [bugfix][writer][starRocks] fix some bugs
d6fca012 [update][common] Add build script for docker images
Published by wgzhao 9 months ago
be765d1e [improve][reader][tdengine] Use primitive type instead of wrapper type
361aa4ce (origin/master, origin/HEAD) [improve][common] improve EncryptUtil class
a852982e [bugfix][common] Fixed Tag mismatch exception
70995c38 Bump github/codeql-action from 2 to 3 (#985)
7844518f [bugfix][lib][storage] Fix dateFormat is invalid when data type is timestamp
d165f76d [improve][plugin][datareader] Add support for generating email address (#983)
97e4c0b6 [update][3rd] Bump multiple 3rd-party deps to updated version
00c53554 [update][core] Remove ununsed import
c0889a91 [update][docs] Add SAP HANA logo
bdd51e86 [update][docs] Add hana guide
603322da [add][plugin] Add support for SAP HANA database (#977)
7e5dcc4f [update][plugin][mongowriter] Replace deprecated MongoClient method
5cfae663 [update][plugin][esreader] Remove deprecated JsonParser#JsonParser method
4f1ca9c0 [update][plugin][influxdbreader] Remove unused InfluxDBReaderTask#post method
d72fa75f [update][plugins] Remove unused import or variables
23fd22dd [update][plugin] Remove unused logger instance
4de07436 [update][rdbms] Remove unused PerfTrace
d0e3e230 [improve][plugin][streamreader] Remove deprecated RandomUtils class
e5161fdb [improve][plugin][datareader] Remove deprecated RandomUtils class
a72b0b3c [improve][common] Remove unused import to TimestampColumn class
0dda008a [bugfix][plugin][sqlitereader] Fix incorrect package name
5372e9c2 [update][3rd] Bump multiple 3rd-party deps to updated version
1ccd78f2 [update][3rd] Bump multiple 3rd-party deps to updated version
e499017d [update][3rd] Bump ch.qos.logback from 1.3.11 to 1.3.12
75e34384 Bump actions/setup-java from 3.13.0 to 4.0.0 (#968)
b5d4ad84 Bump org.fusesource.jansi:jansi from 2.4.0 to 2.4.1 (#967)
04a46195 [update][3rd] Bump multiple 3rd-party deps to updated version
34340206 [update][doc][difference] Add access reader and writer plugin
797bcbd2 [update][doc][readme] improve
ad3c50d9 [update][3rd] Bump multiple 3rd-party deps to updated version
b6c95a02 [update][doc][readme] Add star history chart
8af30ada [update][3rd] Bump multiple 3rd-party deps to updated version
9963d369 [update][github] update action template
Published by wgzhao 11 months ago
Published by wgzhao about 1 year ago
speed.channel
(#927)Published by wgzhao over 1 year ago
Published by wgzhao over 1 year ago
This version breaks backward compatibility, so it is incompatible with version 4.0.x.
Published by wgzhao over 1 year ago
Published by wgzhao almost 2 years ago
Published by wgzhao almost 2 years ago
Published by wgzhao over 2 years ago
Published by wgzhao almost 3 years ago
Published by wgzhao almost 3 years ago
Published by wgzhao almost 3 years ago
microsecond
and nanosecond
(a.k.a timestamp(p)
) (#371)NullPointerException
when inserting a null value #374 (#375)The sha256sum of the addax-4.0.5.tar.gz
file is 92e38612e6be4fe2c07dcb9100bfab05a24b20d357afa16f205aba5b5a5eb528
The sha256sum of the addax-4.0.4.tar.gz
file is 67b94386726c96e85b0441fc592b78af6e7537f9764f76d4957b83cd8ca5ce5b
md5sum: 19766c2577b46bd5b22d63a502f5f5dd
Note: Because Aliyun drive does not support the sharing of compressed files currently, So, I add a .jpg suffix for each binary file, you need to remove this suffix before you can use the
datareader
plugin, generate data to meet specified rule requirements for populating data in development and testing (#291)sqlitereader
plugin (#305)sqlitewriter
plugin (#306)dbfreader
40d0d51gzip -c
to compress multiple files (#316 )where
to set more filters (#298)gzip -c
to compress multiple files (#316 )dbfwriter
c6adb3fmd5sum: cd3a3d6d0c79cbd3bcd259ebb47acbc5
Note: Because Aliyun drive does not support the sharing of compressed files currently, So, I add a .jpg
suffix for each binary file, you need to remove this suffix before you can use them
It has 3 attachements
The updated version 4.0.1
has relased
You can download pre-compiled binary files from Addax-4.0.1
Note: Because Aliyun drive does not support the sharing of compressed files currently, So, I add a .jpg
suffix for each binary file, you need to remove this suffix before you can use them
StorageReaderUtil
class as a separate class, which has reduced the dependency of other plugins on plugin-storage-util (#227)addax.py
remove unused options, remove --mode
, --jobid
, --reader
, --writer
Published by wgzhao over 3 years ago
autoPk
)c52715e3 Changes main program to addax.py
288fbdf2 Add tdengine reader/writer plugins to package #224
6c9f4b41 Bugfixed: exception occurred when move hdfs file from temporary location to destination
e582f768 Use phoenix-core instead of phoenix-client to reduce size
76d3062f Bugfix: string format error
86457ab5 Add correspond compress suffix
9c6e88f2 Bump postgresql from 42.2.22 to 42.2.23 (#218)
df8e8be0 Add correspond compress suffix
e4a04a8d Bump maven-javadoc-plugin from 3.2.0 to 3.3.0 (#211)
83221c37 Bump commons-net from 3.7.2 to 3.8.0 (#212)
7cbf4c6c Bump parquet-avro from 1.11.1 to 1.12.0 (#213)
6264fac0 Bump httpcore from 4.4.13 to 4.4.14 (#214)
40e61943 Rewrite the string type field splitting method using the database's own functions
18a6c3fb Bump kudu-client from 1.8.0 to 1.15.0 (#190)
d8f32950 Bump nexus-staging-maven-plugin from 1.6.7 to 1.6.8 (#210)
91de3c2f Bump commons-lang3 from 3.11 to 3.12.0 (#209)
0e80d62b Bump commons-io from 2.8.0 to 2.10.0 (#208)
68f7e03f Bump snappy-java from 1.1.8 to 1.1.8.4 (#207)
4a638dca Bump taos-jdbcdriver from 2.0.18 to 2.0.32 (#204)
5c25819b Bump fastjson from 1.2.75 to 1.2.76 (#206)
58a8a57d Bump ognl from 3.2.18 to 3.2.21 (#203)
8fc41ad9 Bump joda-time from 2.9.7 to 2.10.10 (#205)
02b000bc Bump maven-dependency-plugin from 3.1.2 to 3.2.0 (#199)
68028621 Bump jedis from 3.4.0 to 3.6.1 (#201)
62ea143f Bump error_prone_core from 2.4.0 to 2.7.1 (#202)
8fee29b8 Bump maven-gpg-plugin from 1.5 to 3.0.1 (#194)
49342f78 Bump postgresql from 42.2.19 to 42.2.22 (#195)
eb09cad7 Bump aircompressor from 0.17 to 0.19 (#196)
96c3c851 Bump druid from 1.2.4 to 1.2.6 (#197)
96e7e750 Add support for auto guess splittable column (#198)
920f93c0 Bump cassandra.jdbc.version from 3.10.2 to 3.11.0 (#192)
44e2d726 Bump avro from 1.10.1 to 1.10.2 (#188)
26d2783e Bump slf4j-api from 1.7.28 to 1.7.31 (#189)
f8d481b9 Bump json-path from 2.5.0 to 2.6.0 (#191)
b254c183 Bump javadbf from 1.11.2 to 1.13.1 (#186)
238fbe23 Bump fluent-hc from 4.5.12 to 4.5.13 (#187)
95169414 Bump httpcore-nio from 4.4.13 to 4.4.14 (#181)
ca07dca9 Bump redis-replicator from 3.4.2 to 3.5.4 (#148)
89feeb71 Bump mongo-java-driver from 3.12.7 to 3.12.8 (#142)
0320d503 Add test for decimal type
98286bbd Allow all fields accept null value
52ace57f plugin hdfswriter: rewrite orc file schema generate method
ce8cfbf8 plugin hdfsreader: simplify parquet file reader codes
bd4aa417 Uses consistent variable definitions
0c14f86b plugin: dbffilewriter Add check for column configuration
8401fbc1 bugfix FileNotFoundException
73e8e034 Support for read/write Parquet file with binary type
1c0b80d9 Add some test cases
cbe64daf plugin hdfsreader: Add support for reading binary data
4e008b96 plugin hdfswriter: Add support for writing binary data with OrcFile