com.wgzhao.addax:addax-all - 6.0.4

Addax 6.0.4 has released! 🎉

We are pleased to announce version 6.0.4, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.

Below are the key updates in this release:

📜 Changes

c402a6108 [chore][docs] update mkdocs navigation for improved readability and localization e3a13908d [refactor][lib][storage] enhance FileHelper and StorageWriterUtil with improved error handling, validation, and documentation a4c6ed638 [chore][lib][rdbms] enhance JavaDoc comments across multiple classes for improved clarity and understanding e621b75a5 [chore][core] improve comments and formatting in FilterTransformer and RetryUtil d1ac643fd [chore][core] improve Communication class with deep-copy constructor and message cloning f772a622c [chore][lib][rdbms] refactor SQL query formatting for SQLite and Sybase cases e65ff3f24 [chore][core][doc] enhance JavaDoc comments for better clarity and understanding 6bd212bc7 [chore][lib][rdbms] replace List with Set for numeric JDBC types in GetPrimaryKeyUtil 9f939b5e6 [chore][github][action] Bump actions/checkout from 4 to 5 (#1332) 5b5bb62ac [chore][3rd] update dependency versions in pom.xml c6f53176b [chore][github][issue] update default version in NEW-ISSUE.yml to 6.0.3 3b2bcf292 [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao 9 months ago

com.wgzhao.addax:addax-all - 6.0.3

Addax 6.0.3 has released! 🎉

We are pleased to announce version 6.0.3, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements. Below are the key updates in this release:

📜 Changes

- Java
Published by wgzhao 10 months ago

com.wgzhao.addax:addax-all - 6.0.2

Addax 6.0.2 has released! 🎉

We are pleased to announce version 6.0.2, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.

Below are the key updates in this release:

Highlight

update Hadoop version to 3.3.6 (#1306)
migrate from Apache HttpClient to Java 11 HttpClient (#1305)
add hidden file filter to listStatus method in DFSUtil

📜 Changes

46ef26e7 (origin/master, origin/HEAD) [feat][plugin][hdfsreader] add hidden file filter to listStatus method in DFSUtil d3afd05c [chore][docs][hivereader] add version compatibility information for HiveReader dfb77d6d [bugfix][core][build] increase pom.xml read limit to capture a project version correctly 0539fbe1 [upgrade][dependencies] update Hadoop version to 3.3.6 (#1306) 02304c52 [chore][license][update] add Apache License 2.0 header to missing files e33e74b4 [chore][plugin][dependencies] update log4j and zstd versions in pom.xml 0d343c68 [improve][plugin][httpreader] improve JSON body handling in POST requests 55b91986 [refactor][core] simplify job resource handling by removing HTTP request logic d0dbbc33 [bugfix][core] fixed job file URL parsing to support case-insensitive protocols 32d42c5b [chore][plugin][icebergwriter] clean up pom.xml by removing unused dependencies and properties bbb3e641 [chore][plugin][hdfsreader] fix indentation in pom.xml 56678f44 [chore][plugin][hivereader] remove unnecessary whitespace in pom.xml ab24da9d [chore][plugin][dependencies] update Avro to 1.12.0 and ORC to 1.9.5 a9a63227 [chore][plugin][icebergwriter] update error message for unsupported file format 06476173 [bugfix][plugin][icebergwriter] fix error when write orc format table (#1304) fdc8934f [chore][plugin][httpreader] remove unused commons-net dependency from pom.xml 2657f087 [refactor][plugin][httpreader] migrate from Apache HttpClient to Java 11 HttpClient (#1305) 5349776e [refactor][core] switch garbage collector from G1GC to ZGC for improved performance fbaab28a [refactor][core] replace Apache HttpClient with Java 11 HttpClient for improved HTTP handling 50fd5557 [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao 11 months ago

com.wgzhao.addax:addax-all - 6.0.1

Addax 6.0.1 has released! 🎉

We are pleased to announce version 6.0.1, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements.

Below are the key updates in this release:

Add support for range data type for PostgreSQL (#1283)
Add support for kerberos with kudu (#1290, #1292)
Add support for geometry data type for MySQL (#1298, #1299)

📜 Changes

2405b5ca [bugfix][plugin][elasticsearchreader] adds missing Apache HttpClient dependency 57bb867b [chore][dependencies] update jackson, redis.replicator, woodstox, and sqlite JDBC versions 682dd905 [feature][plugin][mysqlwriter] Add support for GEOMETRY data type handling (#1299) f1e4d313 [feature][plugin][mysqlreader] Add support for GEOMETRY data type handling (#1298) ab65c647 [chore][dependencies] update versions for druid, jansi, jsch, ngdbc, and iceberg 3b01026a [feature][plugin][kudureader] Add support for kerberos with kudu (#1292) 9a7a25a5 [improve][plugin][writer] enhances conflict handling by filtering out conflict columns in an update statement b1f993f2 [chore][plugin][kuduwriter] simplify KuduHelper initialization and improve code comments b0caf7a7 [feature][writer][kuduwriter] Add support for kerberos with kudu (#1290) 5fbada08 [refactor][plugin][postgresql] clean up error handling and improve code readability 6f95151d [add][plugin][postgresql] Add support for the range data type (#1283) fc5128f4 [chore][update][dependencies] bump versions for paimon, gson, httpclient, clickhouse, and databend f3111d7a [bugfix][plugin][hdfs] add exclusion for hadoop-client-api in protobuf-java dependency 545aa249 [chore][docker] update build script to use correct addax version directory 8fad0506 [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao 11 months ago

com.wgzhao.addax:addax-all - 6.0.0

Addax 6.0.0 has released! 🎉

We are pleased to announce version 6.0.0. This update includes significant improvements, most notably the transition from JDK 1.8 to JDK 17. Below is a summary of key changes and enhancements in this release:

Key Highlights

Migration to JDK 17
- Improved Performance: With JDK 17's performance optimizations, users will experience faster execution and reduced resource consumption.
- Enhanced Security: JDK 17 introduces stronger security mechanisms, offering additional protection against potential vulnerabilities.
- Expanded Language Features: Developers can now utilize the latest Java language features such as:
  - Switch Expressions: Simplify switch logic for better code readability.
  - Text Blocks: Streamline the handling of multi-line strings.
  - Records: Create immutable data structures with minimal boilerplate code.
Compatibility Updates
- Refactored the application codebase to remove deprecated APIs and ensure full compatibility with JDK 17.
- Updated dependency libraries to their JDK 17-compatible versions.
Optimizations
- Improved memory management and garbage collection efficiency with JDK 17's G1 GC enhancements.

Upgrade Notes

Java Runtime Environment Requirement:

This version requires JDK 17 or newer to run. Users currently running JDK 1.8 will need to upgrade their Java runtime environment before deploying this version.

Breaking Changes:

Some deprecated features and APIs from JDK 1.8 may no longer function. Ensure custom integrations or extensions are updated accordingly.

Backward Compatibility:

Older versions of the software and configurations may require minor adjustments due to the upgraded platform. Refer to the compatibility guide in our documentation for detailed instructions.

📜 Changes

da81f0f3 (tag: 6.0.0) [maven-release-plugin] prepare release 6.0.0 f0e51143 (origin/master, origin/HEAD) [refactor][github][action] remove create-release to avoid creating duplicate label 0c6d6194 [chore][github][action] Update maven-publish.yml to trigger on version tags and refine upload condition 0982b261 [chore][core] Refactor comments and logging statements for clarity 0b1ee2ca [bugfix][plugin][streamwriter] Fixed issue where stdout resource being closed prevented the logger from writing to the console. 13bc07a7 [chore][docs] change jdk to 17 70b6b1c9 [chore][docs] Add iceberg logo 7ac68c2f [chore][core] Add reserved keyword system e0c25551 [improve][plugin][s3writer] refine pom to reduce the target size 9749d3d0 [improve][plugin][s3writer] Rename formatwriter package to writer for consistency 8400e243 [add][writer][s3writer] Add support for orc and parquet storage format (#1275) cb1964d4 [chore][plugin][icebergwriter] satisfy code style: Improve code formatting and consistency in IcebergHelper and IcebergWriter classes 67a1f0a1 [chore][plugin][icebergwriter] Add Apache License header to IcebergHelper and IcebergWriter classes fbbd0ea6 [add][plugin][icebergwriter] add write plugin icebergwriter (#1208) 330b2fd1 [feature][core] Optimize garbage collection settings for JDK 17 17843b59 [chore][doc] Update runtime requirements in README files to specify JDK 17 ea54c93c Optimzie for jdk17 (#1273) afbf8b81 [feature][plugin][s3reader] Add support for path-style access configuration in S3 client e4c4bedb [feature][docker] Add Docker Build and Push steps to CI workflow 381951db [maven-release-plugin] prepare for next development iteration

Known bugs:

hdfsreader and hdfswriter plugins

if you encounter the following errors:

2025-06-04 13:56:02.341 [ job-0] ERROR Engine - java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/com/ctc/wstx/io/InputBootstrapper at com.wgzhao.addax.plugin.writer.hdfswriter.HdfsHelper.getFileSystem(HdfsHelper.java:68) at com.wgzhao.addax.plugin.writer.hdfswriter.HdfsWriter$Job.init(HdfsWriter.java:90) at com.wgzhao.addax.core.job.JobContainer.initJobWriter(JobContainer.java:642) at com.wgzhao.addax.core.job.JobContainer.init(JobContainer.java:280) at com.wgzhao.addax.core.job.JobContainer.start(JobContainer.java:126) at com.wgzhao.addax.core.Engine.start(Engine.java:62) at com.wgzhao.addax.core.Engine.entry(Engine.java:116) at com.wgzhao.addax.core.Engine.main(Engine.java:145) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.shaded.com.ctc.wstx.io.InputBootstrapper at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:445) at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:592) at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525) ... 8 more you can delete the $ADDAX_HOME/plugin/reader/hdfsreader/libs/hadoop-client-api-3.2.4.jar and $ADDAX_HOME/plugin/writer/hdfswriter/libs/hadoop-client-api-3.2.4.jar

- Java
Published by wgzhao 12 months ago

com.wgzhao.addax:addax-all - 5.1.2

Addax 5.1.2 has released! 🎉

We are pleased to announce version 5.1.2, which focuses on improving stability and performance by addressing several bugs and implementing minor code refinements. Below are the key updates in this release:

📜 Changes

- Java
Published by wgzhao about 1 year ago

com.wgzhao.addax:addax-all - 5.1.1

Addax 5.1.1 has released! 🎉

We are excited to share the routine patch release of version 5.1.1, focused on incremental improvements to ensure a smoother and more reliable experience. This version primarily addresses a range of minor bugs and incorporates subtle code enhancements for better system performance.

Bug Fixes:

[addax-rdbms] Fix calculateStringBetween() method to avoid generating backslash characters that lead to invalid SQL conditions. (#1258)
[hbase20xsqlreader] Fix null values in convertPhoenixValueToAddaxColumn method
[hdfswriter] Fix missing parquet-avro dependency with exclusions in pom.xml

📜 Changes

31d0ee03 [feature][issue-template] Update default version to 5.1.0 and adjust version options in NEW-ISSUE.yml
8eaad4c1 [chore][deps] Bump com.google.protobuf:protobuf-java from 3.25.1 to 3.25.5 to fix CVE-2024-7254
72a60132 [bugfix][lib][rdbms] Fix calculateStringBetween() method to avoid generating backslash characters that lead to invalid SQL conditions. (#1258)
88692178 Merge branch 'master' of github.com:wgzhao/Addax
ca2dee46 [chore][deps] Update some library versions in pom.xml
76903b49 [bugfix][reader][hbase20xsqlreader] Handle null values in convertPhoenixValueToAddaxColumn method
4f06f387 [chore][deps][3rd]: Update poi and databend JDBC driver versions in pom.xml
50bce26e [chore][github][ci] Update Docker actions to latest versions in workflow
69fc89e6 [bugfix][plugin][hdfswriter] Add missing parquet-avro dependency with exclusions in pom.xml
8aa639aa [feature][ci] Add GitHub Actions workflow for building and pushing Docker images
8c27ccda [chore][depends] Fix Authorization Bypass Through User-Controlled Key vulnerability
17826acc [chore][depends] Fix vulnerable to SQL Injection via line comment generation
93d21295 [chore][depends] Fix Parquet Avro Vulnerability to Arbitrary Code Execution
360c98a5 [chore][depends] Update dependency versions in pom.xml for httpcore, joda-time, ognl, influxdbClient, and spotbugs-maven-plugin
a8f467d0 [improve][docker] Simplify Dockerfile by using official Maven and OpenJDK images and add support for Aliyun mirrors
e3477491 [improve][core] update shebang in addax.sh and adjust COPY command in Dockerfile
6a97a9bb [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao about 1 year ago

com.wgzhao.addax:addax-all - 5.1.0

Addax 5.1.0 has released! 🎉

Highlight

1. HDFS Reader Plugin: Complex Data Type Support

Added support for Array and Map data types in ORC and Parquet file formats, enabling seamless read operations for nested and structured data.

2. HDFS Writer Plugin: Expanded Data Compatibility

Enhanced the writer plugin to support Array and Map data types for ORC and Parquet formats, ensuring full compatibility with complex data structures during write operations.

3. Hive Reader Plugin: Complex Data Type Support

Added support for Array and Map data types in ORC and Parquet file formats

4. Optimized Package Size

Streamlined dependencies and removed redundant components, reducing the overall package size by ~40% (from 900MB to 450MB). This improves deployment efficiency and resource utilization.

📜 Changes

[feature][plugin][hivereader] Add support for ARRAY and Map data type in HiveReader
[improve][plugin][hdfswriter] Refactor ORC writer for code clarity
[feature][plugin][hdfsreader] Add support for ARRAY and MAP data types in ORC and Parquet file format (#1240)
[chore][doc] Refine slogan picture
[feature][plugin][hdfswriter] Add support for ARRAY and MAP data type in ORC and Parquet format (#1238)
[improve][plugin][paimonwriter] Add dynamic bucket mode support and optimize write logic
[improve][docs] Update statsreport.md for clarity and add example service interface
[improve][plugin][hdfsreader] Optimize dependencies to reduce package size by 50%
[improve][issue-template] Update default version in NEW-ISSUE.yml to 5.0.0 and add additional version options
[improve][script] Enhance build-module script to support multiple module builds and improve deployment logic
[improve][plugin][hdfswriter] Optimize dependencies to reduce package size by 50%
[improve][lib][rdbms] Refactor update SQL generation for cleaner code and enhanced readability
[bugfix][plugin][oraclewriter] Remove unnecessary Clob and Blob freeing in PreparedStatement handling
[improve][plugin][rdbms] Add case-insensitive column matching for update mode
[chore][plugin][oracle] Bump Oracle JDBC driver from 19.7.0.0 to 21.5.0.0
[improve][plugin][oraclewriter] Enhance CLOB and BLOB handling in PreparedStatement and add NVARCHAR support
[feature][lib][rdbms] Revert to use commons-dbcp2 BasicDataSource for better compatibility
[bugfix][plugin][hivereader] Fix backwards compatibility with older Hive JDBC drivers
[feature][plugin][hivereader] Optimize dependencies with minimal Hive JDBC imports
[bugfix][plugin] update MySQL connector dependency from mysql-connector-java to mysql-connector-j
[improve][core] remove redundant echo statements before executing Addax job
[chore][core] Bump ch.qos.logback:logback-core and logback-classic from 1.3.12 to 1.3.15
[refactor][lib][rdbms] replace BasicDataSource with DruidDataSource and update dependency versions in pom.xml
[improve][core] enhance boolean parsing to accept 'yes' and 'no' strings
[feature][lib][rdbms] implement efficient string split point calculation for primary keys
[improve][lib][rdbms] streamline SQL schema handling and improve readability in GetPrimaryKeyUtil
[feature][plugin][hdfsreader] remove unused Hive dependencies and update exclusions in pom.xml
[refactor][plugin][hdfsreader] remove unused JobConf and update dependency versions in pom.xml
[feature][plugin][accesswriter] add file existence check and creation for MDB file
[chore][plugin][jsonfilereader] use updated json-smart dependency to fix CVE-2023-1370
[feature][plugin][kafkareader] add maxMessageNumber configuration to KafkaReader for limiting message consumption
[refactor][plugin][paimonweriter] update pom.xml to use properties for version management of Paimon dependencies
[refactor][plugin][hivereader] update pom.xml to simplify dependency management and improve version handling
[refactor][core] remove version numbers and exclusions from dependencies in pom.xml
[update][3rd] update dependencies in pom.xml to latest versions
[feature][core] add install_plugins.sh script for plugin installation from Maven Central
[improve][core] update addax.sh to improve error handling and code readability
[chore][docs] update README files to remove lite image references and adjust build instructions
[refactor][core] improved directory structure and module organization (#1224)
[improve][lib][rdbms] update executeQuery method to handle non-result set queries
[bugfix][plugin][doriswriter] add missing MySQL jdbc driver
[maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao about 1 year ago

com.wgzhao.addax:addax-all - 5.0.0

Addax 5.0.0 has released! 🎉

Compatibility Warning ⚠️

Version Compatibility Notice This release contains core class changes and updated database split algorithm. It may not be fully compatible with deployments using versions prior to 5.0.0

📜 Changes

3d1fb4a2 [maven-release-plugin] prepare for next development iteration
31e03098 [maven-release-plugin] prepare release 5.0.0
ca34d4eb [refactor][plugin] add distribution management and new dependencies in pom.xml
87dbe2b1 [chore][build] enhance build-module.sh with improved error handling and user feedback
39afbc55 [refactor][core] merge the common module into core module
c7d42203 [refactor][plugin] standardize packaging declaration in pom.xml files to meet enforce requirement
7caa74c3 [refactor][plugin] meet enforce rule
e421eba5 (origin/combinecorecommon) [refactor][plugin] update pom.xml dependencies and enhance DefaultDataHandler documentation
4e7cf656 [refactor][plugin] update dependencies to provided scope in pom.xml
b7cd6295 [refactor][core] update error code imports to core package
d6a7c292 [refactor][core] merge the module common into core
9c23ec48 [refactor][plugin][ftpreader] Enhance FTP helpers with wildcard support and recursed file listing
534c61e3 [refactor][plugin][hdfswriter] Improve ORC writer with enhanced null handling and schema building
cd8e2c38 [bugfix][plugin][hdfswriter] Correct schema handling in ParquetWriter
ebfd8f01 [feat][plugin][hdfswriter] Enhance ParquetWriter with improved schema generation, error handling
72413599 [chore][doc][theme] Update theme configuration for improved dark/light mode support and remove deprecated main.html
ed5ecdca [chore][plugin][httpreader] Initialize credsProvider in HttpReader for proper authentication handling
815f2f31 [feat][plugin][httpreader] Add support for token-based authentication in HttpReader
674f6020 [chore][common] Enhance AddaxException for improved error handling and message formatting
972afc48 [chore][lib][rdbms] Improve FileHelper class with enhanced logging, error handling, and code readability
51f42863 [chore][lib][rdbms] Simplify compression handling and improve resource management in StorageReaderUtil
5ff12fa5 [feat][lib][rdbms] enhance split key check to handle empty string correctly in CommonRdbmsReader
2404613f [bugfix][lib][rdbms] Handle null string as a valid column value in DataBaseType
4bfa034b [update][docs][README] Enhance star history section with responsive image support
308358e0 [update][ci] Improve changelog generation in maven-publish.yml for better release tracking
b3e47386 [update][github][template] Enhance bug report template with improved instructions and bilingual support
7f806c18 [update][docs] Revise README for improved clarity, structure, and feature highlights
2cbc371e [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao about 1 year ago

com.wgzhao.addax:addax-all - 4.3.0

Addax 4.3.0 has released! 🎉

Compatibility Warning ⚠️

Version Compatibility Notice
This release contains core class changes and updated database split algorithm. It may not be fully compatible with deployments using versions prior to 4.3.0.

Changes

ee063f41 [update][ui] replace the favicon
aa16ee3f [feat][ui][home] Revamp home page with new hero section, feature cards, and improved layout
d0e12e7b [feat][lib][exception] Enhance AddaxException with new methods for illegal and missing configuration values
afef345b [update][docs][README] Add versioning scheme section with Semantic Versioning guidelines
561d3f31 [refactor][lib][rdbms] Remove unused quoteTableName method and clean up original configuration checks
988305da [refactor][lib][rdbms] Simplify dealColumnConf method by removing connection factory dependency
05dc608f [feat][lib][rdbms] Simplify connection handling and improve method consistency
174f88f7 [feat][lib][rdbms] emit warning for potential thread‑safety issues (#1215)
dbc36527 [bugfix][lib][rdbms] incorrect eachTableSplitSize setting while guess primary key
4943c155 [bugfix][core] Fix parsing of JVM configuration in addax.sh by removing unnecessary characters
a245113f [update][3rd] Update dependency versions to updated version
d8789336 [refactor][core] Add relativePath to parent POM for better module resolution
bfdeb22d [refactor][plugin] Improve code readability by simplifying stream operations and enhancing error handling
109a5651 [refactor][plugin] Translate comments and error messages to English for better clarity and remove unnecessary code
952f062a [refactor][plugin] Translate comments and error messages to English for better clarity
65c45549 [refactor][plugin][hbase11xsqlreader] Translate comments to English for better clarity and remove unnecessary code
3c51c772 [refactor][plugin][hbase11xreader] Translate comments and error messages to English for better clarity
5a69ba28 [refactor][plugin][ftpreader] Translate comments to English for better clarity and remove unnecessary comments
01a450a7 [refactor][plugin][elastichsearcreader] Translate comments and error messages to English for better clarity
659bad7c [refactor][plugin][dbfreader] Translate comments to English and improve error messages for clarity
b2c78c64 [refactor][plugin][datareader] Rename mixup function parameters for clarity and update comments in PhoneUtil and StockUtil
8e0b7312 [refactor][plugin][cassandrareader] Translate comments and error messages to English for better clarity
bd0d0163 [refactor][lib][transformer] Translate comments and JavaDocs to English for better clarity
aa539122 [refactor][lib][storage] Translate comments and JavaDocs to English for better clarity
2e84b584 [refactor][lib][rdbms] Translate comments and JavaDocs to English for better clarity
e42c429d [refactor][core] Translate comments and JavaDocs to English for better clarity
4b1b737e [refactor][common] Add more java docs, translate into english
68cb4256 [feat][core] Update JVM settings to use configuration from core.json and apply environment variables
dde59cd8 Merge branch 'master' of github.com:wgzhao/Addax
a230d588 [feat][doc][readme] Update logo SVG files with new design elements and replace PNG references in README
2079035d [feat][plugin][doriswriter] Update batch size to 102400 and add workers property to loadProps
8436d5be [feat][core] Improve formatting of reader and writer plugin JSON output
1b0bf01d [feat][plugin][doriswriter] Change log level from info to debug for batch data joining and stream load completion
4ebd15b3 Merge branch 'master' of github.com:wgzhao/Addax
3a11fdc5 [update][issue-template] Update version options and improve descriptions in NEW-ISSUE.yml
29c88036 [feat][docker] Enhance build process by adding Docker image push commands and optimizing Maven options
3c81d11f [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao about 1 year ago

com.wgzhao.addax:addax-all - 4.2.4

Addax 4.2.4 has released! 🎉

Changes

bfec4b5e [update][plugin][clickhouse] Bump com.clickhouse:clickhouse-jdbc from 0.6.5 to 0.8.1 (#1206)
bcc57b40 [feat][lib][rdbms] Add support for Quoting reversed column names
5c1ee2d9 [feat][lib][rdbms] add exclude column item(excludeItem) for rdbms reader(#1205)
93a92cda [update][plugin][hdfsreader] remove unused parameter in file read methods
fd3d8189 [update][plugin][hdfsreader] Add javadoc
c2ff30cc [update][lib][rdbms] remove unused method: GetPrimaryKeyUtil#getSchema
a3e2a91b [improve][plugin][hdfsreader] ignore hidden directory or file
763010da [update][lib][storage] change the aircompressor scope from compile to runtime
26d65d5d [bugfix][plugin][hdfsreader] fix schema handling logic
9e20147a [update][lib][storage] exclude older commons-io and commons-lang3 deps from commons-compress
abe02fed [update][plugin][hdfswriter] remove unused imports
af3aa654 [improve][plugin][paimonwriter] remove aws hadoop deps to reduce package size
62ea66fe [update][plugin][hdfs] typo fix
17509f71 [update][github] Add enforcer verify while PR triggered
23226fef [update][maven][enforcer] comply with enforcer plugin rules
cca86d72 create svg logo file
e3671496 [update][deps][databendwriter] Bump com.databend:databend-jdbc from 0.3.2 to 0.3.4
9ae3bbef [improve][plugin][rdbmswriter] ignore writeMode if present instead of throw exception
232c9f68 [update][deps] Bump some deps to updated version
4b55145a [update][docs] wrap long lines for better mobile readability
14834c02 [update][plugin][s3writer] minor code style improve
dc107649 [feat][lib][rdbms] set login timeout value for hive jdbc
00d2f8ca [update][github] use MAVEN_OPTS env variable to set mvn compile behavior
0e2d49a1 [bugfix][plugin][rdbms] isolate database driver configurations using separate enum instances
fc58d3ee [bugfix][plugin][paimonwriter] write timestamp_ntz data error (#1198)
97a21d5a [update][docs] improve grammer
f8c5bf81 [feat][docs] Add landing page (#1197)
a5197aee [update][github][action] Bump actions/setup-java from 4.6.0 to 4.7.0 (#1196)
2afd64f6 [add][plugin][hdfs] Add hdfsSitePath option to specify hdfs-site.xml path
28925657 [update] Add module description
de79f0e5 [update][plugin][sybasewriter] download sybase jdbc driver from maven repo instead of local
376f9b2d [update][plugin][sybasereader] download sybase jdbc driver from maven repo instead of local
04c8f87b [update][core] remove legacy OSSRH setting
7a86838f [update][core] get the gpg private password from env instead of prompt
1168b446 [update][plugin][oraclereader] download sdoapi from maven repo instead of local
3c51d05a [feat] Migration of Accounts from ossrh to maven central repository
9c1af4dc [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao over 1 year ago

com.wgzhao.addax:addax-all - 4.2.3

Addax 4.2.3 has released! 🎉

Changes

88e4900c [update][plugin][paimonwriter] format to meet code style 4fdc864a [update][docs] Add paimonwriter.json to for paimonwriter plugin doc (#1194) 032352f1 [update][docs] Add Paimon logo bda5e2df [add][plugin][paimonwriter] Add support for writing files in Paimon format 1c2ab7da [improve][core] print more detail error message 903ac584 [improve][plugin][datareader] capture IndexOutOfBoundsException b8d6e292 [update][github] Bump actions/setup-java from 4.4.0 to 4.6.0 (#1191) d42aec35 [bugfix][plugin][doriswriter] Fix memory overflow causing task process to block 50440b9f [feature][plugin][s3writer] add pathStyleAccessEnabled config (#1186) 93c1938a [bugfix][plugin][rdbmsreader]rdbmsreader jdbc_url is string not list (#1185) be7dcced [bugfix][lib][rdbms] Fix issue that column names containing 'update' are replaced

- Java
Published by wgzhao over 1 year ago

com.wgzhao.addax:addax-all - 4.2.2

Addax 4.2.2 has released! 🎉

Changes

b19cba69 [enhancement][core][rdbms] Introduce console.enabled property to control console logging 9b7fd3e3 [bugfix][lib][rdbms] Append jdbc suffix before invoking validJbdcUrl 14743311 [update][common] move OverFlowUtil from element package to util package 4ac6e376 [update][lib][rdbms] Use '+' for simple string concatenation instead of String.format 0cd43a0f [update][core] Remove ExceptionTracker.java 4120791e [bugfix][plugin][kudu] Fix the timezone issue when writing and reading timestamp type data. (#1177) e99ce1ca [improve][core] try-catch is only used for code that needs to catch exceptions, not for the entire code block. aaba2b14 [update][core] Remove unused codes 42bbf2b8 [improve][plugin][starrockswriter] Replace Thread.sleep by TimeUnit.sleep to avoid busy-waiting 4be0d47d [update][plugin][hdfsreader] use try-with-resources statement fbe2f40e [update][plugin][hbase20xsqlreader] Remove redundant initializer fe7e2b26 [update][plugin][hbase20xreader] Remove redundant initializer b33492b2 [update][plugin][hbase11xreader] Remove redundant initializer dec3e510 [update][plugin][tdenginereader] Add isPresent() check for Optional.get() method 00eded81 [update][plugin][esreader] Simplify condition judge 373febe0 [update][plugin][hbase11xreader] Remove the condition of always true 0251c44f [update][common] Remove the condition of always false 22687d43 [update][plugin][tdenginereader] Take the default switch to the last case a6050c7f [improve][modules] code cleanup f1e637b2 [update][core] Optimize code for better performance and readability 3e1e2106 [update][doc] Add description for item ignoreError 9370284d [update][plugin] Refactor: take the shell execute into a single common util class 69c1c462 [feature][plugin][hdfswriter] Add new item preShell and postShell (#1175) 44428894 [update][script] migrate docker image from docker.io to quay.io

- Java
Published by wgzhao over 1 year ago

com.wgzhao.addax:addax-all - 4.2.1

Addax 4.2.1 has released! 🎉

Changes

3e54c093 [update][script] Add module build option b2a75a4f [update][plugin][hdfsreader] Refactor: extract orc file reader logic into separator class 2d73b23e [update][plugin][hdfsreader] Refactor: extract file type judge logical into separate class 738fc234 [update][plugin][hdfsreader] Refactor: extract Parquet handling logic into separate class 87bddc62 [bugfix][plugin][hdfsreader] Fix exception when reading an optional fields with null values in Parquet files 2ad2a5b7 [update][plugin][txtfilewriter] Improve handling of file suffixes f825a495 [update][plugin][kudureader] Remove duplicate key definition 160d86e4 [update][core] Enhance statistical output for better readability 37852c29 [update][common] Refactor code 8f0eb495 [bugfix][lib][rdbms] Fix missing where keyword in generated split SQL for spliting table ca62f8d7 [update][lib][rdbms] Refactor primary key types to use enum class 2c6fbf37 [update][plugin][doriswriter] code improvements f31dea1d [update][action] Modify changelog output cb5e75f7 [update][core] Minor code change 7d45b9ee [update][plugin][streamwriter] Refactor code to enhance readability and efficiency 2b674cb1 [update][lib][storage] Simplify a few functions logic b65b4b3c [update][plugin][datareader] Replace deprecated methods 83366e5a [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao over 1 year ago

com.wgzhao.addax:addax-all - 4.2.0

Addax 4.2.0 has released! 🎉

Compatibility Break Release Note for Version 4.2.0

This release note outlines the changes introduced in Version 4.2.0 that may affect compatibility with previous versions. Please review these changes carefully to ensure a smooth transition.

The plugins before 4.2.0 can not used in the 4.2.0 because of the major changes in the plugin framework

Changes

40dad252 [maven-release-plugin] prepare release 4.2.0 e5f045ce [update][action] Fix variable definition cb47451c [update][docs] Update json layout for new version requirements 0ae24210 [feature][lib][rdbms] Add experimental support for DDL statement 04ee37cd [update][lib][rdbms] Remove unused function parameters and improve code readability 33342464 [bugfix][lib][rdbms] Fix NullPointerException when password is not set bcf76c98 [update][plugin][redisreader] Refactor connection.uri to use a list instead of a string ea35daec [bugfix][plugin][redisreader] Fix missing configuration for standalone mode e6812804 [update][lib][rdbms] Refactor writer.parameter.connection to use a map instead of a list e26003ed [update][plugin][excelwriter] Simplify dependencies, add missing log4j-core deps 4ea03b36 [update][plugin][redisreader] Refactor connection item from list to string e9cdef50 [update][reader][rdbmsreader] Refactor connection item from list to string 8ef27e91 [update][reader][mongodbreader] Refactor connection item from list to string 283f1b98 [update][plugin][influxdb2reader] Remove unused HTTPComponents dependencies b9faed61 [update][plugin][influxdbreader] Migrate Apache HttpComponents from 4.x to 5.x 77a1fd72 [improve][core] Fallback to Addax engine for downloads when curl is unavailable 28baad91 [bugfix][script] fix incorrect module path 2705b0e6 [update][dep] Bump commons-codec:commons-codec from 1.15 to 1.17.1 09ab6d6a [update][reader][redisreader] Migrate Apache HttpComponents from 4.x to 5.x febf6bda [update][workflow] Adjust maven compile options 47f7f760 [update][plugin][starrockswriter] Switch to HttpComponents 4.x due to incompatibility with Starrocks backend 3205a1d7 [update][plugin][clickhousewriter] Remove unused HTTPComponents dependencies fada373f [update][plugin][doriswriter] Switch to HttpComponents 4.x due to incompatibility with Doris backend 1e84fbb4 [update][core] Migrate Apache HttpComponents from 4.x to 5.x 4abc3868 [update][plugin][databendwriter] Remove unused HTTPComponents dependencies ef2a8676 [update][plugin][httpreader] Migrate Apache HttpComponents from 4.x to 5.x c088d946 [update][action] Fix maven options bd269f83 [update][dep] Bump some dependencies to latest version 87dc6f98 [update][action] Bump maven from 3.5.4 to 3.8.8 d3dd5e5d [update][reader][hbase20xsql] Use common split function b8455b86 Merge branch 'master' of github.com:wgzhao/Addax 1c7e162e [update][lib][rdbms] Delete RdbmsRangeSplitWrap class, it's not used no longer 0db4dda9 [update][dep] Bump actions/setup-java from 4.3.0 to 4.4.0 (#1143) da9150eb [update][dep] Bump some dependencies to latest version 92a47bea [update][script] Add support for remote deployment using 79428311 [improve][lib][rdbms] Refactor table split strategy (#1145) 291fd697 [update][lib][rdbms] It should split the table even when the is set to 1. e7a07749 [improve][plugin][clickhousewriter] Optimize Codebase: Update JDBC Driver and Enhance HTTP Connections 0750c8b9 [bugfix][plugin][kafkareader] Resolve the issue of consumed data not being output by invoking the flush method d057a054 [feature][plugin][jsonreader] Add support for multiline json file (#1140) d6e586c0 Refactor ftpreader (#1139) 0822901d [update][scripts] Skip Java source and Java doc compile for building module 498a1f73 [update][plugin][excelreader] Minor code change 78c23e24 [update][dep] Bump org.apache.commons-io from 2.15.1 to 2.16.1 6479634d [update][core] Correct the dbf plugin name for the demo files. 9a937eaa [update][lib][storage] Removed the unused method . 62b0627c [update][plugin][txtfilewriter] Made minor code changes and removed unused code. 7aa16da7 [improve][plugin][txtfilereader] Cancel the subsequent tasks if the list of files to read is empty. 18de5117 Refactor wildcard file handling using Paths and Files classes (#1133) 4eef1240 Refactor errorcode (#1132) a891423d [update][plugin][hivereader] Simplify the exception handling to reduce complexity. c7bc7ef1 [improve][plugin][s3writer] Improve performance by refactoring code 1a90bf48 [improve][plugin][s3reader] Improve performance by refactor codes ecd236d7 [update][readme] Add missing databend logo 93b63e54 [improve][plugin][databendwriter] Handle binary / blob types as strings to avoid error a07018c1 [update][dep] Bump com.databend:databend-jdbc from 0.1.2 to 0.3.2 4f300ef4 [update][dep] Bump org.apache.commons:commons-configuration2 from 2.9.0 to 2.11.0 (#1129) 43a50eff [update][dep] Bump fastjson2.version from 2.0.50 to 2.0.52 (#1115) 1d65bafa [update][github][action] Generate dynamic changelog using git log 0d3ceb0c [update][dep] Bump com.github.luben:zstd-jni from 1.5.5-11 to 1.5.6-5 (#1118) 4746b55b [update][dep] Bump commons-cli:commons-cli from 1.6.0 to 1.9.0 (#1120) 6147e168 [update][dep] Bump org.apache.commons:commons-rng-simple from 1.5 to 1.6 (#1121) bfd2903b [update][docker] Use label to replace deprecated maintainer aa080ba4 [update][github][action] Bump maven version from 3.6.3 to 3.8.8 282dbead [update][github][action] migrate deprecating set-output commands fa1e8ea1 [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao over 1 year ago

com.wgzhao.addax:addax-all - 4.1.8

Addax 4.1.8 has released! ㊗️

changelog

8d38bdaf [improve][lib][rdbms] Handle unknown or unsupported types as strings to improve support for various data types ceefb94f [improve][plugin][hdfsreader] Handle data type mismatch by converting to string when expected type is not met 216b08d6 [improve][plugin][hdfsreader] Add support for float data type 33dae275 [improve][plugin][hdfswriter] Enhance handling of time-relative data types b8a97256 [improve][plugin][hdfswriter] Refine timestamp data type handling in Parquet and ORC file formats 950701f5 [bugfix][lib][rdbms] fix incorrect jdbc path 53767a48 [bugfix][core] fix NPE when doest not exists 127f998f [bugfix][core] use conf instead content to valid path 696f0e4b [improve][core] Improved JSON structure for job content and connection parameters (#1125) e44d1cfb [bugfix][plugin][hdfswriter] fix incorrect parquet decimal value display when value scale differs from column definition 56b0414c [improve][plugin][hdfswriter] add check for writable permissions on HDFS path before writing

- Java
Published by wgzhao over 1 year ago

com.wgzhao.addax:addax-all - 4.1.7

Addax 4.1.7 has released! ㊗️

changelog

558b7091 [bugfix][plugin][hdfswriter] Fix NullPointerException when writing Parquet file with null decimal field value 629d6dc3 [update][core] create basic addax layout while first building module bc1f3269 Merge branch 'master' of github.com:wgzhao/addax e0933898 [improve][plugin][hdfswriter] enhance the output for geater clarity dacd3b63 [update][dep] Bump com.alibaba:druid from 1.2.20 to 1.2.23 (#1108) 787a9c2f [update][dep] Bump org.apache.maven.plugins:maven-source-plugin from 3.3.0 to 3.3.1 (#1101) 07aa4146 [improve][plugin][hdfswriter] Refactor HdfsHelper: Extract file type writer methods into separate classes 4923ad9b [bugfix][plugin][hdfswriter] Fix NullPointerException when writing Parquet file with null string field value 9be92e9d [update][core] improve the usage help 19f7e1a1 [update][plugin][ftpwriter] Replace jsch with com.github.mwiede to fix invalid private key issue 3fb32457 [feature][plugin][ftpreader] Add public key authentication support for sftp be6cef65 [plugin][ftpreader] Replace jsch with com.github.mwiede to fix invalid private key issue c1381401 [update][plugins] update json templates 02c714a7 [update][dep] Remove error-prone compiler plugin due to lack of JDK 8 support 0723c071 [update][dep] Bump com.fasterxml.woodstox:woodstox-core from 6.5.1 to 7.0.0 (#1088) 34f38297 [update][dep] Bump org.apache.maven.plugins:maven-dependency-plugin from 3.6.1 to 3.8.0 (#1098) eddf5e02 [update][docs] Correct inaccurate description of the column field for kudu writer efb17247 [update][docker] Add y param to impilicate archive the target 012a5711 [update][docker] remove custom maven settings ff25da8c [update][dep] Bump org.apache.maven.plugins:maven-enforcer-plugin from 3.4.1 to 3.5.0 (#1091) a736fa81 [update][dep] Bump commons-net:commons-net from 3.10.0 to 3.11.1 (#1093) 9176bcb8 [update][docs] improve the document 69bb958f [update][docs] improve the document f7bc24cd [bugfix][plugin][oraclewriter] Fix closed connection exception caused by update a blob field, fix #1092 89a1834a [bugfix][common] Add missing param for split function 18d65623 [update][docs] change lite docker image to latest 5c7692d0 [update][action] update the release version for issue template

- Java
Published by wgzhao over 1 year ago

com.wgzhao.addax:addax-all - 4.1.6

Addax 4.1.6 has released!

changelog

99fe3048 [update][dep] Bump com.sap.cloud.db.jdbc:ngdbc from 2.20.17 to 2.21.11 (#1084) c01e3170 [update][dep] Bump org.sonatype.plugins:nexus-staging-maven-plugin (#1083) fb7b1f01 [update][core] Add a simplier batch process script to invoke addax in windows 6b65414d [bugfix][plugin][rdbmswriter] Fix incorrect package name 3966b367 Create CITATION.cff 50cc09c7 [update][dep] Bump org.tukaani:xz from 1.9 to 1.10 (#1077) 025eac4f [update][dep] Bump com.github.albfernandez:javadbf from 1.14.0 to 1.14.1 (#1074) 3a58b477 [update][dep] Bump poi.version from 5.2.5 to 5.3.0 (#1075) 6b67552e [docs][improve] convert starrocks logo to svg f10eba18 Merge branch 'master' of github.com:wgzhao/addax 4ebe019e [improve][lib][rdbms] improve the split strategy, fix #1072 27782def [improve][docs] adjust logos color for dark theme 14434fec [improve][docs] Enhancing readability through emoji use fa6bc435 [bugfix][plugin][influxdbreader] Fix incorrect package path, fix #1071 3b1b43ac [improve][docs] remove logos background 405b049a [update][github][action]Bump actions/setup-java from 4.2.1 to 4.2.2 (#1067) d3c694a1 [bugfix][plugin][oraclewriter] Fix ora-03106 while updating clob column, fix #1030 821bc0e0 Bump com.google.code.gson:gson from 2.10.1 to 2.11.0 (#1046) 145d131c [update][doc] Add documentation build/publish guide 9cb12ca7 [maven-release-plugin] prepare for next development iteration

- Java
Published by wgzhao almost 2 years ago

com.wgzhao.addax:addax-all - 4.1.5

Addax 4.1.5 has released!

changelog

e42ab571 (origin/master, origin/HEAD) Bump fastjson2.version from 2.0.43 to 2.0.50 (#1045) e36708f9 [improve][plugin][hdfsreader] Refactor parquet reading method to support timestamp data type 27c57616 [improve][core] improve exception print 81801c03 [update][core] remove commons-logging 4d20cbd6 Merge remote-tracking branch 'origin/master' 6c7ea463 [update][core] remove commons-logging 0c53159d Bump org.apache.maven.plugins:maven-gpg-plugin from 3.1.0 to 3.2.4 (#1043) 07791e7f (origin/removecommonslogging) [update][core] Add build module script for develop 1305d14d Bump org.codehaus.plexus:plexus-compiler-javac-errorprone (#1019) 14f917d6 Bump org.junit.jupiter:junit-jupiter-api from 5.10.1 to 5.10.2 (#1014) 9f0dcede Bump com.sap.cloud.db.jdbc:ngdbc from 2.19.11 to 2.20.17 (#1028) 5e258a7a Bump org.influxdb:influxdb-java from 2.23 to 2.24 (#989) ecee5357 Bump com.moilioncircle:redis-replicator from 3.8.0 to 3.8.1 (#981) 1f2703c3 Bump softprops/action-gh-release from 1 to 2 (#1018) 33cc436f Bump actions/setup-java from 4.0.0 to 4.2.1 (#1024) 11e1ccfa Improve exception print (#1038) 8e452e4e [improve][core] disable mongodb drive monitor mass log a13cfa59 [bugfix][reader][mongodb] read timeout with replica cluster (#1037) 48970209 [update][writer][oracle] Remove unused method 143e1072 [bugfix][writer][oracle] Fix ORA-01461 With MERGE INTO Statement And Clob Column #1030 4650d3d8 [update][plugin] Bump databend jdbc from 0.1.4 to 0.1.9 b2920421 [bugfix][lib][storage] Fix skip header logic in StorageReaderUtil.java 9c1503a4 Add ExitOnOutOfMemoryError to return 3 instead of 0 when oom occurred b45a7ea4 Bump org.codehaus.plexus:plexus-compiler-javac from 2.8.8 to 2.14.2 (#991) c00c877d Bump stCarolas/setup-maven from 4 to 5 (#1010) 3d7a453c Bump com.jayway.jsonpath:json-path in /plugin/reader/jsonfilereader (#1002) bbb6b0e8 [improve][writer][doris] improve code, reduce standard log output c41c7653 [improve][writer][doris] Refactor Doris writer plugin (#1007) 02944a8e [update][reader][jsonfile] Bump json-path from 2.8.0 to 2.9.0 8d5dfb82 [improve][reader][http] remove unused variable. 1ca5afb4 [improve][reader][hdfs] remove unused variable. 2cd981aa [improve][writer][tdengine] remove unused variable. a9f5b5ad [improve][writer][elasticsearch] remove unused variable. 114fb7f4 [improve][reader][elasticsearch] remove unused variable. f7119b3d [improve][writer][clickhouse] remove unused variable. 40c9ed9d [bugfix][core] remove redundant initializer for maxLogNum variable fa2b95de [bugfix][writer][starRocks] remove the condition which is always true 3b7f919f [improve][writer][elasticsearch] use StringBuilder to replace string concat fa63fb8a [improve][reader][cassandra] add element type for container class a981417d [improve][writer][starRocks] use lambda to replace Anonymous function 442e97a6 [bugfix][writer][starRocks] fix some bugs d6fca012 [update][common] Add build script for docker images

- Java
Published by wgzhao almost 2 years ago

com.wgzhao.addax:addax-all - 4.1.4

Addax 4.1.4 has released!

Changelog

be765d1e [improve][reader][tdengine] Use primitive type instead of wrapper type 361aa4ce (origin/master, origin/HEAD) [improve][common] improve EncryptUtil class a852982e [bugfix][common] Fixed Tag mismatch exception 70995c38 Bump github/codeql-action from 2 to 3 (#985) 7844518f [bugfix][lib][storage] Fix dateFormat is invalid when data type is timestamp d165f76d [improve][plugin][datareader] Add support for generating email address (#983) 97e4c0b6 [update][3rd] Bump multiple 3rd-party deps to updated version 00c53554 [update][core] Remove ununsed import c0889a91 [update][docs] Add SAP HANA logo bdd51e86 [update][docs] Add hana guide 603322da [add][plugin] Add support for SAP HANA database (#977) 7e5dcc4f [update][plugin][mongowriter] Replace deprecated MongoClient method 5cfae663 [update][plugin][esreader] Remove deprecated JsonParser#JsonParser method 4f1ca9c0 [update][plugin][influxdbreader] Remove unused InfluxDBReaderTask#post method d72fa75f [update][plugins] Remove unused import or variables 23fd22dd [update][plugin] Remove unused logger instance 4de07436 [update][rdbms] Remove unused PerfTrace d0e3e230 [improve][plugin][streamreader] Remove deprecated RandomUtils class e5161fdb [improve][plugin][datareader] Remove deprecated RandomUtils class a72b0b3c [improve][common] Remove unused import to TimestampColumn class 0dda008a [bugfix][plugin][sqlitereader] Fix incorrect package name 5372e9c2 [update][3rd] Bump multiple 3rd-party deps to updated version 1ccd78f2 [update][3rd] Bump multiple 3rd-party deps to updated version e499017d [update][3rd] Bump ch.qos.logback from 1.3.11 to 1.3.12 75e34384 Bump actions/setup-java from 3.13.0 to 4.0.0 (#968) b5d4ad84 Bump org.fusesource.jansi:jansi from 2.4.0 to 2.4.1 (#967) 04a46195 [update][3rd] Bump multiple 3rd-party deps to updated version 34340206 [update][doc][difference] Add access reader and writer plugin 797bcbd2 [update][doc][readme] improve ad3c50d9 [update][3rd] Bump multiple 3rd-party deps to updated version b6c95a02 [update][doc][readme] Add star history chart 8af30ada [update][3rd] Bump multiple 3rd-party deps to updated version 9963d369 [update][github] update action template

- Java
Published by wgzhao over 2 years ago

com.wgzhao.addax:addax-all - 4.1.3

Addax 4.1.3 has released!

Changelog

General

[Add][plugin][reader] Add support for Access Database (#931)
[Add][plugin][writer] Add support for Access Database (#932)
[improve][plugin][txtfilewriter] convert the log to english (#933)
[add][plugin][txtfilewriter] Add support for writing to a file using SQL statements (#934)
[update][plugin][databendwriter]Refactor databendwriter with jdbc, support replace mode (#864)
[improve][docs] improve docs (#941)
[improve][plugin][doriswriter] improve column delimiter parser (#947)

- Java
Published by wgzhao over 2 years ago

com.wgzhao.addax:addax-all - 4.1.2

Addax 4.1.2 has released!

General

[bug][doris-writer]Fix "Endpoint must be set" exception (#908)
[improve][doris-writer] Code refactor (#909)
[bugfix][hivereader] Add missing 3rd deps (#919)
[bugfix][hive-reader] HiveBaseResultSet#getTimestamp method does not support pass Calendar (#920)
[improve][hive-reader] Add support for CDH 6.2.1 (#922)
[improve][docs] correct the description for speed.channel (#927)

- Java
Published by wgzhao over 2 years ago

com.wgzhao.addax:addax-all - 4.1.1

Addax 4.1.1 has released!

General

By unifying the versions of all dependent libraries, the size of software packages has been greatly reduced to 32%!
Add Support for Sybase Anywhere (#825)
Bump guava from 29.0-jre to 31.0-jre (#826)
Migrate groupId com.alibaba to com.alibaba.fastjson2 (#827)
Add reader plugin for Databend (#829)
Load plugin configuration directly by plugin name (#834)

Reader plugins

http reader

[feat]Add support for pagination with http reader plugin #842

- Java
Published by wgzhao almost 3 years ago

com.wgzhao.addax:addax-all - 4.1.0

Addax 4.1.0 has released!

WARN

This version breaks backward compatibility, so it is incompatible with version 4.0.x.

General

Simply core and common modules (#809)
Bump third-party libraries to latest versions
Move the upload statistics from invokes to the logStatistics method (#811
Improve log info (#816) ## Reader plugins

sqlserver reader

Improve guess primary keys (#810)

- Java
Published by wgzhao about 3 years ago

com.wgzhao.addax:addax-all - 4.0.12

Addax 4.0.12 has released!

General

Support Databend writter (#717)
A bunch of 3rd dependencies has upgrade

Reader plugins

cassandra reader

Add support for COUNTER type

elasticsearch reader

Add support for specified column (#673）

sqlserver reader

Add session support for SQL Server (#724)

Writer plugins

sqlserver writer

Add session support for SQL Server (#724)

- Java
Published by wgzhao about 3 years ago

com.wgzhao.addax:addax-all - 4.0.11

Addax 4.0.11 has released!

General

Support Databend writter (#717)

Reader plugins

elasticsearch reader

Add support for specified column (#673）

- Java
Published by wgzhao over 3 years ago

com.wgzhao.addax:addax-all - 4.0.10

Addax 4.0.10 has released!

General

Bump to fastjson2 to improve performance (#600)
Add support for S3 Reader (#613)
Add support for S3 Writer (#615)
Add support for Kafka reader (#665)

Reader plugins

hdfs reader

Fix Failed to specify server's Kerberos principal name (#633)

sqlserver reader

Fix table not found when table or columns include common(,) (#631)

elasticsearch writer

Fix NPE occurred when read null array type value #611 (#614)

hdfs writer

Fix incorrect orc schema for date type (#632)
Fix Failed to specify server's Kerberos principal name (#633)
Add support for HDFS Trash (#658)

- Java
Published by wgzhao over 3 years ago

com.wgzhao.addax:addax-all - 4.0.9

Addax 4.0.9 has released!

General

Remove trino dependencies (#523)
Add kafka writer plugin (#532)
Allow use encrypted password string instead plain text password (#533)
Add starrocks writer plugin (#578)

tdengine reader

Refactor code references official repo (#536)

Writer plugins

hdfs writer

Fix missing decimal scale when decimal scale greater than 10 (#509)

sqlserver writer

- Add support for merge into statement (#513)

tdengine writer

Refactor tdenginewriter plugin references offical codes (#535)

- Java
Published by wgzhao almost 4 years ago

com.wgzhao.addax:addax-all - 4.0.8

Addax 4.0.8 has released!

General

Unify the versions of third-party packages to reduce the size of the installation package (#461)
Optimize storage module (#463)
Fix cast bigint to long error (#490)

Reader plugins

hdfs reader

optimize code (#466)

Writer plugins

clickhouse writer

Using offical recommended stream writing method to get performs the best (#500)

hdfs writer

code optimize (#465)
Fix incorrect store value when use date type with orc file (#489)

- Java
Published by wgzhao over 4 years ago

com.wgzhao.addax:addax-all - 4.0.7

Addax 4.0.7 has released!

General

Add installation script (#442)
When multiple unique indexes exist, the unique index of the numeric type is automatically selected as the split key (#449)
[addax-storage] Add support for reading lzop compress file (0d955e09a7aec)

Reader plugins

data reader

Add support for generate a uuid string (64767b752558b7d)

http reader

Fix NullPoint Exception occurred when no proxy setting (#428)
Add support for nest path expression (#429)

redis reader

Add supporting sentinel model for RedisReader plugin (#444)

Writer plugins

doris writer

merge office doriswriter codes (#448)

kudu writer

Simplify kuduwriter plugin configuration item column (#447)

stream writer

Add support for custom null format, defualt is "NULL" (#430)

- Java
Published by wgzhao over 4 years ago

com.wgzhao.addax:addax-all - 4.0.6

Addax 4.0.6 has released!

General

Add HiveReader plugin (#395)
Add InfluxDB2Reader plugin for InfluxDB 2 or later (#398)
Add InfluxDB2Writer plugin for InfluxDB 2 or later (#398)
More checks on job files and more detailed error messages (#403)
remove duplicated output message (#406)
Improve json template content (#409)
command line add support for generate job file (#411)
Fix getValidColumnIndex Exception (#412, #404)

Reader plugins

hdfs reader

Bump parquet-avro from 1.12.0 to 1.12.2 (#383)

hive reader

Bump hive-jdbc from 3.1.0 to 3.1.2 (#397)

mongodb reader

Keep the same conventions in job file (#415)

rdbms reader

Fix incorrect jdbc driver class when specify driver item (#393)

Writer plugins

hdfs writer

Bump parquet-avro from 1.12.0 to 1.12.2 (#383)

mongodb writer

Keep the same conventions in job file (#419)

postgresql writer

Fix incorrect result when set value to bit(n) field ( a87a661 )

rdbms writer

Fix incorrect jdbc driver class when specify driver item (#394)

- Java
Published by wgzhao over 4 years ago

com.wgzhao.addax:addax-all -

WARNING⚠️: This release has a potentially serious bug, DO NOT use this release in a production environment

警告⚠️：该版本存在潜在的严重缺陷，请勿在生产环境使用

Addax 4.0.5 has released!

General

Add TIMESTAMP data type to support microsecond and nanosecond (a.k.a timestamp(p)) (#371)
Refactor CommonRdbmsReader and CommonRdbmsWriter (#390)

Reader Plugins

ftp reader

Fix IOException when read a large zip/gzip file (#384)

Writer Plugins

ftp writer

Fix incorrect result when write a zip/gzip file (#385)

hdfs writer

Fix NullPointerException when inserting a null value #374 (#375)

The sha256sum of the addax-4.0.5.tar.gz file is 92e38612e6be4fe2c07dcb9100bfab05a24b20d357afa16f205aba5b5a5eb528

- Java
Published by wgzhao over 4 years ago

com.wgzhao.addax:addax-all -

Addax 4.0.4 has released!

General

Add how to debug guide dc3973d
Add Excel Reader plugin (#346)
Add Excel Writer plugin (#350)
Bump logback.version from 1.2.5 to 1.2.6 (#349)
Fix incorrect result when set value with SQLite date type (#354)
Fix NullPoint exception occurred when reading a null column (#353)
Bump junit-jupiter-api from 5.7.2 to 5.8.0 (#352)

Reader plugins

data reader

Add datareader package to project's target folder (#321)

dbf reader

Bump javadbf from 1.13.1 to 1.13.2 (#323)

rdbms reader

Fix load JDBC driver failure (#334)

redis reader

Bump jedis from 3.6.3 to 3.7.0 (#328)

sqlite reader

Bump sqlite-jdbc from 3.36.0.2 to 3.36.0.3 (#324)

writer plugins

dbf writer

Bump javadbf from 1.13.1 to 1.13.2 (#323)

greenplum writer

Fix ClassCastException in CopyWorker#call (#325)
Optimize write performance (#331)

rdbms writer

Fix load JDBC driver failure (#334)

redis writer

Bump jedis from 3.6.3 to 3.7.0 (#328)

sqlite writer

Bump sqlite-jdbc from 3.36.0.2 to 3.36.0.3 (#324)

The sha256sum of the addax-4.0.4.tar.gz file is 67b94386726c96e85b0441fc592b78af6e7537f9764f76d4957b83cd8ca5ce5b

- Java
Published by wgzhao over 4 years ago

com.wgzhao.addax:addax-all -

Addax 4.0.3 has released!

Download

You can download pre-compiled binary files from Addax-4.0.3 if you are in Chinese mainland, otherwise
Download from the following attachment addax-4.0.3.tar.gz

md5sum: 19766c2577b46bd5b22d63a502f5f5dd

Note: Because Aliyun drive does not support the sharing of compressed files currently, So, I add a .jpg suffix for each binary file, you need to remove this suffix before you can use the

Release notes

General

Add datareader plugin, generate data to meet specified rule requirements for populating data in development and testing (#291)
Introduce new sqlitereader plugin (#305)
Introduce a new sqlitewriter plugin (#306)
Optimize compress type process (#318)

Reader plugins

dbffile reader

Rename to dbfreader 40d0d51

ftp reader

Fix read failure when using gzip -c to compress multiple files (#316 )

kudu reader

Allow specify columns instead of all columns (#297 #295 #252)
Add support for configuring where to set more filters (#298)

sqlite reader

Bump sqlite-jdbc from 3.36.0.1 to 3.36.0.2 (#311)

stream reader

Allow specify scale when configure a random double (#288)

txtfile reader

Fix read failure when using gzip -c to compress multiple files (#316 )

Writer plugins

dbffile writer

Rename to dbfwriter c6adb3f

kudu writer

Fixed data lost without flushing cache, thanks @niexiongchao (#294)

sqlite writer

Bump sqlite-jdbc from 3.36.0.1 to 3.36.0.2 (#311)

- Java
Published by wgzhao almost 5 years ago

com.wgzhao.addax:addax-all -

4.0.2 has released!

download

You can download pre-compiled binary files from Addax-4.0.2 if you are in Chinese mainland, otherwise
Download from addax-4.0.2.tar.gz

md5sum: cd3a3d6d0c79cbd3bcd259ebb47acbc5

Note: Because Aliyun drive does not support the sharing of compressed files currently, So, I add a .jpg suffix for each binary file, you need to remove this suffix before you can use them

Release notes

General

Add shrink package size script (#262)
Add support for docker #265
Update doc: Add JDBC-RESTful driver guide for TDengine database e847736e8f
Add support for writing a zip-compressed file (#282)

Reader plugins

hbase11xsql reader

Change dependencies for reduce the size by half a1d548ce

tdengine reader

Bump taos-jdbcdriver from 2.0.32 to 2.0.33 (#261)
Fix null pointer exception when not setting fetchSize item (#270)

Writer plugins

ftp writer

Add support for zip compression format (#282)
Add support for user authentication with public key (#283)

tdengine writer

Bump taos-jdbcdriver from 2.0.32 to 2.0.33 (#261)
Fix incorrect columnIndex (#272 , #277)

txtfile writer

Add support for zip compression format (#282)

It has 3 attachements

Source code (zip)
Source code (tar.gz)
addax-4.0.2.tar.gz (pre-compiled binary package)

- Java
Published by wgzhao almost 5 years ago

com.wgzhao.addax:addax-all -

4.0.1 has released!

The updated version 4.0.1 has relased

download

You can download pre-compiled binary files from Addax-4.0.1

Note: Because Aliyun drive does not support the sharing of compressed files currently, So, I add a .jpg suffix for each binary file, you need to remove this suffix before you can use them

Release notes

General

The program run script is changed to addax.sh to remove the dependency on Python (#253)
Strip part of the methods of the StorageReaderUtil class as a separate class, which has reduced the dependency of other plugins on plugin-storage-util (#227)
addax.py remove unused options, remove --mode, --jobid, --reader, --writer
Bump commons-compress from 1.20 to 1.21 (#232)
Change project structure (#234)
Bump commons-io from 2.10.0 to 2.11.0 (#236)
Extract the configuration items and default values used by each plugin into a common class to reduce redundant code (#239)
Bump logback.version from 1.2.3 to 1.2.4 (#243)
Bump slf4j-api from 1.7.31 to 1.7.32 (#246)
Fixed some typos (#250)

Reader plugins

dbf file reader

Fixed missing 3rd dependency jars ( #225)
Fixed null pointer exception when reading null value ( #229 )
Add support for wildcard to column item (#235)

hbase11xsql reader

Fix the problem that connecting hbase fails when kerberos is enabled (#241)

mongodb reader

Bump mongo-java-driver from 3.12.8 to 3.12.9 (#238)

redis reader

Bump redis-replicator from 3.5.4 to 3.5.5 (#221)
Bump jedis from 3.6.2 to 3.6.3 (#247)

stream reader

Add support for self-increment of time data type (#237)

textfile reader

Add support for get column by name to txtfilereader plugin (#251, #254) ## Writer plugins

hbase11x writer

Add support for login with kerberos (#245)

hbase11xsql writer

Improve the performance of writing (#242)

hbase20xsql writer

Add support for kerberos authentication and phoenix thick connection mode (#248)

mongodb writer

Bump mongo-java-driver from 3.12.8 to 3.12.9 (#238)

redis writer

Bump jedis from 3.6.2 to 3.6.3 (#247)

- Java
Published by wgzhao almost 5 years ago

com.wgzhao.addax:addax-all - 4.0.0

This is the first release under the new brand name

Highlights

HDFS reader plugin supports reading of binary data type
HDFS writer plugin supports writing of binary data type
Rewritten the implementation of ORC and PARQUET for more efficient execution
Rewrite the string type field splitting method using the database's own functions
Add support for auto guess splittable column (introduce new configure item autoPk)
Bump a dozen of 3rd dependencies to the updated version

该版本主要功能点

HDFS reader 插件支持读取 binary 数据类型
HDFS writer 插件支持写入 binary 数据类型，该数据可以从关系型数据库的 Blob 字段获取(Oracle 暂未支持）
重写了 ORC 和 PARQUET 文件的读写代码，使用两个文件系统的直接API，提升读写效率
重写了字符类型字段的分割函数，利用数据自身的功能提供了更合理的分割范围，而不是之前的随机字符串分割，并支持中文
增加了读取关系型数据库表时自动猜测分割字段的功能（默认不启用），详见文档说明
大量第三方依赖包升级到最新版本

Details

c52715e3 Changes main program to addax.py 288fbdf2 Add tdengine reader/writer plugins to package #224 6c9f4b41 Bugfixed: exception occurred when move hdfs file from temporary location to destination e582f768 Use phoenix-core instead of phoenix-client to reduce size 76d3062f Bugfix: string format error 86457ab5 Add correspond compress suffix 9c6e88f2 Bump postgresql from 42.2.22 to 42.2.23 (#218) df8e8be0 Add correspond compress suffix e4a04a8d Bump maven-javadoc-plugin from 3.2.0 to 3.3.0 (#211) 83221c37 Bump commons-net from 3.7.2 to 3.8.0 (#212) 7cbf4c6c Bump parquet-avro from 1.11.1 to 1.12.0 (#213) 6264fac0 Bump httpcore from 4.4.13 to 4.4.14 (#214) 40e61943 Rewrite the string type field splitting method using the database's own functions 18a6c3fb Bump kudu-client from 1.8.0 to 1.15.0 (#190) d8f32950 Bump nexus-staging-maven-plugin from 1.6.7 to 1.6.8 (#210) 91de3c2f Bump commons-lang3 from 3.11 to 3.12.0 (#209) 0e80d62b Bump commons-io from 2.8.0 to 2.10.0 (#208) 68f7e03f Bump snappy-java from 1.1.8 to 1.1.8.4 (#207) 4a638dca Bump taos-jdbcdriver from 2.0.18 to 2.0.32 (#204) 5c25819b Bump fastjson from 1.2.75 to 1.2.76 (#206) 58a8a57d Bump ognl from 3.2.18 to 3.2.21 (#203) 8fc41ad9 Bump joda-time from 2.9.7 to 2.10.10 (#205) 02b000bc Bump maven-dependency-plugin from 3.1.2 to 3.2.0 (#199) 68028621 Bump jedis from 3.4.0 to 3.6.1 (#201) 62ea143f Bump errorpronecore from 2.4.0 to 2.7.1 (#202) 8fee29b8 Bump maven-gpg-plugin from 1.5 to 3.0.1 (#194) 49342f78 Bump postgresql from 42.2.19 to 42.2.22 (#195) eb09cad7 Bump aircompressor from 0.17 to 0.19 (#196) 96c3c851 Bump druid from 1.2.4 to 1.2.6 (#197) 96e7e750 Add support for auto guess splittable column (#198) 920f93c0 Bump cassandra.jdbc.version from 3.10.2 to 3.11.0 (#192) 44e2d726 Bump avro from 1.10.1 to 1.10.2 (#188) 26d2783e Bump slf4j-api from 1.7.28 to 1.7.31 (#189) f8d481b9 Bump json-path from 2.5.0 to 2.6.0 (#191) b254c183 Bump javadbf from 1.11.2 to 1.13.1 (#186) 238fbe23 Bump fluent-hc from 4.5.12 to 4.5.13 (#187) 95169414 Bump httpcore-nio from 4.4.13 to 4.4.14 (#181) ca07dca9 Bump redis-replicator from 3.4.2 to 3.5.4 (#148) 89feeb71 Bump mongo-java-driver from 3.12.7 to 3.12.8 (#142) 0320d503 Add test for decimal type 98286bbd Allow all fields accept null value 52ace57f plugin hdfswriter: rewrite orc file schema generate method ce8cfbf8 plugin hdfsreader: simplify parquet file reader codes bd4aa417 Uses consistent variable definitions 0c14f86b plugin: dbffilewriter Add check for column configuration 8401fbc1 bugfix FileNotFoundException 73e8e034 Support for read/write Parquet file with binary type 1c0b80d9 Add some test cases cbe64daf plugin hdfsreader: Add support for reading binary data 4e008b96 plugin hdfswriter: Add support for writing binary data with OrcFile

- Java
Published by wgzhao almost 5 years ago

com.wgzhao.addax:addax-all -

24bdf314 Remove duplicate string
7b11021b Httpreader support sock proxy (#177)
6507fb9f bugfix: txtreader process blank or null value throws null point exception
9961d5ea bugfix: Incorrect conversion of mysql year type
548adf7f bugfix: convert json to string will filter null value #171 (#172)
74a5ca10 Use connection pool for improve connection stable

Known issues

https://github.com/wgzhao/Addax/issues/222

- Java
Published by wgzhao almost 5 years ago

com.wgzhao.addax:addax-all -

6c829813 Migrates common-lang to common-lang3 b68f42c2 Use connection pool for improve connection stable 4b618933 Remove un-necessary username and password c5b308db Extracts IP/Host from all kinds of jdbc url 151314ae Merge branch 'master' of github.com:wgzhao/DataX eb2ddc66 Add support for reading compress files in jsonfilereader plugin 96c2f9bd Add detail info when hive type cast failure c8ebaeb3 Merge remote-tracking branch 'github/master' 24082b3c Fixed read only the first line via each file ce07a1bf improve retention-policy implement in InfluxDBWriter plugin #162 125f9d1e influxdb: fix column maybe not have time (#160) 9bebd7ae Add retentionPolicy option in plugin InfluxDBWriter #162 810965e7 Fixed #157 javadoc syntax error a04ccc3c Merge branch 'master' of github.com:wgzhao/DataX f89ee158 Fixed #158 main class not found in Windows and in-correct encoding in Windows 0e3f4e8e Fixed protobuf in-compliant version 8e7f910f Fixed printf error e10a0f08 Fixed javadoc syntax error #157 339ae8fa 1. Fixed #156 exception occurred when writing Parquet file with null value 2. Optimize Decimal type 55079bac Fixed #155 jdbc java runtime version compliant exception

- Java
Published by wgzhao about 5 years ago

com.wgzhao.addax:addax-all -

General Changes

Bump protobuf-java from 2.5.0 to 3.15.5
Bump mssql-jdbc from 8.4.0.jres8 to 9.2.1.jre15
Add missing ElasticSearchReader package
Add support for get version in datax.py

RDBMS Reader

Fixed get XML data as string instead of SQLXML handler

RDBMS Writer

Add support XML data type

Stream Reader

Add field value incrment function

InfluxDB Reader

Fixed job template file
Add timeout configure items
Use native influxDB API instead of influxdb-java (#153)

InfluxDB Writer

Add timeout configure items

Textfile Reader

Add support for more compress format (#154)

- Java
Published by wgzhao about 5 years ago

com.wgzhao.addax:addax-all -

Fixed: unknown host exception when writing parquet file #135
Documentation streamreader and streamwriter
Add support for DorisDB writer #131
Add support more than one channel setup for InfluxDB #130
Add support for InfluxDB TAG data type #125
Add support for TDengine reader/writer #119
Add flattend index type

- Java
Published by wgzhao about 5 years ago

General Changes

Add HTTP reader plugin
make package.xml more general

- Java
Published by wgzhao over 5 years ago

com.wgzhao.addax:addax-all -

3.1.8

General Changes

Add Kudu reader plugin
Add kudu writer plugin
Add Greenplum writer plugin
Add InfluxDB reader plugin
Add InfluxDB Writer plugin
Change loglevel to reduce console output
Add more exit code

- Java
Published by wgzhao over 5 years ago

com.wgzhao.addax:addax-all -

General Changes

Add support for more data type such as Array, UUID, JSON, XML
Add more deme job files
Add support for HBase 2.0 reader ( hbase20xreader )
Fixes for some minor issues
Update some sample job json-string for documentation

ClickHouse reader

Add support for DateTime, DateTime64 data type

ClickHouse writer

Add support for DateTime, DateTime64 data type

PostgreSQL reader

Add support for UUID,JSON, INET,MACADDR data type

PostgreSQL writer

Add support for UUID,JSON, INET,MACADDR data type

SQLServer reader

Add support for image data type

SQLServer writer

Add support for image data type

Oracle writer

Fixed incorrect column cuased by duplicate variable initialization (#92)

Transformer

Add power expressions (^) for dx_map function

- Java
Published by wgzhao over 5 years ago

com.wgzhao.addax:addax-all -

General Changes

Add tar.gz release package
Takes item password to optional instead of required one

Redis writer

Fixed incorrect target packaging folder (#81)

Oracle writer

Add support for merge into statement via configuring wirteMode item (#82)

PostgreSQL writer

Add support for insert into ... on conflict statement via configuring wirteMode item (#82)

- Java
Published by wgzhao over 5 years ago

com.wgzhao.addax:addax-all - 3.1.5

Release Notes

General Changes

Various code clean

DBF reader

Reconstruct this plugin with 3rd-party jar package
Add support for Date type
Fix for the occasional null pointer exception

DBF writer

Add support for Date type

HDFS reader

Fix read failure when the filetype is text (#66)

Elasticsearch writer

Fixed missing dependency jars (#68)

- Java
Published by wgzhao over 5 years ago

com.wgzhao.addax:addax-all - 3.1.4

This is an emergency fix version

- Java
Published by wgzhao over 5 years ago

com.wgzhao.addax:addax-all -

There are serious problems with this version, do not use it!

Release 3.1.3 (16 Nov 2020)

General Changes

Various code clean
Misc bugs fixed

Redis reader

Delete temporary local file
Only parse redis String data type, other types will be ignore

HDFS reader

Add support for reading Parquet file (#54)

- Java
Published by wgzhao over 5 years ago

com.wgzhao.addax:addax-all - release 3.1.2

Changelog

General

Does not parse the -m command line argument, it doesn't really do anything!

SQLServer reader

Add support for datetime data type with old SQLServer edition

HBase11xsql writer

Add support for truncating table before inserting records
Add support for specifing zookeeper's port, if not presents, it uses 2181 as default port

HDFS writer

Add support for timestamp data type

MongoDB reader

Add support for json data type

- Java
Published by wgzhao over 5 years ago

com.wgzhao.addax:addax-all - 3.1.1

3.1.1

General

Transformer add column's basic operation
Use prestosql's hadoop and hive jars instead of apache's
various misc codes optimize

dbffilereader

remove supported for reading compressed dbf file

jsonreader

fixed parse non-string type value

dbffilewriter

fixed boolean type writing error

hdfswriter

Use keyword parquest indicates support parquet format, old keyword par is not used

- Java
Published by wgzhao over 5 years ago

Recent Releases of com.wgzhao.addax:addax-all

com.wgzhao.addax:addax-all - 6.0.4

Addax 6.0.4 has released! 🎉

📜 Changes

com.wgzhao.addax:addax-all - 6.0.3

Addax 6.0.3 has released! 🎉

📜 Changes

com.wgzhao.addax:addax-all - 6.0.2

Addax 6.0.2 has released! 🎉

Highlight

📜 Changes

com.wgzhao.addax:addax-all - 6.0.1

Addax 6.0.1 has released! 🎉

📜 Changes

com.wgzhao.addax:addax-all - 6.0.0

Addax 6.0.0 has released! 🎉

Key Highlights

Upgrade Notes

📜 Changes

Known bugs:

hdfsreader and hdfswriter plugins

com.wgzhao.addax:addax-all - 5.1.2

Addax 5.1.2 has released! 🎉

📜 Changes

com.wgzhao.addax:addax-all - 5.1.1

Addax 5.1.1 has released! 🎉

Bug Fixes:

📜 Changes

com.wgzhao.addax:addax-all - 5.1.0

Addax 5.1.0 has released! 🎉

Highlight

1. HDFS Reader Plugin: Complex Data Type Support

2. HDFS Writer Plugin: Expanded Data Compatibility

3. Hive Reader Plugin: Complex Data Type Support

4. Optimized Package Size

📜 Changes

com.wgzhao.addax:addax-all - 5.0.0

Addax 5.0.0 has released! 🎉

Compatibility Warning ⚠️

📜 Changes

com.wgzhao.addax:addax-all - 4.3.0

Addax 4.3.0 has released! 🎉

Compatibility Warning ⚠️

Changes

com.wgzhao.addax:addax-all - 4.2.4

Addax 4.2.4 has released! 🎉

Changes

com.wgzhao.addax:addax-all - 4.2.3

Addax 4.2.3 has released! 🎉

Changes

com.wgzhao.addax:addax-all - 4.2.2

Addax 4.2.2 has released! 🎉

Changes

com.wgzhao.addax:addax-all - 4.2.1

Addax 4.2.1 has released! 🎉

Changes

com.wgzhao.addax:addax-all - 4.2.0

Addax 4.2.0 has released! 🎉

Compatibility Break Release Note for Version 4.2.0

Changes

com.wgzhao.addax:addax-all - 4.1.8

Addax 4.1.8 has released! ㊗️

changelog

com.wgzhao.addax:addax-all - 4.1.7

Addax 4.1.7 has released! ㊗️

changelog

com.wgzhao.addax:addax-all - 4.1.6

Addax 4.1.6 has released!

changelog

com.wgzhao.addax:addax-all - 4.1.5

Addax 4.1.5 has released!

changelog

com.wgzhao.addax:addax-all - 4.1.4

Addax 4.1.4 has released!

Changelog

com.wgzhao.addax:addax-all - 4.1.3

Addax 4.1.3 has released!

Changelog

General

com.wgzhao.addax:addax-all - 4.1.2