datacap

DataCap released!

Emergency release version: Due to an error in calling the API during pre-release testing, the data set building function cannot be used. This version is mainly used to modify the data set building function.

Env

• Fixed logo path reference error problem

Dataset

• Fixed the problem that the data set cannot be constructed

Docker

• Fixed the problem of missing fields in initialization script

DataCap released!

In this version update, we mainly restructured the UI

Core

• Fixed dependency package import error
• [Report] Fixed the problem of jumping to the report list after publishing the report
• [Dashboard] supports displaying report names
• [Dashboard] Fixed the problem of missing lower right border of the report
• [Dashboard] Fixed the issue of error when modifying jump

UI

• Refactor UI to shadcn ui

Pipeline

• Removed old build functionality
• Supports specifying startup scripts

DataSet

• Fixed the problem of table creation failure due to not configuring the life cycle column
• Build failure prohibits ad hoc querying
• Combine ad hoc query grouping into dimensions
• Fix calculation of total rows and total size

File System

• Support delete function

Executor

• [Seatunnel] supports flink engine
• [Seatunnel] supports seatunnel engine

Dependencies

• Update testcontainers.version 1.17.6 to 1.19.5
• Update com.datastax.oss:java-driver-core 4.16.0 to 4.17.0

DataCap Released!

Plugin

• ParadeDB support (https://github.com/devlive-community/datacap/issues/589)
• Support for TimescaleDB (https://github.com/devlive-community/datacap/issues/593)

DataSet

• [Chart] Add Area Chart (https://github.com/devlive-community/datacap/issues/611)
• [Chart] Add Multi-Area Chart (https://github.com/devlive-community/datacap/issues/610)
• [Chart] Add a pie chart (https://github.com/devlive-community/datacap/issues/613)
• [Charts] Support line chart breakpoint processing
• [Chart] Grouping Histogram (https://github.com/devlive-community/datacap/issues/612)
• [Chart] Support Word Cloud (https://github.com/devlive-community/datacap/issues/614)
• Support for adding primary keys (https://github.com/devlive-community/datacap/issues/624)
• Add 'Total Rows' and 'Total Size' (https://github.com/devlive-community/datacap/pull/676)
• Ad hoc queries with custom aliases (https://github.com/devlive-community/datacap/issues/615)
• Dimension sorting is supported
• Metric sorting is supported
• Support for data sampling columns (https://github.com/devlive-community/datacap/issues/605)
• Add a symbol number type
• Fixed an issue with the display of lists on small screens
• Ad hoc query custom functions (https://github.com/devlive-community/datacap/issues/603)
• Add filter groupings
• Merge query columns
• Fixed the issue that duplicate requests were caused by duplicated data
• Fixed the issue that the grouping of editing reports was abnormal
• The issue of infinite loop query is fixed
• SUPPORT FILTERS 'IS NULL', 'IS NOT NULL'
• Fixed an issue where multi-column queries caused expres to be confused
• SUPPORT FILTERS 'LIKE', 'NOT LIKE'
• Support filters '=', '<>'
• Support filters '>', '>='
• Support filters '<', '<='
• Support synchronization of historical error messages
• Support for clearing data (https://github.com/devlive-community/datacap/issues/622)
• Support for dynamically adding columns (https://github.com/devlive-community/datacap/issues/623)
• Restructure the dataset details page
• Add a datetime type
• Support for custom lifecycles (https://github.com/devlive-community/datacap/issues/616)
• DISABLE 'BOOLEAN', 'DATETIME' TYPE ASSIGNMENTS
• Support for virtual columns (https://github.com/devlive-community/datacap/issues/602)
• Docker Compose support (https://github.com/devlive-community/datacap/issues/648)
• Support Qiniu Cloud Storage (https://github.com/devlive-community/datacap/issues/618)

Dependencies

• Update io.crate: crate-jdbc '2.6.0' to '2.7.0'
• Update Impala: ImpalaJDBC42 '2.6.29.1035' to '2.6.32.1041'
• Update org.yaml: snakeyaml '2.0' to '2.2'
• Update org.apache.hive: hive-jdbc '3.1.2' to '3.1.3'
• Update org.elasticsearch.plugin: x-pack-sql-jdbc '8.11.3' to '8.12.0'
• Update jackson.version '2.16.0' to '2.16.1'
• Update org.apache.maven.plugins: maven-javadoc-plugin '3.6.0' to '3.6.3'
• Update com.microsoft.sqlserver: mssql-jdbc '11.2.1.jre8' to '12.6.0.jre8'
• Updated postgresql.version '42.6.0' to '42.7.2'

DataCap Released!

General

• [Dashboard] Support for removing reports
• [Dashboard] Support preview
• [Dashboard] Modification is supported
• [Metadata] PostgreSQL database is supported
• [Metadata] Support for synchronizing error messages
• [Metadata] Support for metadata synchronization after build (https://github.com/devlive-community/datacap/issues/585)
• [Metadata] Support manual synchronization of metadata from data sources (https://github.com/devlive-community/datacap/issues/586)
• [Metadata] Support for synchronizing history from data sources
• Add a query schema
• Fixed function creation/update time issues
• Optimized the question template
• Support for GitHub CI localization
• Add a system architecture diagram (https://github.com/devlive-community/datacap/issues/491)
• Support for buffering query results (https://github.com/devlive-community/datacap/issues/490)

SPI

• Fixed the problem of data source concurrency exception (https://github.com/devlive-community/datacap/issues/513)

Parser

• Add a SQL parser SPI
• Add Trino SQL parser (https://github.com/devlive-community/datacap/issues/569)
• Add MySQL SQL parser (https://github.com/devlive-community/datacap/issues/568)

Scheduler

• Add a scheduling SPI
• Support for default schedulers

Pipeleine

• Fixed the issue of pipeline grouping
• SqlServer support
• Refactoring the Seatunnel actuator
• Refactoring SPI with Kotlin rewrites
• Reconstruct the pipeline configuration method

Plugin

• MatrixOne (https://github.com/devlive-community/datacap/issues/574) support
• Support for ScyllaDB (https://github.com/devlive-community/datacap/issues/543)

DataSet

• Add a column model (metric|dimension)
• Add an ad-hoc query visual editor
• Add a line chart
• Add a data table
• Add a histogram
• SQL statements can be displayed and queried
• Custom expressions for indicators are supported
• Dimension grouping is supported
• Add indicator expression hints
• Specify expressions by type
• Metric aliases are supported
• Published|Dataset reports can be edited
• Partition keys are supported
• Column aliases are supported
• Support for syncing history
• Support for ad-hoc queries (https://github.com/devlive-community/datacap/issues/581)
• Scheduled data synchronization (https://github.com/devlive-community/datacap/issues/590)

Docs

• Added file system integration development documentation
• Add a Partner Presentation (https://github.com/devlive-community/datacap/issues/582)

Dependencies

• Update org.apache.maven.plugins: maven-compiler-plugin '3.3' to '3.12.1'
• Update com.dameng:DmJdbcDriver18 '8.1.2.192' to '8.1.3.62'
• Update mysql to '8.0.30'
• Update snowflake to '3.14.4'
• Update com.taosdata.jdbc: taos-jdbcdriver '3.0.0' to '3.2.7'
• Update org.apache.kylin: kylin-jdbc '2.6.3' to '4.0.3'
• Update slf4j.version '1.7.36' to '2.0.10'
• Update org.apache.maven.plugins: maven-assembly-plugin '3.5.0' to '3.6.0'
• Update org.duckdb: duckdb_jdbc '0.8.1' to '0.9.2'
• Update org.apache.ignite:ignite-core '2.8.1' to '2.16.0'
• Update org.projectlombok: lombok '1.18.28' to '1.18.30'

The current version involves several major updates.

DataCap Released!

General

• [Metadata] Support for cloning rows
• [Metadata] Support truncating tables
• [Metadata] Data can be refreshed
• [Metadata] Tables can be deleted
• [Metadata] Displays table structure
• [Metadata] Support for displaying table ER diagrams
• [Metadata] Table data can be exported
• [Metadata] You can create new tables
• [Metadata] Support for creating new columns
• [Metadata] Columns can be deleted
• [Query] Add auto-add LIMIT
• [Users] Support for user avatars
• [Data Source] Optimized the message for deleting a data source
• [Report] Support data report function
• [Dashboard] Dashboard function is supported
• [Dataset] Dataset data is supported

SPI

• Support for FileSystem
• Support for Local FileSystem

Docs

• Add documentation for using the SDK

SqlServer

• Support for multiple versions
• Fixed the connection failure caused by the connection handle

Pipeline

• MySQL JDBC mode is supported
• Support drag-and-drop builds

Dependencies

• Update org.mongodb: mongodb-jdbc 2.0.2 to 2.0.3
• Update ch.qos.logback: logback-classic 1.2.11 to 1.2.13
• Update org.apache.kafka: kafka-clients 2.8.1 to 3.6.1
• Update ch.qos.logback: logback-core 1.2.11 to 1.2.13
• Update com.oracle.database.jdbc: ojdbc8 21.9.0.0 to 23.3.0.23.09
• Update org.elasticsearch.plugin: x-pack-sql-jdbc 7.10.0 to 8.11.3
• Update jackson.version 2.14.2 to 2.16.0

The current release involves several major updates.

DataCap is released!

General

• Remove invalid metadata manager
• Optimization issues template
• Add version to app
  
• Support to check whether the java version is compatible at startup
• Fixed an error in selecting columns directly without selecting tables
• Supports custom column display
  
• Supports resetting column positions
  
• Querying the table view results in a value that cannot be converted
• Add jvm config
• No column information is returned when the data is empty
• Fixed switching table query data results in null query columns
• Support reset auto increment
  
• Unify the data types returned by each plug-in
• Support for viewing build statement sentences
  
• Add filter for table
  
• Support add new row data
  

Web

• Remove unused components

Dependencies

• Bump com.h2database:h2 from 2.1.214 to 2.2.224
• Bump org.jetbrains.dokka:dokka-maven-plugin from 1.8.10 to 1.9.10

The current release involves several major updates.

DataCap is released!

General

• Support column order
  
• Support delete rows
• Support delete multiple rows
  
• Supports data update without primary key
  
• Supports data update with primary key
  
• Support preview pending changes

Editor

• Support selection query
  
• Support custom configure
  

Docs

• Add user profile doc

Dependencies

• Bump org.apache.maven.plugins:maven-javadoc-plugin from 3.5.0 to 3.6.0
• Bump com.oceanbase:oceanbase-client from 2.4.2 to 2.4.5
• Bump org.apache.maven.plugins:maven-javadoc-plugin from 3.5.0 to 3.6.0

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Support database synchronization
• Support table synchronization
• Support column synchronization
• Add scheduler history
• Refactor metadata module
• Improve SQL files

Editor

• Replace monaco to ace

Docs

• Add deployment documents in Chinese
• Refine the fragment and data source Chinese documentation

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Fix the issue where the data source check task returns an empty
• Add captcha
• Support login verification code
• Automatic refresh of verification code failure is supported
• Support signup verification code
• Support signup enable
• Move etc to configure

Web

• Fixed empty editor destruction exception
• Global public page adds layout
• Fixed the profile page error
• Fixed the abnormal login page style

Pipeline (Apache Seatunnel)

• Support kafka source and sink
• Support delete
• Build pipeline page
• Support submit
• Support SWITCH field type
• Add executor logo
• Supports traffic limiting queuing
• Support stop
• Reset the pipeline when the service restarts
• Add logging interface and optimize UI
• Support field description
• Support field select type
• Support field checker
• Support field array
• Support redis sink
• Supports specifying the runtime mechanism

Dependencies

• Bump com.google.guava:guava from 31.1-jre to 32.1.2-jre
• Bump org.devlive.sdk:openai-java-sdk from 1.5.0 to 1.9.0
• Bump com.h2database:h2 from 2.1.214 to 2.2.220
• Bump org.projectlombok:lombok from 1.18.24 to 1.18.28
• Bump org.apache.kafka:kafka-clients from 2.8.0 to 2.8.1
• Bump org.duckdb:duckdb_jdbc from 0.7.0 to 0.8.1
• Bump com.github.eirslett:frontend-maven-plugin from 1.12.1 to 1.13.4
• Bump kotlin.version from 1.8.20 to 1.9.10
• Bump org.sonatype.plugins:nexus-staging-maven-plugin from 1.6 to 1.6.13

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Fixed openai-java-sdk version
• Add version for source
• Add a data source scan task
• Optimized status icon
• Remove support for built-in H2 database

Web

• Support text
• Fix div white-space
• Added calendar heatmap chinease
• Fixed data contribution graph error
• When the data source is not available list disables selection

Kyuubi

• Fix unable to execute set syntax sql
• Fix connection not closed

Oracle

• Support get DBName and TableName

Clickhouse

• Fixed no query errors in the default database

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Remove log default debug level
• Split module
• Fixed depend
• Support redirect for menu
• Fixed sql schema
• Support whether to function menu
• Replace openai sdk to openai-java-sdk
• Refactor chat

Web

• Fixed cache not clear, need to click again
• Fixed an error with invalid token
• Adds buffer tag name
• Fixed abnormal profile page using h2 database
• 404 caused by repair service restart

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• The number of rows returned by the query history is added
• Fixed a 404 error on the home page
• Strip plugins into separate folders

Web

• Refactor the folder
• Add menu breadcrumbs
• Synchronous server routing
• Add not login page
• Add source manager route
• Fixed the callback exception of route construction failure
• Fix data source type marker exception

Plugins

• Support apache cassandra

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Fix service start default connection mongo
• Fixed h2 db update_time and create_time for sql template
• Improve the H2 metadata management to obtain type
• Improve the mysql metadata management to obtain type
• Fixed metadata management data page default to 1
• Reconstruct the data render table
• Support column type
• Add time consuming and view executing SQL
• Support for selectable totals per page
• Supports header hint data types
• Supports replication of selected data results
• Support for selecting specified column queries
• Support filter
• Fixed the default user creation time being null
• Support Permission
• Fixed user createTime is null

Web

• None Network authorization information is not cleared
• Optimize data management to obtain data
• Disable warnings output to console
• Increased editor buffering prompt limit
• Removes the default collation rule
• Rename user dashboard path
• Add dashboard chat style
• Fix navigation style
• Add data source load state

Plugins

• Support apache pinot
• Support mongo community

Dependencies

• Bump clickhouse-jdbc from 0.3.2-patch9 to 0.4.6
• Bump oracle-xe from 1.17.6 to 1.18.1
• Bump kyuubi-hive-jdbc-shaded from 1.6.0-incubating to 1.7.1

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Support github publish packages
• Optimized the docker image publishing process
• Support format date
• Add a connection to the database to specify the time zone
• Fixed default h2 database uninitialized scheduled task
• Add admin user to README.md
• Add docker image label
• Add wechat qr to README.md
• Add docker badge
• Fixed source create time is null

Docs

• Add chinese index
• Add the Rainbond deployment document
• Add plugin docs
• Top scrolling notifications are supported

Web

• Fix invalid paging of data table
• Fixed not rendering properly
• Fix missing translation results for rendering containing translational data
• Support copy multiple selection rows
• Fix data source test status issues
• Support close message
• Add schedule link

Plugins

• Support ceresdb
• Support greptimedb
• Support questdb
• Support apache doris
• Support starrocks
• Support hologres
• Support apache hadoop hdfs

SPI

• Remove http retry logic

Yandex Database

• Fixed ydb dependency conflicts

Trino

• Add configure

Dependencies

• Bump trino-jdbc from 397 to 414 (#331)
• Bump iotdb-jdbc from 0.13.0 to 1.1.0 (#309)

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Rename executor directory
• Optimize document release timing
• Fixed format connect url close #304
• Support proxy for chatgpt close #299
• ChatGPT is currently unable to associate context close #298
• Support returning parsing error results
• Add schedule lib
• Support the code editor supports automatic prompts for data source library tables and columns close #301
• Fix initialization sql script
• Support h2 database
• Remove some invalid jars
• Add docker publish ci

Docs

• Refactor install docs

Web

• The code editor supports code fragments close #300

Plugins

• Support h2 for native (memory)

Kafka

• Perfect test case
• Support SHOW DATABASES and SHOW TABLES ...

Oracle

• Fixed validation sql content

Dependencies

• Bump jackson.version from 2.13.4 to 2.14.2
• Bump postgresql from 42.5.0 to 42.6.0

Contributors

Many thanks to the following contributors for contributing to the source code of this release

In no particular order

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Add other issues template
• Add role
• Upgrade JDK 8 to 11
• Support chatgpt
• Add submit pipeline api

Experimental

• Add seatunnel executor

Client

• Support execute sql on source
• Fixed code bugs

Docs

• Add icon to connectors

SPI

• Add executor spi

Web

• Fixed duplicate tree menu data
• Optimized type display icon
• Optimize data source testing｜save interaction
• Support query history display plug-in type
• Add system announcement display
• Fixed the 'keyword' is repeated with tab page addition bug #208
• Replace markdown preview component

Plugins

• Support kafka

Dependencies

• Upgrade redis version from 3.6.3 to 4.3.1
• Bump maven-assembly-plugin from 3.1.1 to 3.5.0 #272
• Bump antlr4.version from 4.9.3 to 4.12.0 #262
• Bump jedis from 3.6.3 to 4.3.1 #254
• Bump DmJdbcDriver18 from 8.1.2.141 to 8.1.2.192 #234

Contributors

Many thanks to the following contributors for contributing to the source code of this release

In no particular order

The current release involves several major updates.

DataCap is released

General

• Add logo
• Support SHOW PATHS xxx
• Fixed function time field
• Refactor all module
• Add http lib
• Add logger lib

SPI

• JDBC: Repair Connection failure Do not close the connection

Web

• Add default watermark
• Remove about page
• Add routing permission control
• Optimize lazy loading of the tree menu of the query page

Plugins

• Support duckdb for jdbc close #249
• Support alioss for native #250

Zookeeper (Native)

• Support SHOW PATHS

Dependencies

• Bump maven-javadoc-plugin from 3.4.1 to 3.5.1
• Bump oceanbas-client from 2.4.0 to 2.4.2

Contributors

Many thanks to the following contributors for contributing to the source code of this release

In no particular order

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Support dsl query
• Remove incubator
• Add sql parser
• Refactor the module directories
• Set port default value is 0

SPI

• Fixed jdbc no password exception is configured

Web

• Support multi column sort

Plugins

• Support zookeeper for native

Docs

• Add powered by page

Redis (Native)

• Fixed mget,hget value is displayed as null #219

Dependencies

• Bump maven-javadoc-plugin from 2.10.4 to 3.4.1
• Bump ojdbc8 from 21.1.0.0 to 21.9.0.0
• Bump mongodb-jdbc from 2.0.0 to 2.0.2

Contributors

Many thanks to the following contributors for contributing to the source code of this release

In no particular order

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Fixed restart script
• Supports monitor process
• Do not modify the default system SQL template
• Fixed plugin template by name
• Support user login log
• Refactoring plug-in configuration extraction mode

Experimental

• Support data source manager
• Add client cli

Web

• Plug-in ICONS are displayed based on the plug-in type
• Optimize editor auto prompt
• Support watermark
• Templates are not supported for adding data sources
• Fixed footer link

Plugins

• Support snowflake for jdbc
• Support ydb for jdbc

Docs

• Refactor some docs

Redis (Native)

• Fixed command multiple parameters

Contributors

Many thanks to the following contributors for contributing to the source code of this release

In no particular order

The current release involves several major updates.

🎉 🎉 🎉 🎉 🎉 🎉 DataCap is released 🎉 🎉 🎉 🎉 🎉 🎉

General

• Support change username
• Support custom sql template
• Support plugin function
• Add restart script

Web

• Optimize the presentation of the data source list
• Add data source description and prompt
• Support query history id order
• Support quote query history

Plugins

• Support oceanbase for jdbc
• Support redis for native
• Support neo4j for jdbc
• Support iotdb for jdbc

Redis

• Support auth for native

Contributors

Many thanks to the following contributors for contributing to the source code of this release
In no particular order