dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

APACHE-2.0 License

Stars
12.4K
Committers
590

Bot releases are hidden (Show)

dolphinscheduler - 2.0.7

Published by JinyLeeChina almost 2 years ago

Bugfix:

  • Monitoring: Added disk available capacity monitoring (#10030)
  • fix Parameter transfer problem when recover failed task (#10694)
  • fix copy bug (#10940)
  • fix dependent task when the dependent on process have forbidden tasks (#10952)
  • correct post body for http alert plugin (#11946)
  • [bugfix-10116]fix complement data bug (#12376)
  • [Fix-12167][MasterServer] The retry task was submitted in advance (#12291)
  • [Bug][API] fix Circular dependencies are not checked in save process task relation (#12294)
  • [Fix-12422][MasterServer] The task needing fault tolerance cannot be submitted (#12423)
  • [doc] Correct Docker README URL (#11794)
  • [Fix-10080]When the created tenant name is too long, an error message will be prompted (#10081)
dolphinscheduler - 3.1.0

Published by caishunfeng about 2 years ago

Feature

  • [Feature-8252][doc] K8s and namespace manager docs and web page update (#9881)
  • [feat][task plugin] Add Jupyter task plugin (#9872)
  • [Feature-9474] [CI] Add cluster test script verify on shell script (#9997)
  • [Feature-10034][CI] Add postgresql cluster test in CI (#10035)
  • [feat] Add batch rerun and stop for process instance (#10013)
  • [Feat][UI] Add resource username for function and resource manage (#10086)
  • [Feature][plugin] Add k8s task in task plugin (#9425)
  • [Feature][Task Plugin] Add mlflow task plugin for MLops scenario. (#10036)
  • [Feature] [CI] Add alert server cluster test #10125
  • [python] Change distribute name avoid confusion with main pkg (#10134)
  • [Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) (#10150)
  • [Feature][CI] Schedule Dead Link Checker (#10000)
  • [Feature][MLops] Add MLflow Projects (custom project) component (#10175)
  • [Feature][Permission] Project management module authority control refactoring, authority abstract interface setting. (#10261)
  • [Feature][Datasource]replace DataSourceController API with string JSON and cast to DTO (#10276)
  • [Feature][API] Modify the permissions of project management, security center, data source center and data quality module. (#10289)
  • [Feature][Permission] Reconstruction of permissions of resource center and monitoring center. (#10307)
  • [feat][task] Add OpenMLDB task plugin (#10198)
  • [Feature][Task Plugin] Add support for dynamic form for zeppelin task plugin (#9977) (#10269)
  • [Feature-10290] [API] Refactor org.apache.dolphinscheduler.api.controller.AccessTokenController#createToken api (#10301)
  • [Feature] Should not add refresh logic in the e2e case. (#10331)
  • [Feature][Monitoring] Added disk available capacity monitoring (#10287)
  • [Feature-6758][Task] Add limit resource usage for tasks base on cgroup (#10373)
  • [Feature][metrics] Add master, worker metrics (#10326)
  • [Feature] [MLOps] support mlflow deploy with docker compose (#10217)
  • [Feature][Metrics] Enable prometheus to collect metrics in standalone mode demo (#10398)
  • [Feature][UI] Add manual input for scheduling dates. (#10396)
  • Add mysql registry plugin (#10406)
  • [CI] Add OWASP Dependency Check (#10058)
  • [Feature][Improvement] Support multi cluster environments - k8s type (#10096)
  • [Feature-10411] Add tenant api test (#10442)
  • [Feature-10363][server] S3 Resource center supports bucket customization (#10433)
  • [feature][task] Enable zeppelin schedule a whole zeppelin note (#10434)
  • [Feature] Enable users to switch and install conda env in jupyter task (#10337)
  • [Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372) (#10407)
  • [Feature] [Permission]Data permission module added and Query class api remove verification. (#10504)
  • [Feature] TaskGroup remove query func permission check. #10557
  • [python] Support using full-name definitions for resources (#10551)
  • [feat] ui build no inherit from maven proxy (#10590)
  • [Feature] Time function analysis extension. (#10624)
  • [feature][task-flink] Support Flink application mode (#9577)
  • [Feature][Master] Failover workflow instance base on priority (#10754)
  • [Feature] Enable users to create python env from requirements.txt (#10658)
  • [Feature-10629][Improvement] Support multi cluster environments - namespace use cluster (#10650)
  • [Feature][dependencies] Bump spring-core from 5.3.12 to 5.3.19 (#10857)
  • [Feature-10219][EMR] EMR supports use to add steps to an existing cluster (#10657)
  • [Feature-10871] add workflow executing data query (#10875)
  • [Feat][UI] Uniform search button size. (#10880)
  • [Feature][Metrics] Add resource download related metrics for workers (#10749)
  • [Feat][UI] Add title display to the table in the security center. (#10969)
  • feat: Added global trim method (#10975)
  • [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#10925)
  • [Feature][Datax Task]Datax task plugin support custom parameters (#10950)
  • feat: Add trim method to all input (#10984)
  • [Feat][UI] Added LDAP function. (#11029)
  • [Feature][Task Plugin] Increase zeppelin task stability in production (#11010)
  • [Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935)
  • [python] add import SageMaker task (#11121)
  • Add base loop task execotor and http template parser (#11137)
  • [Feature-10604] Task name in the copied and imported workflow without copy suffix (#10607)
  • [Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.ProjectController (#10832)
  • [Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter (#10960)
  • [Feature] Add CURD to the project/tenant/user section of the API and add its tests. (#10913)
  • [Feature] Add new task type chunjun (#10937)
  • Write alert result into db (#11221)
  • [Python] Migrate exists method call in PythonGateway to corresponding service (#11188)
  • [Feature][style] Add spotless maven plugin for automatic style fix. (#11272)
  • [Python] Combine gateway.entry_point call in python api side (#11330)
  • [Feature-9978][UI] add node dependency type feature (#11235)
  • [Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.QueueController (#11154)
  • [python] Add local dev mod runing python integate tests (#11362)
  • [Feature-10117][UI] Hide node execution when start from the workflow definition list page (#11372)
  • [Feature-11223] support stream task (#11350)
  • [python] Add multiple version of document (#11391)
  • [python] Add support interpreter version 310 and 311-dev (#11170)
  • [Feature-7024] Add waiting strategy to support master/worker can recover from registry lost (#11368)
  • [Feature][Style] Enable spotless to manage imports (#11458)
  • Support reading application properties from kubernetes config map (#11402)
  • [Feature-10182][task-datax] datax access kerberos authenticated bigdata cluster (#11387)
  • [Feature][Style] Make sure there is one and only one empty line at the end of each java file (#11520)
  • [Feature] New task plugin Pytorch (#11498)
  • [feature-11408] add hive option (#11493)
  • feat: Locations Formats the layout if it does not exist (#11535)
  • [Feature][UI] Enable highlight and auto-complete for SQL scripts (#11659)
  • [python] Auto location when create process definition (#11681)
  • [Feature][Task Plugin] Support hive cli task plugin (#11651)
  • [feature][API]feature: add task type list and enable user to add task type to fav (#11727)
  • Add Kubernetes configmap reload to all components (#11730)
  • [Feature-11530] add state history for process instance (#11757)
  • [DSIP-11][python] create workflows from YAML configuration (#11988)
  • [Feature][Registry] Support etcd as registry (#10981) (#11997)
  • [Feat][python] Add parameter environment to task (#11763) (#11989)
  • [feat][python] Support Pytorch task in python api (#11975)
  • [feat][python] Add sagemaker yaml example (#11925)
  • [feat][python] Support OpenMLDB task in python api (#11944)
  • [feat][python] Support MLflow task in python api (#11962)
  • [Feature][PyDolphinScheduler] Support DVC task in pyds #11922 (#11941)
  • [Feature-10273][Datasource] Add dataSource for AWS Athena (#11157) (#12039)
  • [Feat][UI] Update package. (#12046)
  • [python] Support SageMaker task type (#11002)
  • [Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center (#11708)

Improvement

  • [refactor][perf] cache compiled regex pattern (#10099)
  • [improve] Change Mysql Driver (#10220)
  • [Style][UI] Split multilingual modules. (#10256)
  • Clean up unused dependencies and packaging issues (#9944)
  • [Style][UI] Format code. (#10314)
  • Add dolphinscheduler-task-all in api module (#10350)
  • Move datasource params to datasouce plugin module (#10353)
  • issues-10354: upgrade commons-io to fix CVE (#10355)
  • issue-10356: upgrade logback to fix cve (#10357)
  • Remove quartz at WorkerServer (#10358)
  • Add dolphinscheduler-scheduler module (#10360)
  • [improve] Using create or replace function in sql task (#10170)
  • Optimize MasterServer, add MasterRPCService (#10371)
  • change to common lang3 and fix checkstyle (#10380)
  • Upgrade log4j in E2E (#10359)
  • Add some warning log in master (#10383)
  • [Improve] Enhance complement function transformation (#10376)
  • Update chart.yaml dependencies version (#10420)
  • [imporve] Add index to table t_ds_relation_process_instance (#10461)
  • [Improvement][Api] Interface and entity optimization to improve code scalability (#10466). (#10468)
  • [Improve] Add LDAP user not exsitst action config (#10451)
  • Modify obsolete swagger parameters in AuditLogController (#10494)
  • Remove the schedule thread in LowerWeightHostManager (#10310)
  • [Improvement][Metrics] Apply micrometer naming convention to metrics (#10477)
  • change import method access to protected (#10536)
  • [Improve]Remove the code logger.isDebugEnabled() #5918 (#10542)
  • [Improvement][Metrics] Update some metrics names in grafana-demo dashboards (#10432) (#10552)
  • Optimize master log, use MDC to inject workflow instance id and task instance id in log (#10516)
  • add datasource health check to the healthcheck endpoint (#10588)
  • dependent node log output optimization and fix checkstyle (#10593)
  • [Improvement][Master] batch remove TaskInstaceId and workflowInstanceId (#10620)
  • [Improvement][Worker] fixed naming of rpc package (#10614)
  • Add JDK11 on unit-test (#10364)
  • Validate master/worker config (#10649)
  • [Improvement]Delete the getSession in the Registry interface (#10633)
  • [Refactor][UI] Refactor yarn queue manage using NSpace component. (#10680)
  • [Refactor][UI] Refactor token manage using NSpace component. (#10681)
  • [Refactor][UI] Refactor k8s namespace manage using NSpace component. (#10682)
  • [Improvement-10617] Add comment in slot check (#10618)
  • [Improvement] heartbeat info improvement (#10699)
  • Optimize sql script use insert ignore (#10700)
  • [Optimization] Calculate global parameter and local parameter at master. (#10704)
  • resource modules query fix. (#10687)
  • [Refactor][UI] Refactor environment manage using NSpace component. (#10702)
  • [Refactor][UI] Refactor cluster manage using NSpace component. (#10701)
  • [Enhancement][API] Support batch copy and export online workflow #10678
  • [Refactor][UI] Refactor worker group manage using NSpace component. (#10735)
  • [Task] Add Dinky task to better support the development and execution of FlinkSQL (#10640)
  • [Optimization]Optimize some details of MLFlow task plugin #10740 (#10739)
  • [Optimization] Config module resource relation fix. (#10718)
  • [Improvement] [Alert Server] Add default datasource url in alert server application.yaml for consistency (#10790)
  • [python] Correct some docs for python api (#10772)
  • [Task] Added Apache SeaTunnel 2.x task node (#10480)
  • [Refactor][UI] Refactor alarm instance manage using NSpace component. (#10799)
  • [Refactor][UI] Refactor alarm group manage using NSpace component. (#10803)
  • Remove quartz in service (#10748)
  • [Refactor][UI] Refactor user manage using NSpace component. (#10816)
  • [Improvement] Resource authority module database table unique index increased. (#10807)
  • [ui] Data Quality Result Display Optimize (#10835)
  • [Improvement] [CI] Add label robot to pull request (#10848)
  • [Refactor][UI] Refactor tenant manage using NSpace component. (#10879)
  • [Python] Supports creating or editing resources. (#10823)
  • [Refactor][UI] Refactor audio log using NSpace component. (#10991)
  • impv: not mark issue stale with security label (#10982)
  • [Refactor][UI] Refactor datasource using NSpace component. (#11022)
  • [Refactor][UI] Refactor task result using NSpace component. (#11054)
  • Add dolphinscheduler-bom to manage the dependency version (#11025)
  • [Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11045)
  • [Improvement][Task]Improve seatunnel task command log (#11027)
  • [Improve] Hide Change Pwd Page When Login With LDAP (#11041)
  • [Refactor][UI] Refactor rule manage using NSpace component. (#11069)
  • [Refactor][UI] Refactor time display use datatable render function (#11078)
  • [Refactor][UI] Refactor file manage using NSpace component. (#11073)
  • [Improvement][Task Log] Task status log print description instead of code (#11009)
  • [Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support (#11017)
  • [Refactor][UI] Refactor function manage using NSpace component. (#11124)
  • [Improvement 11072][common] Added HTTPS request support in kerberos environment (#11127)
  • [Refactor][UI] Refactor resource manage using NSpace component. (#11098)
  • [Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics (#11128)
  • [Enhancement][API] Copy workflow with scheduler info (#10677)
  • Refactor alert-api with lombok (#11133)
  • [Improvement][ExecutorServiceImpl] remove some unnecessary (#11122)
  • Add is success in loop task status (#11169)
  • [python] Refactor structure to avoid cycle import (#11167)
  • [Improvement][Metrics] Upgrade plugin versions in grafana demo dashboards (#11192) (#11193)
  • [Improvement][UI] Unified local parameters UI (#11190)
  • [Refactor][UI] Refactor task group option using NSpace component. (#11209)
  • [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle (#11213)
  • [Improvement][UI] Improve monaco-editor component in ts. (#11274)
  • [Improvement][Metrics] Add metrics for alert server (#11240)
  • [Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator (#11305)
  • [Improvement][UI] Scrolling will be applied to parent model on editor scrolled to top/bottom (#11335)
  • [Refactor][UI] Refactor task group queue using NSpace component. (#11341)
  • [Refactor][UI] Refactor project list using NSpace component. (#11369)
  • Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus (#11340)
  • [Improvement-11394][Task Plugin] Remove Passed Parameter --queue in Seatunnel Task Plugin (#11395)
  • Add pause to task instance status (#11390)
  • [Refactor][UI] Refactor project workflow definition using NSpace component. (#11398)
  • [Improvement-11380][scp-host.sh] Set StrictHostKeyChecking=no option to ssh (#11382)
  • [Refactor][UI] Refactor workflow definition timing using NSpace component. (#11415)
  • [Refactor][UI] Refactor workflow definition version using NSpace component. (#11420)
  • [Improvement] Avoid using search in for and start using testSaveTaskDefine (#11383)
  • Clear thread name in BaseTaskProcessor (#11422)
  • [Refactor][UI] Refactor task instance batch using NSpace component. (#11447)
  • [Refactor][UI] Refactor workflow instance using NSpace component. (#11446)
  • [Improvement-11386][UI] Concise the logic available for task action buttons (#11419)
  • [Refactor][UI] Refactor task instance stream using NSpace component. (#11454)
  • optimize sorting priority for workflow define (#11462)
  • [Refactor][UI] Refactor task definition batch stream using NSpace component. (#11485)
  • [Refactor][UI] Refactor task definition version using NSpace component. (#11495)
  • [test-11432][HttpTask] Add unit tests to http task (#11453)
  • [Improvement] File deletion logic optimization (#11519)
  • [Improvement-11468] Support re running historical version workflow (#11489)
  • [Improvement]Add a stop function when you are ready to do pause operation (#11543)
  • [Improvement] [LDAP] Bug fix: Config value return "null" instead of real null currently. (#11325)
  • Remove logger header in task log file (#11555)
  • [Improvement-11550] [Doc]Document content update (#11577)
  • Upgrade spring boot and swagger (#11574)
  • Add dependent task instance log (#11541)
  • [improvement] Add two parameters in workergroup, and support the application of description display and other parameters (#11542)
  • [Improvement][TaskInstance] reduce database queries (#11522)
  • [Improvement-10942][UI]The workflow or task name is too long and results in incomplete display (#10957)
  • [Improvement][User] Query all users filter un enabled. (#11504)
  • [Improvement-#11613] Add spi priority factory (#11614)
  • [improvement-#11630]fix document about common.properties (#11653)
  • Refactor worker execute task process (#11540)
  • add unit test ci timeout (#11655)
  • [Improvement-11662][dao] fix foreach null items in mapper.xml
  • Refactor heart beat task, use json to serialize/deserialize (#11702)
  • optimize the process instance query, change the date time range (#11719)
  • reduce task dependencies (#11731)
  • [Improvement] Replace commons-lang 2 function invocations with commons-lang3 (#11810)
  • Bump up dependencies to fix cves (#11765)
  • Remove not use web service comment in alert server (#11819)
  • [Improvement-#11768][Monitor] Support monitor h2 database in monitor page (#11813)
  • [Improve] Upgrade Hadoop to 3.2.4 (#11832)
  • Remove htrace dependencies (#11881)
  • [Improvement-11834] Upgrade docker base image to support python3.9 (#11835)
  • Optimize date range condition (#11911)
  • Add debug logs for properties read from common.properties (#11910)
  • Add validations of possible malicious keys (#11966)
  • [Improvement] and task instance date range search (#11963)
  • [Improvement-11291][sql] Improvement the log output while executing multiple sql statements (#11292)
  • Script cannot contains ''' in params (#12068)
  • [improvement]Add Set cluster name (#12058)
  • [Improvement] Add Set cluster name (#12074)
  • add(dependent node's add unprivileged project list): dependent node's add unprivileged project list (#12073)
  • [improve] Optimize MLFlow task plugin for easy of use (#12071)
  • Remove dao in worker (#10994)
  • Move utils, builder under master (#11000)
  • [Improvement][Worker] Resource may store in hadoop/S3 (#11206)

Bugfix

  • [Fix][UI][V1.0.0-Beta] Fix the problem of packing failure. (#9962)
  • [Bug] [MASTER-9811]fix cmd param to overwrite global param when executing complement (#9952)
  • [Fix-10002] Fix some bugs in datasource list (#10005)
  • [Fix][UI] Fix the task name validator error. (#10008)
  • [Fix-9975] The selected task instance was recreated when the Master service failed over (#9976)
  • [Fix][UI] Support only one file upload on the file manage page. (#10007)
  • [Fix][UI] Fix errorOutputPath column in dataquality page (#10015)
  • [fix-9991][worker]fix statement is closed before resultSet.getMetaData() (#10014)
  • [dataquality] Fix task commnd null bug (#9974)
  • [Fix-10039] Flink run command when perfecting Python jobs (#10042)
  • [Bug] fix run on docker and k8s (#10026)
  • [python] Fix pre_submit_check error when local params in tasks (#10032)
  • [Fix][UI]Modify error message (#10054)
  • Fix flaky filemanage_e2e_test (#10068)
  • [Fix][UI] Fix in the Chinese state, there is a problem with the multi-language support of the form. (#10066)
  • [Fix][UI] Fix bug where username is empty in file manage (#10070)
  • [Bug][Master] fix master task failover (#10065)
  • [Fix-10080]When the created tenant name is too long, an error message will be prompted (#10081)
  • Create process definition with task group and task group priority cannot be save into db (#10078)
  • [Fix][Docker] Support Multi-Architecture Docker Images (#10052)
  • [Fix-10082]Resource userName is null and udf function manager add a username (#10064)
  • [Fix-10049] Conditions Task branch flow failed (#10077)
  • [Fix][UI] fulfill missing fields in DataQuality (#10098)
  • [fix] Enhance name pre checker in resource center (#10094)
  • [BUG][TaskGroup] Task group does not take effect (#10093)
  • [Build][UI] Solve vite config throws terser warning. (#10105)
  • Fix alert server curator health check not work (#10111)
  • Fix unit test and remove unused import (#10113)
  • [Bug][doc] Fix the open-api docs request error (#10100)
  • [Fix][UI] Add the task status of pending. (#10129)
  • [Fix][UI] Limit task group resource capacity to only positive integers. (#10158)
  • [Fix]Change the HTTP or HTTPS regular expression (#10166)
  • [Fix][UI] Fix the problem that the failure strategy field in the time management form is multilingual. (#10169)
  • [Fix-10057][api] api parameter name misspelling (#10063)
  • [Fix][UI] Add seatunnel icon (#10178)
  • fix spcial week init bug (#10183)
  • [Fix-10076] queryUserByToken use server timezone (#10177)
  • [Fix][UI] Fix data-quality component multi-language support. (#10202)
  • [Fix-10199] [Workflow/Workflow Definition] After deleting messages in batches, the error message is repeated (#10201)
  • [Bug][Deploy]Fix worker-server path in script scp-hosts.sh (#10208) (#10209)
  • fix#10214 Delete online workflows in batches, prompt information is accurate (#10215)
  • [python] Fix process definition attr release state not work (#10151)
  • [Fix][UI] add assignment of totalPage (#10165)
  • [Fix-10103][k8s]Fix k8s Change DataSource Error (#10128)
  • [Fix][UI] Fix the problem of multi-language support of workflow instance host in Chinese state. (#10223)
  • [fix-10207] When the registered alarm plugin is empty, the error message is not clear (#10224)
  • [Fix][UI] Fix issue with treemap depth in workflow relationships. (#10229)
  • [fix] Task group queue query all list error (#10237)
  • [Fix#9923] The alarm instance management interface is always in the loading state (#9924)
  • [Fix][UI] Set task group name empty of default value (#10243)
  • [fix][deploy] File overwrite when specific value set to installPath (#10241)
  • [fix] Deploy scp-hosts use fullpath avoid dangling (#10249)
  • [Bug] init docker compose DATABASE env (#10244)
  • [Fix-10181] Fix the logic of judging that the tenant does not exist (#10185)
  • [Fix][UI] Fix status statistics card height is inconsistent. (#10268)
  • [Fix] Fix the timeout alarm button is invalid (#10260)
  • [Fix] Fix the line.separator problem for alert-plugin' test case #10277 (#10278)
  • [fix] Fix the SERIAL_DISCARD execution_type not working (#10258)
  • [Fix][UI] Add mapping_columns filed for the data_quality ruleInputParamter. (#10286)
  • [Fix][UI] Display the result page when the DB page has no data. (#10298)
  • [Fix-8828] [Master] Assign tasks to worker optimization (#9919)
  • Fix database initialize late in standalone. (#10296)
  • [Fix-10317] [ui] Fix the tips of startTimeout in the jupyter form (#10319)
  • [Bug][Api-Server]Fix bug when user without tenant uploads file in resource center (#10303)
  • [Fix] Privilege Reconstruction Data Query Fix & Resource Creation Post Operations (#10313)
  • [Fix][UI] Fixed the issue that the status statistics on the project overview page were inconsistent. (#10328)
  • [Fix-10305][common] AWS config Constant definitions are repeated (#10311)
  • fix bug_10343 (#10344)
  • [Fix-10318][ui] Fix EMR Task UI custom parameters Is not correct (#10334)
  • [Fix-10338] Tenant does not belong to resource permission. (#10339)
  • [Fix] [Worker] Fix worker will hang if fails to start (#10342)
  • [fix][deploy]fix run on kubernetes bug (#10379)
  • [Fix-10367] Permission check related key adjustment. (#10368)
  • [Fix-10412] [Standalone] Failed to start standalone server according to the official document (#10414)
  • Fixed the problem of not having permission to modify the allocated resource data. (#10410)
  • [fix][Python] Support same task name in project defferent process definition (#10428)
  • [DolphinScheduler] Fix wrong class name in doc (#10438)
  • [Bug][Tools] Add datasource url for mysql profile in tools application.yaml (#10399)
  • [Fix-10425]Recovery LDAP Config (#10429)
  • [fix-10386]LDAP user create with status enable (#10426)
  • [Fix][UI] Add loading before file modification data is returned. (#10450)
  • [Bug-10394] [Update Possword] Change password shows error (#10437)
  • [fix][python] Correct variable type of SQL type (#10464)
  • fix rename form not init bug in file manange (#10471)
  • Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe (#10479)
  • [Fix] Fix the JSONUtils tool class time zone problem #10282 (#10284)
  • [fix][master]: fix condition npe (#10478)
  • Fix PeerTaskInstancePriorityQueue cannot contains method use taskInstanceId to check (#10491)
  • [Fix]Recovery Traffic Control Config (#10505)
  • [Fix-10413] Fix Master startup failure the server still hang (#10500)
  • [FIX] Could not find or load main class org.apache.zookeeper.ZooKeeperMain (#10535)
  • [Fix-10522] [API] Fix get executable time null pointer exception (#10523)
  • [Fix-10452] Serial wait for policy recovery (#10453)
  • [Fix-10274]Close InitialLDAPContext In LDAP (#10532)
  • fix: Current node settings number of failed retries may not be negative (#10530)
  • [fix][doc] Add DVC task plugin doc link (#10529)
  • [Fix] fix the HttpUtilsTest' test case , it is always time out. (#10294)
  • [fix] Change K8s postgresql password key name (#10545)
  • [Fix-10513] Fix the doc of pseudo-cluster mysql installation error #10564
  • [Fix-10547][data-quality] Fix Table or view not found #10549
  • [Fix-10514] The master frequently print the same info or error logs, leads to insufficient disk space #10568
  • fix standalone start error (#10577)
  • fix dependent task re-run params error (#10580)
  • [Fix-10400]Fix K8s deployment bitnami version error (#10567)
  • [Fix][dolphinscheduler-spi] json parse support LocalDateTime (#10440)
  • [Fix-10539] [Bug] [UI] Copy task a to B, change the user-defined parameter (#10611)
  • [Fix][UI] Fix bytesToSize function calculation error. (#10627)
  • [fix-10596] Workflow relationship cannot be displayed normally (#10625)
  • [fix-10632][ui] fix the workflow name with underline cannot be displayed correctly error. (#10636)
  • [Bug] [Master] Worker failover will cause task cannot be failover (#10631)
  • [Bug] [Api] The copied workflow create time and update time is still copied from the original workflow
  • [Fix-10641] [Common] Fix the hdfs NPE (#10642)
  • [Bug] [Task] SQL task no exception stack trace in task log (#10656)
  • [Fix-10652] fix docker-compose.yml (#10653)
  • [Fix][UI] Fix bug where the home page displays no data. (#10697)
  • fix bug where project overview page display no data (#10720)
  • [Bug] [Api-Service] Workflow and subworkflow instance does not change after clicking rerun。 (#10727)
  • [Fix-10666] Workflow submit failed will still in memory and never retry (#10667)
  • Fix language not matched (#10775)
  • [Bug][Script] Remove deprecated arg in remove-zk-node.sh (#10789)
  • [Fix][UI] Fix the environment name display back error. (#10797)
  • [API] Do not specify rollback for ensure in case of any exception or error. (#10793)
  • [Fix-10785] Fix state event handle error will not retry (#10786)
  • [CI] Fix checkstyle & review dog don't work (#10812)
  • [python] fix doc build error (#10810)
  • [python] Fix submit and run error (#10792)
  • [Fix-10829][UI] display real workflow relation in WorkFlow Relation page (#10836)
  • [Fix-10842] Fix master/worker failover will cause status incorrect (#10839)
  • Complement numbers will run in a loop under the serial strategy fixed. (#10862)
  • [Bug][Api] Complete Data workflow remove duplicates. (#10850)
  • [Fixed-10833] [Bug] [Quartz] timezone display doesn't match the next_fire_time in ds 3.0.0-beta1 version (#10865)
  • [Bug][Api] Complete Data workflow remove duplicates. (#10868)
  • [Fix-10863] Command execution result data statistics remove userId condition. (#10864)
  • [Fix-10854] Fix database restart may lost task instance status (#10866)
  • [fix] update queue and tenant with same code error (#10877)
  • [Fix][UI] Fix hive datasource doesn't show principal bug (#10876)
  • [Fix-10827] Fix network error cause worker cannot send message to master (#10886)
  • [bug][task-plugins]fix switch class name and add param check to the switch task plugin (#10894)
  • [fix] mlflow project success status (#10897)
  • [fix] delete workflow or task used by other tasks (#10873)
  • display timing record start time (#10915)
  • fix bug where task name display in gantt (#10900)
  • [Fix][UI] Add validator to the next node field of the switch task. (#10898)
  • Catch exception when check state in StateWheelExecuteThread (#10908)
  • Solve transaction problems under multi-threading (#10917)
  • [fix][plugin]: fix spark sql use custom parma. (#10821)
  • [FIX-10784][Bug] [ALERT-SERVER] FEISHU Plugin might block the whole alert process loop (#10888)
  • [fix] Can not query exists environments (#10884)
  • [Fix-10909] Returns executionStatus for each process instance status and access token module support. (#10922)
  • Fix taskInstance's host is not worker nettyServer address (#10926)
  • Fix kill yarn job error when failover caused by doesn't set ProcessDefinition (#10948)
  • [Fix][UI] Set the next node to not required. (#10932)
  • [fix-10954]Querying the task group list returns empty data (#10955)
  • fix: typo task definition. (#10958)
  • [Fix-10890] fix some bugs in the Resource page (#10907)
  • [Fix-10595][api] Fix Dependent Node Only View Projects Created By Self (#10834)
  • [python] Fix tasks with multiple upstream and workflow query error (#10941)
  • [fix] [MLflow Task plugin] Sometimes errors are reported using preset algorithms (#10986) (#10987)
  • Kill task when we do master failover to avoid task lost (#10997)
  • fix: typo executor service (#10980)
  • Fix worker cannot shutdown due to resource close failed or heart beat check failed (#10979)
  • [hotfix][Worker] Remove service dependency from worker module (#11008)
  • [Fix-11003]Task group queue is not updated to final state (#11004)
  • [Bug] fix task params pass (#11053)
  • [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors (#10734)
  • [Fix-11031] AccessToken can only be used by the creator. (#11032)
  • [E2E] [CI] Fix flaky e2e test (#11077)
  • Try to fix filemanage e2e flaky test (#11097)
  • add oracle dependency (#11095)
  • [Fix][UI] Widen the segment separator input box. (#11096)
  • fix view variable display bug (#11100)
  • [Fix][UI] Fix the problem of too large spacing in operation. (#11090)
  • fix space validate for create folder bug (#11106)
  • [fix] py sagemaker doc (#11109)
  • [Fix-10918] Close datasource when expire from guava cache (#11120)
  • [fix][Data Quality] Data Quality Report Display For Admin Role #10919 (#10977)
  • [Fix][UI] fix bug where The Gantt chart does not show the execution status (#11135)
  • [Bug] [API] If the single log length is long, it will causes the View Log page to hang (#10612)
  • [Fix][UI] Add duplicate of file suffix (#11136)
  • fix k8s master and worker start error (#11156)
  • [Bug-11101] fix task failover NPE (#11168)
  • [Fix-10665] [S3] Fix s3 download method (#10675)
  • [Fix-11140] Added resource parameters for function verification (#11141)
  • [Fix] Parameter values disappear when editing Zeppelin task (#11115)
  • [Bug-11071] fix local params (#11184)
  • fix nodeSize is not a function bug (#11200)
  • [BUG-11181] [Document] text check (#11183)
  • [Fix-11007] [Master] fix forced_success bug (#11088)
  • [Fix][UI] Fix datax task data instance replay error. (#11222)
  • fix work oom when task logs's size is very large (#11224)
  • Add alertPluginInstanceId in AlertInfo (#11231)
  • Fix recovery from failed task will dead loop (#11239)
  • fix bug where confirm disable error (#11251)
  • [Fix][UI] fix bug where log modal display object (#11271)
  • [fix-11233][ui] Remove custom template switch button in chunjun component module (#11234)
  • Fix TaskGroup cannot work and will cause master dead loop (#11254)
  • [fix] Process definition length too long when copy or import (#10621)
  • no-admin user query alert group fix (#11301)
  • [Fix][UI] Fix the taskPriority options not showing when hover. (#11294)
  • [Bug][Doc] Fix typos in docs which causes links to upgrade section to fail (#11333)
  • [Fix][UI] fix bug where icons are displayed in one line. (#11320)
  • [fix-11295] remove duplicate classes (#11355)
  • [Fix-11366][UI] Workflow instance should not support right-click running (#11367)
  • [Fix-11376][task plugin]Seatunnel Task cannot save successfully when select spark engine (#11377)
  • [fix-11378] fix API-Server release response message typo (#11400)
  • [Fix-10392][SqlTask]: Fix list param error when use sql task (#11285)
  • [Fix-11051][Task]Fix the process exitValue exception when the process times out and the process does not end. (#11099)
  • [Fix-1360]: Fix Description length check (#11371)
  • [Fix-11413] Cannot set task status to kill if the task is not in running(#11414)
  • [Fix][UI] fix bug where warn group name not display (#11429)
  • [fix-10961][alert server]Change the content of alert to an array (#11033)
  • Fix find last process instance in dependent task is not correct (#11424)
  • Fix workflow instance may failover many times due to doesn't check the restart time (#11445)
  • Set master's task running status in runTask to avoid the task group acquire failed, but the task status is in running (#11451)
  • If the task processor is not found need to throw error rather than exception (#11461)
  • [Fix-11465] Serial first, the last executing instance will be stopped (#11466)
  • [Fix][UI] Fix the table header in the workflow instance. (#11487)
  • [Fix][UI] Fix the preTask options are unavailable when creating a task in the task definition page. (#11501)
  • [fix] Database change not sync (#11258)
  • [Fix][UI] Remove unsupported datasource types in the datax task. (#11527)
  • Set process instance and task priority default value as 2 (#11539)
  • [fix-11404]: make the common.properties to configurable on values.yaml (#11441)
  • Fix some resource leak (#11576)
  • [Fix][Issue-11579] Cannot check the application status. (#11580)
  • Fix vulnerability in LDAP login (#11586)
  • Refresh server startup time when recovery from waiting (#11595)
  • Fix quartz threadPriority config name error (#11596)
  • Fix kill task failed will cause the taskGroup cannot release and add taskGroup log (#11469)
  • [Fix-9980] [Server] fix heartBeatTaskCount bug (#11232)
  • Fix homepage email subscription link (#11622)
  • [Fix][UI] Fix the port in the datasource edit. (#11624)
  • [Fix-11616] Workflow Definition Name Change Validation Optimization. (#11617)
  • [Fix][UI] Fix the problem that the pagination component is not centered in the environment management. (#11646)
  • [Fix][UI] Fix bug where crontab special of month and year (#11661)
  • [fix][python] Sql pattern add truncate. (#11666)
  • [bug][python] Fix task switch error when default branch not defined last (#11606)
  • [Fix-11633] The data type of the PostgreSQL database column is wrong. (#11633) (#11634)
  • [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11701)
  • [Fix][UI] Add the task name entry when the workflow instance detail page goes to the task instance page. (#11761)
  • [fix][doc] Update the registry related configuration in values.yaml (#11444) (#11981)
  • [Bug][Workflow Definition] fix ordinary users can not create depend task (#11961) (#11977)
  • [Bug-11650][worker] #11650 fix SQL type task, stop task cause NPE (#11668) (#11958)
  • [Bug] [Master] WorkflowExecuteRunnable will face a infinite loop #11838 (#11864) (#11950)
  • [Fix][db] fix init&upgrade mysql-meta-schema bugs (#11887) (#11935)
  • [Bug] Fix procedure task param pass #11919 (#11926)
  • [Fix-11217] [Doc] add postgresql config in doc: datasource-setting (#11326)
  • [fix-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames (#11696)
  • [fix-#11691] Add lz4-java in clickhouse datasource. (#11697)
  • Example Change the regular expression of the data source password (#11459) (#11990)
  • Fix insertOrUpdate plugin may failed due to concurrent operation (#11471) (#11996)
  • Update dolphinscheduler_ddl.sql fix alert t_ds_user add time_zone is not correct (#11795)
  • [python] Fix permission error when create related objects (#11783)
  • [Bug][Dependent]: Id also clone due to duplicate when use dependent mode. (#11929)
  • Fix listing processDefinition the schedulerReleaseState will never be null (#11888)
  • Add chunjun in dolphinscheduler-task-all/pom.xml (#11375)
  • [Bug] [dolphinscheduler-api] Data Analysis Service API responds with jackson deserialization exception (#11858)
  • [Fix][Monitor]Monitor UI not show DisakAvailable and MemoryUsage correctly (#11870)
  • fix workflow keep running when task fail (#11930)
  • Fix cannot save processDefinition (#11931)
  • Bug Dependent downstream trigger error when schedule cycle not day. (#11734)
  • Fix update TaskDefinition error (#12064)
  • [fix][python] Task switch branch not show in webui (#12120)
  • [Fix] Also auto formatter workflow instance if location is null (#12080)
  • fix python home conflict (#12112)
  • [Fix][UI] Fix workflow name overlaps bug (#11862) (#12125)
  • [BUG]Delete Setting ID (#12096)
  • Fix insert command error due to the id is not null (#12092) (#12098)
  • [BUG][BE-12113]fix htrace dependency conflicts (#12126)
  • [bug][k8s] Change the config file keys in K8s to be the same as those in common.properties (#11812)
  • [k8s] Delete unnecessary configurations. (#11808)
  • fix upgrade for 310 (#12137)
  • [fix#12000]Cannot remove the WorkerGroup from the master service (#12050)
  • fix env config space bug (#12147)

Doc

  • [Docs] Upgrade license. (#9967)
  • [Docs] Update README. (#9970)
  • [doc] Fix docs deadlink in readme (#9972)
  • [doc] Update the document picture to new UI (#9953)
  • [Doc] Add example and notice about task type Conditions (#9945)
  • [Docs] Fix docker link. (#9998)
  • [doc] Add the description about execute type in SQL task (#9987)
  • [doc] Add example and notice about task type Dependent (#10001)
  • [doc] Correct kubernetes (#9985)
  • [doc] Correct docs of development-environment-setup (#9995)
  • [Bug][Document] Fix task group management document link error (#10062)
  • [Fix-10083][Doc]Change Docker cmd && Change WebexTeams Chinese Translation (#10084)
  • [doc] Show all the functions of the home page through screenshots (#10118)
  • [doc] change document structure (#10124)
  • [doc] Remove flink call docs (#10122)
  • [doc] Update editorial workflow content and images (#10130)
  • [doc] Update website docs link (#10161)
  • [doc] Refactor global parameter docment (#10045)
  • [doc] Update project directory structure in docs (#10107)
  • [Doc] Add complie supporting system (#10188)
  • [doc] Update delete workflow description (#10203)
  • [doc] Update task DataX document (#10218)
  • [doc] Update kubernetes' FAQ (#10221)
  • [doc] Refactor local parameter docment (#10119)
  • [doc] Delete SPRING_DATASOURCE_DRIVER_CLASS_NAME in doc (#10228)
  • [doc] Add setValue syntax in local param (#10245)
  • [doc] Correct all setup documents (#10074)
  • [doc] Upgrade screenshot to latest version in dev document (#10242)
  • [doc] Refactor context parameter docment (#10227)
  • [docs] Added local file configuration guide for resource center (#10264)
  • [doc] Update the development environment to build the software version (#10246)
  • [doc] Fix api standard error (#10292)
  • [doc] Add how to use resource in shell task (#10308)
  • [doc] Use related path for img (#10325)
  • [Docs]Update Slack Invite Link (#10362)
  • [Docs] Upgrade license. (#10365)
  • [doc] Add switch task demo (#10247)
  • [doc] Correct resource in HDFS HA cluster (#10445)
  • [Doc] Add how to set the alarm mailbox in faq (#10401)
  • [Doc] Add api test doc (#10499)
  • [doc] Correct the complement add docs (#10521)
  • [doc] Add docs about complement dependent mode (#10587)
  • [doc] Add doc about how to use healthcheck endpoints (#10592)
  • [doc] Add run the task alone doc. (#10581)
  • [docs] Add links to metrics docs (#10583)
  • [doc] Correct installPath when using related path (#10597)
  • [doc] Modify Shell task file (#10634)
  • [doc] Change subprocess dependent (#10637)
  • [doc] Modified parameter doc files. (#10659)
  • [doc] Replace the dag screenshot of the README. (#10662)
  • [doc] Update metadata and design doc (#10600)
  • [doc] Add doc for pre-sql and post-sql (#10685)
  • [doc] Change datasource doc (#10660)
  • [doc] Change tasks doc (#10639)
  • [doc] Modified alert doc files (#10714)
  • [doc] Modify quick start. (#10712)
  • Merging general settings to faq (#10716)
  • [Docs] Replace the dag screenshot of the README. (#10741)
  • [doc] Modified project doc. (#10711)
  • [doc] Change tasks docs (#10751)
  • [doc] Unify data source switching of the docs during installation (#10688)
  • [doc] Replace the dag screenshot of the README. (#10798)
  • [doc] Modified dq, monitor, security, resources (#10715)
  • [doc] Modify features, hw, intro and homepage docs. (#10713)
  • [doc] Correct custom jdbc driver for K8s Doc (#10768)
  • [Docs] Updated license. (#10838)
  • [Doc][Upgrade] Fix tiny error in upgrade docs (#10847)
  • [doc] Add missing doc change by snehal (#10892)
  • [Doc]Chinese translation updated (#11146)
  • [doc] Fix bugs in doc installation, design and glossary (#11084)
  • [doc] Add new page incompatible change (#11153)
  • [doc] Add notice when environment can not select (#11276)
  • [Doc] update the configuration doc (#11113)
  • [doc] migrate community and development docs into main repo (#11313)
  • [Doc] Add tools/libs to the init database steps (#11345)
  • [doc] Fixed hadoop link to avoid dead link (#11363)
  • [doc] Improve the document introduction of complement (#11275)
  • [doc] Refine the deployment documentation (#11361)
  • [doc] Recover traffic configuration (#11288)
  • [doc] Add how obtain IP address from network card in FAQ (#11311)
  • [Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11435)
  • [Doc][DSIP] Move DSIP docs to the right place (#11442) (#11443)
  • [doc] Use Rainbond deployment DolphinScheduler Cluster (#10951)
  • [Doc][Security] Update instructions on worker groups (#11483)
  • [Doc] Update UI readme. (#11496)
  • [Doc][Bug] Fix resource center docs for standalone mode (#11600)
  • [DOC] should notice that need setting the full path when call the resource file #11620 (#11621)
  • [Docs] Update README. (#11641)
  • [doc] Correct E2E Doc, fix WorkerGroupPage typo (#11629)
  • [DOC] improve zk digest doc (#11703)
  • [Doc][Improvement] Add instructions for process execution type and data complement (#12121)
  • add Feishu alert doc and configure email alert doc to the docsdev.js (#11173)
  • [doc] Fix installation typo (#11220)
  • [Improvement-11481][docs] Add log specification document to contribution guidelines. (#11484)
  • Enable spotless to fix markdown checkstyle and refactor faq.md as an example (#11384)
  • Update doc according to recent update of Spring / Swagger (#11755)
  • [Doc] Put default task parameters in a new file #11776 (#11957)
  • [Fix-10830][Doc] Change the start or install script command sh in the document to bash (#10831)
  • [Doc][Style] Fix doc format once for all (#12006)

Chore

  • [ci] Correct CODEOWNERS and add new pom.xml owner (#9954)
  • [Build][UI] Upgrade dependencies. (#9956)
  • [chore] Combine version 206 and 210 sql upgrade to 300 (#9959)
  • [ci] Dead link check all markdown file (#10004)
  • [chore] update by release version (#10299)
  • [ci] Fix mergeable for ddl change and remove label unexpect (#7099)
  • [CI] bumping actions/cache to v3 to fix ci error (#10345)
  • [Build][UI] Upgrade dependencies. (#10346)
  • [CI] Add code owner of .github (#10347)
  • [CI] Add some codeowner (#10385)
  • [chore] Remove unnecessary badge total lines (#10405)
  • add codeowner (#10457)
  • add_some_code_owners (#10462)
  • Open checkstyle, change checkstyle severity from info to warning (#10492)
  • add codeowner (#10537)
  • [chore] update by release version (#10742)
  • [ci] mergable do not handle label (#10638)
  • Add improvement template (#10764)
  • Add doc issue template (#10804)
  • [API-Test] [Checkstyle] Reformat api-test code and enable checkstyle (#10805)
  • add reviewdog token to enable checkstyle (#10819)
  • [Build][UI] Updated dependencies. (#10813)
  • [CI] Try to fix label bot (#10852)
  • [ci] Fix mergeable will get mad add/remove label sometimes (#10856)
  • fix label bot again (#10859)
  • [python] Integrate test run strategy change (#10825)
  • Add EricGao888 to help review docs, tools, etc. (#11047)
  • [python] Add directly install without clone source code (#11179)
  • [ci] Make cluster test work on release branch (#11199)
  • [community] Remove stackoverflow ref link in website (#11342)
  • Modifying Slack Links (#11416)
  • update PyDolphinScheduler documentation link. (#11474)
  • update slack (#11578)
  • [CI] Fix cluster test abnormal (#11688)
  • add lombok config (#11212)
dolphinscheduler - 3.0.1

Published by zhuangchong about 2 years ago

Bugfix

  • [Improvement][UI] Unified local parameters UI #11190
  • [Fix][UI] Fix bug where icons are displayed in one line. #11320
  • [Improvement-11386][UI] Concise the logic available for task action buttons #11419
  • [Fix][UI] Fix the preTask options are unavailable when creating a tas… #11501
  • S3 Resource center supports bucket customization (#12022)
  • fix status check issue (#11580) (#12030)
  • [LDAP] Config value should return real null instead of 'null' string (#12031)
  • [3.0.1-preapre][cherry-pick]3.0.1 UI (#12020)
  • [Fix][UI] Fix bug where crontab special of month and year #11661
  • [UI] Enable highlight and auto-complete for SQL scripts #11659
  • [Fix][UI] Fix the problem that the pagination component is not centered in the environment management. #11646
  • [Fix][UI] Fix the port in the datasource edit. #11624
  • [Fix][UI] Fix the table header in the workflow instance. #11487
  • [Fix][UI] Fix bug where warn group name not display #11429
  • [Feature-10117][UI] Hide node execution when start from the workflow definition list page #11372
  • [Fix-11366][UI] Workflow instance should not support right-click running #11367
  • [fix-10961][alert server]Change the content of alert to an array (#11033)
  • [Fix][UI] Fix workflow name overlaps bug (#11862) (#12019)
  • [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11994)
  • fix heartBeatTaskCount bug (#12024)
  • Fix kill task failed will cause the taskGroup cannot release and add taskGroup log (#11469) (#12013)
  • Workflow Definition Name Change Validation Optimization. (#11986)
  • add unit test ci timeout (#11655) (#12021)
  • [helm] fix worker template persistentVolumeClaim link (#11248) (#12018)
  • Set master's task running status in runTask to avoid the task group acquire failed, but the task status is in running (#11451) (#12011)
  • [python] Refactor structure to avoid cycle import (#11167)
  • [python] Add support interpreter version 310 and 311-dev (#11170)
  • [bug][python] Fix task switch error when default branch not defined last (#11606)
  • [fix][python] Sql pattern add truncate. (#11666)
  • Add dependent task instance log (#11541) (#12014)
  • If the task processor is not found need to throw error rather than exception (#11461) (#12012)
  • Fix workflow instance may failover many times due to doesn't check the restart time (#11445) (#12010)
  • Fix find last process instance in dependent task is not correct (#11424) (#12009)
  • Fix quartz threadPriority config name error (#11596) (#12015)
  • [Fix-11413] Cannot set task status to kill if the task is not in running(#11414) (#12007)
  • Clear thread name in BaseTaskProcessor (#11422) (#12008)
  • Bug Dependent downstream trigger error when schedule cycle not day. (#11987)
  • [CI] Fix cluster test abnormal (#11688) (#11985)
  • [Improvement-11380][scp-host.sh] Set StrictHostKeyChecking=no option to ssh (#11382) (#11995)
  • optimize the process instance query, change the date time range (#11719) (#11991)
  • [Fix-11051][Task]Fix the process exitValue exception when the process times out and th… (#11099) (#11983)
  • [fix-11404]: make the common.properties to configurable on values.yaml (#11441) (#11967)
  • ][fix-11452][Bug] [Logger Server] Incorrect password regular expression (#11993)
  • Remove logger header in task log file (#11555) (#11968)
  • [Bug] [API] The task priority and process instance priority might be null and cause NPE (#11969)
  • [Bug] [spark-sql] In spark-sql, select both SPARK1 and SPARK2 versions and execute /bin/spark-sql (#11971)
  • Update dolphinscheduler_ddl.sql (#11974)
  • [fix-#11815] fix ck column names contain special characters (#11973)
  • [Bug][Workflow Definition] fix ordinary users can not create depend task (#11961) (#11976)
  • [Fix-11877][UI] Fix the problem that the environment cannot be delete (#11934)
  • [fix-10938]: use dot to replace source and make the default env work in shell (#11937)
  • fix hdfs defaultFs not working (#11823) (#11936)
  • [Quartz] cron did not work as expected (#11932)
  • [Bug] [Master] WorkflowExecuteRunnable will face a infinite loop #11838 #11864 (#11949)
  • [Bug-#11650][worker] #11650 fix SQL type task, stop task does not take effect (#11938)
  • [Fix][db] fix init&upgrade mysql-meta-schema bugs #11887 (#11933)
  • Process definition length too long when copy or import #10621 (#11893)

Documentation

  • [improvement-#11630]fix document about common.properties (#11653)
  • update PyDolphinScheduler documentation link. (#11474)
  • [doc] Correct E2E Doc, fix WorkerGroupPage typo (#11629)
  • Fix homepage email subscription link (#11622)
  • [DOC] should notice that need setting the full path when call the resource file #11620 (#11621)
  • [Doc][Bug] Fix resource center docs for standalone mode (#11600)
  • feat: update slack (#11578)
  • [Improvement-11550] [Doc]Document content update (#11577)
  • [Doc][Security] Update instructions on worker groups (#11483)
  • [Doc][DSIP] Move DSIP docs to the right place (#11442) (#11443)
  • [Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11435)
  • feat: Modifying Slack Links (#11416)
  • [python] Add multiple version of document (#11391)
  • [doc] Refine the deployment documentation (#11361)
  • [Fix-11217] [Doc] add postgresql config in doc: datasource-setting (#11326)
  • [doc] Improve the document introduction of complement (#11275)
  • [DOC] improve zk digest doc (#11703) (#11992)
  • [Doc] Remove re-upload file function in the 3.0.0's doc (#11804) (#11984)
  • [doc] Add how obtain IP address from network card in FAQ (#11311) (#11982)
  • fix doc about sub-process's child node describe (#11972)
  • [fix][doc] Update the registry related configuration in values.yaml (#11444) (#11980)
dolphinscheduler - 3.0.0

Published by zhongjiajie about 2 years ago

Feature

  • Add Task group feature to limit the concurrency of taskInstance (#6422)
  • [UI Next] A new version of the UI proposal (#7332)
  • [UI Next] Data Quality (#8275)
  • Support custom timezone (#8310)
  • Dependent tasks can re-run automatically in the case of complement (#8373)
  • Optimize workflowlieage query speed (#8499)
  • Add dataSource for Amazon Redshift (#8527)
  • Refactor cli config dict mechnism (#8593)
  • E2E test adapt M1 chip (#9039)
  • Support output parameters transfer from parent workflow to child work flow. (#9396)
  • [python] Add mechanism cli with simple command (#8516)
  • [python] Add config mechanism and cli subcommand config (#8585)
  • [Feature- 9837][plugin/ui] support FlinkSQL Task (#9840)
  • [Feature-9177][Task] The sql task supports configuring segmentation notation to provide execution of multiple statements (#9917)
  • [Feature][UI] Disabled statistics. (#9935)
  • [Feature][Log]Add timezone information in log output (#9913)
  • [Feature] Remove old ui. (#9909)
  • [Feature][UI Next][V1.0.0-Beta] Add hints to the password repeat. (#9888)
  • [Feature][UI Next][V1.0.0-Beta] Rename SeaTunnel. (#9839)
  • [Feature][UI Next] Add front-end for Apache Zeppelin task plugin (#9597) (#9810)
  • [Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9733)
  • [Feature]The utils configuration files are centrally managed under common (#9706)
  • [Feature]Unified exposure method class (#9698)
  • [Feature][UI][V1.0.0-Beta] Modify timeout from 10s to 15s of axios (#9644)
  • [Feature][UI][V1.0.0-Beta] Add dependent task status in dependent task. (#9663)
  • [Feature][Task-Plugin]Add zeppelin task-plugin to support Apache Zeppelin (#9327)
  • [Feature][UI Next][V1.0.0-Beta] Monaco Editor supports theme switching function. (#9521)
  • [Feature][UI Next][V1.0.0-Beta] Change the css style usage of the blue number flopper in the alarm center to css variables. (#9511)
  • [python] Add task decorator for python function (#9496)
  • [python] Support read config in env variable (#9517)
  • [Feature][Task] K8s namespace auth manager (#9303)
  • [Feature][API] Refactor get dependent node information api (#9591)
  • [Feature][UI Next]Added the method of downloading files (#9605)
  • [Feature] [ALERT-9406]enrich alert info when insert new row into DB (#9445)
  • [Feature] [ALERT-9406]add new properties to alert class (#9408)
  • [Feature-9204][alert] Implement alert send status (#9208)
  • [Improve][API] Allowed the non-root user to create the task group. (#9523)
  • [DS-9263][Improvement][master]optimize failover (#9281)
  • [Improvement] change method access (#9390)
  • [improve][python] Specify warning group when deploy process-definition (#9773)
  • [improve][api] Support to upload file without file type suffix (#9553)
  • [Improvement][server] varPool support syntax #{setValue(key=value)} (#9586)
  • [Improvement-9609][Worker]The resource download method is selected according to the configurati… (#9636)
  • [Python] Supports creating or editing resources. (#10823)
  • [Feature-10871] add workflow executing data query (#10875)

Improvements

  • Task back-end plugin optimization, new plugins only need to modify the plugin's own module (#8584)
  • Verify the endtime and starttime when submit/create a cron under workflow (#8874)
  • Dependent The global project can be selected when adding dependencies (#9016)
  • AlertSender optimization and gracefully close, such as MasterServer (#9221)
  • implement use the slot to scan the database (#9228)
  • Slim dist package by migrate python gatewar into apiserver (#9230)
  • [python] Migrate pythonGatewayServer into api server (#9372)
  • [python] Add missing doc about config and connect remote server (#9443)
  • [Master/Worker] Change the task ack to runnning callback (#8719)
  • [Master] add task event thread pool (#9293)
  • [Improvement-10617] Add comment in slot check (#10618)
  • Optimize MasterServer, add MasterRPCService (#10371)
  • [python] Integrate test run strategy change (#10825)
  • Optimize master log, use MDC to inject workflow instance id and task instance id in log (#10516)
  • Add some warning log in master (#10383)
  • [Improvement] Resource authority module database table unique index increased. (#10807)
  • [Improvement] [Alert Server] Add default datasource url in alert server application.yaml for consistency (#10790)
  • [Improvement] heartbeat info improvement (#10699)
  • Add JDK11 on unit-test (#10364)
  • Update SparkRuntimeEnvironment.java (#10549)
  • add datasource health check to the healthcheck endpoint (#10588)
  • [Improvement][UI] Improve monaco-editor component in ts. (#11274)
  • [python] Add directly install without clone source code (#11179)

Bugfix

  • Task back-end plugin optimization, new plugins only need to modify the plugin's own module (#8584)
  • Verify the endtime and starttime when submit/create a cron under workflow (#8874)
  • Dependent The global project can be selected when adding dependencies (#9016)
  • AlertSender optimization and gracefully close, such as MasterServer (#9221)
  • implement use the slot to scan the database (#9228)
  • Slim dist package by migrate python gatewar into apiserver (#9230)
  • [python] Migrate pythonGatewayServer into api server (#9372)
  • [python] Add missing doc about config and connect remote server (#9443)
  • [Master/Worker] Change the task ack to runnning callback (#8719)
  • [Master] add task event thread pool (#9293)
  • [Bug] init docker compose DATABASE env (#10244)
  • [fix] Deploy scp-hosts use fullpath avoid dangling (#10249)
  • [fix][deploy] File overwrite when specific value set to installPath (#10241)
  • [Fix][UI] Set task group name empty of default value (#10243)
  • [Fix#9923] The alarm instance management interface is always in the loading state (#9924)
  • [fix] Task group queue query all list error (#10237)
  • [improve] Change Mysql Driver (#10220)
  • [Fix][UI] Fix issue with treemap depth in workflow relationships. (#10229)
  • [fix-10207] When the registered alarm plugin is empty, the error message is not clear (#10224)
  • [Fix][UI] Fix the problem of multi-language support of workflow instance host in Chinese state. (#10223)
  • [Fix-10103][k8s]Fix k8s Change DataSource Error (#10128)
  • [Fix][UI] add assignment of totalPage (#10165)
  • [python] Fix process definition attr release state not work (#10151)
  • fix#10214 Delete online workflows in batches, prompt information is accurate (#10215)
  • [Bug][Deploy]Fix worker-server path in script scp-hosts.sh (#10208) (#10209)
  • [Fix-10199] [Workflow/Workflow Definition] After deleting messages in batches, the error message is repeated (#10201)
  • [Fix][UI] Fix data-quality component multi-language support. (#10202)
  • [refactor][perf] cache compiled regex pattern (#10099)
  • [Fix-10076] queryUserByToken use server timezone (#10177)
  • fix spcial week init bug (#10183)
  • [Fix][UI] Add seatunnel icon (#10178)
  • [Fix-10057][api] api parameter name misspelling (#10063)
  • [Fix][UI] Fix the problem that the failure strategy field in the time management form is multilingual. (#10169)
  • [Fix]Change the HTTP or HTTPS regular expression (#10166)
  • [Fix][UI] Limit task group resource capacity to only positive integers. (#10158)
  • [Fix][UI] Add the task status of pending. (#10129)
  • [python] Change distribute name avoid confusion with main pkg (#10134)
  • Fix alert server curator health check not work (#10111)
  • [Build][UI] Solve vite config throws terser warning. (#10105)
  • [BUG][TaskGroup] Task group does not take effect (#10093)
  • [fix] Enhance name pre checker in resource center (#10094)
  • [Fix][UI] fulfill missing fields in DataQuality (#10098)
  • fix issue-10061 (#10062)
  • [Feat][UI] Add resource username for function and resource manage (#10086)
  • [Fix-10049] Conditions Task branch flow failed (#10077)
  • [Fix-10082]Resource userName is null and udf function manager add a username (#10064)
  • [Fix][Docker] Support Multi-Architecture Docker Images (#10052)
  • Create process definition with task group and task group priority cannot be save into db (#10078)
  • [Fix-10080]When the created tenant name is too long, an error message will be prompted (#10081)
  • [Bug][Master] fix master task failover (#10065)
  • [Fix][UI] Fix bug where username is empty in file manage (#10070)
  • [Fix][UI] Fix in the Chinese state, there is a problem with the multi-language support of the form. (#10066)
  • [Fix][UI]Modify error message (#10054)
  • [python] Fix pre_submit_check error when local params in tasks (#10032)
  • [Bug] fix run on docker and k8s (#10026)
  • [Fix-10039] Flink run command when perfecting Python jobs (#10042)
  • [dataquality] Fix task commnd null bug (#9974)
  • [fix-9991][worker]fix statement is closed before resultSet.getMetaData() (#10014)
  • [Fix][UI] Fix errorOutputPath column in dataquality page (#10015)
  • [Fix][UI] Support only one file upload on the file manage page. (#10007)
  • [Fix-9975] The selected task instance was recreated when the Master service fail… (#9976)
  • [Fix][UI] Fix the task name validator error. (#10008)
  • [Fix-10002] Fix some bugs in datasource list (#10005)
  • [Bug] [MASTER-9811]fix cmd param to overwrite global param when executing complement (#9952)
  • [Fix][UI][V1.0.0-Beta] Fix the problem of packing failure. (#9962)
  • [Build][UI] Upgrade dependencies. (#9956)
  • [chore] Combine version 206 and 210 sql upgrade to 300 (#9959)
  • [Fix][UI][V1.0.0-Beta] Fix the problem of packing failure. (#9966)
  • [Fix #9925]: fix ellipsis bug in table column (#9936)
  • fix miss fixvalue input (#9933)
  • [Fix][UI Next][V1.0.0-Beta] Fix console bug after deleting a node from the context menu. (#9932)
  • [Fix] add resource capacity required rule (#9922)
  • [Fix][UI Next][V1.0.0-Beta] Fix data quality data not displayed. (#9930)
  • [Fix]Added request header validation (#9915)
  • [Fix-9906] After the serial wait execution strategy stops the running workflow instance, the instance will be woken up and executed if there is a wait instance. (#9907)
  • [Fix][UI-NEXT] Disable file name (#9893)
  • [Fix][UI Next][V1.0.0-Beta] Fix jdbc connect parameter validate bug (#9891)
  • [Fix][UI Next][V1.0.0-Beta] Fix the task group queue display error. (#9890)
  • [Fix][UI Next][V1.0.0-Beta] Fix edge deletion unhandled and remove the useless nextNodes. (#9875)
  • [Fix][UI Next][V1.0.0-Beta] Fix some errors on the datasource page. (#9877)
  • [Fix][UI Next][V1.0.0-Beta] Fix the page input error on the token manage page. (#9879)
  • [Fix][UI Next][V1.0.0-Beta] Fix bug where logo disappeared when format dag. (#9864)
  • [Fix-9856]Failed to upload the file but get misleading error message (#9861)
  • [Fix-9868] A task flow definition isolates the runs of different execution strategies by version numbers. (#9869)
  • [Bug] [worker] fix CommandType TASK_EXECUTE_RUNNING_ACK don't consumed (#9849) (#9850)
  • [Fix][UI Next][V1.0.0-Beta] Fix the problem that there is no prompt for selecting users. (#9858)
  • [fix] fix query access token for specified user failed (#9855)
  • [Fix][UI Next][V1.0.0-Beta] Add validation rules to dependency of the dependent task. (#9844)
  • Serial wait for subsequent execution (#9847)
  • [Bug-9829][Api] Fix schedule timezone (#9830)
  • [Fix]fix the search bar echoes abnormally (#9835)
  • [BUG][ALERT-SERVER]validate script before alert script (#9834)
  • [Fix] json object serialization error (#9828)
  • [Fix][UI][V1.0.0-Beta] Fix the problem of wrong workflow name. (#9833)
  • Task queue status update. (#9832)
  • [Fix][UI] Hide the version control button in workflow instance (#9825)
  • The node ID under serial is greater than the current ID. (#9820)
  • [Fix][UI] Fix timing modal start time and end time bug (#9815)
  • [Bug] [Website-9764]add http alert doc and change body param to unnecessary (#9792)
  • [Fix-9796] The task queue can be executed normally. (#9797)
  • [Fix][UI Next][V1.0.0-Beta] Add a return button and set the form to disabled on the file detail page. (#9802)
  • [Fix][Next-UI][V1.0.0-Beta] Fix placeholder error on the task queue page. (#9805)
  • [Fix-9352][datasource-api]data source client uses a cache with an expiration time (#9353)
  • revert delete dumplicate task_definition_log ddl (#8567)
  • [Bug][dep] Bump httpclient version to 4.5.13 (#9631)
  • [bug][db] Table relation_project_user have duplicate record (#9536)
  • [fix-9785][UI Next][dev] dynamic change height in viewlog when full screen (#9788)
  • [feat] Update README (#8261)
  • [Bug][Api] Failed to rerun the workflow instance (#9795)
  • [Bug]Fix log request errors (#9791)
  • Task group queue supports fuzzy search. (#9784)
  • [Bug] [Alert-9786] Http alert Get method not working (#9787)
  • [Bug] [Website-9764]add script doc to the alert function (#9765)
  • A task instance that normally queries the serial wait state. (#9777)
  • [Bug]Fix groupId initialization value problem (#9775)
  • [Fix][UI Next][V1.0.0-Beta] Add the 'startNodeList' field to the 'start-process-instance' interface. (#9769)
  • [Bug]Fix right-click menu function error (#9766)
  • [Fix][UI Next][V1.0.0-Beta] Fix cannot select the workload scheduling time bug (#9762)
  • [Fix][UI Next][V1.0.0-Beta] Remove the default values for node name and child node. (#9760)
  • [Fix][UI Next][V1.0.0-Beta] Change the label from recovery failed to failed to retry. (#9761)
  • Add the host address of the execution server to the sub task task instance. (#9758)
  • fix query issue when update environment (#9752)
  • improve task flow date time exception handle (#9732)
  • Subtask component treemap problem fix. (#9755)
  • [common] Make dolphinscheduler_env.sh work when start server (#9726)
  • [Fix-9717] The failure policy of the task flow takes effect (#9718)
  • fix process instance global param not include to task instance when master executing (#9730)
  • [Fix][UI Next][V1.0.0-Beta] Fix the bug that the tenant is 0 when editing a user. (#9739)
  • [Bug-9737][Api] fix task plugin load in api (#9744)
  • [Fix][UI][V1.0.0-Beta] Set the default value of host to '-' and Disable log button without host data. (#9742)
  • [Fix][UI Next][V1.0.0-Beta] Fix citation errors. (#9741)
  • [Bug][Script] Fix the type of variable workersGroupMap is not supported in bash 3.x (#9614)
  • [Bug]Fixed the problem of no request from right click viewing log (#9728)
  • [Improve][python] Support create table syntax and custom sql type param (#9673)
  • [Bug][UI][V1.0.0-Beta] Fix action buttons not displayed on one line bug (#9700)
  • [Bug] [UI][V1.0.0-Beta] Fix task group name can't clear bug (#9708)
  • [Bug-9719][Master] fix failover fail because task plugins has not been loaded (#9720)
  • [fix][Service] BusinessTime should format with schedule timezone (#9714)
  • [Fix][UI Next][V1.0.0-Beta] Set the timout label to not show. (#9710)
  • [Fix][UI Next][V1.0.0-Beta] Fix bug where route is error in file manage root (#9697)
  • [Fix][UI Next][V1.0.0-Beta] Fix success logo is not display bug (#9694)
  • [Fix][UI Next][V1.0.0-Beta] Fix the startup parameter display error. (#9692)
  • [Fix][UI Next][V1.0.0-Beta] Change update user to edit user. (#9683)
  • fix alert msg and change primitive to String to avoid wrong format (#9689)
  • [Fix][UI Next][V1.0.0-Beta] Fix bug where name copy is invalid (#9684)
  • [Fix] Support more generic tenant code when create tenant (#9634)
  • [hotfix][docker] Removed extra equals in mail user (#9677)
  • [chore] Correct the java doc in funtion DagHelperTest generateDag2 (#9602)
  • fix task dispatch error overload resource pool of task group (#9667)
  • Project management batch deletion should give a specific description if it fails. (#9669)
  • [Bug][UI][V1.0.0-Beta] Fix display resource not exist error message bug (#9657)
  • [Fix][UI][V1.0.0-Beta] Fix the parameter variables and startup parameters window cannot auto close bug (#9653)
  • [Fix][UI][V1.0.0-Beta] Adjust the UI presentation of the dependent task. (#9649)
  • [Fix][UI][V1.0.0-Beta] Replace the back-end interface for dependent task. (#9645)
  • [Fix][UI][V1.0.0-Beta]Fix data not update bug for workflow version switch (#9642)
  • [Improvement][style]add comment and clear warn (#9247)
  • [Bug-9608] Serialize the task definition failed (#9622)
  • [Bug][DAO] Update db init script and soft_version (#9628) (#9637)
  • [Bug] cancel application when kill task (#9624)
  • [Fix-9617]New task group project name drop-down data is displayed according to user type. (#9625)
  • [Fix][UI][V1.0.0-Beta] Fix tooltip not display bug in task instance (#9630)
  • upgrade commons-compress to 1.21 (#9540)
  • update jackson and jackson.databind version to fixes many security issues (#9572)
  • use secure version of postgresql (#9573)
  • [Fix][UI][V1.0.0-Beta] Fix the task name cleared after switching the task type. (#9623)
  • [Fix][UI][V1.0.0-Beta] Change node name to task name in the task modal on the task definition page. (#9620)
  • [Fix][UI][V1.0.0-Beta] Remove the sql comment in the procedure task and add the instructions link to the procedure task. (#9619)
  • [Fix][UI] Fix the udf function echoed error in the sql task. (#9616)
  • fix 9584 (#9585)
  • [Fix-9610] Sub-workflow status check is limited to SUB_PROCESS components (#9611)
  • [Python] Make detached signature during release (#9607)
  • [Bug][Standalone Server] Deduplicate the classpath jars in start.sh of the standalone server (#9583)
  • [Fix-9593] Storage Management StorageOperate No Instance (#9594)
  • Add ingress annotations (#9492)
  • [Fix][UI Next][V1.0.0-Beta] The version information creation time in the workflow definition is changed to the operateTime field. (#9590)
  • fix task kill (#9578)
  • [Bug] [API-9558]fix homepage task instance count method to use submit time to recount (#9559)
  • [Refactor][UI Next]Reconstructing the Log Component (#9574)
  • fix process pause and rerun (#9568)
  • [fix-9428] [DataSource] delete the password and test again, it is successful without password bug (#9428) (#9531)
  • [Fix][Master Server] handle warn+failed timeout strategy in workflow execute thread of master server (#8077) (#9485)
  • Check the status of the child process when the parent process is running (#9567)
  • fix workflow instance can not be save bug (#9554)
  • [Perf][UI Next][V1.0.0-Beta] Optimize judgment logic. (#9561)
  • [Fix][UI Next][V1.0.0-Beta] Fix the color matching problem of the relationship diagram. (#9546)
  • [Fix][UI] Fix the problem of displaying task execution icons. (#9549)
  • [Fix][UI] Fix condition task connection failure. (#9548)
  • fix Fault tolerance warning mapper add alert type to insert (#9533)
  • [Bug] [Dev] Fix start/stop/status/init script error (#9514)
  • [Fix-9525] [Worker] Environment did not work as expected (#9527)
  • [Fix][UI Next][V1.0.0-Beta] Fix the resource Center dark mode display exception when viewing the file details. (#9526)
  • [Fix][UI Next][V1.0.0-Beta] Added access to the child node function (#9518)
  • [Fix-9516] [Statistics] Statistics Manager shows data should belongs to current user (#9515)
  • Add python module dependency in the dist module (#9506)
  • [Improvement][Master] Fix typo for MasterTaskExecThreadTest (#9513)
  • [Bug] [ALERT-9487] change email attachment filename to add random string to avoid issues (#9498)
  • [Bug-9501][Worker] fix kill task error before running (#9509)
  • [Fix][Next-UI] Fix the jumping problem of close button on dag page. (#9494)
  • [Fix-9174] [Alert] Fix deduplication of alarm information (#9371)
  • [FIX][WEBSITE-9224]fix wechat doc and wechat form display (#9439)
  • [Bug][Next UI] Fix the branch flow options of the switch task is not available. (#9481)
  • [Fix][UI Next] Fix the problem of disabling owned user input during project editing. (#9476)
  • [FIX-9471][Script] fix run install.sh error (#9472)
  • [Fix][Next-UI] Add LIST type to the custom parameter types of task node. (#9468)
  • fix the OUT direct param could pass to the current script (#9463)
  • [Bug][UI Next]Fix global variable validation condition for save button in workflow definition. (#9454)
  • [Fix][UI][2.0.5] Add LIST type to the custom parameter types of task node. (#9455)
  • [python] Recover python release properties (#9444)
  • [Future-9396]Support output parameters transfer from parent workflow to child work flow (#9410)
  • [UI] Migrate NPM to PNPM in CI builds (#9431)
  • [Fix-9316] [Task] Configure DB2 data source SQL script execution report ResultSet has been closed exception in SQL task (#9317)
  • [Fix-9251] [WORKER] reslove the sql task about of add the udf resource failed (#9319)
  • Update inappropriate characters (#9413)
  • [DS-9387][refactor]Remove the lock in the start method of the MasterRegistryClient class (#9389)
  • [Bug][UI Next]Modify the display state logic of save buttons under workflow definition (#9403)
  • [Fix-9221] [alert-server] optimization and gracefully close (#9246)
  • [BUG][WORKER-9349]fix param priority (#9379)
  • [Bug][API-9364]fix ProcessInstance wrong alert group id (#9383)
  • [Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223) (#9299)
  • [python] Migrate pythonGatewayServer into api server (#9372)
  • [optimization] [Service] Optimization ProcessService and add ProcessService interface (#9370)
  • [Bug-9235][Alert]Fix wechat markdown message and change wechat form structure (#9367)
  • [Fix][UI] fix status statistics card height is inconsistent(#10268)
  • [Fix] fix the line.separator problem for alert-plugin test case (#10277)
  • [Fix][UI] add mapping_columns filed for the data_quality (#10286)
  • [Fix] fix database initialize late in standalone (#10296)
  • [Style][UI] split multilingual modules (#10256)
  • [Fix][UI] display the result page when the DB page has no data.
  • [Style][UI] format code. (#10314)
  • [Fix-10317] [UI] fix the tips of startTimeout in the jupyter form (#10319)
  • [Fix][UI] fix the issue that the status statistics on the project overview page were inconsistent(#10328)
  • [Fix-10318][ui] fix EMR Task UI custom parameters Is not correct (#10334)
  • [Build][UI] upgrade dependencies(#10346)
  • [Feature] add dolphinscheduler-task-all in api module (#10350)
  • [Improvement] upgrade commons-io to fix CVE (#10355)
  • [Improvement] upgrade logback to fix cve (#10357)
  • [Improvement] Upgrade log4j in E2E (#10359)
  • [Fix][Deploy] fix run on kubernetes bug (#10379)
  • [Bug][Tools] add datasource url for mysql profile in tools application.yaml (#10399)
  • [Fix-10412] [Standalone] failed to start standalone server according to the official document
  • [Improvement] update chart.yaml dependencies version (#10420)
  • [Fix-10386] LDAP user create with status enable (#10426)
  • [Fix][Python] support same task name in project defferent process definition
  • [Fix-10425] recovery LDAP Config (#10429)
  • [Fix][UI] add loading before file modification data is returned. (#10450)
  • [Fix][Python] correct variable type of SQL type (#10464)
  • [Fix] fix rename form not init bug in file manange (#10471)
  • [Fix-10305][common] AWS config Constant definitions are repeated (#10311)
  • [Fix-10522] [API] fix get executable time null pointer exception(#10524)
  • [Fix] [Worker] fix worker will hang if fails to start (#10501)
  • [Fix] could not find or load main class org.apache.zookeeper.ZooKeeperMain (#10535)
  • [Fix] change K8s postgresql password key name (#10545)
  • [Feature] ui build no inherit from maven proxy (#10590)
  • [Fix][dolphinscheduler-spi] json parse support LocalDateTime (#10440)
  • [Fix] fix standalone start error (#10577)
  • [Fix-10400] fix K8s deployment bitnami version error (#10567)
  • fix: Current node settings number of failed retries may not be negative (#10530)
  • Modify obsolete swagger parameters in AuditLogController (#10494)
  • [Fix]Recovery Traffic Control Config (#10505)
  • [fix][master]: fix condition npe (#10478)
  • fix dependent task re-run params error (#10580)
  • dependent node log output optimization and fix checkstyle (#10593)
  • [fix-10596] Workflow relationship cannot be displayed normally (#10625)
  • [Fix][UI] Fix bytesToSize function calculation error. (#10627)
  • [API] Do not specify rollback for ensure in case of any exception or error. (#10793)
  • [Fixed-10833] [Bug] [Quartz] timezone display doesn't match the next_fire_time in ds 3.0.0-beta1 version (#10865)
  • [Fix-11003]Task group queue is not updated to final state (#11004)
  • [Fix][UI] fix bug where log modal display object (#11271)
  • fix: Upgrade database DDL to avoid log path too long error
  • fix bug where confirm disable error (#11251)
  • Fix recovery from failed task will dead loop (#11239)
  • [Fix-11007] [Master] fix forced_success bug (#11088)
  • fix nodeSize is not a function bug (#11200)
  • [Bug-11071] fix local params (#11184)
  • [Fix] Parameter values disappear when editing Zeppelin task (#11115)
  • [fix] Make DDL work in version 3.0
  • [Fix-10665] [S3] Fix s3 download method (#10675)
  • [Bug-11101] fix task failover NPE (#11168)
  • [python] Fix tasks with multiple upstream and workflow query error (#10941)
  • [fix] update queue and tenant with same code error (#10877)
  • [python] Fix submit and run error (#10792)
  • [Bug-11071] Fix task local params NPE (#11166)
  • [python] Support using full-name definitions for resources (#10551)
  • fix space validate for create folder bug (#11106) (#11172)
  • fix k8s master and worker start error (#11156)
  • [Fix][UI] Add duplicate of file suffix (#11136)
  • [Bug] [API] If the single log length is long, it will causes the View Log page to hang (#10612)
  • [Fix][UI] fix bug where The Gantt chart does not show the execution status (#11135)
  • [Fix-10918] Close datasource when expire from guava cache (#11120)
  • [Fix][UI] Fix the problem of too large spacing in operation. (#11090)
  • fix view variable display bug (#11100)
  • [Fix][UI] Widen the segment separator input box. (#11096)
  • add oracle dependency (#11095)
  • [Feature-10594][ui] Data Quality Result Display Optimize (#10835)
  • [Fix-10539] [Bug] [UI] Copy task a to B, change the user-defined para… (#10611)
  • [Fix][UI] Set the next node to not required. (#10932)
  • [Fix][UI] Add validator to the next node field of the switch task. (#10898)
  • Fix worker cannot shutdown due to resource close failed or heart beat check failed (#10979)
  • Kill task when we do master failover to avoid task lost (#10997)
  • Fix kill yarn job error when failover caused by doesn't set ProcessDefinition (#10948)
  • Fix taskInstance's host is not worker nettyServer address (#10926)
  • Catch exception when check state in StateWheelExecuteThread (#10908)
  • [Fix-10827] Fix network error cause worker cannot send message to master (#10886)
  • [Fix-10854] Fix database restart may lost task instance status (#10866)
  • [Fix-10842] Fix master/worker failover will cause status incorrect (#10839)
  • [Fix-10785] Fix state event handle error will not retry (#10786)
  • [Fix-10785] Fix state event handle error will not retry (#10786)
  • [Fix-10666] Workflow submit failed will still in memory and never retry (#10667)
  • Validate master/worker config (#10649)
  • [Bug] [Master] Worker failover will cause task cannot be failover (#10631)
  • Remove the schedule thread in LowerWeightHostManager (#10310)
  • [Fix-10413] Fix Master startup failure the server still hang (#10500)
  • Fix PeerTaskInstancePriorityQueue cannot contains method use taskInstanceId to check (#10491)
  • Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe (#10479)
  • [Feature][metrics] Add master, worker metrics (#10326)
  • Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe (#10479)
  • [Fix] Fix the JSONUtils tool class time zone problem #10282 (#10284)
  • [Fix-10595][api] Fix Dependent Node Only View Projects Created By Self (#10834)
  • [Fix-10890] fix some bugs in the Resource page (#10907)
  • fix: typo task definition. (#10958)
  • [FIX-10784][Bug] [ALERT-SERVER] FEISHU Plugin might block the whole alert process loop (#10888)
  • Solve transaction problems under multi-threading (#10917)
  • fix bug where task name display in gantt (#10900)
  • display timing record start time (#10915)
  • [bug][task-plugins]fix switch class name and add param check to the switch task plugin (#10894)
  • [Fix][UI] Fix hive datasource doesn't show principal bug (#10876)
  • Complement numbers will run in a loop under the serial strategy fixed. (#10862)
  • [Fix-10829][UI] display real workflow relation in WorkFlow Relation page (#10836)
  • [Build][UI] Updated dependencies. (#10813)
  • [Fix][UI] Fix the environment name display back error. (#10797)
  • [Bug][Script] Remove deprecated arg in remove-zk-node.sh (#10789)
  • Fix language not matched (#10775)
  • fix bug where project overview page display no data (#10720)
  • [Fix][UI] Fix bug where the home page displays no data. (#10697)
  • [Fix-10652] fix docker-compose.yml (#10653)
  • [Bug] [Task] SQL task no exception stack trace in task log (#10656)
  • [Fix-10641] [Common] Fix the hdfs NPE (#10642)
  • [Bug] [Api] The copied workflow create time and update time is still copied from the original workflow
  • Fix TaskGroup cannot work and will cause master dead loop (#11254) (#11318)

Documentation

  • [doc] Correct all setup documents (#10074)
  • [doc] Add setValue syntax in local param (#10245)
  • [Fix-10083][Doc]Change Docker cmd && Change WebexTeams Chinese Translation (#10084)
  • [doc] Refactor local parameter docment (#10119)
  • [doc] Update kubernetes' FAQ (#10221)
  • [doc] Migrate develop docs from website (#9457)
  • [doc] fix url wrong in zh doc (#9421)
  • [doc] Add some dev missing doc (#9427)
  • [doc] Remove observability (#9402)
  • [doc] Change get help from dev mail list to slack (#9377)
  • [FIX-9355] Fix scheduleTime of start-process-instance api in api-doc (#9359)
  • [task-spark][docs] Corrected notice section (#9375)
  • [doc] Update task DataX document (#10218)
  • [doc] Update delete workflow description (#10203)
  • [Doc] Add complie supporting system (#10188)
  • [doc] Update project directory structure in docs (#10107)
  • [doc] Refactor global parameter docment (#10045)
  • [doc] Update website docs link (#10161)
  • [doc] Update editorial workflow content and images (#10130)
  • [doc] Remove flink call docs (#10122)
  • [doc] change document structure (#10124)
  • [doc] Show all the functions of the home page through screenshots (#10118)
  • [Bug][doc] Fix the open-api docs request error (#10100)
  • [doc] Correct docs of development-environment-setup (#9995)
  • [doc] Correct kubernetes (#9985)
  • [doc] Add example and notice about task type Dependent (#10001)
  • [doc] Add the description about execute type in SQL task (#9987)
  • [Doc] Add example and notice about task type Conditions (#9945)
  • [doc] Update the document picture to new UI (#9953)
  • [doc] Fix docs deadlink in readme (#9972)
  • [Docs] Update README. (#9970)
  • [docs] Correct custom docker image in faq (#9939)
  • [Docs][UI][Beta] Update README. (#9895)
  • [Docs][UI Next][V1.0.0-Beta] Add @types-lodash license. (#9883)
  • [doc] Separate and correct getting start by docker (#9862)
  • [doc] Fix syntax error cause website not work correctly (#9826)
  • [doc] Dir development should not ref other dirs content (#9812)
  • [doc] Add how to change standalone database type (#9376) (#9736)
  • [Feature][doc] Refactor and separate the Resource Center Document (#9658)
  • [Feature][Doc] Add docs for zeppelin task plugin (#9866)
  • [bug] [doc] fix the data quality link error about the navigation of dolphinscheduler 3.0.0-alpha zh docs (#9887)
  • [Improve][docs] Add spark sql docs to task spark (#9851)
  • [Feature-9566][Docs] Missing shell script application_id listening logic (#9778)
  • [doc] Add data quality to sidebar and correct docker resource path (#9662)
  • [Docs][DataQuality]: Add DataQuality Docs (#9512)
  • [Docs] enhance alert doc (#9534)
  • [Bug][Doc]Update database init instruction docs (#9659)
  • [Docs] Add license file for screenfull. (#9581)
  • [doc] Fix dead link after 3.0.0 release (#9562)
  • [python] Add missing doc about config and connect remote server (#9443)
  • [Improvement][doc] update time zone doc (#9503)
  • [Feature][Doc] Switch shell task instruction screenshots to latest (#9434)
  • [task-flink][docs] Corrected name (#9600)
  • [Doc] Refactor context parameter document (#10227)
  • [Doc] Delete SPRING_DATASOURCE_DRIVER_CLASS_NAME in doc (#10228)
  • [Doc] Upgrade screenshot to latest version in dev document (#10242)
  • [Doc] Update the development environment to build the software version (#10246)
  • [Doc] Add switch task demo (#10247)
  • [Doc] Added local file configuration guide for resource center (#10264)
  • [Doc] Fix api standard error (#10292)
  • [Doc] Add how to use resource in shell task (#10308)
  • [Doc] Upgrade license. (#10365)
  • [Doc] Add how to set the alarm mailbox in faq (#10401)
  • [Doc] Fix wrong class name in doc (#10438)
  • [Doc] Correct installPath when using related path (#10597)
  • [Doc] update the configuration doc (#11113)
  • [doc] Add notice when environment can not select (#11276)
  • [Doc]Chinese translation updated (#11146)
  • [doc] Fix installation typo (#11220)
  • add Feishu alert doc and configure email alert doc to the docsdev.js (#11173)
  • [doc] Fix bugs in doc installation, design and glossary (#11084)
  • [doc] Change subprocess dependent (#10637)
  • [docs] Add links to metrics docs (#10583)
  • [doc] Add run the task alone doc. (#10581)
  • [doc] Add doc about how to use healthcheck endpoints (#10592)
  • [doc] Add docs about complement dependent mode (#10587)
  • [Fix-10830][Doc] Change the start or install script command sh in the document to bash (#10831)
  • [doc] Add missing doc change by snehal (#10892)
  • [Doc][Upgrade] Fix tiny error in upgrade docs (#10847)
  • [Docs] Updated license. (#10838)
  • [doc] Correct custom jdbc driver for K8s Doc (#10768)
  • [doc] Modify features, hw, intro and homepage docs. (#10713)
  • [doc] Modified dq, monitor, security, resources (#10715)
  • [doc] Replace the dag screenshot of the README. (#10798)
  • [doc] Unify data source switching of the docs during installation (#10688)
  • [doc] Change tasks docs (#10751)
  • [doc] Modified project doc. (#10711)
  • [Docs] Replace the dag screenshot of the README. (#10741)
  • [doc] Modify quick start. (#10712)
  • [doc] Modified alert doc files (#10714)
  • [doc] Change tasks doc (#10639)
  • [doc] Change datasource doc (#10660)
  • [doc] Add doc for pre-sql and post-sql (#10685)
  • [doc] Update metadata and design doc (#10600)
  • [doc] Replace the dag screenshot of the README. (#10662)
  • [doc] Modified parameter doc files. (#10659)
  • [python] fix doc build error (#10810)
  • [python] Correct some docs for python api (#10772)
  • Merging general settings to faq (#10716)

Chore

  • add_alert_server_cluster_test (#10125)
  • [Feature-10034][CI] Add postgresql cluster test in CI (#10035)
  • [docker] Change docker hub HUB
  • [CI] Enable CI to remove unexpected files in /docs/img dir (#9393)
  • [Feature-9474] [CI] Add cluster test script verify on shell script (#9997)
  • [Improve][common] code clean in the common module (#9435)
  • Add improvement template (#10764)
  • [ci] Make cluster test work on release branch (#11199)
dolphinscheduler - 2.0.6

Published by JinyLeeChina over 2 years ago

  • [Fix-8645][Api] Resource Re Upload, name duplicate (#8811)
  • [Feature][Dag] Jump back to the list page after the workflow is saved. (#8989)
  • [Fix-8929][DAO]Description Failed to upload the file because the full name was too long (#9020)
  • [Fix-8544][API] The folder's size can't be updated when creating, updating or deleting a resource file int the folder. (#9107)
  • [BUG][ALERT-SERVER]validate script before alert script (#9834)
  • [Fix-10386]LDAP user create with status enable version 2.0.6 (#10508)
  • [Fix-10517] Some important bugs in version 2.0.5 (#10541)
  • [Fix][UI] Fix bytesToSize function calculation error. (#10628)
  • to #9801: fix delete job of quartz not work (#10645)
  • to #9595: fix param lost when execute failed task (#10646)
  • [Improvement] heartbeat info improvement (#10699)
  • [Fix-10672] Dependent task retry bug (#10707)
  • [Fix-10443][server]fix dependent task always running (#10708)
  • [Fix-10673] Workflow recovery bug with failed tasks (#10722)
  • [Fix-10762] [bug] Dependent tasks wait for the workflow to end (#10765)
dolphinscheduler - 3.0.0-beta-2

Published by devosend over 2 years ago

Bugfix

  • [Fix][UI] fix status statistics card height is inconsistent(#10268)
  • [Fix] fix the line.separator problem for alert-plugin test case (#10277)
  • [Fix][UI] add mapping_columns filed for the data_quality (#10286)
  • [Fix] fix database initialize late in standalone (#10296)
  • [Style][UI] split multilingual modules (#10256)
  • [Fix][UI] display the result page when the DB page has no data.
  • [Style][UI] format code. (#10314)
  • [Fix-10317] [UI] fix the tips of startTimeout in the jupyter form (#10319)
  • [Fix][UI] fix the issue that the status statistics on the project overview page were inconsistent(#10328)
  • [Fix-10318][ui] fix EMR Task UI custom parameters Is not correct (#10334)
  • [Build][UI] upgrade dependencies(#10346)
  • [Feature] add dolphinscheduler-task-all in api module (#10350)
  • [Improvement] upgrade commons-io to fix CVE (#10355)
  • [Improvement] upgrade logback to fix cve (#10357)
  • [Improvement] Upgrade log4j in E2E (#10359)
  • [Fix][Deploy] fix run on kubernetes bug (#10379)
  • [Bug][Tools] add datasource url for mysql profile in tools application.yaml (#10399)
  • [Fix-10412] [Standalone] failed to start standalone server according to the official document
  • [Improvement] update chart.yaml dependencies version (#10420)
  • [Fix-10386] LDAP user create with status enable (#10426)
  • [Fix][Python] support same task name in project defferent process definition
  • [Fix-10425] recovery LDAP Config (#10429)
  • [Fix][UI] add loading before file modification data is returned. (#10450)
  • [Fix][Python] correct variable type of SQL type (#10464)
  • [Fix] fix rename form not init bug in file manange (#10471)
  • [Fix-10305][common] AWS config Constant definitions are repeated (#10311)
  • [Fix-10522] [API] fix get executable time null pointer exception(#10524)
  • [Fix] [Worker] fix worker will hang if fails to start (#10501)
  • [Fix] could not find or load main class org.apache.zookeeper.ZooKeeperMain (#10535)
  • [Fix] change K8s postgresql password key name (#10545)
  • [Feature] ui build no inherit from maven proxy (#10590)
  • [Fix][dolphinscheduler-spi] json parse support LocalDateTime (#10440)
  • [Fix] fix standalone start error (#10577)
  • [Fix-10400] fix K8s deployment bitnami version error (#10567)

Document

  • [Doc] Refactor context parameter document (#10227)
  • [Doc] Delete SPRING_DATASOURCE_DRIVER_CLASS_NAME in doc (#10228)
  • [Doc] Upgrade screenshot to latest version in dev document (#10242)
  • [Doc] Update the development environment to build the software version (#10246)
  • [Doc] Add switch task demo (#10247)
  • [Doc] Added local file configuration guide for resource center (#10264)
  • [Doc] Fix api standard error (#10292)
  • [Doc] Add how to use resource in shell task (#10308)
  • [Doc] Upgrade license. (#10365)
  • [Doc] Add how to set the alarm mailbox in faq (#10401)
  • [Doc] Fix wrong class name in doc (#10438)
  • [Doc] Correct installPath when using related path (#10597)
dolphinscheduler - 3.0.0-beta-1

Published by zhongjiajie over 2 years ago

Feature

  • [Feature- 9837][plugin/ui] support FlinkSQL Task (#9840)
  • [Feature-9177][Task] The sql task supports configuring segmentation notation to provide execution of multiple statements (#9917)
  • [Feature][UI] Disabled statistics. (#9935)
  • [Feature][Log]Add timezone information in log output (#9913)
  • [Feature] Remove old ui. (#9909)
  • [Feature][UI Next][V1.0.0-Beta] Add hints to the password repeat. (#9888)
  • [Feature][UI Next][V1.0.0-Beta] Rename SeaTunnel. (#9839)
  • [Feature][UI Next] Add front-end for Apache Zeppelin task plugin (#9597) (#9810)
  • [Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9733)
  • [Feature]The utils configuration files are centrally managed under common (#9706)
  • [Feature]Unified exposure method class (#9698)
  • [Feature][UI][V1.0.0-Beta] Modify timeout from 10s to 15s of axios (#9644)
  • [Feature][UI][V1.0.0-Beta] Add dependent task status in dependent task. (#9663)
  • [Feature][Task-Plugin]Add zeppelin task-plugin to support Apache Zeppelin (#9327)
  • [Feature][UI Next][V1.0.0-Beta] Monaco Editor supports theme switching function. (#9521)
  • [Feature][UI Next][V1.0.0-Beta] Change the css style usage of the blue number flopper in the alarm center to css variables. (#9511)
  • [python] Add task decorator for python function (#9496)
  • [python] Support read config in env variable (#9517)
  • [Feature][Task] K8s namespace auth manager (#9303)
  • [Feature][API] Refactor get dependent node information api (#9591)
  • [Feature][UI Next]Added the method of downloading files (#9605)
  • [Feature] [ALERT-9406]enrich alert info when insert new row into DB (#9445)
  • [Feature] [ALERT-9406]add new properties to alert class (#9408)
  • [Feature-9204][alert] Implement alert send status (#9208)
  • [Improve][API] Allowed the non-root user to create the task group. (#9523)
  • [DS-9263][Improvement][master]optimize failover (#9281)
  • [Improvement] change method access (#9390)
  • [improve][python] Specify warning group when deploy process-definition (#9773)
  • [improve][api] Support to upload file without file type suffix (#9553)
  • [Improvement][server] varPool support syntax #{setValue(key=value)} (#9586)
  • [Improvement-9609][Worker]The resource download method is selected according to the configurati… (#9636)

Bugfix

  • [Bug] init docker compose DATABASE env (#10244)
  • [fix] Deploy scp-hosts use fullpath avoid dangling (#10249)
  • [fix][deploy] File overwrite when specific value set to installPath (#10241)
  • [Fix][UI] Set task group name empty of default value (#10243)
  • [Fix#9923] The alarm instance management interface is always in the loading state (#9924)
  • [fix] Task group queue query all list error (#10237)
  • [improve] Change Mysql Driver (#10220)
  • [Fix][UI] Fix issue with treemap depth in workflow relationships. (#10229)
  • [fix-10207] When the registered alarm plugin is empty, the error message is not clear (#10224)
  • [Fix][UI] Fix the problem of multi-language support of workflow instance host in Chinese state. (#10223)
  • [Fix-10103][k8s]Fix k8s Change DataSource Error (#10128)
  • [Fix][UI] add assignment of totalPage (#10165)
  • [python] Fix process definition attr release state not work (#10151)
  • fix#10214 Delete online workflows in batches, prompt information is accurate (#10215)
  • [Bug][Deploy]Fix worker-server path in script scp-hosts.sh (#10208) (#10209)
  • [Fix-10199] [Workflow/Workflow Definition] After deleting messages in batches, the error message is repeated (#10201)
  • [Fix][UI] Fix data-quality component multi-language support. (#10202)
  • [refactor][perf] cache compiled regex pattern (#10099)
  • [Fix-10076] queryUserByToken use server timezone (#10177)
  • fix spcial week init bug (#10183)
  • [Fix][UI] Add seatunnel icon (#10178)
  • [Fix-10057][api] api parameter name misspelling (#10063)
  • [Fix][UI] Fix the problem that the failure strategy field in the time management form is multilingual. (#10169)
  • [Fix]Change the HTTP or HTTPS regular expression (#10166)
  • [Fix][UI] Limit task group resource capacity to only positive integers. (#10158)
  • [Fix][UI] Add the task status of pending. (#10129)
  • [python] Change distribute name avoid confusion with main pkg (#10134)
  • Fix alert server curator health check not work (#10111)
  • [Build][UI] Solve vite config throws terser warning. (#10105)
  • [BUG][TaskGroup] Task group does not take effect (#10093)
  • [fix] Enhance name pre checker in resource center (#10094)
  • [Fix][UI] fulfill missing fields in DataQuality (#10098)
  • fix issue-10061 (#10062)
  • [Feat][UI] Add resource username for function and resource manage (#10086)
  • [Fix-10049] Conditions Task branch flow failed (#10077)
  • [Fix-10082]Resource userName is null and udf function manager add a username (#10064)
  • [Fix][Docker] Support Multi-Architecture Docker Images (#10052)
  • Create process definition with task group and task group priority cannot be save into db (#10078)
  • [Fix-10080]When the created tenant name is too long, an error message will be prompted (#10081)
  • [Bug][Master] fix master task failover (#10065)
  • [Fix][UI] Fix bug where username is empty in file manage (#10070)
  • [Fix][UI] Fix in the Chinese state, there is a problem with the multi-language support of the form. (#10066)
  • [Fix][UI]Modify error message (#10054)
  • [python] Fix pre_submit_check error when local params in tasks (#10032)
  • [Bug] fix run on docker and k8s (#10026)
  • [Fix-10039] Flink run command when perfecting Python jobs (#10042)
  • [dataquality] Fix task commnd null bug (#9974)
  • [fix-9991][worker]fix statement is closed before resultSet.getMetaData() (#10014)
  • [Fix][UI] Fix errorOutputPath column in dataquality page (#10015)
  • [Fix][UI] Support only one file upload on the file manage page. (#10007)
  • [Fix-9975] The selected task instance was recreated when the Master service fail… (#9976)
  • [Fix][UI] Fix the task name validator error. (#10008)
  • [Fix-10002] Fix some bugs in datasource list (#10005)
  • [Bug] [MASTER-9811]fix cmd param to overwrite global param when executing complement (#9952)
  • [Fix][UI][V1.0.0-Beta] Fix the problem of packing failure. (#9962)
  • [Build][UI] Upgrade dependencies. (#9956)
  • [chore] Combine version 206 and 210 sql upgrade to 300 (#9959)
  • [Fix][UI][V1.0.0-Beta] Fix the problem of packing failure. (#9966)
  • [Fix #9925]: fix ellipsis bug in table column (#9936)
  • fix miss fixvalue input (#9933)
  • [Fix][UI Next][V1.0.0-Beta] Fix console bug after deleting a node from the context menu. (#9932)
  • [Fix] add resource capacity required rule (#9922)
  • [Fix][UI Next][V1.0.0-Beta] Fix data quality data not displayed. (#9930)
  • [Fix]Added request header validation (#9915)
  • [Fix-9906] After the serial wait execution strategy stops the running workflow instance, the instance will be woken up and executed if there is a wait instance. (#9907)
  • [Fix][UI-NEXT] Disable file name (#9893)
  • [Fix][UI Next][V1.0.0-Beta] Fix jdbc connect parameter validate bug (#9891)
  • [Fix][UI Next][V1.0.0-Beta] Fix the task group queue display error. (#9890)
  • [Fix][UI Next][V1.0.0-Beta] Fix edge deletion unhandled and remove the useless nextNodes. (#9875)
  • [Fix][UI Next][V1.0.0-Beta] Fix some errors on the datasource page. (#9877)
  • [Fix][UI Next][V1.0.0-Beta] Fix the page input error on the token manage page. (#9879)
  • [Fix][UI Next][V1.0.0-Beta] Fix bug where logo disappeared when format dag. (#9864)
  • [Fix-9856]Failed to upload the file but get misleading error message (#9861)
  • [Fix-9868] A task flow definition isolates the runs of different execution strategies by version numbers. (#9869)
  • [Bug] [worker] fix CommandType TASK_EXECUTE_RUNNING_ACK don't consumed (#9849) (#9850)
  • [Fix][UI Next][V1.0.0-Beta] Fix the problem that there is no prompt for selecting users. (#9858)
  • [fix] fix query access token for specified user failed (#9855)
  • [Fix][UI Next][V1.0.0-Beta] Add validation rules to dependency of the dependent task. (#9844)
  • Serial wait for subsequent execution (#9847)
  • [Bug-9829][Api] Fix schedule timezone (#9830)
  • [Fix]fix the search bar echoes abnormally (#9835)
  • [BUG][ALERT-SERVER]validate script before alert script (#9834)
  • [Fix] json object serialization error (#9828)
  • [Fix][UI][V1.0.0-Beta] Fix the problem of wrong workflow name. (#9833)
  • Task queue status update. (#9832)
  • [Fix][UI] Hide the version control button in workflow instance (#9825)
  • The node ID under serial is greater than the current ID. (#9820)
  • [Fix][UI] Fix timing modal start time and end time bug (#9815)
  • [Bug] [Website-9764]add http alert doc and change body param to unnecessary (#9792)
  • [Fix-9796] The task queue can be executed normally. (#9797)
  • [Fix][UI Next][V1.0.0-Beta] Add a return button and set the form to disabled on the file detail page. (#9802)
  • [Fix][Next-UI][V1.0.0-Beta] Fix placeholder error on the task queue page. (#9805)
  • [Fix-9352][datasource-api]data source client uses a cache with an expiration time (#9353)
  • revert delete dumplicate task_definition_log ddl (#8567)
  • [Bug][dep] Bump httpclient version to 4.5.13 (#9631)
  • [bug][db] Table relation_project_user have duplicate record (#9536)
  • [fix-9785][UI Next][dev] dynamic change height in viewlog when full screen (#9788)
  • [feat] Update README (#8261)
  • [Bug][Api] Failed to rerun the workflow instance (#9795)
  • [Bug]Fix log request errors (#9791)
  • Task group queue supports fuzzy search. (#9784)
  • [Bug] [Alert-9786] Http alert Get method not working (#9787)
  • [Bug] [Website-9764]add script doc to the alert function (#9765)
  • A task instance that normally queries the serial wait state. (#9777)
  • [Bug]Fix groupId initialization value problem (#9775)
  • [Fix][UI Next][V1.0.0-Beta] Add the 'startNodeList' field to the 'start-process-instance' interface. (#9769)
  • [Bug]Fix right-click menu function error (#9766)
  • [Fix][UI Next][V1.0.0-Beta] Fix cannot select the workload scheduling time bug (#9762)
  • [Fix][UI Next][V1.0.0-Beta] Remove the default values for node name and child node. (#9760)
  • [Fix][UI Next][V1.0.0-Beta] Change the label from recovery failed to failed to retry. (#9761)
  • Add the host address of the execution server to the sub task task instance. (#9758)
  • fix query issue when update environment (#9752)
  • improve task flow date time exception handle (#9732)
  • Subtask component treemap problem fix. (#9755)
  • [common] Make dolphinscheduler_env.sh work when start server (#9726)
  • [Fix-9717] The failure policy of the task flow takes effect (#9718)
  • fix process instance global param not include to task instance when master executing (#9730)
  • [Fix][UI Next][V1.0.0-Beta] Fix the bug that the tenant is 0 when editing a user. (#9739)
  • [Bug-9737][Api] fix task plugin load in api (#9744)
  • [Fix][UI][V1.0.0-Beta] Set the default value of host to '-' and Disable log button without host data. (#9742)
  • [Fix][UI Next][V1.0.0-Beta] Fix citation errors. (#9741)
  • [Bug][Script] Fix the type of variable workersGroupMap is not supported in bash 3.x (#9614)
  • [Bug]Fixed the problem of no request from right click viewing log (#9728)
  • [Improve][python] Support create table syntax and custom sql type param (#9673)
  • [Bug][UI][V1.0.0-Beta] Fix action buttons not displayed on one line bug (#9700)
  • [Bug] [UI][V1.0.0-Beta] Fix task group name can't clear bug (#9708)
  • [Bug-9719][Master] fix failover fail because task plugins has not been loaded (#9720)
  • [fix][Service] BusinessTime should format with schedule timezone (#9714)
  • [Fix][UI Next][V1.0.0-Beta] Set the timout label to not show. (#9710)
  • [Fix][UI Next][V1.0.0-Beta] Fix bug where route is error in file manage root (#9697)
  • [Fix][UI Next][V1.0.0-Beta] Fix success logo is not display bug (#9694)
  • [Fix][UI Next][V1.0.0-Beta] Fix the startup parameter display error. (#9692)
  • [Fix][UI Next][V1.0.0-Beta] Change update user to edit user. (#9683)
  • fix alert msg and change primitive to String to avoid wrong format (#9689)
  • [Fix][UI Next][V1.0.0-Beta] Fix bug where name copy is invalid (#9684)
  • [Fix] Support more generic tenant code when create tenant (#9634)
  • [hotfix][docker] Removed extra equals in mail user (#9677)
  • [chore] Correct the java doc in funtion DagHelperTest generateDag2 (#9602)
  • fix task dispatch error overload resource pool of task group (#9667)
  • Project management batch deletion should give a specific description if it fails. (#9669)
  • [Bug][UI][V1.0.0-Beta] Fix display resource not exist error message bug (#9657)
  • [Fix][UI][V1.0.0-Beta] Fix the parameter variables and startup parameters window cannot auto close bug (#9653)
  • [Fix][UI][V1.0.0-Beta] Adjust the UI presentation of the dependent task. (#9649)
  • [Fix][UI][V1.0.0-Beta] Replace the back-end interface for dependent task. (#9645)
  • [Fix][UI][V1.0.0-Beta]Fix data not update bug for workflow version switch (#9642)
  • [Improvement][style]add comment and clear warn (#9247)
  • [Bug-9608] Serialize the task definition failed (#9622)
  • [Bug][DAO] Update db init script and soft_version (#9628) (#9637)
  • [Bug] cancel application when kill task (#9624)
  • [Fix-9617]New task group project name drop-down data is displayed according to user type. (#9625)
  • [Fix][UI][V1.0.0-Beta] Fix tooltip not display bug in task instance (#9630)
  • upgrade commons-compress to 1.21 (#9540)
  • update jackson and jackson.databind version to fixes many security issues (#9572)
  • use secure version of postgresql (#9573)
  • [Fix][UI][V1.0.0-Beta] Fix the task name cleared after switching the task type. (#9623)
  • [Fix][UI][V1.0.0-Beta] Change node name to task name in the task modal on the task definition page. (#9620)
  • [Fix][UI][V1.0.0-Beta] Remove the sql comment in the procedure task and add the instructions link to the procedure task. (#9619)
  • [Fix][UI] Fix the udf function echoed error in the sql task. (#9616)
  • fix 9584 (#9585)
  • [Fix-9610] Sub-workflow status check is limited to SUB_PROCESS components (#9611)
  • [Python] Make detached signature during release (#9607)
  • [Bug][Standalone Server] Deduplicate the classpath jars in start.sh of the standalone server (#9583)
  • [Fix-9593] Storage Management StorageOperate No Instance (#9594)
  • Add ingress annotations (#9492)
  • [Fix][UI Next][V1.0.0-Beta] The version information creation time in the workflow definition is changed to the operateTime field. (#9590)
  • fix task kill (#9578)
  • [Bug] [API-9558]fix homepage task instance count method to use submit time to recount (#9559)
  • [Refactor][UI Next]Reconstructing the Log Component (#9574)
  • fix process pause and rerun (#9568)
  • [fix-9428] [DataSource] delete the password and test again, it is successful without password bug (#9428) (#9531)
  • [Fix][Master Server] handle warn+failed timeout strategy in workflow execute thread of master server (#8077) (#9485)
  • Check the status of the child process when the parent process is running (#9567)
  • fix workflow instance can not be save bug (#9554)
  • [Perf][UI Next][V1.0.0-Beta] Optimize judgment logic. (#9561)
  • [Fix][UI Next][V1.0.0-Beta] Fix the color matching problem of the relationship diagram. (#9546)
  • [Fix][UI] Fix the problem of displaying task execution icons. (#9549)
  • [Fix][UI] Fix condition task connection failure. (#9548)
  • fix Fault tolerance warning mapper add alert type to insert (#9533)
  • [Bug] [Dev] Fix start/stop/status/init script error (#9514)
  • [Fix-9525] [Worker] Environment did not work as expected (#9527)
  • [Fix][UI Next][V1.0.0-Beta] Fix the resource Center dark mode display exception when viewing the file details. (#9526)
  • [Fix][UI Next][V1.0.0-Beta] Added access to the child node function (#9518)
  • [Fix-9516] [Statistics] Statistics Manager shows data should belongs to current user (#9515)
  • Add python module dependency in the dist module (#9506)
  • [Improvement][Master] Fix typo for MasterTaskExecThreadTest (#9513)
  • [Bug] [ALERT-9487] change email attachment filename to add random string to avoid issues (#9498)
  • [Bug-9501][Worker] fix kill task error before running (#9509)
  • [Fix][Next-UI] Fix the jumping problem of close button on dag page. (#9494)
  • [Fix-9174] [Alert] Fix deduplication of alarm information (#9371)
  • [FIX][WEBSITE-9224]fix wechat doc and wechat form display (#9439)
  • [Bug][Next UI] Fix the branch flow options of the switch task is not available. (#9481)
  • [Fix][UI Next] Fix the problem of disabling owned user input during project editing. (#9476)
  • [FIX-9471][Script] fix run install.sh error (#9472)
  • [Fix][Next-UI] Add LIST type to the custom parameter types of task node. (#9468)
  • fix the OUT direct param could pass to the current script (#9463)
  • [Bug][UI Next]Fix global variable validation condition for save button in workflow definition. (#9454)
  • [Fix][UI][2.0.5] Add LIST type to the custom parameter types of task node. (#9455)
  • [python] Recover python release properties (#9444)
  • [Future-9396]Support output parameters transfer from parent workflow to child work flow (#9410)
  • [UI] Migrate NPM to PNPM in CI builds (#9431)
  • [Fix-9316] [Task] Configure DB2 data source SQL script execution report ResultSet has been closed exception in SQL task (#9317)
  • [Fix-9251] [WORKER] reslove the sql task about of add the udf resource failed (#9319)
  • Update inappropriate characters (#9413)
  • [DS-9387][refactor]Remove the lock in the start method of the MasterRegistryClient class (#9389)
  • [Bug][UI Next]Modify the display state logic of save buttons under workflow definition (#9403)
  • [Fix-9221] [alert-server] optimization and gracefully close (#9246)
  • [BUG][WORKER-9349]fix param priority (#9379)
  • [Bug][API-9364]fix ProcessInstance wrong alert group id (#9383)
  • [Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223) (#9299)
  • [python] Migrate pythonGatewayServer into api server (#9372)
  • [optimization] [Service] Optimization ProcessService and add ProcessService interface (#9370)
  • [Bug-9235][Alert]Fix wechat markdown message and change wechat form structure (#9367)

Document

  • [doc] Correct all setup documents (#10074)
  • [doc] Add setValue syntax in local param (#10245)
  • [Fix-10083][Doc]Change Docker cmd && Change WebexTeams Chinese Translation (#10084)
  • [doc] Refactor local parameter docment (#10119)
  • [doc] Update kubernetes' FAQ (#10221)
  • [doc] Migrate develop docs from website (#9457)
  • [doc] fix url wrong in zh doc (#9421)
  • [doc] Add some dev missing doc (#9427)
  • [doc] Remove observability (#9402)
  • [doc] Change get help from dev mail list to slack (#9377)
  • [FIX-9355] Fix scheduleTime of start-process-instance api in api-doc (#9359)
  • [task-spark][docs] Corrected notice section (#9375)
  • [doc] Update task DataX document (#10218)
  • [doc] Update delete workflow description (#10203)
  • [Doc] Add complie supporting system (#10188)
  • [doc] Update project directory structure in docs (#10107)
  • [doc] Refactor global parameter docment (#10045)
  • [doc] Update website docs link (#10161)
  • [doc] Update editorial workflow content and images (#10130)
  • [doc] Remove flink call docs (#10122)
  • [doc] change document structure (#10124)
  • [doc] Show all the functions of the home page through screenshots (#10118)
  • [Bug][doc] Fix the open-api docs request error (#10100)
  • [doc] Correct docs of development-environment-setup (#9995)
  • [doc] Correct kubernetes (#9985)
  • [doc] Add example and notice about task type Dependent (#10001)
  • [doc] Add the description about execute type in SQL task (#9987)
  • [Doc] Add example and notice about task type Conditions (#9945)
  • [doc] Update the document picture to new UI (#9953)
  • [doc] Fix docs deadlink in readme (#9972)
  • [Docs] Update README. (#9970)
  • [docs] Correct custom docker image in faq (#9939)
  • [Docs][UI][Beta] Update README. (#9895)
  • [Docs][UI Next][V1.0.0-Beta] Add @types-lodash license. (#9883)
  • [doc] Separate and correct getting start by docker (#9862)
  • [doc] Fix syntax error cause website not work correctly (#9826)
  • [doc] Dir development should not ref other dirs content (#9812)
  • [doc] Add how to change standalone database type (#9376) (#9736)
  • [Feature][doc] Refactor and separate the Resource Center Document (#9658)
  • [Feature][Doc] Add docs for zeppelin task plugin (#9866)
  • [bug] [doc] fix the data quality link error about the navigation of dolphinscheduler 3.0.0-alpha zh docs (#9887)
  • [Improve][docs] Add spark sql docs to task spark (#9851)
  • [Feature-9566][Docs] Missing shell script application_id listening logic (#9778)
  • [doc] Add data quality to sidebar and correct docker resource path (#9662)
  • [Docs][DataQuality]: Add DataQuality Docs (#9512)
  • [Docs] enhance alert doc (#9534)
  • [Bug][Doc]Update database init instruction docs (#9659)
  • [Docs] Add license file for screenfull. (#9581)
  • [doc] Fix dead link after 3.0.0 release (#9562)
  • [python] Add missing doc about config and connect remote server (#9443)
  • [Improvement][doc] update time zone doc (#9503)
  • [Feature][Doc] Switch shell task instruction screenshots to latest (#9434)
  • [task-flink][docs] Corrected name (#9600)

Chore

  • add_alert_server_cluster_test (#10125)
  • [Feature-10034][CI] Add postgresql cluster test in CI (#10035)
  • [docker] Change docker hub HUB
  • [CI] Enable CI to remove unexpected files in /docs/img dir (#9393)
  • [Feature-9474] [CI] Add cluster test script verify on shell script (#9997)
  • [Improve][common] code clean in the common module (#9435)
dolphinscheduler - 3.0.0-alpha

Published by zhuangchong over 2 years ago

[Feature]
[#6422] Add Task group feature to limit the concurrency of taskInstance
[#7332] [UI Next] A new version of the UI proposal
[#8275] [UI Next] Data Quality
[#8310] Support custom timezone
[#8373] Dependent tasks can re-run automatically in the case of complement
[#8499] Optimize workflowlieage query speed
[#8527] Add dataSource for Amazon Redshift
[#8593] Refactor cli config dict mechnism
[#9039] E2E test adapt M1 chip
[#9396] Support output parameters transfer from parent workflow to child work flow.
[#8516] [python] Add mechanism cli with simple command
[#8585] [python] Add config mechanism and cli subcommand config

[Improvements]
[#8584] Task back-end plugin optimization, new plugins only need to modify the plugin's own module
[#8874] Verify the endtime and starttime when submit/create a cron under workflow
[#9016] Dependent The global project can be selected when adding dependencies
[#9221] AlertSender optimization and gracefully close, such as MasterServer
[#9228] implement use the slot to scan the database
[#9230] Slim dist package by migrate python gatewar into apiserver
[#9372] [python] Migrate pythonGatewayServer into api server
[#9443] [python] Add missing doc about config and connect remote server
[#8719] [Master/Worker] Change the task ack to runnning callback
[#9293] [Master] add task event thread pool

[BUG]
[#7236] Failed to create tenant using S3a Minio
[#7416] Text file busy
[#7896] When the project is authorized, it will generate a duplicate authorized project
[#8089] start server failed because can't connect to postgresql
[#8183] message:datasource plugin 'spark' is not found.
[#8202] MapReduce generated command built-in parameter location is wrong
[#8751] Change param user, queue do no work in ProcessDefinition
[#8756] Process using the dependence component cannot migrate between test and prod environment
[#8760] Resource file deletion conditions
[#8791] Rectify the issue with affecting the original node's data when editing the form of the copied node.
[#8951] Worker resources are exhausted and cause downtime
[#9243] Some types of alarms can't display project name

dolphinscheduler - 2.0.5-release

Published by JinyLeeChina over 2 years ago

[Improvements]
[#8110] The fault-tolerant process of the worker is optimized, so that when the server is under too much pressure, the worker service is interrupted, and the task can be transferred to other workers to continue.
[#8445] Optimize the page display flag of forbidden tasks to distinguish the display of normally executed tasks
[#8441] Add a prompt on the task box to display all the long task names.
[#8187] The function of re uploading files is added in the resource center. When users need to modify the execution script, they do not need to reconfigure the task parameters to realize the function of automatically updating the execution script.
[#8169] After the modification workflow is optimized, the page remains in the DAG page and will not jump to the list page.
[#8285] In the dingtalk alarm plugin, add the markdown information type in the alarm content.

[BUG]
[#8213] Fixed the task runs incorrectly when the worker group contains uppercase letters.
[#8347] Fixed the workflow cannot be stopped when the task fails and retries
[#8135] Fixed JDBC connection parameter not input '@'
[#8367] Fixed complement may not end normally
[#8170] Fix the sub workflow that cannot be entered from the page

dolphinscheduler - 2.0.3-release

Published by zhuangchong over 2 years ago

Download:
https://dolphinscheduler.apache.org/en-us/download/download.html

Feature
[#7804] DingTalk alert plugin adds signature.
[#7857] Problems caused by modifying the administrator user information.
[#7675] Supports whether SQL is placed in one session
[#7571] Add dependent tips about success or failure

Improvement
[#7990] zkRoot in conf/config/install_ config does not take effect
[#7713] The data source password in the log is not encrypted

Bug:
[#8131] add delete workflow instance when delete process definition
[#8098] udf sub resource manage edit modal cant close
[#8081] process is always running: netty writeAndFlush without retry when failed leads to worker response to master failed
[#7986] After deleting the running workflow, the master keeps brushing the error log
[#8056] Edit the bug of worker grouping in environment management.
[#7512] dependent node ui dislocation
[#7913] Error in querying historical version information of workflow
[#7982] common task log in master no need to print separately
[#7962] The global parameters of the sub_process node are not passed to the associated workflow task
[#7953] query log can not show contents when task log in master on k8s
[#7815] There are duplicate processes in the process definition list
[#7698] process instance is always running: task is failure when process instance FailureStrategy.END
[#7732] field ‘is_directory’ in t_ds_resources table has error type in PostgreSQL database
[#7883] Repair JDBC connection of Oracle
[#7538] when there is a forbidden node in dag, the execution flow is abnormal
[#7789] querySimpleList return wrong projectCode

dolphinscheduler - 2.0.2-release

Published by lenboo almost 3 years ago

Download:
https://dolphinscheduler.apache.org/en-us/download/download.html

Feature
[#6470] Add Python API for DolphinScheduler
[#7460] Wechat alert support send to group chat

Improvement
[#7529] Init DB schema from the full sql file

Bug:
[#7661] Fix the memory leak of logger in worker
[#7750 ]Compatible historical version data source connection information
[#7748] Remove init script when gaining a new DB connection
[#7705] Because of memory limitations, upgrade from 1.3.5 to 2.0.2 error
[#7786] Server restart fail after force killed
[#7660] Wrong create time of process definition version
[#7607] Failed to execute PROCEDURE node
[#7639] Add default config of quartz and zookeeper in common config map
[#7654] Dependent node on change project code error
[#7658] workflow copy error
[#7609] Workflow is always running when worker sendResult success but master not received bug
[#7554] H2 in standalone server will auto restart after several minutes
[#7434] An error is reported when executing the MySQL table creation statement
[#7537] Dependent node retry delay did not work
[#7451] Remove '+1' (day) in the date of the complement data
[#7392] Add hive datasource failed

dolphinscheduler - 2.0.1-release

Published by lenboo almost 3 years ago

Download:
https://dolphinscheduler.apache.org/en-us/download/download.html

Bug fix

[#7039] fix that the hive data source connection failed when using Kerberos
[#7338] repairing standalone service startup failed
[#7215] fix the problem that the alarm group display cannot be displayed
[#7152] fix the problem of abnormal file upload
[#7083] fix the problem that the switch task failed to run
[#7070] fix the failure of workflow timeout policy
[#6809] fix the problem that the SQL task cannot send mail
[#7004] fix master still work when it lose zookeeper connection

Improvements

[#6772] optimized the operation of some APIs
[#7166] speed up the loading of workflow instance pages
[#6934] optimize the display information of the workflow relationship page

dolphinscheduler - 2.0.0-release

Published by lenboo almost 3 years ago

Features:

[#6597] supports dolphinscheduler upgrade from 1.x to 2.0
[#6812] speed up the site loading when project exists multi process definitions
[#6763] remove the detection of dumplicate task names
[#6655] remove the registry monitor

Bug Fix:
[#6613] fix bug in task retry mechanism
[#6707] fix error when set up the global parameters in process defintion
[#6882] fix process cannt finish and its status always be running
[#6771] fix failover worker interrupt
[#6658] fix task code in bulk definition
[#6737] fix event handle twice in two thread pool
[#6682] replace task name with task code
[#6653] fix netty client create too many channels
[#6640] fix PROCESS_HOST_UPDATE_REQUST command donot be supported.
[#6591] fix improt process definition error

dolphinscheduler - 2.0.0-alpha

Published by lenboo almost 3 years ago

New Features:
[#3961]Create registry center plug-in to support different type of registry components
[#4325]Propose for process definition json split
[#5077]Add parameter transfer function between tasks
[#4355]Propose for master refactor and scheduler module
[#6417]add 'read log' in the task instance right-click context menu
[#6499]report busy state when worker is overload
[#6471]Cache process definition in master
[#6483]upgrade the druid and mysql connector version
[#4878]Add task plug-in function to support more custom task types
[#5273]Add switch task node
[#5098]Remove deduplicate logs in controllers
[#5083]Refactored data source creation
[#5172]add timing online/offline marking color
[#3805]The implement of passing variables between tasks
[#3049]Add alarm plug-in function to support more custom alarm components
[#4463]add an option to the UI page for saving the workflow definition: whether to go online? online by default First-time contributor good first issue new feature
[#3222]Store password in ciphertext instead
[#3191]add query top n process instance order by running duration

BugFix
[#6550]The list of environments in the DAG task pop-up window is not updated
[#6506]Fix install.sh for DS 2.0 and add comment to install_config.conf
[#6497]Shell task can not use user defined environment correctly
[#6478]Missing history data in complement data mode
[#6352]override the old process definition when I use the copy workflow feature
[#6342]Task instance page date backfill bug
[#5701]When deleting a user, the accessToken associated with the user should also be deleted
[#4809]cannot get application status when kerberos authentication is enabled
[#4450]Hive/Spark data sources do not support multi-tenancy when Kerberos authentication is enabled bug

dolphinscheduler - 1.3.9 Release Notes

Published by CalvinKirs almost 3 years ago

Feature/Update
[Feature#6022]Add standalone server module to make it easier to develop and run

BUGFIX
[Bug#6429] [UI] sub_process node open sub_task show empty page bug
[Fix#6337][Task] sql limit param no default value

dolphinscheduler - 1.3.8 Release Notes

Published by CalvinKirs about 3 years ago

Feature/Update
[#5405] [Improvement]Docker & K8s Improvement Plan Round 2
[#5858][Improvement][Docker] Docker image should support multi-arch like arm64 in docker-compose
[#5706][Improvement][common] Upgrade the version of fastjson from 1.2.61 to 1.2.75
[#5577][Improvement][UI] Add Project Name in Project Page
[#5567][Improvement][UI] Add project id in web ui url for sharing
[#5475][Improvement][Api] Upload resource to remote failed, the local tmp file need to be cleared
[#5468][Improvement][Net]Optimize IP acquisition in complex network environment
[#5467][Improvement][UI] UI cannot be displayed normally in some browsers

BUGFIX
[#6007][Bug][Worker] fix Wrong complement date
[#5719][Bug][K8s] Ingress ERROR io.k8s.api.networking.v1beta1.IngressSpec.tls: got "map", expected "array" On TLS enabled
[#5701][Bug][UI][DAO]When deleting a user, the accessToken associated with the user should also be deleted
[#5699][Bug][UI] Update user error in user information
[#5596][Bug][Python] Conflict between python_home and datax_home configuration in dolphinscheduler_env.sh
[#5559][Bug][Master Server] Master Server was shutdown but the process still in system
[#5581][Bug][Mysql] Specific key was too long, max key length is 767 bytes for varchar(256) in some mysql with innodb_large_prefix=OFF
[#5578][Bug][Master] ServerNodeManager WorkerGroupListener capture data change and get data failed
[#5570][Bug][Worker] worker.groups in worker.properties is still commented after installation in 1.3.6
[#5550][Bug][Master] remove check with executePath when kill yarn job
[#5549][Bug][Worker] SqlTask NPE
[#5431][Bug][K8s] Master and worker cannot get the right address with custom DNS in 1.3.6

dolphinscheduler - 1.3.6 Release Notes

Published by CalvinKirs over 3 years ago

Feature/Update

[#5062][Feature][Worker Group] Create/Edit/Delete Worker Group in Web UI
[#5175][Improvement][Server] Optimize and reduce worker group queries of database and zookeeper
[#4852][Feature] Support SkyWalking agent plugin
[#4837][Improvement][Docker/K8s] Docker & K8s Improvement Plan #4843 #4732 #4871 #4881 #4804 #4886 #2687 #4897 #3124 #5155 #5068 #5100 #2584 #4905 #5351
[#5023][Improvement][Docker/K8s] Improve docker and k8s #2584 #2687 #4732 #4871 #4886 #4897
[#5158][Improvement][Docker/K8s] Support more configs, more service access, skywalking configs, improve image for python, update faq and add support matrix #5155 #5068 #5141 #402 #403
[#5068][Improvement][Docker/K8s] Task support matrix and solution on docker/k8s
[#5195][Improvement][Docker/K8s] Improve feedback #5309 #5310
[#5100][Feature][K8s] Support task scalability on K8s such as Spark, Flink and DataX
[#5224][Improvement][Docker] Add workdir for dockerfile and remove redundant container_name and dolphinscheduler-postgresql-initdb
[#5310][Improvement][Server] The log "load is too high or availablePhysicalMemorySize(G) is too low" is not clear
[#5028][Feature][MR] Support MapReduce name
[#4960][Feature][Spark] Support spark name
[#4285][Feature] Add Flink job name
[#4976][Feature][Flink] Support name and parallelism input
[#4805][Improvement][SQL] Place the upgraded schema to the correct version directory and check schema errors
[#4751][Improvement][API] Improvement the duration field modify the display to a time-based minute-second format (e.g. 1d 10h 20m 1s)
[#4740][Improvement][UI] Set the default Tenant as default or the first existing tenant in the save process
[#403][Feature]The memory of worker, master, and other services does not need to be the same
[#174][Improvement][SqlTask] Add a switch to send mail and print head logs in SqlTask
[#5187][Build] Optimize long release name and remove unused nginx release
[#5087][Feature][SqlTask] Add a switch to send mail and print head logs in SqlTask
[#4624][Improvement][Server] When the server exist in the dead server list of zk,need stop service byself
[#4969][Improvement][UI] Support more file types in file detail page
[#2619][Improvement][API] /dolphinscheduler/projects/create doesn't return project ID when create successful
[#4270][Feature]support distributed tracing

BUGFIX

[#5309][Bug][Common] memoryUsage is -33%
[#4843][Bug][Docker] 1.3.5 release compose file config error WORKER_GROUP
[#4651][Bug][Docker] Random PSQLException in docker bug
[#5351][Bug][K8s] Quartz cron task cannot take effect
[#4905][Bug][K8s] Incorrect host problem in minikube
[#5176][Bug][Server] Wrong excludeFilters cause the worker server to start the master's beans and threads like LowerWeightHostManager and RefreshResourceTask
[#5132][Bug][server] when an exception occurs in the taskExecuteThread, task cannot stop immediately
[#5115][Bug][Server] The registered address of a server is the loopback address 127.0.0.1
[#5150][Bug][Server] DB transaction failure
[#5103][Bug][Resource] The file name of File and UDF resource not changed and cannot re-upload after renaming name
[#5349][Bug][master] Manually kill the task that fails to be retried. After the parallel task succeeds, the workflow status is always running
[#5328][Bug][Bug][MasterServer] process contain depend on task is always running
[#5199][Bug][api] When sleep is included in a shell task, cannot kill the task
[#5063][SQL] Fix MySQL datasource jdbc connect parameters
[#5048][Bug][Api] Delete the stopped workflow without deleting the corresponding subprocess, the workflow instance name is not displayed in the subprocess
[#5044][Bug][Master] Fix First master fault tolerance when startup
[#5037][Bug][Server] Both the master and the worker is hanging after restarting and stopping
[#4866][Bug][Common] Not loaded hdfs-site.xml causes the client to fail to access the datanode
[#4862][Bug][Server] Kill yarn application command won't be executed when killing error bug
[#4840][Bug][Master] Master cannot fault-tolerant when multiple Masters start at the same time
[#4816][Bug][API] The API calls the workflow instance query interface and queries all the data when the time parameter is wrong
[#4738][Bug][Mail] Send mail failed instead of execute sql error
[#4760][Bug][Api] init dolphinscheduler-postgre.sql error
[#4705][Bug][API] KeeperException$NoNodeException
[#4674][Bug][UI] The tips error when login with username and without password
[#4650][Bug][Api] Process definition create, update and copy error in PostgreSQL bug
[#4716][Bug][Master,Worker] The task execution path should be calculated by the worker, not the master
[#4617][Bug][LoggerServer] task log can not refresh in time

dolphinscheduler - 1.3.5 Release Notes

Published by CalvinKirs over 3 years ago

Feature/Update
[K8s] Support resource storage when fs.defaultFS=file:///
[Docker] Update readme
[UI] Improve parameter name
[UI] download url resolve and security page disappear delay problem under GENERAL_USER
[API]enable response resources gzip compression
[#703]Docker image optimization
[#4439][API] Cors inteceptor problems
[#4418][login controller] Need password when open in new tab

BUG FIX
[#3237][Docker] the file requirements.yaml in helm mode has error flag
[#3298][K8s]when recreate or upgrade helm release, the host ip changed
[#4691][UDF] udf jar path not exist when fs.defaultFS starts with file:///
[#4640][UI] Fixed a 404 error when the project name contains "HTTP"
[#4648][UI] TypeError: Cannot read property 'id' of undefined in createUser
[#4566][Worker] worker-server logback partial logs are not printed
[#4526][Worker] worker server doesn't work fine in K8s
[#4472][DataSource] Hive JDBC partial permission parameter concatenation JDBC URL error
[#4247][API] When schedulertime is empty, rerun the workflow, the time of the global parameter is not the latest
[#4449][API] Update workflow instance to report null point exception
[#4455]kill task error because of shell output truncation
[#4271][Logger] IOException or NoSuchFileException in logger server
[#4162][UI]fix re-login problem in new tab and state synchronization problem in multiple tabs
[#3457][Flink] fix flink args build problem

dolphinscheduler - 1.3.4 Release Notes

Published by davidzollo almost 4 years ago

Feature/Update
[#2925][server] init TaskLogger in TaskExecuteProcessor
[ambari-update] change version from 1.3.3 to 1.3.4
[sqoop-update] modify sqoop task param when upgrade ds to 1.3.4
[#4143][quartz-update] upgrade quartz version to 2.3.0

BUG FIX
[#2917 #4034 #4104 #4135][sqoop] sqoop optimization and bug fix
[#3177] task time parameter parsing error
[#3457][flink] fix flink args build problem
[#4034][server] fix sqoop import fail
[#3900][server] kill multi yarn app in one job
[#4054][api] fix The last week of the month for adding/editing timing, preview and save timing will report an error
[#4054][ui] Repair the last Sunday of each month
[#4084][server] fix taskInstance state change error
[#4104] fix sqoop task jdbc string contains special char
[#4135][worker] fix sqoop import hive error
[#4114][server] fix clear task execute path is related to master.
[#4084][master] fix taskInstance state change error
[#4090][dao] execute a single task in workflow throw NullPointerException
[#4190][dao] when the amount of json data is large, the process list page display slowly.
[#4218][bug] start from the setting nodes with NODE_PRE would be NPE
[#4223][ui] fix dag node name verification

dolphinscheduler - 1.3.3 Release Notes

Published by lgcareer almost 4 years ago

BUG FIX
[#3615] [master] After the task is executed successfully, but the next task has not been submitted, stop the master,the workflow will fail
[#4010] [master] When the condition node fails, the process status is failed after fault tolerance
[#3929] [master/worker] After the master and worker are fault-tolerant, the process instance fails after the task instance is successfully executed
[#3994] [Sql] Failed to import SQL file of sql/dolphinscheduler_mysql.sql
[#3964] [api/ui] The timeout warning of sub_process does not take effect
[#3974] [api/worker] The child process does not inherit the worker group of the parent process
[#3966] [master] The timeout warning does not take effect in sub_process
[#3958] [api] files should not be created successfully in the directory of the authorized file
[#3618] [worker] Too many files will be opened because of task executed fininished but not release the file handle.
[#3615] [master] After the task is executed successfully, but the next task has not been submitted, stop the master,the workflow will fail.
[#3843] [api] When the update workflow definition name already exists, the prompt is not friendly.
[#3924] [ui] When saving the workflow definition, if the backend verification is not successful, the save popup will not close.
[#3789] [remote] support netty heart beat to resolve channel time out.
[#3836] [API] verifyProcessDefinitionName error message
[#3702] [api] Resource file reupload does not overwrite the original file. This button is an invalid one
[#3621] [master] After batch deleting the executing process instances, the master cannot get the worker feedback results
[#3617] [master] After subtask fault tolerance, 2 task instances are generated,The process instance status always is executing
[#3616] [master] When the master receives the result from the worker, the master just stops. After the master restarts, the workflow status is always executing
[#3573] [dao] potential horizontal unauthorized access
[#3887] [ui] The English version of the resource file list and UDF list data is not displayed
[#3702] [api] Resource file reupload does not overwrite the original file. This button is an invalid one
[#3487] [API] Creating folders with multiple threads will result in multiple identical folders
[#3493] [api] worker group manage ui could not display createtime and updatetime
[#3549] [Server][sqlTask]The alias column in the query SQL does not take effect
[#3792] [ui] The pie chart on the project homepage does not adapt to the screen size
[#3719] [api] The task resource could not be deleted
[#3548] [UI] Monitor gauge chart display blank with same pid bug
[#3707] [ui] The batch delete function in the workflow definition and workflow instance pages cannot be canceled if selected
[#3553] [ui] when edit the work flow,the selected connecting line has no style change,but the others have get bigger
[#3238] [docker] Can not create folder in docker with standalone mode
[#3713] [common] catfile method Stream not closed
[#3258] [api] Connot get create time and update time,report DateTimeParseException

Improvement
[#3720] [ui] js mailbox verification
[#3843] [api] When the update workflow definition name already exists, the prompt is not friendly
[#3131] [api] When the new tenant already exists, the prompt is incorrect