Release 3.4.3
Click to expand
- [DSIP-107][Scheduler] Add schedule missed fire policy (#18464) @liang-wenjie
Click to expand
- [Improvement-18040] [Doc] Update the parameter priority explanation in the docs. (#18321) @njnu-seafish
- [Doc-18322][Parameter] Add a note to the parameter priority documentation specifying and fix some issues (#18323) @njnu-seafish
- [Improvement-18304][API] Remove dead code after t_ds_relation_user_alertgroup… (#18316) @det101
- [Improvement-18332][Worker] Remove plaintext passwords from the logs (#18333) @njnu-seafish
- [Improvement-17563][Helm] Update mysql helm chart version (#18336) @qiuyanjun888
- [Doc-18326][Parameter] Fix and Enrich the documentation for parameter priority. (#18327) @njnu-seafish
- [Improvement-18354][UI] Change the description field to optional (#18355) @njnu-seafish
- [Improvement-18359][UI] Change the description field to optional in k8s config (#18360) @njnu-seafish
- [Improvement-17933][api] Restrict audit logs to current user for non-admin users (#18368) @qiuyanjun888
- [Improvement-18403][API&Security] Avoid raw password exposure in user parameter validation errors (#18404) @njnu-seafish
- [Improvement-18412][api] Fix missing validation for resource preview limit parameter (#18411) @destinyoooo
- [Improvement-18388][TASK]Killed shell tasks should be displayed as FAILURE (#18407) @HomminLee
- [Improvement-18437][API] Add index idx_project_submit_time for queryTaskInstanceListPaging (#18438) @njnu-seafish
- [Improvement-18439][API]Add composite index idx_project_start_time for workflow instance query (#18440) @njnu-seafish
- [Improvement-18441][API&DAO] Optimize TaskInstanceMapper to exclude large text fields from list queries (#18442) @njnu-seafish
- [Doc-18474][Upgrade] Fix zh/en incompatible upgrade docs out of sync (#18478) @njnu-seafish
- [Improvement-18556][API] Remove obsolete dynamic sub-workflow API (#18557) @ruanwenjun
- [Improvement-18558][API] Harden user list access and responses (#18560) @ruanwenjun
- [Improvement-18563][API] Refine datasource authorization list APIs (#18564) @ruanwenjun
- [Improvement-18568][API] Remove obsolete task update-with-upstream API (#18569) @ruanwenjun
- [Improvement-18580][api] Fix typo in DataSourceServiceImpl log message (#18581) @kittimzhe
- [Improvement-18443][API&DAO] Optimize WorkflowInstanceMapper to exclude large text fields from list queries (#18444) @njnu-seafish
- [Improvement-18589][API] Align cluster query permissions (#18590) @ruanwenjun
- [Chore] Remove unused code (#18599) @SbloodyS
Click to expand
- [Fix-18330] Replace HashMap with ConcurrentHashMap in UserGroupInformationFactory to avoid ConcurrentModificationException (#18331) @eye-gu
- [Fix-18340][Helm] Fix duplicate app.kubernetes.io/name label on ConfigMap (#18341) @vlaborie
- [Fix-18346] countTaskInstanceStateByProjectCodes uses submit_time filtering (#18347) @eye-gu
- [Improvement-17705] Add kill-application-when-task-failover logic (#18353) @SbloodyS
- [Fix-17794] Fix rerun workflow instance should follow the specified workerGroup parameter (#18352) @SbloodyS
- [Fix-18247] Fix when forceTaskSuccess is performed on the last unsuccessful workflow instance, the workflow instance cannot be reset to the success state (#18351) @SbloodyS
- [Fix-18307][API] The frontend is correctly using the preferred values of the associated project for task creating and workflow scheduling (#18308) @njnu-seafish
- [Fix-18378] Fix list resources returned only 1000 records in s3 storage type (#18381) @SbloodyS
- [Fix-18391] [Alert] Remove redundant plugin definition table existence check during AlertServer startup (#18392) @njnu-seafish
- [Fix-18409][Common] Fix DAG.addEdge accepting an edge that creates a cycle when paths converge (#18410) @nkuprins
- [Fix-18406] Fix task instance failed but workflow instance remains in running state while using continue strategy with a blocked intermediate predecessor (#18415) @SbloodyS
- [Fix-18338] Check task if it's waiting for TaskGroup slot when pause/kill (#18414) @SbloodyS
- [Fix-18446][task-sql]Persist sqlSource and sqlResource fields when saving SQL task node (#18447) @nanxiuzi
- [Fix-18540][Master] Reset the runtime state when recreating a failed task instance (#18541) @SEPURI-SAI-KRISHNA
- [Fix-18538][Master] Schedule task retry at endTime + retryInterval (#18539) @SEPURI-SAI-KRISHNA
- [Fix-18562][Common] FileUtils.writeContent2File fails for parentless paths (#18408) @hiSandog
- [Fix-18559][API] Align workflow mutations with project write permissions (#18561) @ruanwenjun
- [Fix-18570][Master] Detect wrapped CommandDuplicateHandleException in bootstrapError (#18570) (#18573) @hellodml
- [Fix-18565][API] Validate datasource access for task definitions (#18566) @ruanwenjun
- [Doc-18579] Fix malformed links in datasource and configuration docs (#18578) @kittimzhe
- [Fix-18582][API] Align actuator endpoint matching (#18583) @ruanwenjun
- [Fix-18596][API] Enforce permission checks for sub-workflow references (#18597) @ruanwenjun
- [Fix-17883] Fix K8s Alert HTTP test sending failed by using IP for non-StatefulSet pods (#18574) @zhang-arvin
- [Fix-18389][DataX] Read job definition from attached resource file when custom json is empty (#18434) @nikhiln64
- [Fix-18576][Dependent Task] Fix parsing for ALL dependent tasks (#18605) @yan9651688
- [Fix-18601][Alert] Align Alert Script test-send behavior (#18602) @ruanwenjun
- [Fix-18604][Master] Preserve forced-success state when recovering failed workflows (#18608) @wcmolin
Click to expand
- [Chore][API] Remove obsolete cluster query-by-code API (#18584) @ruanwenjun
- [Chore] Update next release version to 3.4.3 (#18613) @ruanwenjun
Click to expand
- [Chore] Fix sonar token leak (#18363) @SbloodyS
- [Chore] Remove sonar check (#18374) @SbloodyS
- [Chore] Fix auto labeler error (#18375) @SbloodyS
Release 3.4.2
Click to expand
- [DSIP-37] Disable HTTP TRACE requests in jetty via configuration (#18119) @SbloodyS
- [DSIP-95][API] Complete the functionality of using dependencies in the complement data (#18003) @det101
Click to expand
- [Feature-18070][Task] Add Amazon EMR Serverless task plugin (#18069) @norrishuang
- [Feature-18136][API] Support view the running task/workflow of a active master/worker at UI monitor page (#18138) @ruanwenjun
Click to expand
- [Improvement-17986][task-plugin] Support parameter replacement in Flink and FlinkStream task (#17987) @macdoor
- [Chore][Doc] Fix typos in WorkflowInstanceServiceTest and JVM.json (#18018) @sanjana2505006
- [Improvement-17947][ui] Improve delete confirmation to show workflow name (#18029) @asadjan4611
- [Improvement-17874][ApiServer] Remove the default value of expireTime and let the user choose the time (#17907) @njnu-seafish
- [Improvement-17942][API&UI]Add startParams validation logic in both the frontend and backend. (#17956) @njnu-seafish
- [Improvement-18056][ui] Remove the unused code in dolphinscheduler-ui (#18057) @ruanwenjun
- [Improvement-18056][api] Remove the unused code in dolphinscheduler-api (#18058) @ruanwenjun
- [Improvement-18056][Alert] Remove the unused code in alert module (#18062) @ruanwenjun
- [Improvement-18045][Doc]Improvement Parameter passing behavior doc (#18046) @njnu-seafish
- [Improvement-17010][datax] Add datax channel count to a custom parameter. (#17898) @HEEKDragonOne
- [Improvement-17960][API]Add null/empty/duplicate validation logic for globalParams when creating or updating a workflow (#17961) @njnu-seafish
- [Chore] Update download URL for DolphinScheduler tarball (#18087) @pjfanning
- [Doc-18078] document improvement (#18079) @SbloodyS
- [Improvement-17908][Flink] Make -sae parameter configurable in UI with default off (#17909) @leocook
- [Chore] Remove LICENSE files of dependencies under Apache License 2.0 (#17768) @ruanwenjun
- [Improvement-18051][alert] Remove unused dead code in WeChatSender mkString (#18100) @asadjan4611
- [Improvement-18095][API-Test] Add dependent task api test case (#18096) @SbloodyS
- [Improvement-18072][Api] Add user permission validation logic to the connectionTest, getDatabases, getTables, and getTableColumns methods in DataSourceController (#18073) @njnu-seafish
- [Improvement-18056] Remove unused code in dao module (#18107) @SbloodyS
- [Improvement-18056] Remove unused code in api module (#18105) @SbloodyS
- [Improvement-18056] Remove unused code in common module (#18104) @SbloodyS
- [Improvement-18056] Remove unused code in alert module (#18103) @SbloodyS
- [Improvement-18056] Remove unused code in datasource module (#18111) @SbloodyS
- [Improvement-18056] Remove unused code in service module (#18112) @SbloodyS
- [Improvement-18056] Remove unused code in spi module (#18113) @SbloodyS
- [Improvement-18056] Remove unused code in storage module (#18114) @SbloodyS
- [Improvement-18056] Remove unused code in task plugin module (#18115) @SbloodyS
- [Improvement-18056] Remove unused code in tools module (#18116) @SbloodyS
- [Improvement-18056] Remove unused code in yarn aop module (#18117) @SbloodyS
- [Improvement-18056] Remove unused code in worker module (#18118) @SbloodyS
- [Doc-18120] Remove irrelevant windows system documents (#18121) @SbloodyS
- [Improvement-17433] Support identify IPv6 addresses properly (#18126) @SbloodyS
- [Improvement-18084][API] Address the inconsistent class comments in DataSourceService and DataSourceServiceImpl classes. (#18086) @njnu-seafish
- [Improvement-18127][Master] Remove the redundant workflow completion check when handling workflow timeout events (#18128) @njnu-seafish
- [Improvement-17564][Helm] Update minio helm chart version (#18122) @SbloodyS
- [Improvement-17562][Helm] Update postgresql helm chart version (#18123) @SbloodyS
- [Improvement-17561][Helm] Update zookeeper helm chart version (#18124) @SbloodyS
- [Improvement-18056] Clean up unused methods and classes in the dolphinschudler-api module (#18134) @njnu-seafish
- [Chore] Bump lodash (#18141) @SbloodyS
- [Chore] Bump up vite (#18144) @SbloodyS
- [Improvement-18142][Datasource] Normalize the use of the DataSourceConstants class (#18143) @njnu-seafish
- [Improvement-18019][task-sql] Support SQL from resource file and parameter placeholders (#18020) @macdoor
- [Improvement-18056] Clean up unused methods and classes in the dolphinschudler-common module (#18147) @njnu-seafish
- [Improvement-18151] Simplify the code with lombok annotations (#18152) @SbloodyS
- [Improvement-18056] Clean up unused methods and classes in the dolphinschudler-dao-plugin module (#18156) @njnu-seafish
- [Chore] Remove unused method in IWorkflowFailureStrategy (#18159) @ruanwenjun
- [Improvement-18137][Master] Rename IWorkflowExecutionRunnable/ITaskExecutionRunnable to IWorkflowExecution/ITaskExecution (#18163) @ruanwenjun
- [Improvement-18056] Clean up unused methods and classes in the dolphinschudler-dao module (#18153) @njnu-seafish
- [Improvement-18161][Pom] Does not support automatic hot-reloading of configuration files from ConfigMap (#18162) @ruanwenjun
- [Chore] Fix code scaning and cve (#18167) @SbloodyS
- [Improvement-18056] Clean up unused methods and classes in the dolphinschudler-service module (#18169) @njnu-seafish
- [Improvement-18056] Clean up unused methods and classes in the dolphinschudler-registry module (#18165) @njnu-seafish
- [Improvement-17843][Master] Add IT case for task timeout alert (#18001) @shrihari7396
- [Improvement-18064][ApiServer] Update globalParams replace logic and test case (#18068) @njnu-seafish
- [Improvement-18056] Clean up unused methods and classes in the dolphinschudler-master module (#18164) @njnu-seafish
- [Doc-18193][dolphinscheduler-alert-http] Fix incorrect alert param doc (#18194) @SbloodyS
- [Improvement-16754][DataX] Support DataX writer parameter batchSize (#18192) @leocook
- [Chore] Unit-Test optimize (#18214) @SbloodyS
- [Improvement-18224][API] Migrate K8sNamespaceService Map<String,Object> returns to typed returns (#18227) @ruanwenjun
- [Doc-18239] Fix outdated Spark documentation links (#18241) @llphxd
- [Improvement-18224][API] Migrate SchedulerService Map<String,Object> returns to typed returns (#18226) @ruanwenjun
- [Improvement-18224][API] Migrate WorkerGroupService Map<String,Object> returns to typed returns (#18228) @ruanwenjun
- [Improvement-18224][API] Migrate TaskDefinitionService Map<String,Object> returns to typed returns (#18229) @ruanwenjun
- [Improvement-18224][API] Migrate WorkflowInstanceService Map<String,Object> returns to typed returns (#18232) @ruanwenjun
- [Fix-18222][JdbcRegistry] Reuse a singleton scheduler executor in JdbcRegistryThreadFactory (#18223) @ruanwenjun
- [Improvement-18224][API] Migrate small-service Map<String,Object> returns to typed returns (#18230) @ruanwenjun
- [Improvement-18224][API] Migrate UsersService Map<String,Object> returns to typed returns (#18234) @ruanwenjun
- [Improvement-18224][API] Migrate WorkflowDefinitionService Map<String,Object> returns to typed returns (#18236) @ruanwenjun
- [Improvement-18224][API] Migrate TaskGroupService and ExecutorServiceforceStartTaskInstance to typed returns (#18233) @ruanwenjun
- [Improvement-18224][API] Migrate ProjectService Map<String,Object> returns to typed returns (#18245) @ruanwenjun
- [Improvement-18249][DAO] Route ProjectMapper and WorkflowDefinitionMapper access through repository Dao (#18250) @ruanwenjun
- [Improvement-18249][DAO] Route ScheduleMapper access through ScheduleDao (#18251) @ruanwenjun
- [Improvement-18249][DAO] Route TaskInstanceMapper access through TaskInstanceDao (#18252) @ruanwenjun
- [Improvement-18249][DAO] Route ClusterMapper and K8sNamespaceMapper access through repository Dao (#18257) @ruanwenjun
- [Improvement-18249][DAO] Route TenantMapper access through TenantDao (#18258) @ruanwenjun
- [Improvement-18249][DAO] Route UserMapper access through UserDao (#18253) @ruanwenjun
- [Improvement-18249][DAO] Route WorkflowTaskRelationMapper access through WorkflowTaskRelationDao (#18260) @ruanwenjun
- [Improvement-18249][DAO] Route DataSourceMapper and DataSourceUserMapper access through repository Dao (#18259) @ruanwenjun
- [Improvement-18249][DAO] Route WorkflowInstanceMapper access through WorkflowInstanceDao (#18256) @ruanwenjun
- [Improvement-18249][DAO] Route QueueMapper access through QueueDao (#18263) @ruanwenjun
- [Improvement-18249][DAO] Route ProjectUserMapper access through ProjectUserDao (#18262) @ruanwenjun
- [Improvement-18249][DAO] Route AlertGroupMapper and AccessTokenMapperaccess through repository Dao (#18261) @ruanwenjun
- [Improvement-18249][DAO] Route TaskDefinitionMapper access through TaskDefinitionDao (#18254) @ruanwenjun
- [Improvement-18267][Remote Logging] Allow custom S3 region with endpoint (#18268) @wcmolin
Click to expand
- [Fix-17464] Use Driver to create jdbc connection (#18033) @ruanwenjun
- [Fix-18054] [DependentTask] Cannot dependent single task due to dao error (#18055) @ruanwenjun
- [Fix-18053] Fix publish-docker error (#18059) @SbloodyS
- [Fix-18041][Worker]Fix Parameter passing feature is unavailable in K8S Task (#18042) @njnu-seafish
- [Fix-18043][Worker]Fix Parameter passing feature is unavailable in Zeppelin Task (#18044) @njnu-seafish
- [Fix-17773][ApiServer] Replace the TaskCode references within the task parameters for ConditionTask and SwitchTask when coping workflow (#17982) @njnu-seafish
- [Fix-18061] Fix end time is empty when workflow insstance stopped by serial discard (#18076) @SbloodyS
- [Fix-17906] Fix can't get pod's log in k8s task (#18075) @SbloodyS
- [Fix-17389][Http-Task] Fix json parsing exception in request body (#18085) @SbloodyS
- [Fix-17847] Fix incWorkflowInstanceByStateAndWorkflowDefinitionCode not called in version 3.4.0 (#18082) @SbloodyS
- [Fix-17767][Master] fix execute task in workflow instance not effective (#18000) @Mrhs121
- [Fix-17943][dolphinscheduler-task-dinky] When DolphinScheduler calls a Dinky job and passes date parameters, the actual values are not being replaced (#18080) @shaolei7788
- [Fix-17817][Master] Add workflow timeout event and handle (#18063) @njnu-seafish
- [Fix-18132][API] Sync workflow definition version back after create/update (#18133) @wcmolin
- [Fix-18139][Docker] Docker compose deployment error (#18140) @SbloodyS
- [Fix-17557] Fix helm chart deploy error (#18148) @SbloodyS
- [Fix-18154] Fix abnormal transmission of sub-workflow complement date (#18155) @SbloodyS
- [Fix-18131] Workflow instance stuck in RUNNING state forever when using CONTINUE failure strategy with a failed upstream task (#18146) @SbloodyS
- [Fix-18168] Fix OBS listStorageEntity not returning subdirectories (#18170) @CloudExtreme
- [Fix-18182][API] User can delete task definitions in unauthorized projects (#18183) @ruanwenjun
- [Chore][UI] Fix @types/lodash version causing pnpm install failure (#18187) @Mrhs121
- [Fix-18199][Doc] Fix incorrect description of Serial Discard execution strategy (#18204) @ruanwenjun
- [Fix-18197][Master] Fix master failover releasing wrong lock path (#18207) @ruanwenjun
- [Fix-18177][Task Plugin] Fix AliyunServerlessSpark plugin dependency conflicts and improve exception handling (#18180) @includetts
- [Fix-18211][API] Add missing project authorization on view-gantt/view-variables and trigger workflow APIs (#18212) @ruanwenjun
- [Fix-18201][TaskPlugin] Fix RemoteShell task NullPointerException and… (#18210) @leocook
- [Fix-18269][Master] Move LogicFakeTask to test scope (#18270) @ruanwenjun
- [Fix-18276][API] Fix alert plugin instance permission check (#18279) @ruanwenjun
- [Fix-18283][API] Add project permission check on workflow lineage and workflow-definition list endpoints (#18284) @ruanwenjun
- [Fix-18292][Registry] Carry deleted node value in JDBC registry REMOVE event (#18296) @ruanwenjun
- [Fix-18299][API] Enforce access token owner checks (#18300) @ruanwenjun
- [Fix-18302][Common] Fix SQL license header parsing (#18301) @hiSandog
Click to expand
- [Chore] Initialize CLAUDE.md (#18188) @ruanwenjun
- [Improvement-18224][API] Migrate EnvironmentService Map<String,Object> returns to typed returns (#18225) @ruanwenjun
- [Chore][Master] Quietly exit WorkerGroupDispatcher loop on interrupt (#18240) @ruanwenjun
- [Chore][Docs] Refresh commit message convention to match current practice (#18242) @ruanwenjun
- [Chore][Docs] Add AGENT.md (#18271) @ruanwenjun
- [Chore][Doc] Fix English FAQ answer formatting (#18288) @hiSandog
Click to expand
- [Chore][Doc] Fix typo proejct in WorkflowInstanceServiceTest (#18037) @sanjana2505006
- [Chore] Polish CI (#18088) @SbloodyS
- [Chore] Polish CI (#18090) @SbloodyS
- [Chore] Polish ci (#18093) @SbloodyS
- [Chore] Polish ci (#18102) @SbloodyS
- [Chore] Change code owner (#18145) @SbloodyS
- [Chore] Fix publish docker error (#18149) @SbloodyS
- [Chore] Remove .flake8 file (#18160) @ruanwenjun
- [Chore][CI] Temporarily disable PythonTaskE2ETest due to CI runner issue (#18208) @ruanwenjun
- [Chore] Reverts #18153 (#18206) @ruanwenjun
- [Chore] Fix UT will be skip at CI (#18205) @ruanwenjun
- [Chore] Unit-Test performance optimize (#18213) @SbloodyS
- [Chore] Recover python e2e test in ci (#18209) @SbloodyS
- [Chore] Hotfix ut ci (#18221) @SbloodyS
- [Chore][API] Remove deprecated ProjectService#checkProjectAndAuth (#18218) @ruanwenjun
Release 3.4.1
Click to expand
- [DSIP-104][API&UI] Suggest remove import and export function (#17941) @SbloodyS
Click to expand
- [Improvement-17795][Master] Add dispatch timeout checking logic to handle cases where the worker group does not exist or no workers are available (#17796) @njnu-seafish
- [Feature-17931] Support configurable maximum runtime for workflow/task instance (#17932) @ruanwenjun
Click to expand
- [Doc-17639] Parameter passing docs improvement (#17841) @SbloodyS
- [Improvement-17855] Supports the custom and built-in variables for java task (#17860) @Mrhs121
- [Improvement-17861][zeppelin task plugin] support zeppelin tasks with parameters parsing (#17862) @ylq5126
- [Improvement-17788] [TaskPlugin] Optimization of log processing for RemoteShellTask (#17800) @qiong-zhou
- [Chore][Doc] Frontend development doc improvement (#17880) @SbloodyS
- [Chore] Remove unused code in api-server (#17871) @ruanwenjun
- [Chore] Improve Java command path construction using Paths.get() (#17894) @Mrhs121
- [Improvement-17695][ProcedureTask] Support cancel procedure task (#17696) @njnu-seafish
- [Doc-17896] Change default value for quartz job store class (#17897) @XpengCen
- [Improvement-17924] Remove Slack references and update Community sections in READMEs (#17925) @iampratap7997-dot
- [Doc-17913] Add frontend code check section in development documentation in both Chinese and English (#17914) @njnu-seafish
- [Improvement-17926] Supports creating worker groups without workers (#17927) @ruanwenjun
- [Chore] Fix typos and improve wording in README files (#17959) @iampratap7997-dot
- [Improvement-17957][UI] Improvement of Spark parameters validation (#17958) @XpengCen
- [Improvement-17994][Seatunnel] harden startupScript and -i args (#17996) @yzeng1618
Click to expand
- [Fix-17820][Master] Fix task timeout alerts failed (#17818) @njnu-seafish
- [Fix-17690][Dependent] SQL error occurred while executing a dependent task in postgresql (#17837) @SbloodyS
- [Fix-17838][Bug] [ApiServer] Remove WAIT_TO_RUN and add FAILOVER while querying workflow instances (#17839) @njnu-seafish
- [Fix-17848] Fix incorrect placement of JVM arguments in java task (#17850) @Mrhs121
- [Fix-17831] Fix incorrect parallelism num when complement data in parallel excution mode (#17853) @SbloodyS
- [Fix-17834] [Master] Fix workflow failure strategy cannot work (#17851) @ruanwenjun
- [Fix-17864] [ApiServer] Remove STOP state for task instance from ui (#17865) @njnu-seafish
- [Fix-17758][Master] Mark task as failed if TaskExecutionContext initialization fails (#17821) @njnu-seafish
- [Fix-17901] Fix incorrect or unclear description in installation documentation (#17903) @SbloodyS
- [Fix-17904][Seatunnel] Seatunnel link 404 not found in doc (#17905) @SbloodyS
- [Fix-17912] Fix http plugin cannot send json nested types (#17911) @Alexander1902
- [Fix-17915][alert] Fix the issue of setting timeout exceptions in the HTTP alert plugin, where the unit in the code is not consistent with the page. (#17920) @maomao199691
- [Fix-17967] Fix Parameter passing feature is unavailable in Procedure Task (#17968) @Mrhs121
- [Fix-17969][API] Add tenant validation for workflow (#17970) @ruanwenjun
- [Fix-17971] Fix ProcedureTask can not pass out parameter and can not execute query procedure. (#17973) @ruanwenjun
- [Fix-17984][UI] Release workflow definition list loading lock on request failure (#17989) @asadjan4611
- [Fix-17995][API] Non-admin users cannot delete their own access tokens (#17997) @dill21yu
- [Fix-17979][DAO] Fix INT/BIGINT mismatch of workflow_definition_code in t_ds_serial_command. (#17988) @iampratap7997-dot
- [Fix-18006][UI] Fix KeyCloak icon 404 not found (#18007) @SbloodyS
Click to expand
- [Chore] bump up license year (#17863) @SbloodyS
Click to expand
- [Chore] Remove unmaintained version in issue template (#17870) @SbloodyS
- [Chore] Fix frontend build regenerate the new pnpm-lock.yaml file. (#17878) @SbloodyS
- [Chore] Remove unused file in .licenserc.yaml (#17866) @ruanwenjun
- [Chore] Hotfix CI error (#17919) @SbloodyS
- [Chore] Fix max disk usage cannot replace by env at e2e (#17918) @ruanwenjun
- [Chore] Bump testcontainer to
1.21.4to fix could not find a valid Docker environment at CI (#17978) @ruanwenjun - [Chore] Add AI usage confirmation to the PR template (#17977) @ruanwenjun
- [Chore] Move generateK8sTaskExecutionContext from AbstractParameters to K8sTaskParameters (#17976) @ruanwenjun
- [Chore] Change required_approving_review_count to 1 (#17992) @ruanwenjun
- [Chore] Bump zk to 3.8.3 (#17980) @ruanwenjun
- [Chore] Remove duplicate declaration at pom (#17981) @ruanwenjun
- [Chore] Replace DataSourceProcessorManager with DataSourcePluginManager (#17975) @ruanwenjun
3.4.0
Click to expand
- [DSIP-88][Auth] Enhancing Apache DolphinScheduler with Generalized OIDC Authentication (#17340) @tusaryan
- [DSIP-90][Task] Add a gRPC task plugin (#17402) @npofsi
- [DSIP-92][Master] Refactor workflow serial strategy (#17531) @ruanwenjun
- [DSIP-94][PyTorch] Remove pytorch task type (#17808) @SbloodyS
Click to expand
- [Doc-17574] Add timezone configuration notice for MySQL datasource (#17598) @EinsteinInIct
- [Chore][Master] Supplemental workflow instance trace id in log (#17605) @det101
- [Improvement-17630] Add index for t_ds_task_group_queue to improve performance (#17631) @SbloodyS
- [Chore] Release doc improvement (#17612) @SbloodyS
- [Improvement-17647][Resource Center] Disable the timeout limit in the frontend logic when upload file. (#17648) @njnu-seafish
- [Improvement-17649][registry-jdbc] Correct 'DataChance' typos (#17650) @qiong-zhou
- [Doc-17616][Improvement] Add registry plugin usage doc (#17662) @SbloodyS
- [Improvement-17573][UI] Renamed the publicKey field to privateKey in the SSH connection parameters under the datasource configuration. (#17666) @CauliflowerEater
- [Feature-17566][Helm] add secrets and initContainers in worker statefulset (#17519) @jmmc-tools
- [Improvement-17697][SqlTask] Support cancel sql task (#17692) @ruanwenjun
- [Improvement-17664][Master] Regularly clean the the failover mark in registry (#17667) @ruanwenjun
- [Improvement-17025][UI] optimize queryLog to avoid infinite recursive invoke (#17029) @ChaoquanTao
- [Doc-17728][Master] Update load-balance doc (#17735) @Mrhs121
- [Doc-17472] update security doc contact (#17717) @dill21yu
- [Improvement-17738][Dependency] Upgrade PostgreSQL JDBC Driver to fix CVE-2024-1597 (#17740) @dill21yu
- [Improvement-17749][UI][DATAX] Improvement datax json parameter validate (#17750) @sdhzwc
- [Improvement-17715][Registry] The registry center's lock mechanism supports reentrant acquisition. (#17744) @qiong-zhou
- [Improvement-17248][UI] Optimize file details display area to reduce blank space (#17731) @zhan7236
- [Improvement-17739][Dependency] Upgrade Spring Boot to fix CVE-2023-20873 (#17747) @dill21yu
- [Fix-17753][Task-Plugin] Fix workflow killed not success when shell is sh (#17776) @qiong-zhou
- [Improvement-17708][API] Remove default value of
python-gateway.auth-token(#17801) @ruanwenjun
Click to expand
- [Fix-17600][Master] Only mark task as inactive in WorkflowTopologyLogicalTransitionWithTaskFinishLifecycleEvent (#17601) @ruanwenjun
- [Fix-17597][Master] Fix condition task node not run in workflow when pre-task node failed (#17606) @sanfeng-lhh
- [Fix-17604][API] Correct logic for assigning and remove worker groups to project (#17607) @Mrhs121
- [Fix-17534][Service/Master] Add global parameters and varpool from current workflow instance and add them to start params list of the trigger request of a sub workflow (#17578) @kvermeulen
- [Fix-17527][registry-api] Fix Master Worker API startup fails to clean failover finished nodes due to invalid ZooKeeper path (#17663) @qiong-zhou
- [Fix-17637] [API] Workflow lineage deletion optimization (#17641) @det101
- [Fix-17668] [jdbc-registry] Aim to purge history registry data change events older than N hours, but actually purge events within N hours (#17669) @qiong-zhou
- [Fix-17643] [registry-jdbc] fix dead client haven't fired JdbcDataChangeEvent issue (#17645) @qiong-zhou
- [Fix-17613] [Master] Task group queue priority always remains 0 (#17614) @KwongHing
- [Fix-17638][API] Optimize workflow lineage update logic (#17678) @det101
- [Fix-17721] [API] Optimize the logic of queryDownstreamDependentWorkflowDefinitions (#17746) @det101
- [Fix-17732] Change workflow instance status to failure when command handle failed (#17745) @ruanwenjun
- [Fix-17688] Resource validation error and duplicate folders when using Aliyun OSS storage (#17689) @nanxiuzi
- [Fix-17701][SqlTask] handle duplicate column aliases in SQL result by appending column index suffix (#17702) @njnu-seafish
- [Fix-17710][Master] Fix master task dispatch failure by filtering out null map keys. (#17711) @njnu-seafish
- [Fix-17704][HttpTask] The output parameters of an HTTP task cannot be referenced in downstream tasks. (#17716) @det101
- [Fix-17758][Master] Mark task as failed if TaskExecutionContext initialization fails (#17759) @njnu-seafish
- [Chore]Revert "[Fix-17758][Master] Mark task as failed if TaskExecutionContext initialization fails" (#17807) @ruanwenjun
- [Fix-17798] Fix assign workergroup to project is incorrect (#17799) @Mrhs121
- [Fix-17797][Helm] fix broken LDAP auth and missing search filter (#17802) @docherak
- [Fix-17780][TaskPlugin] Fix shell output log might loss due to incorrect usage of log buffer (#17790) @ruanwenjun
- [Fix-17785] Fix install_plugsins.sh cannot work in docker container (#17812) @SbloodyS
Click to expand
- [Chore][doc] Release 3.3.2 (#17611) @ruanwenjun
- [Improvement-12563]Add authentication to the Prometheus endpoint and adapt it for Kubernetes (K8S) environments. (#17577) @njnu-seafish
- [Chore] Hotfix doc CI error (#17671) @SbloodyS
- [Improvement-17646][JdbcRegistry] Using transaction in JdbcRegistryDataManager (#17754) @ruanwenjun
Click to expand
- [Chore] Hot fix ci error (#17609) @SbloodyS
- [Chore] Add IT case to verify forbidden condition tasks. (#17615) @ruanwenjun
- [Chore] Fix flaky CI (#17673) @SbloodyS
- [Chore] Mask token in api log (#17656) @ruanwenjun
- [Chore] Add IT Case for task using taskGroup with different taskGroupPriority (#17680) @ruanwenjun
- [Chore] Fix sonar error (#17722) @SbloodyS
- [Chore][CI] Remove dead link check in mergeable check (#17810) @SbloodyS
- [Chore] Fix ci cat server log failed in cluster-test (#17782) @ruanwenjun
3.3.2
Click to expand
- [Improvement-17447] Remove unused task definition doc (#17448) @SbloodyS
- [Improvement-17445] Fix dolphindb doc location error (#17444) @SbloodyS
- [Chore] Optimize pom, make dolphinscheduler-spi provided (#17500) @ruanwenjun
- [Improvement-17485][Master] Change batchTriggerAcquisitionMaxCount default value equals to threadCount (#17483) @ruanwenjun
- [Doc-17490] Deployment doc improvement (#17491) @SbloodyS
- [Improvement-17467][Master] Support set a separate dataSource for quartz (#17468) @ruanwenjun
- [Improvement-17506][dao] Add index on column workflow_definition_code for table t_ds_schedules to reduce time cost when access db (#17513) @unigof
- [Chore] Prevent NPE when handling zk connection events (#17526) @Mrhs121
- [Improvement-17480][Storage] Separate the local storage implementation from hdfs storage plugin (#17547) @ruanwenjun
Click to expand
- [Fix-17473] [Task Plugin] Fix Aliyun SS task final state (#17475) @EricGao888
- [Fix-17469]Fix threadLocal will not clean if exception occur in LoginHandlerInterceptor (#17474) @njnu-seafish
- [Fix-17436][Workflow]Task timeout kill throw exception (#17437) @njnu-seafish
- [Fix-17370] Fix worker server start failed when using hdfs storage type (#17496) @SbloodyS
- [Fix-17453] Fix TASK_ONLY strategy cannot work (#17461) @ruanwenjun
- [Fix-17477] Fix workflow can be deleted which contains failover instance (#17478) @ruanwenjun
- [Fix-17406]Fix Parameter passing feature is unavailable in SQL Task (#17456) @Zzih96
- [Fix-17413][DataSource][Hive&Spark]Principal field is not displayed and not used correctly in kerberos env (#17493) @njnu-seafish
- [Fix-17370][FOLLOWUP] Fix worker server start failed when using hdfs storage type (#17524) @Mrhs121
- [Fix-17520][TaskExecutor] fix not clear task exec path when set development.state=false in common.properties (#17523) @LourierL
- [Fix-17548] [Api] Sub WorkFlow Set Schedule Failed (#17549) @shangeyao
- [Fix-17555] [Master] TaskDispatchableEvent might block when the queue exist hight priority delay event (#17556) @ruanwenjun
- [Fix-17495] [Kubernetes] Fix configuration file mounting path issue (#17517) @cn-hew
- [Fix-17575][Workflow] Add a check for duplicate task names when saving or updating a workflow. (#17576) @njnu-seafish
- [Fix-17579][Workflow] fix view variable error after setting startup parameters for workflow instance (#17583) @Mrhs121
Click to expand
- [Chore] Fix doc deadlink error (#17466) @SbloodyS
- [Chore] fix k8s e2e (#17553) @Gallardot
- [Chore] Change version to 3.3.2 (#17602) @ruanwenjun
Click to expand
- [Chore] Hotfix ci error (#17463) @SbloodyS
- [Chore] Fix zk repo (#17471) @Gallardot
- [Chore][CI] Fix flaky ci (#17479) @SbloodyS
- [Chore] Try to fix ci dead link check 429 (#17509) @SbloodyS
- [Chore] Hotfix CI error (#17545) @SbloodyS
- [Chore] Remove unused zt-zip lib (#17525) @ruanwenjun
3.3.1
Click to expand
- [DSIP-55][Master] Separate the waiting dispatched task into different queue by worker group (#17037) @det101
- [DSIP-40][APIService] Add LogClient to fetch log (#17165) @det101
- [DSIP-83][datasource-plugin] Add DolphinDB datasource (#17404) @eco8848
Click to expand
- [Chore] Some release improvement (#17107) @SbloodyS
- [Chore] Add mistaken security vulnerabilities in security model (#17120) @ruanwenjun
- [Improvement-16767] Takeover sub-workflow in sub-workflow-task (#17153) @reele
- [Improvement-17179][Master] Remove GlobalTaskDispatchWaitingQueue (#17180) @ruanwenjun
- [Improvement-17194][Master] Removed unused params in TaskExecutionContext (#17195) @ruanwenjun
- [Improvement-17202] Retry TaskKillLifecycleEvent/TaskPauseLifecycleEvent when task instance is submitted but already dispatched (#17203) @ruanwenjun
- [Doc-17209]Fix typos and improve grammar in README.md (#17206) @Rockefeller04
- [Chore][Doc] Fix typo for contribution docs (#17219) @npofsi
- [Doc-17228] [README] Point links to latest docs and correct typos (#17229) @RooobinYe
- [Improvement-17241][UI] workflow instance list index should display workflow instance id instead of serial number (#17242) @SbloodyS
- [Doc-16755] Improve architecture description with JDBC and Etcd supportImprove design doc (#17092) @Oscarcheng0312
- [Improvement-17249][Doc] Improve development-environment-setup documentation with plugins (#17258) @det101
- [Improvement-17277]Remove unused testFlag (#17282) @SbloodyS
- [Improvement-17267] Throw exception if deserialize json failed in JSONUtils (#17243) @ruanwenjun
- [Improvement-17288] CodeGenerateException is swallowed in ProcessDefinitionDemo (#17289) @ruanwenjun
- [Improvement-17302][Alert] simplify double handling in ExcelUtils (#17303) @pjfanning
- [Improvement-17157][Master] Support setting max.concurrent.workflow.instances (#17159) @tusaryan
- [Improvement-17311][RPC] Validate the args type in RPC method (#17312) @ruanwenjun
- [Improvement-17304][Master/Worker] Make busy master/worker can registered (#17305) @ruanwenjun
- [Improvement-17328] Upgrade Databend JDBC jar to 0.3.9 (#17329) @pjfanning
- [Doc-17327] add helm section in development documentation in both Chinese and English (#17335) @njnu-seafish
- [Improvement-17361][TaskPlugin] Use logger marker to exclude the system log in task instance log content. (#17378) @ruanwenjun
- [Improvement-16979] Unify PriorityDelayQueue with AbstractDelayEventBus (#17155) @reele
- [Improvement-16994][TaskPlugin] support serverless spark template (#17411) @abzymeatsjtu
- [Improvement-17426][docs] Complete and fix mistakes in development md (#17427) @Calvin979
- [Improvement-17422][UI] Remove executionOrder when RUN_MODE_PARALLEL (#17432) @njnu-seafish
Click to expand
- [Fix-17111][registry] Fix zookeeper registry start failed message. (#17115) @yingh0ng
- [Fix-16929][Meter] Fix startup failed when metrics is disabled. (#17094) @yingh0ng
- [Fix-17109] Recovered workflow host may incorrect (#17112) @reele
- [Fix-17103][Deploy] DataxTask getColumnName Cause failure (#17104) @deng-jeffer
- [Fix-17137][CLUSTER-MANAGE] Fix update time not effective (#17138) @sdhzwc
- [Improvement-17061] Improvement linkis option parameters default show (#17136) @sdhzwc
- [Fix-17040][sql] Preserve PL/pgSQL DO $$ blocks in PostgreSQL SQL splitting (#17145) @DhiyaneshwaranR
- [Fix-17142] Add UK uniq_workflow_definition_code on t_ds_workflow_definition (#17151) @ruanwenjun
- [Fix-17173] [JVM Metrics] Fix JVM memory monitoring metrics (#17174) @dill21yu
- [Fix-17182][Dependent Task] error occured in dependent task node (#17183) @SbloodyS
- [Fix-17187][Dependent Task] finish dependent task error (#17188) @SbloodyS
- [Fix-17175] The base path of COS resources obtained is incorrect (#17176) @gaoyan1998
- [Fix-17186] Namespace Selection Missing in k8s task (#17190) @jieme
- [Fix-17189][UI] Dependent task result status icon error (#17191) @SbloodyS
- [Fix-17177] Fix cos resource can not list (#17178) @gaoyan1998
- [Doc-17211] Update links in Chinese Quick Start guide to point to Chinese versions (#17210) @Xilin10012
- [Fix-17217] HotFix TaskKillLifecycleEvent/TaskPauseLifecycleEvent retry interval (#17218) @ruanwenjun
- [Fix-17208][dependent] Fix validate dependent failure waiting time (#17207) @sdhzwc
- [Fix-17184] Fix varpool cannot use (#17199) @ruanwenjun
- [Fix-17239][Dependent] Dependent check get wrong result in manual running execution type (#17240) @SbloodyS
- [Fix-17225][Doc] fix parameter priority pass order (#17234) @unigof
- [Fix-17232][master] handle the problem that master nodes gains the same slot id (#17233) @ZhongJinHacker
- [Fix-17026][API] Fix the schedule-release-state from import workflowDefinition whose scheduled-release-state was online (#17132) @yingh0ng
- [Fix-17625][Dolphinscheduler on K8S]fix dolphinscheduler can't reconnect zookeeper when PodIP change (#17270) @Asakiny
- [Fix-17297][YARN-QUEUE-MANAGE]Fix creation time should not be changed when modifying data (#17298) @sdhzwc
- [Fix-17308][Alert] Missing alert logic when workflow instance finished (#17309) @SbloodyS
- [Fix-17299][alert] upgrade to poi 5.4.1 (#17300) @pjfanning
- [Fix-17317][Task-API] Add kill yarn or k8s application after killing task (#17325) @njnu-seafish
- [Fix-17281][alert] Fix The maximum length of cell contents (text) is 32767 characters (#17283) @hkun0120
- [Fix-17316][Task-API] Add check process status after killing task (#17320) @njnu-seafish
- [Fix-17342] Refresh restart time when failover a workflow instance (#17344) @ruanwenjun
- [Fix-17350] Fix issues of sub-workflow failover from different master server (#17352) @reele
- [Fix-17359][Task-API] Use sudo -i to avoid killing yarn application failed. (#17362) @njnu-seafish
- [Fix-17369][Deploy docker] update docker .env hub (#17369) @zhyyyq
- [Fix-17356][Dependent] error creating Dependent (#17357) @SbloodyS
- [Fix-17353] Dependent calculation ignore need-fault-tolerance state (#17385) @reele
- [Fix-17036] Change the interval of kerberos refresh from minute to hour (#17394) @wuzhenhua01
- [Fix-17355] Fix reassignWorkflowInstanceHost may failed when no events in channel (#17372) @reele
- [Fix-17354][Master] Killed state of timeout failure strategy will cause workflow can't finish or stop (#17392) @ruanwenjun
- [Fix-17408] Don't filter out inactive worker addresses in onWorkerGroupChange (#17412) @reele
- [Fix-17414]Workflow relation are not displayed (#17417) @det101
- [Fix-17431] init-job failed to execute the 3.3.1 SQL (#17434) @det101
- [Fix-17406]Fix OssStorageOperator missing init method causing ossclient to be null (#17438) @Zzih96
Click to expand
- [Chore] Fix release process (#17095) @SbloodyS
- [Chore][docs] Update documentation notice content sync with website readme (#17160) @Applenice
- [Chore][Doc] Fix typos and improve the expression in
glossary.md. (#17380) @Sud0x67 - [Chore][Doc] Fix typos and improve the expression in
README.md. (#17384) @Sud0x67
Click to expand
- [Chore] Hotfix ci pending actions (#17110) @SbloodyS
- [Chore] Hotfix ci error (#17121) @SbloodyS
- [Chore] Hotfix ci error (#17172) @SbloodyS
- [Chore] Fix spelling in ProcedureTask log.info (#17213) @jbampton
- [Chore] Skip maven-dependency-plugin in ci (#17223) @ruanwenjun
- [Chore][CI] Hot fix ci error (#17272) @SbloodyS
- [Chore][CI] Fix owasp dependency check (#17296) @SbloodyS
- [Chore] Optimize the configuration in ServerLoadProtection (#17315) @ruanwenjun
- [Chore][Master] Rename methods in StateAction for better readability. (#17379) @Sud0x67
- [Chore][CI] Hot fix CI error (#17395) @SbloodyS
- [Chore] Remove unused code in ProcessService (#17391) @ruanwenjun
- [Chore] Fix typo in WorkerConfig (#17418) @qingzhongli
Please add -Dspotless.skip=true when you want to compile from source code.
3.3.0-alpha
Click to expand
- [DSIP-19] Support zeppelin connections in the connection center, as well as external connections to the connection center in zeppelin tasks (#14434) @xdu-chenrj
- [DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks (#14976) @xdu-chenrj
- [DSIP-19] Support k8s connections in the connection center, as well as external connections to the connection center in k8s tasks (#14977) @xdu-chenrj
- [DSIP-24][RemoteLogging] Support AbsRemoteLogHandler (#15769) @pegasas
- [DSIP-26][Audit log] Audit log improvement design (#15554) @qingwli
- [DSIP-25][Remote Logging] Split remote logging configuration (#15826) @pegasas
- [DSIP-44] Set a delay time to TaskExecuteRunnable if it dispatched failed (#16069) @ruanwenjun
- [DSIP-45] Polish the Storage SPI (#16141) @ruanwenjun
- [DSIP-46] Unify the logic task params data structure between front-end and back-end (#16193) @ruanwenjun
- [DSIP-50][UDF Manage] Remove unused udf manage function (#16212) @SbloodyS
- [DSIP-51][Task] Remove unused pigeon task plugin (#16219) @SbloodyS
- [DSIP-54][Master] Use ClusterManager to manage the cluster in master (#16263) @ruanwenjun
- [DSIP-53] Suggest add process lineage parsing for dependent task (#16288) @SbloodyS
- [DSIP-56] Refactor JDBC registry support session timeout and data change event (#16287) @ruanwenjun
- [Improvement-16122][Authentication] Improvement k8s resource center statement (#16123) @pegasas
- [DSIP-57][Audit] Revert PR 14981 code (#16370) @SbloodyS
- [DSIP-59] remove single task definition code and ui (#16397) @SbloodyS
- [DSIP-60][Http task plugin] Refactor http task plugin (#16413) @SbloodyS
- [DSIP-62][Http Alert Plugin] Refactor http alert plugin (#16484) @SbloodyS
- [DSIP-61][Master] Refactor thread pool and state event orchestration in master (#16327) @ruanwenjun
- [DSIP-67] Use command to trigger workflow instance rather generate workflow instance (#16523) @ruanwenjun
- [Improvement-16516] Uniformly name process in backend code as workflow (#16524) @SbloodyS
- [Improvement-16537][API] Fix typo on api workflow parallel backfill (#16538) @pegasas
- [DSIP-70] Deprecated upgrade code of 1.x and 2.x in 3.3.0-release (#16551) @SbloodyS
- [DSIP-65] SubWorkflow logic task support pause/kill/recover (#16566) @ruanwenjun
- [DSIP-68] Unify the table structure and table fields in backend and frontend ui sections (#16544) @SbloodyS
- [DSIP-75] Support auto add license header by spotless (#16643) @ruanwenjun
- [DSIP-38] Add plugin directory in binary package (#16613) @SbloodyS
- [DSIP-38] Support upload/download plugins from maven repo (#16654) @SbloodyS
- [DSIP-78][Data Quality] Remove data quality module (#16794) @SbloodyS
- [DSIP-38] Optimize dependency tree (#16838) @SbloodyS
- [DSIP-73] Add dolphinscheduler-task-executor module to unify the task execution logic (#16790) @ruanwenjun
- [DSIP-72][Dynamic Task] Remove dynamic task type (#16842) @SbloodyS
- [DSIP-27][Task Plugin] Some improvements of JAVA task plugin (#16542) @ailiujiarui
- [DSIP-87] Remove cache configuration of task (#16892) @ruanwenjun
Click to expand
- [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) @weixiaonan1
- [feature#14654] alert-spi support prometheus alertmanager (#15079) @xjlgod
- [Improvement][Alert] Add a test send feature when creating an alert instance (#15163) @qingwli
- [Feature-15248][dolphinscheduler-alert-plugins] add alert plugin aliyun-voice (#15248) @xujiaqiang
- [Feature] timed scheduler Improvement (#15449) (#15450) @ly109974
- [Feature-14863][API] Support to manage what worker groups can be used for a project. (#15600) @calvinjiang
- [Feature-16229] Add python using file e2e test case (#16240) @SbloodyS
- [Feature-16269][dinky-task]Supports dinky tasks to accept Prepare Params passed within a task or from a previous task (#15947) @gaoyan1998
- [Feature-16132][Task Plugin] support for oceanbase datax task (#16281) @xxsc0529
- [Feature-16127] Support emr serverless spark (#16126) @EricGao888
- [Feature-10872][UI] Display the total count in all listing page (#16590) @SbloodyS
- [Feature-16396][storage-plugin] Add Tencent Cloud COS Storage Plugin (#16565) @Mighten
- [Feature-16608][Doc] Add Security Model for DS (#16609) @wangxj3
- [Feature-16801][UI] Add copy path of resource file in task definition (#16803) @SbloodyS
- [Feature-16834] Start worker node with worker group label (#16875) @SbloodyS
Click to expand
- [Fix-14885][pom] fix spotless format file path (#14889) @imp2002
- [Improvement] Fix confusing constant string for unit convertor (#15126) @EricGao888
- [Improvement][Alert] Add timeout params for HTTP plugin (#15174) @qingwli
- [Improvement] Remove spring cache for dao (#15184) @ruanwenjun
- [Improvement] Move delay calculation to Master (#15278) @ruanwenjun
- [Improvement][E2E] support e2e compose v2 fix code style (#15325) @jackyyyyyssss
- [Improvement][E2E]e2e improve add workflow httpTask e2e case (#15420) @jackyyyyyssss
- [Improvement][E2E] add e2e javatask case (#15469) @jackyyyyyssss
- [Improvement] Enable set ServerLoadProtection fot Master/Worker (#15439) @ruanwenjun
- [Improvement][HTTP] support customization of the JSON format in http body (#15531) @Gallardot
- [Improvement] [RemoteShell] Remove duplicate dolphinscheduler-datasource-all in pom.xml (#15635) @Gallardot
- [TEST] fix log server related test (#15659) @abzymeinsjtu
- [Improvement][UT] Improve Worker runner coverage (#15428) @pegasas
- [TEST] fill up access token test (#15710) @abzymeinsjtu
- [Improvement-15719] Remove the useless methods in ProcessUtils (#15720) @rickchengx
- [TEST] fill up alert group service test (#15777) @abzymeinsjtu
- [Improvement-16552] Directly use Quartz replase api to bootstrap a schedule (#15781) @ruanwenjun
- [Improvement-15760][datasource-plugin] fix sql task split error #15760 (#15794) @songwenyong
- [TEST] inc coverage of alert plugin instance svc (#15799) @abzymeinsjtu
- [TEST] increase coverage of datasource service (#15801) @abzymeinsjtu
- [TEST] increase coverage of environment service (#15840) @abzymeinsjtu
- [Improvement][Audit] Change time to create_time (#15846) @qingwli
- [Fix-15706] Seatunnel improvement (#15852) @xinxingi
- [Improvement] Refactor record audit log logic (#15881) @qingwli
- [Improvement][Spark] Support Local Spark Cluster (#15589) @pegasas
- [TEST] increase coverage of project preference service test (#15939) @abzymeinsjtu
- [TEST] increase coverage of project workergroup relation service (#15944) @abzymeinsjtu
- [Improvement] Remove OmitStackTraceInFastThrow in start.sh (#16054) @ruanwenjun
- [Improvement] Rename variable QUEUE_MAX_SIZE to QUEUE_INITIAL_SIZE (#16040) @alei1206
- [Doc] fix typos in installation md (#16079) @lw-yang
- [Doc] Update ZooKeeper download link (#16085) @sofiaJYX
- [Improvement][Flink] Change Flink command into FLINK_HOME (#16004) @pegasas
- [Fix] chore: fix a typo (#16104) @Gallardot
- [Improvement] Add RPC metrics (#16121) @ruanwenjun
- [CI][E2E] Improve e2e m1 chip local mode (#16130) @SbloodyS
- [Imporvement] Improve the MasterCofnig module comments of dolphinscheduler (#16134) @caicancai
- [Improvement][Worker] Rename workerZKPath to workerRegistryPath (#16144) @caicancai
- [CI][UT] Fix flaky unit test (#16151) @SbloodyS
- [Imporve][Master] Refine the doselect annotation of the distributionpolicy (#16149) @caicancai
- [Fix] Fix typo: tpc -> tcp (#16160) @caicancai
- [Chore] Improve ci check (#16161) @SbloodyS
- [Chore] Add issue link tempate for IDEA (#16158) @Gallardot
- [Improvement-16182] Increase zk connect timeout (#16180) @ruanwenjun
- [CI] Bump up owasp version (#16187) @SbloodyS
- [Chore] Improve pr title check (#16213) @SbloodyS
- [Fix-16224] Add Shell using file E2E case (#16220) @ruanwenjun
- [Fix-16228] Fix E2E health check url is not correct (#16227) @ruanwenjun
- [Chore] [CI] Add api-test and e2e-test to spotless check (#16242) @SbloodyS
- [Chore] Force check ci on prapare/release branch (#16216) @ruanwenjun
- [Fix-16257][Doc] The incorrect document screenshot of the task parmas passing (#16261) @QuakeWang
- [Improvement-16266][Metrics] add heartbeat metrics (#16267) @Gallardot
- [Improvement-15815][ui] improving to find current version identifier(#15815) (#15933) @pusl6
- [Chore] Improve ci check (#16294) @SbloodyS
- [Improvement-16311] Polish installation docs (#16312) @SbloodyS
- [Improvement-16333][Helm] Support for updateStrategy (#16334) @Gallardot
- [Fix-15927] Polish dependent task docs. (#16342) @SbloodyS
- [Improvement-15448] Remove redundant query in project list (#16341) @SbloodyS
- [Improvement-16360] [Doc] Add project worker group auth doc (#16361) @SbloodyS
- [Chore] modify release doc (#16371) @wangxj3
- [Doc-16375] change front build command (#16372) @ThomasTan2002
- [Improvement-15448][api] Use Map to avoid traversing List repeatedly (#16365) @Kinsonx
- [Doc-16403] simplify k8s deploy steps (#16402) @Gallardot
- [Improvement-16421]remove duplicate code of AliyunServerlessSparkDataSourceProcessor (#16422) @wangxj3
- [Improvement-16426] Delete the TaskGroupQueue in release method (#16425) @ruanwenjun
- [Improvement-16487][Master] Improve the dependent result for workflow dependency tasks (#16488) @shouwangyw
- [Improvement-16501][dolphinscheduler-api]typo in Status.java(#16501) (#16504) @lyyprean
- [Improvement-16546][Master] Add repeatTriggerWorkflowInstance/triggerFromFailureTasks/triggerFromSuspendTasks in IWorkflowControlClient (#16545) @ruanwenjun
- [Chore] Improve release doc (#16553) @SbloodyS
- [Improvement-16574][Master] Move some task operations into ITaskExecutionRunnable (#16575) @ruanwenjun
- [Improvement-8295][Document] Standalone Deployment doc should instruct users to configure sudo without password (#16585) @SbloodyS
- [Improvement-16586][Doc] Rename sub-process to sub-workflow in docs (#16587) @SbloodyS
- [Improvement-16598][UI] SQL task type optimization of sending alarm notifications (#16599) @SbloodyS
- [Improvement-16641] Add thread name in logback (#16640) @ruanwenjun
- [Improvement-16635] Using Docker Hub in Schema Check CI (#16636) @SbloodyS
- [Improvement-16534][Master] Switch task support includes method (#16594) @ChaoquanTao
- [Improvement-16647][UI][Workflow Instance] Remove deprecated workflow execution states (#16648) @sdhzwc
- [Improvement-16612][Master] For logical tasks on the Master, there should be support for dry run (#16616) @shouwangyw
- [Improvement-16507] Remove spring-boot-starter-cache (#16593) @binitshrest
- [Doc-16732][Development] development-environment-setup improvement (#16733) @SbloodyS
- [Improvement-16746][seatunnel] pass user defined task parameter to seatunnel (#16756) @liunaijie
- [Doc-16779] update seatunnel link (#16780) @liunaijie
- [Improvement-16757][Deploy] Avoid overwrite gc log (#16788) @deng-jeffer
- [Improvement-16802][UI] use relative width for task editor (#16769) @kevinjmh
- [Improvement-16809] Optimize the AbstractHAServer implementation (#16810) @ruanwenjun
- [Improvement-16807][UI] Optimize Statistics international display (#16808) @sdhzwc
- [Improvement-16758][Deploy] Record the fatal error Log (#16829) @zhu3pang
- [Improvement-16106] Add admin-user-filter in LDAP (#16826) @SbloodyS
- [Improvement-16835][Worker] Clear empty directory under task working path after task instance finish (#16836) @ruanwenjun
- [Improvement-16867] Add project_code index on t_ds_workflow_definition (#16869) @SbloodyS
- [Improvement-16850][API] Broadcast to cluster when worker group changed (#16860) @ruanwenjun
- [Improvement-16880] Merge worker group from config and ui and distinct display it in api (#16883) @SbloodyS
- [Improvement-16872][Master] Select a coordinator from masters to wake up task group (#16873) @ruanwenjun
- [Improvement-16870][RPC] Support retry configuration in rpc module (#16899) @ruanwenjun
- [Chore] Remove unused utils in common module (#16902) @ruanwenjun
- [Fix-16905][Alert] Fix incorrect log description in AlertHeartbeatTask (#16904) @justicerling
- [Improvement-16907][Master] Response for stop/pasue event when workflow instance statue is ready_stop/ready_pause (#16908) @ruanwenjun
- [Improvement-16920][UI] Release workflow definition process improvement (#16922) @SbloodyS
- [Improvement-16887][Dependent Task] Dependent task improvement (#16910) @SbloodyS
- [Improvement-16982][Master] When master startup, initialize the cluster from registry (#16983) @ruanwenjun
- [Improvement-16985][Registry] SubscribeListener support set scope (#16986) @ruanwenjun
- [Improvement-16999] Fix SensitiveDataConverter cannot convert empty data (#17000) @ruanwenjun
- [Improvement-17001] Once workflow is not exist, delete scheduler task (#17003) @ruanwenjun
- [Chore] Add stale issue lables (#17027) @SbloodyS
- [Improvement-17065][UI][TASK] Improvement custom parameters read-only mode show (#17068) @sdhzwc
- [Improvement-17063][UI][DATASYNC] Improvement datasync json parameter validate (#17064) @sdhzwc
Click to expand
- [Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue (#14992) @qingwli
- [Fix] Change HTTP plugin timeout param to number type (#15234) @qingwli
- [Fix] Fix k8sTaskExecutionContext setting configYaml (#15116) @xdu-chenrj
- [Fix][UI] When you edit a task in the task definition list, the front task list is displayed (#12819) @clovelll
- [Fix] ddl without drop exists (#14128) @zhongjiajie
- [Fix] Fix jdbc registry cannot work (#15861) @ruanwenjun
- [Fix-16061] modify log msg in
WorkflowExecuteRunnable#isTaskDepsComplete()(#16062) @alei1206 - [Fix][UI] ensure number type field has number type value when edting alarm instance (#16089) @rockfang
- [Fix][UI] Fix the message toast issue (#16088) @rockfang
- [Bug] Fix Complement data Tenant abnormality (#16092) @changxiangshimian
- [Chore ] CI add auto-assign-action (#16165) @SbloodyS
- [CI] Fix ci auto assign error (#16171) @SbloodyS
- [Fix] Fix HdfsStorageOperatorTest NPE (#16178) @ruanwenjun
- [CI] Fix CommandDaoImplTest might failed (#16175) @ruanwenjun
- [Fix-16290] Filter the NaN of system_cpu_usage/process_cpu_usage (#16289) @ruanwenjun
- [Fix-16295][Task] Remote Shell Task plugin run error (#16296) @wangbowen1024
- [Fix-16279] Support Java 8 date/time type
java.time.OffsetDateTime(#16304) @xxzuo - [Fix-16322] Set default registry-disconnect-strategy:strategy to stop (#16323) @ruanwenjun
- [Fix-15644][ui] fix ui Failed to query list after editing file (#15647) @bajiaolong
- [Fix-16329] Fix offline workflow error (#16330) @SbloodyS
- [Fix-15519] Polish datax task docs (#16325) @SbloodyS
- [Fix-16308] Fix query resources list paging error and docs. (#16324) @SbloodyS
- [Fix-16347] Fix JdbcRegistry will get duplicate children (#16348) @ruanwenjun
- [Fix-15828] fix expandListParameter (#15878) @xxzuo
- [Fix-16353][dao] Fix incorrect parameter name 'processLineages' in batchInsert method (#16354) @starrysxy
- [Fix-16346] Fix a bug that prevents re-uploading resource files (#16356) @JohnZp
- [Fix-16388][Helm] fail to change updateStrategy from RollingUpdate to onDelete (#16389) @Gallardot
- [Fix-16428] only admin user can grant datasource (#16429) @wangxj3
- [Fix-16424] K8sUtils#jobExist may cause huge memory usage (#16432) @ChaoquanTao
- [Fix-16374][dolphinscheduler-alert] Fix DingTalk replace the atUserIds parameter with atDingtalkIds (#16379) @xxzuo
- [Fix-16464] [pom] fix parent pom plugin config error (#16463) @chenss-1
- [Fix-16382] Fix the bug of async master task casthread pool invocations ramp-up (#16461) @Dyqer
- [Fix-16475][UI] Can't SET Timing successful in Workflow Definition grid (#16476) @topsli
- [Fix-16492][alert] FeiShuSender Exception.getMessage is null (#16498) @saowu
- [Doc-16490] Changed some notes about python gateway service (#16493) @BruceWong96
- [Fix-15961] [UI] Rename pythonCommand to pythonLauncher in pytorch task. (#16495) @cncws
- [Doc-16535] remove doc of extra ssh task node type (#16536) @wangxj3
- [Fix-16569][alert] Feishu send alert message failed (#16588) @saowu
- [Fix-16629][UI][Workflow Instance] fix status display error (#16630) @sdhzwc
- [Fix-16338][Test] Fix Master integration test case has been skipped in ci (#16637) @ruanwenjun
- [Fix-16567] Unable to delete copied nodes in unsaved workflow (#16576) @Xuxiaotuan
- [Fix-16650] Memory leaks in KubernetesApplicationManager (#16652) @ChaoquanTao
- [Fix-16655][Doc] Fix the missing document (#16666) @SbloodyS
- [Fix-16578] Fix environment resource permission (#16579) @wangxj3
- [Fix-16680][ApiServer] Query project list paging error (#16681) @shouwangyw
- [Fix-16692][Doc] Incorrect docs of howto (#16693) @SbloodyS
- [Fix-16700] [doc] The Vertica datasource is under "Introduction to Function" (#16701) @FrommyMind
- [Fix-16705] [Built-in Parameter] Fix project name and definition name variable parameter not resolved (#16715) @sdhzwc
- [Fix-16740][SeaTunnel-Task] fix can't submit resource center config file issue (#16741) @liunaijie
- [Fix-16517][Alert Instance] Alert plugin instance i18n wrong result in rendering frontend ui (#16751) @sdhzwc
- [Fix-16764] Tasks dispatched failed weren't delayed properly as documented in GlobalTaskDispatchWaitingQueueLooper (#16763) @slimtom95
- [Fix-16770] [Workflow State Statistics] Fix workflow state statistics status shows error (#16771) @sdhzwc
- [Improvement-16773][Parameter] Create project parameters-Field modify user adds default value (#16775) @sdhzwc
- [Fix-16786][Datasource] Fix jdbc connect parameters json validation question (#16787) @sdhzwc
- [Fix-16783][Datasource] Fix switching multiple data sources, displaying field errors (#16784) @sdhzwc
- [Fix-16793] WorkerGroupChangeNotifier may can not detect cluster's first time change (#16796) @reele
- [Fix-16331] Fix the resource file cannot be displayed hierarchically (#16799) @SbloodyS
- [Fix-16813] Missing implememts in isTaskExecutionRunnableForbidden (#16814) @reele
- [Fix-16820][Alert] fix alert status after alert sent by AlertSender (#16824) @toujours33
- [Fix-16811] [JdbcRegistry] Clear the jdbc EPHEMERAL data and lock which client is not exist (#16837) @ruanwenjun
- [Fix-16849] load-balance configuration documentation description issue (#16851) @SbloodyS
- [Fix-16884] Using transaction when fetch command to avoid fetch command from slave database (#16885) @ruanwenjun
- [Fix-16906] Fix tenant has no permission to execute kill command (#16909) @ruanwenjun
- [Fix-16914] [Task] ParameterUtils will throw exception when the input contains '$[xx]' (#16916) @ruanwenjun
- [Fix-16900][api] fix when the copied workflow, the logical node switch loses the flow relationship (#16911) @llllkid
- [Fix-16940] Fix incorrect docs link in priority parameter (#16941) @SbloodyS
- [Fix-16918][Task] Fix wrong permissions configuration while executing shell (#16923) @BruceWong96
- [Fix-16942] Fix global master failover might cause master dead (#16953) @ruanwenjun
- [Fix-16934][api] When creating workflows containing switch nodes in different orders, the copied workflows may lose associations. (#16939) @llllkid
- [Chore] python gateway unable to execute workflow (#16969) @zhongjiajie
- [Fix-16903] Fix monitor page cannot display well (#16968) @ruanwenjun
- [Fix-16978][Master] Fix AbstractDelayEvent compare method is incorrect (#16980) @reele
- [Fix-16627] [dolphinscheduler-api] LoginHandlerInterceptor.preHandle check session without expire time check (#16989) @ruanwenjun
- [Fix-16990] Fix WorkflowExecutionGraph#isTaskFinish is not working correctly (#16995) @ruanwenjun
- [Fix-16991] Missing environmentConfig when retry/failover/recover task instance (#16998) @ruanwenjun
- [Chore] Fix workflow is offline can be trigger (#17008) @ruanwenjun
- [Fix-17004] Fix process termination logic in cancelApplication method (#17005) @davidzollo
- [Fix-17019][Task Api] Missing execute path in resource limit mode. (#17020) @CommandCV
- [Fix-17022][tools] SQL syntax error at upgrade sql file in 3.2.0_schema (#17028) @weideguo
- [Fix-17030] Fix one task might be duplicate trigger if exist multiple predecessors (#17038) @ruanwenjun
- [Fix-17036] Fix kerberos will not refresh in HdfsStorageOperator (#17039) @ruanwenjun
- [Fix-17050][Master] Fix workflow graph topology logical error (#17051) @MYssq
- [Fix-17055] Fix nextBranch is empty in switch task (#17054) @ruanwenjun
- [Fix-17052][UI]Fix ui-setting route with the same name (#17053) @det101
- [Fix-17071][UI] correct datasource list id (#17072) @liunaijie
- [Fix-17023] Fix split and remove comment error in Doris task. (#17070) @yingh0ng
- [Fix-17078] Revert 11726 (#17080) @ruanwenjun
- [Fix-17073]Fix DataSource/JDBC connection failure (#17081) @tusaryan
- [Chore] Remove channelsLock on onChannelInactive to avoid deadlock (#17084) @ruanwenjun
Click to expand
- [Fix-16410] wrong env in values.yaml (#16412) @yelijing18
- [Chore] Remove unsupported feature in README.md (#16549) @ruanwenjun
- [Doc-16555] Add note of Alert Script Plugin (#16556) @wangxj3
- [Chore] Fix publish docker error in CI (#16667) @SbloodyS
- [CI] [Hotfix] Fix docs dead link error (#16708) @SbloodyS
- [Chore][doc] Correct typos (#16762) @GOODBOY008
- [DSIP-82][Master/Worker] Use FAILOVER_FINISH_NODES to avoid duplicate workflow/task when failover (#16821) @ruanwenjun
- [Chore] Add flame diagram in CI (#16847) @SbloodyS
- [Chore] Update home.png in read.md (#16890) @ruanwenjun
- [Chore] Remove unused step in development-environment-setup.md (#16925) @ruanwenjun
- [Chore] Remove unused alert.rpc.port in common.properties (#16957) @ruanwenjun
- [Chore] Fix ci error (#17041) @SbloodyS
Click to expand
- [Chore] Rename dolphinscheduler-aop to dolphinscheduler-yarn-aop (#16095) @ruanwenjun
- [Chore] Use testcontainer origin exposed port rather than generate random port (#16195) @ruanwenjun
- [Chore] Remove unused SQLIntegrityConstraintViolationException in JdbcOperator (#16200) @ruanwenjun
- [Chore] Add mergeable check (#16217) @SbloodyS
- [Chore] Remove unused dependentResult in TaskInstance (#16236) @ruanwenjun
- [Chore] Fix flaky e2e test (#16246) @SbloodyS
- [Chore] add codeowner to help review k8s,meter,registry,helm, etc. (#16259) @Gallardot
- [Chore] remove unuse resource query (#16239) @caishunfeng
- [Chore] Use SecureRandom rather than ThreadLocalRandom (#16291) @ruanwenjun
- [Chore] Improve owasp dependency check (#16305) @SbloodyS
- [Chore] Fix sonar cannot work (#16307) @ruanwenjun
- [Chore] Improve frontend ci check (#16335) @SbloodyS
- [Chore] Stale issue improvement (#16398) @SbloodyS
- [Chore][Hotfix] Change docker-compose to docker compose in ci (#16416) @SbloodyS
- [Chore] Fix push docker ci error (#16418) @SbloodyS
- [Chore] Add E2E-K8S-Result to mergeable check (#16439) @SbloodyS
- [Chore] Remove staleness code owner (#16547) @SbloodyS
- [Chore] Improve the robustness of CI (#16592) @SbloodyS
- [Chore][CI] Fix ci cache error (#16600) @SbloodyS
- [Chore][CI][Hotfix] Fix sqlserver e2e test ci error (#16633) @SbloodyS
- [Chore] Remove maven-javadoc-plugin (#16639) @ruanwenjun
- [Chore] Remove unused class in dolphinscheduler-service (#16846) @ruanwenjun
- [Chore] Remove unused closeAlert (#16877) @ruanwenjun
- [Chore] Remove unused JDBCDataSourceProvider (#16881) @ruanwenjun
- [Chore] Fix JdbcRegistryTestCase might failed due to purge dead clients interval is too small (#16894) @ruanwenjun
- [Chore] Fix StopWorkflowInstanceExecuteFunctionTest failed on Locale.SIMPLIFIED_CHINESE (#16893) @ruanwenjun
- [Fix-16935][Doc] fix typos in
PULL_REQUEST_TEMPLATE.md(#16936) @Mighten - [Chore] Set update time when online/offline schedule (#17002) @ruanwenjun
- [Chore] Fix SensitiveDataConverter cannot work (#17006) @ruanwenjun
- [Chore] Enable discussions in .asf.yaml (#17069) @ruanwenjun
- [Chore] Add notification in asf.yaml (#17075) @zhongjiajie
- [Chore] recover issue buttom in asf.yaml (#17076) @zhongjiajie
- [Chore][CI] Hotfix ci error (#17082) @SbloodyS
3.2.2
- [DSIP-39][parameter] Improvement startup parameters/global parameters/project parameters data type (#15967) @sdhzwc
- merge schema 330 into 321 and change docs (#15582) (#15586) @zhongjiajie
- [Improvement][API] add PageInfo UT (#15622) @Gallardot
- [Doc] fix CNCF logo (#15634) @Gallardot
- [Doc][remote shell] missing remote shell doc for version 3.2.1 (#15660) @pegasas
- [Improvement-15603][API] When removing or modifying a workflow the system can check if there any tasks depend on it. (#15681) @calvinjiang
- [Improvement-15694][UI] After saving the task form the task node uses the wrong background color. (#15695) @calvinjiang
- [Improvement-15707][Master] Work out the issue that the workflow with a task dependency couldn't work well. (#15712) @calvinjiang
- [Improvement-15723][UI] Work out the issue that project preferences doesn't replace all places that they need to affect. (#15724) @calvinjiang
- [Improvement-15725][UI] The default option of project preferences can be clearable. (#15727) @calvinjiang
- [CI] Frontend ci require passed before merge (#15735) @SbloodyS
- [Bug][Worker] Replace jre with jdk (#15764) @Gallardot
- [Improvement][RemoteLogging] Move init into loghandler (#15780) @pegasas
- [Improvement] add resource full name check (#15786) @caishunfeng
- [Improvement-15744][parameter] project parameter add update time and update user id (#15745) @sdhzwc
- Remove dolphinscheduler-data-quality from dolphinscheduler-task-dataquality (#15791) @ruanwenjun
- [Improvement-15713][api]DataSource And UdfFunc list query use Enum code value rather than ordinal (#15714) @songwenyong
- [Improve] Fix typo on ProcessServiceImpl (#15817) @qingwli
- [Improvement][Api] Delete useless batchUpdateUdfFunc method (#15844) @qingwli
- [Fix-15866][Doc] Update the taobao npm mirror address (#15867) @xxzuo
- Add DSIP template (#15871) @ruanwenjun
- [DSIP-28] Donnot scan whole project beans under classpath (#15874) @ruanwenjun
- [DSIP-31] Reduce the connection pool size of hikari (#15890) @ruanwenjun
- [Improvement] Fix alert code smell (#15892) @qingwli
- Use workerNodeInfoWriteLock to update work node info (#15903) @DaqianLiao
- [Improvement-15919][datasource] Improvement datasource get name (#15920) @sdhzwc
- [Improvement-15910][UI] Supposed to provide a default value for the custom parallelism when using the mode of parallel execution. (#15912) @calvinjiang
- Optimizing the scope of RPC base classes (#15946) @ruanwenjun
- [DSIP-35][Alert] Refactor the alert thread model (#15932) @ruanwenjun
- [Improvement] Fix the git url command injection in pytorch task(#15873) (#15950) @cntigers
- Add link to ETCD/JDBC Registry Guideline (#15597) @pegasas
- Add unified integretion test for registry module (#15981) @ruanwenjun
- [Doc] Repair resource configuration exist typo (#15988) @dongyu6
- [Improvement] Use safe constructor with snake yaml (#15758) @EricGao888
- [Improvement][Monitor] Show master && worker Busy Or Normal Status and Show Commands table list (#15978) @qingwli
- [Improvement][Monitor] Add UT for montor (#15998) @qingwli
- Deprecated 2.0.9/3.0.6 upgrade test (#16012) @ruanwenjun
- docs: fix type in contribute.md (#16022) @jxbwhe
- [Improvement][Docs]Correction of Typos in the Chinese Document in appendix.md (#16033) @TianXinCoord
- [Fix] Fix audit log parma typo (#16077) @qingwli
- [Improvement][Helm] Make configmap of api/master/worker/alert configuration (#16058) @pegasas
- [Improvement-16125][dolphinscheduler-dist] Reduce binary distribution tarball file size (#16192) @zhuxt2015
- Fix recover pause workflowInstance may generate failover taskInstance (#15611) @ruanwenjun
- Fix out parameter may loss (#15617) @ruanwenjun
- [Bug][API] list paging missing totalpage (#15619) @Gallardot
- Fix Hive jdbc url (#15627) @xxzuo
- [Bug][dolphinscheduler-task-seatunnel] script resource file path error (#15621) @cqutwangyu
- [Bug] Fix can modify file which is not under resource path (#15652) @ruanwenjun
- [Bug] Fix task might be dispatched even if it has been killed (#15662) @ruanwenjun
- [Bug] [Worker] fix: create linux user with home dir (#15670) @zero-element
- [Fix-15639] [Master] parameterPassing is null case NPE (#15678) @liuchunhua
- [Fix-15679][UI] fix switch status button not show correctly (#15686) @liuchunhua
- [Fix][Master] Fix Potential danger in the event of a worker failover (#15689) @ZhongJinHacker
- [bug][Plugins]fix word spell error in readme.md (#15716) @ZhongJinHacker
- Fix the NullPointerException when "start param to overwrite global param" (#15677) @wustlz
- [CI] Fix ui build error (#15732) @SbloodyS
- [Fix-15698][UI] close the definition when opened in the new tab (#15736) @arlendp
- [CI] Fix frontend ci not trigger (#15749) @SbloodyS
- [Bug] Disable delete a specific workflow version when exist workflow instance under this version which is not finish (#15730) @ruanwenjun
- [Bug] Fix delay execution task will never be dispatched (#15751) @ruanwenjun
- [Bug] Fix Switch logic task doesn't check the branch exist (#15755) @ruanwenjun
- [Fix] add resource full name check (#15757) @caishunfeng
- [Fix-15771] Fix normal user can grant project permission (#15772) @silentxingtian
- [bug][ui] add missing datasource and update datasource id (#15776) @whhe
- [Bug] Fix TaskGroupCoordinator might cause OOM when there is a lot of waiting TaskGroupQueue (#15773) @ruanwenjun
- [Bug] Fix dependent task logic (#15795) @abzymeinsjtu
- [Bug] [Common] Fix typo on common.properties (#15806) @pegasas
- Fix cannot construct instance of StreamingTaskTriggerResponse (#15816) @atjiucheng
- [Improvement] Abnormal characters check (#15824) @pinkfloyds
- [Improvement] Modify python-gateway: enabled default to false. (#15825) @pinkfloyds
- [Fix-15787] Reuse code and solve the problem of complex SQL parsing exceptions in… (#15833) @xinxingi
- Fix ErrorCommand loss some fields in Command (#15847) @ruanwenjun
- Bind processId to construct CodeGenerator (#15848) @ruanwenjun
- Forbidden forcess success a task instance in a running workflow instance (#15855) @ruanwenjun
- [Bug] Fix QUARTZ table order is not correct in initialization schema (#15857) @ruanwenjun
- Change ssh heartbeat type to IGNORE (#15858) @ruanwenjun
- [FIX] Fix failure to recover stopped instance (#15880) @privking
- Fix queryByTypeAndJobId might error due to multiple result (#15883) @ruanwenjun
- Fix kill dynamic task doesn't kill the wait to run workflow instances (#15896) @ruanwenjun
- Fix auto create tennat concurrently will cause the task failed (#15909) @ruanwenjun
- Fix jar path is not correct in java task (#15906) @ruanwenjun
- [FIX] Completed tasks cannot be re-executed in a workflow instance (#15884) @privking
- [Fix-15937] Add tenantCode propagation to DynamicCommandUtils.createCommand (#15956) @stoplyy
- [fix-15907] Fix get remote shell exit code is incorrect (#15911) @Zzih96
- [Fix-15969] [Helm] No DB Nodes Exist (#15970) @Gallardot
- EMR task support replace params placeholder (#15975) @ruanwenjun
- docs: fix spelling (#15996) @jbampton
- Fix database schema change check failed with pg in ci (#15995) @ruanwenjun
- [Fix-15992] maintain slot index by iterate MasterPriorityQueue orderly (#15993) @coldestlin
- Fix workflow instance restart failed due to duplicate key in varpool (#16001) @ruanwenjun
- Use random port in registry IT (#16014) @ruanwenjun
- Fix rpc channel leak due to concurrent operation (#16021) @ruanwenjun
- Fix WorkerTaskExecutorThreadPool#isOverload is incorrect (#16027) @ruanwenjun
- [Fix][CI] fix the ci error of E2E-K8S-Execute (#16031) @rickchengx
- [Hotfix] Fix NettyRemotingClient might throw IllegalMonitorStateException (#16038) @ruanwenjun
- [Fix-16046][SqlTask] Fix Sql task use time type is incorrect (#16050) @yinxiaolog
- [helm] remove AppVersion from common labels (#16066) @Gallardot
- Revert "[Improvement] Abnormal characters check" (#16102) @ruanwenjun
- Fix task instance which status is dispatch will not be failover (#16107) @ruanwenjun
- Fix task nodes under switch task will not be skipped (#16108) @ruanwenjun
- [Bug] Fix condition task will cause workflow instance failed (#16152) @ruanwenjun
- [Fix-16063] Fix admin login tenant unspecified issue after upgrade to v3.2.1 (#16064) @tinglink
- [Fix-16174] Incorrect cluster installation guide. (#16208) @SbloodyS
- [Fix-16222] Fix worker overload will casue task failed (#16221) @ruanwenjun
- [Fix-16211] Remove ExecutePath in buildJarCommand to fix Java Task in Jar Mode (#16238) @lanxing2
- [Hotfix] Fix dsip name (#15876) @ruanwenjun
- [DSIP-32][Master] Add command fetcher strategy for master fetch command (#15900) @ruanwenjun
- [Chore] [Cherry-Pick] cherry pick some pr to 3.2.2 (#16215) @SbloodyS
- [Doc] Fix ci docs check timeout issue (#15664) @SbloodyS
- chore: modify some CODEOWNERS (#15654) @zhongjiajie
- [HotFix] [CI] Temporary skipping mergeable check (#15958) @SbloodyS
- [Chore] Revert some incompatible change for 3.2.2 (#16214) @SbloodyS
- [Fix-16191] Fix task cannot use workflow's environment (#16199) @ruanwenjun
3.2.1
- fix: Resource relate path invalid when tenant change (#15581)
- [fix][worker]:Fix the issue of missing disk usage reporting information in the worker (#15565)
- [Fix] Fix WorkflowInstance batch start failed will throw incorrect exception. (#15577)
- Fix create parent directory will cause FileAlreadyExistsException (#15576)
- Fix Recover WorkflowInstance will casue workflow Instance state is success but task insatnce is killed/paused (#15574)
- fix: data quality may fail in docker mode (#15563)
- fix: start param for wf not work (#15544)
- fix: ddl without drop exists (#14128)
- fix switch js (#15487)
- fix: data quality can not use (#15551)
- Fix createFile with permission will not work (#15556)
- [Bug][force-success] force success add end time (#15144)
- [Bug][Task Api] fix 'MACPATTERN' in ProcessUtils and cover all cases on MacOS in ProcessUtilsTest (#15480)
- Fix TaskGroupQueue will never be wakeup due to wakeup failed at one time (#15528)
- Exit JVM when OOM (#15538)
- Fix exception occur in RpcServer side, it will not be sent to RpcClient (#15536)
- front: When you edit a task in the task definition list, the front task list is displayed (#12819)
- [Fix] [Bug] Change default version of Workflow/TaskDefinition to
1(#15498) - [Bug] Fix a bug, When the worker service offline, workerNodeInfo cache in master cannot delete the offline worker (#15459)
- fix workflow will have same updatetime when import (#14810)
- [BUG] #15013 Fix retryInterval in RetryPolicy will never be used in RetryUtils (#15014)
- Throw IllegalArgumentException if parse time placeholder error (#15514)
- Fix PostgresqlDatabaseContainerProvider get Image is incorrect (#15434)
- [Bug][Api] Fix NPE when deleting a workflow instance (#15485)
- Directly Throw exception when taskInstancy log path is empty which log need to be queried (#15511)
- Fix notify failover WorkflowInstance will cause NPE (#15499)
- [HotFix] Fix createTaskInstanceWorkingDirectory failed if the old path exist (#15377)
- [bug] Exception when using host in ipv6 format (#14040)
- [Bug][Master]serial_wait strategy workflow unable to wake up (#15270)
- [BUG][Task] fix java task classpath (#15470)
- [Bug] [Audit log] Fix Audit log UI query error (#15427)
- [Bug][Registry] Optimizing waiting strategy (#15223)
- Set TaskGroupQueue updateTime when force start (#15510)
- TaskGroupPriority only compare When TaskGroup is same (#15486)
- Remove taskQueue and looper in worker (#15292)
- Display the resource file doesn't exist message in task create page (#15350)
- Recreate new TaskInstance Working Directory when exist in worker (#15358)
- [Bug] Close SSH session after remote shell finish (#15348)
- Fix check value rather than key in AbstractDataSourceProcessor#checkOther (#15351)
- Fix resource file usage(Delete Resource/ResourceUser which is deprecated)
- [Bug][Master] send ACK event timeout (#15346)
- Fix k8sTaskExecutionContext setting configYaml (#15116)
- [Fix #15129] [Dependent] The date rules of the dependent node are ambiguous. (#15289)
- Fix failover Master might not release taskGroup (#15287)
- [HotFix] Fix TaskOutputParameterParser might OOM if meed a bad output param expression (#15264)
- [Bug-15215][Api] non-admin should not modify tenantId and queue (#15254)
- Set the tenant as the owner in final stage (#15256)
- Use chown to set the file owner (#15240)
- [Fix] Change HTTP plugin timeout param to number type (#15234)
- fix switch condition (#15228)
- Fix docs style is incorrect by CI pass (#15167)
- Expire session when update user password (#15219)
- Fix home page workflow instance miss status (#15193)
- fix security issue (#15192)
- fix can't stop bug (#15191)
- Remove API Result in Service (#15181)
- Exclude DataSourceAutoConfiguration in worker server (#15169)
- [Bug] Fix TriggerRelationMapper cannot work due to miss DatabaseIdProvider (#15153)
- Fix spotless (#15164)
- Fix incorrect button display text (#15160)
- [Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue (#14992)
- fix missing 'KYUUBI' in droplist of datasource (#15140)
- [Bug] Fix endless loop (#15092)
- fix: execute sql error: datasource plugin 'doris' is not found。 (#15123)
- Fix confusing constant string for unit convertor (#15126)
- [fix-#11726] fix error when set connection proerty both in the URL and an argument (#15093)
- [Fix-15072][Resource Center] Non-admin user can not query resource recursively (#15097)
- [E2E][Bug] Fix k8s-e2e (#15098)
- Fix SqlTask cannot split the given sql when browser in windows (#15062)
- [Fix-15036] [API] Fix task definition edit doesn't work (#14801)
- remove sub workflow finish notify (#15057)
- Fix missing Kyuubi type in UI (#15051)
- [Fix-14885][pom] fix spotless format file path (#14889)
- Fix When the task instance status is 'STOP' (#14967)
- Revert "[Bug] [Resource] fix resource delete bug (#15003)
- [Bug] [Resource] fix resource delete bug (#15003)
- Delete File generated by UT (#15022)
- [Improvement][UT] Improve Worker registry coverage (#15380)
- refactor comments & function name for confuse (#15546)
- [Improvement][HTTP] support custom rendering of http body (#15531)
- [improvement][api] Fix typo for controllers (#15438)
- [Feature-15475][DinkyTask] DinkyTask supports Dinky-1.0.0 and common sql (#15479)
- [Improvement][K8S]Optimize MDC for K8S tasks (#15390)
- Enable set ServerLoadProtection fot Master/Worker (#15439)
- [Feature] timed scheduler Improvement (#15449)
- [Improvement][E2E] add e2e javatask case (#15469)
- [Enhancement][API]Enhance mysql connection properties (#15433)
- [Improvement][E2E]e2e improve add workflow httpTask e2e case (#15420)
- Add config for defaultTenantEnabled (#15391)
- Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496)
- adjust the sequence of alarm group and add validate (#15382)
- Use Druid to split sql (#15367)
- optimize add select filter (#15378)
- [Improvement][Helm] using helm-docs to generate docs automatically (#15299)
- [Improvement][K8S] Custom label of a K8S task can be passed to the pod (#15369)
- Optimize server startup log (#15362)
- [Improvement][E2E] support e2e compose v2 fix code style (#15325)
- [Improvement] Ensure that HttpUtils can only get result from certification URL (#15288)
- delete debugger (#15316)
- Set maxRows in SqlTask (#15342)
- [Feature-15146][dolphinscheduler-task-sqoop] add sqoop source/target type (#15146)
- [Feature-15248][dolphinscheduler-alert-plugins] add alert plugin aliyun-voice (#15248)
- [Improvement-15260][dolphinscheduler-datasource-hana] add hana related dependencies (#15260)
- fail-fast for dependent check (#15197)
- [Improvement] Move delay calculation to Master (#15278)
- Add dolphinscheduler-extract-common module (#15266)
- Support parse task output params under multiple log (#15244)
- [Improvement-15009][Parameter] Change project parameter value to text (#15010)
- Remove spring cache for dao (#15184)
- [Improvement] Clean up Scheduler logic (#15198)
- [Improvement][Alert] Add a test send feature when creating an alert instance (#15163)
- [Improvement][Helm] support task type filter (#15179)
- [Improvement][Resource Center] Display brief file name in file-details page (#15137)
- [Improvement][Alert] Add timeout params for HTTP plugin (#15174)
- [feature#14654] alert-spi support prometheus alertmanager (#15079)
- [Improvement][K8S] Remove ResourceQuota (#14991)
- [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977)
- [DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks (#14976)
- [DSIP-19] Support zeppelin connections in the connection center, as well as external connections to the connection center in zeppelin tasks (#14434)
- [Feature-14832][Listener]Implementation of Listener Mechanism (#14981)
- Remove mapper usage in tools (#15073)
- [Feature-14678][Master][UI]Dependent task parameter passing (#14702)
- Add IT for mysql5/postgresql16 initialize/upgrade (#15063)
- Add IT for dolphinscheduler-tools module (#15043)
- Set kubectl version to v1.28.3 (#15053)
- Add dolphinscheduler-dao-plugin module (#15019)
- [improvement][Resources] Improve details page return to the previous list page (#14951)
- [Improvement][Alert] Alert plugin enhance fail message (#15024)
- [Improvement][Registry][Jdbc] Add jdbc registry config in helm charts (#14431)
- [Improvement][Master] Calculate the remainTime then we set the delay execution. (#15012)
- [Doc][Docker] fix typo on start with docker (#15534)
- [Doc] remove skywalking, update note (#15028)
- Change download url in backend.yml (#15526)
- [Doc][K8S] Add DS K8S Operator into k8s deployment character (#15516)
- Add guideline link into DolphinScheduler mail list (#15447)
- Remove unused cache-evict.png (#15220)
- [Doc-15500][Task] Update cli opts of spark and flink (#15501)
- doc write wrong,should be MinIO it's not MinION (#15395)
- [Doc]remove temporary markdown comments (#15385)
- doc: Classify docs to avoid misleading (#15282)
- Add deploy on Terraform on README (#15189)
- Modify the documentation that python task will not work properly when '\n' indicates the presence of a variable and needs to use 'repr(value)' (#15145)
- [Docs] fix typo (#15032)
- merge schema 330 into 321 and change docs (#15582)
- Set the workflow instance ready state to running in failover (#15572)
- cp: Reduce the size of tarball to continue ASF release (#15004)
- chore: Docs change for 3.2.1 release (#15539)
- [DS-15489][style]rename the vo object suffix (#15504)
3.1.9
- [Bug-15215][Api] non-admin should not modify tenantId and queue #15254 @zhanqian-1993
- [Bug] fix switch condition #15228 @caishunfeng
- [Fix-14805] Task definition log may be written twice #15016 @HomminLee
- [Bug][Master] fix duplicate event, avoid event stacking #14986 @caishunfeng
- [Fix-14963] Fix the error of using shell task to obtain Home variable in Ubuntu system #14964 @zhuangchong
- [Fix-14729] fix problem with the command generated by the flink task #14902 @LiuCanWu
- Construct processInstance may NPE when master handling command #14888 @fuchanghai
- [Bug] [Mater] The process always runs when the process contains subprocess and params deliver #14856 @qingwli
- [Task] Change Seatunnel task run-mode to deploy-mode #14800 @zhangbaipeng
- fix(dolphinscheduler-alert): fix create http request error #14793 @hunter-cloud09
- [Fix-14627][dolphinscheduler-ui] Fix there are too many child node in sub_process, it cannot to filter by keywords #14770 @chenshuai1995
- [Fix-14546] seatunnel unable submit spark job to spark #14617 @Yhr-N
- [Fix]Solve the deadlock problem caused by queuing #13191 @dahai1996
- after a submit failure, stop the processInstance to avoid an endless loop #13051 @fuchanghai
- doc: Classify docs to avoid misleading #15282 @zhongjiajie
- [Docs] fix typo #15032 @liunaijie
- Fix a typo in English development-environment-setup.md #14767 @wangzheyuan
Full Changelog: https://github.com/apache/dolphinscheduler/compare/3.1.8...3.1.9