tencent cloud

Tencent Cloud DataBuddy

Workflow Overview

Download
Focus Mode
Font Size
Last updated: 2026-10-09 16:12:13
AI-Translated

Overview

A workflow is the smallest independent unit in the Workflow module responsible for orchestration and scheduling. A workflow consists of several task nodes and dependencies between nodes, describing what tasks are executed under what conditions.
Core capabilities of workflows:
Following Studio: Studio handles development and debugging, while Workflow handles publishing, scheduling, and Ops.
Unified orchestration: All task types (Notebook, SQL, Python File, Ray, offline data ingestion, IF ELSE, For Each, nested workflows, and quality monitoring) are orchestrated on the same canvas.
Complete Ops chain: Covers run records, run details (graph mode, list mode, and Gantt chart), intelligent diagnosis, and alarms and notifications.

Core Concepts

Concept
Description
Workflow
A collection of tasks connected by dependencies, serving as the smallest unit of scheduling.
Task
An execution unit in a workflow, corresponding to a piece of code (Notebook / SQL / Python) or a built-in node (IF ELSE / For Each / Nesting).
Workflow Run
An instance of a workflow execution that records runtime information such as start time, end time, status, and parameters.
Task Run
An instance of a task execution that belongs to a workflow run.
Scheduling Trigger
Execution entry of a workflow: Scheduled / Cron / File arrival / Continuous running / Manual trigger.

Prerequisites

You have joined the workspace and have access to the Workflow module.
The workspace is bound to compute resources. Task execution depends on the corresponding resource group.

Workflow Status

Status
Description
Pending
All tasks are in the waiting state.
Running
At least one task is running.
Successful
All tasks have succeeded or been excluded from running.
Failed
All tasks have reached the final state and at least one has failed.
Skipped
All tasks are skipped (concurrency limit).
Terminating
The workflow is terminating.

Task Status

Status
Description
Waiting for Workflow Concurrency
Workflow concurrency reaches the upper limit, waiting for other workflows to be released.
Waiting for Upstream
The upstream task has not reached the final state.
Waiting for Task Concurrency
The project-level task concurrency limit reaches 2000.
Waiting for Resources
Waiting for Scheduling / Engine Resources.
Running
Task running.
Terminating
The task is terminating.
Retry upon Failure
The task is waiting to retry after failure.
Skipped
Skipped due to concurrency limit.
Successful
The task ran successfully.
Failed
The task failed to run.
Upstream Failed
The upstream task is in a failed state, causing the downstream task to fail.
Excluded from Running
Excluded due to unmet run conditions or upstream conditional branches.

Use Limits

A single workspace can contain up to 10,000 workflows, and a single workflow can contain up to 1,000 task nodes.
Maximum platform-level concurrent tasks: 2,000 (per workspace).

References

Help and Support

Was this page helpful?

Help us improve! Rate your documentation experience in 5 mins.

Feedback