tencent cloud

Tencent Cloud DataBuddy

문서Tencent Cloud DataBuddyData EngineeringWorkflowOps and MonitoringMonitoring Workflows and Tasks

Monitoring Workflows and Tasks

다운로드
포커스 모드
폰트 크기
마지막 업데이트 시간: 2026-10-09 16:13:20
AI 번역
Run monitoring for workflows and tasks is used to view the status, duration, parameters, and exceptions of each run, serving as the most frequently used entry point during Ops. This document covers three levels of views: the workflow run list, workflow run details, and task run details.

Overview

DataBuddy provides the following run monitoring views:
View
Entries
Primary purpose
Workflow Run List
Workflow - Workflow Run
View the running status of all workflows from a global perspective.
Workflow Details Page - Run History
Workflow - Workflow
View the run history and duration trends of a single workflow.
Workflow Run Details
List run ID/Workflow run Gantt chart navigation
View the DAG diagram, list, and Gantt chart of a single run.
Task Run Details
DAG node/List name/Gantt chart name navigation
View the run result, run logs, task insights, and Spark UI of a single task.

Prerequisites

You have joined the workspace and have View or higher permissions on the target workflow.
The workflow has been run at least once.

Operation Steps

Step 1: Viewing the Workflow Run List (Global)

1. In the left navigation pane, choose Workflow > Workflow Run to go to the run list page.
2. A filter bar is displayed at the top, allowing you to filter both the graph and the list simultaneously.
3. The chart at the top displays:
Run Quantity Trend: A stacked chart that displays the number of runs in different states over time.
Top 5 Error Codes: A bar chart. Click an error code to quickly filter the current list.
1. A list of run instances on which you have View permissions is displayed in the space below.

Filter Options

Filter
Description
Workflow name
Enter a workflow name. Fuzzy search is supported.
Start time/End time
Time picker with minute-level precision. Selectable range: last 60 days. Default: last 3 days.
Run account
Filter by run account. Multiple selection is supported.

List Fields

Field
Description
Workflow name
Click to go to the workflow details page.
Run stream ID
Click to go to the run details page.
Start time/End time
Format: YYYY-MM-DD HH:MM:SS
Running status
See "Running status" below.
Running Time
Format: 6m3s
Triggering Method
Manual trigger / Scheduled trigger / Continuous run
Error Code
Displayed upon failure
Running Parameter
Format: name:sys;age:20
Operation
Rerun / Terminate / Delete (for details, see Ops operations on workflows and tasks)
Tip
Workflow run list data is retained for only 60 days.

Step 2: Viewing Run Records (Single Workflow)

1. Open the details page of the target workflow.
2. Switch to the Run Records Tab.
3. A filter bar is displayed at the top, allowing you to filter both the graph and the list simultaneously.
4. The Run Time Trend chart is displayed at the top, and the run instance list is displayed at the bottom.

Filter Options

Filter
Description
Start time/End time
Time picker with minute-level precision. Selectable range: last 60 days. Default: last 3 days.
Run account
Filter by run account. Multiple selection is supported.

List Fields

Field
Description
Run stream ID
Click to go to the run details page.
Start time/End time
Format: YYYY-MM-DD HH:MM:SS
Running status
See "Running status" below.
Running Time
Format: 6m3s
Triggering Method
Manual trigger / Scheduled trigger / Continuous run
Error Code
Displayed upon failure
Running Parameter
Format: name:sys;age:20
Operation
Rerun / Terminate / Delete (for details, see Ops operations on workflows and tasks)
Tip
The fields displayed in the list can be adjusted by selecting or clearing them as needed. All fields are displayed by default, and the action buttons are located in the upper-right corner of the list.

Step 3: Viewing Workflow Run Details

In the workflow run list, click a Run Stream ID / Workflow Run Gantt Chart to go to the run details page. The run details provide three views:

3.1 Graph Mode (DAG)

The DAG chart displays all task instances and upstream/downstream dependencies within the workflow. The color of each node indicates its status:
Color
Status
Green
Successful
Red
Failed / Upstream Failed
Blue
Running
Gray
Pending / Excluded from Running
Yellow
Retry upon Failure
Operation
Description
Node hover
Display task details (run ID, run account, status, duration, error code, and more).
Node click
Go to the task run details page.
Toolbar
Zoom in / Zoom out / Reset zoom to 100% / Search / Full screen / Refresh

3.2 List Mode

All task instances in the current run are displayed in a table, and you can search by task name. Columns:
Field
Description
Task Name
Click to go to the task run details page.
Run ID
Unique identifier of the task run
Task type
Notebook / SQL / Python / Offline ingestion / IF ELSE / For Each / Nested workflow / Data quality
Start time/End time
Displays the actual execution time.
Running status
See "Task running status" below.
Running Time
Format: 6m3s
Triggering Method
Manual trigger / Scheduled trigger / Continuous run
Number of retries
Number of retries for the current task
Computing Resource
Resource group actually used
Source file path.
Click to go to the corresponding file.

3.3 Gantt Chart

The horizontal timeline displays the start-end interval of each task:
Color
Status
Green
Successful
Red
Failed
Gray
Excluded from Running

3.4 Run Information (Right Sidebar)

Area
Field
Basic Information
Workflow ID / workflow run ID / trigger mode / status / start time / end time / wait duration / run duration
Computing Resource
Resource group associated with tasks in the workflow
Parameter configuration
Parameters of this run

Step 4: Viewing Task Run Details

On the workflow run details page, click a DAG node, a list name, or a Gantt chart name to go to the task run details. Tabs on the task details page:
Tab
Description
Execution result
Display task code and results.
Running logs
Error codes + error messages + logs
Task Insights
Cumulative CPU time, scanned data size, Shuffle, number of output rows, and more
Spark UI
Click the button to go to Spark UI.

Run Log Area Operations

Operation
Description
Refreshing
Select refresh frequency (such as manual refresh or automatic refresh every 10 seconds).
Automatic wrap
Automatically wrap long lines
Search
Search log keywords and quickly jump to matching logs.
Log download
Download complete logs to local device.

Task Run Details: General Information (Right Sidebar)

Area
Field
Basic Information
Workflow ID / workflow run ID / task run ID / run account / trigger mode / status / start time / end time / wait duration / run duration
File
Referenced file path. Click to go to the referenced file location.
Computing Resource
Resource group and configuration actually used
Parameter configuration
Parameters of this task

Step 5: Selecting a Run (Multiple Runs of the Same Task)

If the same task is executed multiple times in a single run, you can select any execution to view at the top of the task run details page:
The latest execution is selected by default.
Sorted in descending order by run start time.

Status Description

Workflow Run Status

Status
Description
Pending
All tasks are in the waiting state.
Running
At least one task is running.
Successful
All tasks have succeeded or been excluded from running.
Failed
All tasks have reached the final state and at least one has failed.
Skipped
The entire workflow is skipped due to concurrency limit.
Terminating
The workflow is terminating.

Task running status

Status
Description
Terminal State or Not
Waiting for Workflow Concurrency
Workflow concurrency reaches the upper limit, waiting for other workflows to be released.
No
Waiting for Upstream
The upstream task has not reached the final state.
No
Waiting for Task Concurrency
The project-level task concurrency limit reaches 2000.
No
Waiting for Resources
Waiting for Scheduling or Engine Resources
No
Running
Task running
No
Terminating
The task is terminating.
No
Retry upon Failure
Waiting for retry after task failure
No
Skipped
Skipped due to concurrency limit
Yes
Successful
The task is running successfully.
Yes
Failed
Task Execution Failed.
Yes
Upstream Failed.
The upstream task is in a failed state, causing the downstream task to fail.
Yes
Excluded from Running
Excluded due to unmet run conditions or upstream conditional branches.
Yes

Use Limits

Run record data is retained for only 60 days.
The column configuration (which columns are displayed and their order) is retained for the next visit.
The Spark UI on the task run details page opens in a new browser Tab.

FAQs

Q1: What does a gray node labeled "Excluded from Run" in the DAG mean? The task is automatically skipped because the judgment result of the upstream condition node is not met. For details, see IF ELSE Conditional Task.
Q2: What should I do if a task remains in the "Waiting for Resources" state for a long time?
On the task run details page, view the intelligent diagnosis of the task to determine whether the issue is caused by queuing, insufficient resources, quota exceeded, or other reasons.
Go to Compute Resource Overview to view the resource group load.
Q3: What should I do if the log query result is too large to display the complete content? Click Download Log to obtain the complete log.

References

Ops Operations for Workflows and Tasks
Workflow and Task Alarms
Intelligent Diagnosis of the Task
IF ELSE Conditional Task
Compute Resource Overview
이전 주제: System Built-in Parameters다음 주제: Ops Operations for Workflows and Tasks

도움말 및 지원

문제 해결에 도움이 되었나요?

피드백

키워드로 검색
    Enter keywords to search documentation