Release Notes
Product Introduction
Purchase Guide
Getting Started
Buddy
- Buddy - Data Analytics Scenarios
- Data Engineering Agent
- Buddy Overview
- Data Governance Agent
- Buddy Data Security
- Overview of Buddy Agent Basic Capabilities
Platform Management
- Workspace Management
- Compute Resource Management
- Data Source Management Overview
Data Integration
- Supported Data Ingestion Solutions
- Supported Data Sources and Read Capabilities
- Data Source Management
- List of Data Sources
- Offline Data Synchronization
- Real-Time Data Synchronization
- File Upload
Data Engineering
- Studio
- Workflow
- CI/CD
Data Science
- Data Science Overview
- Model Experiments
- Feature Management
- Model Management
- Model Service
Data Analysis
- Data Exploration Overview
Data Governance
- Data Catalog Overview
- Data Discovery Overview
- Data Security Overview
- Data Quality Overview
- Semantic Model Overview
- Governance Tag Overview
Data Applications
- Agent Development
- MCP
- Model List
API Documentation
- History
- Introduction
- API Category
- Making API Requests
- Console APIs
- Workspace APIs
- Computational Resource APIs
- Development Studio APIs
- Workflow APIs
- Catalog APIs
- Data Types
- Error Codes
FAQs
Agreements
Contact Us
Glossary

Supported Data Sources and Read Capabilities

Download

Focus Mode

Font Size

Last updated: 2026-10-09 16:09:07

AI-Translated

Overview
DataBuddy data ingestion continuously expands the supported data source types, covering categories such as relational databases, big data storage, semi-structured data, NoSQL databases, and message queues. This document lists the currently supported data sources by category and their read capability support across different ingestion paths (offline synchronization, real-time full-database synchronization, and sharded database and table synchronization).
A data source is registered with DataBuddy as a data source connection. For details, see Add a data source connection. The destination of a synchronization task is always a Catalog table (based on Iceberg native tables) or a Volume.
Read Capability Legend
Flag.
Description
✓
Supported
-
Currently not supported
Real-time synchronization paths typically have stricter requirements on source versions. For the detailed supported version range, refer to the Supported Version column.
Relational Database
Data Source
Offline read
Real-time full database read
Sharded database and table read
Supported Version
MySQL
✓
✓
✓
5.6 / 5.7 / 8.0.x
Tencent Cloud MySQL
✓
✓
✓
Same as MySQL
TDSQL-C MySQL
✓
✓
✓
5.7 / 8.0
TDSQL MySQL
✓
✓
-
InnoDB Type
PostgreSQL
✓
✓
✓
9.6 / 10 / 11 / 12
SQL Server
✓
✓
✓
2008 / 2008R2 / 2012 / 2014 / 2016 / 2017 / 2019
Oracle
✓
✓
✓
11 / 12 / 19
OceanBase
✓
✓
-
3.1.4 / 4.2.1.3
IBM DB2
✓
-
-
-
DM Database
✓
-
-
7 / 8
GBase
✓
-
-
-
GaussDB
✓
-
-
-
Greenplum
✓
-
-
4.x / 5.x / 6.x
TiDB
✓
-
-
-
Big Data Storage
Data Source
Offline read
Real-time full database read
Sharded database and table read
Supported Version
Hive
✓
-
-
1.x / 2.x / 3.x
HDFS
✓
-
-
2.x / 3.x
HBase
✓
-
-
2.2.x
TCHouse-D
✓
-
-
-
TCHouse-C
✓
-
-
-
TCHouse-X
✓
-
-
-
TCHouse-P
✓
-
-
-
Doris
✓
-
-
0.15 / 1.x
Iceberg
✓
-
-
0.13.1+
StarRocks
✓
-
-
-
ClickHouse
✓
-
-
20.7+
Kudu
✓
-
-
-
Hudi
✓
-
-
-
TDengine
✓
-
-
-
BigQuery
✓
-
-
-
Semi-Structured Data
Semi-structured data sources primarily handle unstructured file ingestion and offline reading scenarios. By combining file-to-table sync tasks with those targeting a Volume, you can achieve multiple usage modes such as archiving as-is, parsing into tables, and format conversion.
Data Source
Offline read
Real-time read
Description
COS
✓
-
Tencent Cloud COS; supports use as an offline sync source and as an entry for "COS file to table".
Amazon S3
✓
-
Overseas object storage; supports regex matching for file paths and full/incremental sync.
Azure Blob
✓
-
Access via container path
FTP
✓
-
Offline sync link only
SFTP
✓
-
Supports password and SSH private key authentication
File System
✓
-
Self-managed file system
Rest API
✓
-
Supports GET/POST, Header, and single/multiple requests; supports single JSON objects and JSON arrays.
NoSQL Database
Data Source
Offline read
Real-time full database read
Supported Version
MongoDB
✓
✓
4.x
TencentDB for MongoDB
✓
✓
Same as MongoDB
Elasticsearch
✓
-
6.x / 7.x
Tencent Cloud Elasticsearch
✓
-
Same as Elasticsearch
CTSDB / InfluxDB
✓
-
-
Message queue
Data Source
Offline read
Real-time full database read
Supported Version
Kafka
✓
✓
2.4.1 / 2.7.1 / 2.8.1 / 2.8.2
CKafka
✓
✓
Same as Kafka
Viewing Available Data Source Types
The preceding list is for reference only. When you go to Data Source Management or create a data source connection in a data ingestion task, you can view the complete list of types actually supported by the current version in the Data Source Type drop-down list. For specific connection configuration items of each data source, see the corresponding section in Data Source List.
References
Supported Access Solutions
Add Data Source Connection
Real-Time Whole-Database Multi-Table Task Configuration

Help and Support

Was this page helpful?

You can also Contact sales or Submit a Ticket for help.

Help us improve! Rate your documentation experience in 5 mins.

Feedback

tencent cloud

Tencent Cloud DataBuddy

Supported Data Sources and Read Capabilities

Overview

Read Capability Legend

Relational Database

Big Data Storage

Semi-Structured Data

NoSQL Database

Message queue

Viewing Available Data Source Types

References

Help and Support

Data Source	Offline read	Real-time full database read	Sharded database and table read	Supported Version
MySQL	✓	✓	✓	5.6 / 5.7 / 8.0.x
Tencent Cloud MySQL	✓	✓	✓	Same as MySQL
TDSQL-C MySQL	✓	✓	✓	5.7 / 8.0
TDSQL MySQL	✓	✓	-	InnoDB Type
PostgreSQL	✓	✓	✓	9.6 / 10 / 11 / 12
SQL Server	✓	✓	✓	2008 / 2008R2 / 2012 / 2014 / 2016 / 2017 / 2019
Oracle	✓	✓	✓	11 / 12 / 19
OceanBase	✓	✓	-	3.1.4 / 4.2.1.3
IBM DB2	✓	-	-	-
DM Database	✓	-	-	7 / 8
GBase	✓	-	-	-
GaussDB	✓	-	-	-
Greenplum	✓	-	-	4.x / 5.x / 6.x
TiDB	✓	-	-	-

Data Source	Offline read	Real-time read	Description
COS	✓	-	Tencent Cloud COS; supports use as an offline sync source and as an entry for "COS file to table".
Amazon S3	✓	-	Overseas object storage; supports regex matching for file paths and full/incremental sync.
Azure Blob	✓	-	Access via container path
FTP	✓	-	Offline sync link only
SFTP	✓	-	Supports password and SSH private key authentication
File System	✓	-	Self-managed file system
Rest API	✓	-	Supports GET/POST, Header, and single/multiple requests; supports single JSON objects and JSON arrays.