字段映射配置
字段映射配置
使用场景:当配置字段映射时,平台内置的字段类型映射集无法涵盖所有字段类型之间的映射关系,超级管理员可手动配置不同字段类型之间的映射关系,保证数据集成正常运行。
使用角色:超级管理员。
功能描述:平台支持手动配置平台与第三方数据库之间的字段映射关系,可作用于 DDL 建表、库表导入、库表导出、实时数据同步、数据信道作业等字段映射。
新建
操作流程:
登录超管账号,进入字段映射配置界面,点击页面上方“新建字段映射”并按要求填写信息后“保存”即可新建字段映射。
注意
新增字段映射保存时,系统自动与已有的映射进行校验(含内置),相同的平台字段类型、映射库类型、映射库字段类型只能有一个,不可重复创建。
- 填写项说明:
- 字段类型:仅下拉选择目前平台支持的数据类型;
- 映射库类型:下拉选择,当前支持目标库与数据导出目标库一致,包括MySQL、Oracle、PostgreSQL、SQL Server、DM、KingbaseES、HighGO、ElasticSearch;
- 映射库字段类型:手动输入需要与平台进行字段映射的字段名称。
修改
点击字段映射操作列中“修改”按钮可修改字段类型、映射库类型和映射库字段类型。
删除
点击字段映射操作列中“删除”按钮后二次确认即可删除字段映射信息。
注意
- 内置映射不允许修改、删除;
- 字段映射删除后视为不兼容,在进行映射配置时,将无法映射连线。
优先映射转换
内置、自定义映射均可设置优先映射转换,设置后则DDL解析、数据导入快速创建平台内表等场景会优先使用该映射进行自动映射转换。对于同一目标类型的同一字段类型,若一个开启了优先映射转换,则该类型其他映射自动关闭。
字段类型兼容说明
数据集成相关功能进行映射配置时,同名字段映射的判断逻辑之一是字段类型兼容,不兼容字段将无法自动、手动连线,下表为系统内置的字段类型映射集说明。
目标类型 | 目标字段类型 | 字段类型 |
---|---|---|
DM | FLOAT | FLOAT4 |
DM | DECIMAL | DECIMAL |
DM | BOOLEAN | BOOL |
DM | VARBINARY | BYTEA |
DM | BIGINT | INT8 |
DM | TIMESTAMP | TIMESTAMP |
DM | VARCHAR | VARCHAR |
DM | INT | INT4 |
DM | NUMBER | DECIMAL |
DM | BOOL | BOOL |
DM | CHAR | CHAR |
DM | TEXT | TEXT |
DM | LONGVARCHAR | TEXT |
DM | TIMESTAMPTZ | TIMESTAMPTZ |
DM | DATE | DATE |
DM | DOUBLE | FLOAT8 |
DM | NUMERIC | DECIMAL |
DM | TIMESTAMP | TIMESTAMPTZ |
DM | DEC | DECIMAL |
DM | BINARY | BYTEA |
DM | INTEGER | INT4 |
DM | TINYINT | INT4 |
DM | SMALLINT | INT4 |
HIVE2 | TIMESTAMPTZ | TIMESTAMPTZ |
HIVE2 | CHAR | CHAR |
HIVE2 | DOUBLE | FLOAT8 |
HIVE2 | BIGINT | INT8 |
HIVE2 | TINYINT | INT4 |
HIVE2 | VARCHAR | VARCHAR |
HIVE2 | TIMESTAMP | TIMESTAMP |
HIVE2 | BOOLEAN | BOOL |
HIVE2 | DECIMAL | DECIMAL |
HIVE2 | FLOAT | FLOAT4 |
HIVE2 | SMALLINT | INT4 |
HIVE2 | INT | INT4 |
HIVE2 | STRING | VARCHAR |
HIVE2 | DATE | DATE |
HIVE2 | TIMESTAMP | TIMESTAMPTZ |
HIVE3 | VARCHAR | VARCHAR |
HIVE3 | TIMESTAMPTZ | TIMESTAMPTZ |
HIVE3 | TIMESTAMP | TIMESTAMPTZ |
HIVE3 | DOUBLE | FLOAT8 |
HIVE3 | FLOAT | FLOAT4 |
HIVE3 | BIGINT | INT8 |
HIVE3 | SMALLINT | INT4 |
HIVE3 | INT | INT4 |
HIVE3 | DATE | DATE |
HIVE3 | DECIMAL | DECIMAL |
HIVE3 | CHAR | CHAR |
HIVE3 | TIMESTAMP | TIMESTAMP |
HIVE3 | BOOLEAN | BOOL |
HIVE3 | TINYINT | INT4 |
HIVE3 | STRING | VARCHAR |
HIVE4 | TINYINT | INT4 |
HIVE4 | SMALLINT | INT4 |
HIVE4 | FLOAT | FLOAT4 |
HIVE4 | DOUBLE | FLOAT8 |
HIVE4 | TIMESTAMP | TIMESTAMPTZ |
HIVE4 | DATE | DATE |
HIVE4 | TIMESTAMPTZ | TIMESTAMPTZ |
HIVE4 | TIMESTAMP | TIMESTAMP |
HIVE4 | STRING | VARCHAR |
HIVE4 | INT | INT4 |
HIVE4 | CHAR | CHAR |
HIVE4 | VARCHAR | VARCHAR |
HIVE4 | DOUBLE PRECISION | FLOAT8 |
HIVE4 | DECIMAL | DECIMAL |
HIVE4 | BIGINT | INT8 |
HIVE4 | BOOLEAN | BOOL |
HIVE5 | BOOLEAN | BOOL |
HexaDB | DATE | DATE |
HexaDB | INT4 | INT4 |
HexaDB | DECIMAL | DECIMAL |
HexaDB | BOOL | BOOL |
HexaDB | TEXT | TEXT |
HexaDB | BYTEA | BYTEA |
HexaDB | TIMESTAMPTZ | TIMESTAMPTZ |
HexaDB | VARCHAR | VARCHAR |
HexaDB | TIMESTAMP | TIMESTAMPTZ |
HexaDB | INT8 | INT8 |
HexaDB | FLOAT4 | FLOAT4 |
HexaDB | FLOAT8 | FLOAT8 |
HexaDB | CHAR | CHAR |
HexaDB | TIMESTAMP | TIMESTAMP |
HighGo | BIGINT | INT8 |
HighGo | DATE | DATE |
HighGo | TIMESTAMP | TIMESTAMP |
HighGo | INT | INT4 |
HighGo | DECIMAL | DECIMAL |
HighGo | BYTEA | BYTEA |
HighGo | INT8 | INT8 |
HighGo | FLOAT4 | FLOAT4 |
HighGo | VARCHAR | VARCHAR |
HighGo | SMALLINT | INT4 |
HighGo | INTEGER | INT4 |
HighGo | REAL | FLOAT4 |
HighGo | DOUBLE PRECISION | FLOAT8 |
HighGo | NUMERIC | DECIMAL |
HighGo | BOOLEAN | BOOL |
HighGo | BOOL | BOOL |
HighGo | CHAR | CHAR |
HighGo | TEXT | TEXT |
HighGo | CHARACTER | CHAR |
HighGo | CHARACTER VARYING | VARCHAR |
HighGo | FLOAT8 | FLOAT8 |
HighGo | INT4 | INT4 |
HighGo | TIMESTAMP | TIMESTAMPTZ |
HighGo | TIMESTAMPTZ | TIMESTAMPTZ |
KingBaseES | MEDIUMINT | INT4 |
KingBaseES | NUMBER | DECIMAL |
KingBaseES | DECIMAL | DECIMAL |
KingBaseES | DATETIME | TIMESTAMP |
KingBaseES | INTEGER | INT4 |
KingBaseES | INT3 | INT4 |
KingBaseES | MIDDLEINT | INT4 |
KingBaseES | TINYTEXT | TEXT |
KingBaseES | SMALLINT | INT4 |
KingBaseES | MEDIUMTEXT | TEXT |
KingBaseES | LONGTEXT | TEXT |
KingBaseES | TEXT | TEXT |
KingBaseES | VARCHAR | VARCHAR |
KingBaseES | BOOLEAN | BOOL |
KingBaseES | NUMERIC | DECIMAL |
KingBaseES | DOUBLE PRECISION | FLOAT8 |
KingBaseES | BIGINT | INT8 |
KingBaseES | TINYINT | INT4 |
KingBaseES | CHARACTER VARYING | VARCHAR |
KingBaseES | FLOAT | FLOAT8 |
KingBaseES | FLOAT | FLOAT4 |
KingBaseES | REAL | FLOAT4 |
KingBaseES | DATE | DATE |
KingBaseES | DATETIME | TIMESTAMPTZ |
KingBaseES | TIMESTAMP | TIMESTAMPTZ |
KingBaseES | TIMESTAMPTZ | TIMESTAMPTZ |
KingBaseES | TIMESTAMP | TIMESTAMP |
KingBaseES | CHARACTER | CHAR |
KingBaseES | CHAR | CHAR |
MongoDB | DATE | DATE |
MongoDB | BOOLEAN | BOOL |
MongoDB | INT | INT4 |
MongoDB | DOUBLE | FLOAT8 |
MongoDB | STRING | VARCHAR |
MongoDB | LONG | INT8 |
MySQL | DOUBLE | FLOAT8 |
MySQL | INT | INT4 |
MySQL | BIGINT | INT8 |
MySQL | BINARY | BYTEA |
MySQL | TIMESTAMP | TIMESTAMPTZ |
MySQL | TIMESTAMPTZ | TIMESTAMPTZ |
MySQL | MEDIUMINT | INT4 |
MySQL | VARCHAR | VARCHAR |
MySQL | VARBINARY | BYTEA |
MySQL | LONGTEXT | TEXT |
MySQL | MEDIUMTEXT | TEXT |
MySQL | TINYTEXT | TEXT |
MySQL | DECIMAL | DECIMAL |
MySQL | FLOAT | FLOAT4 |
MySQL | INTEGER | INT4 |
MySQL | DEC | DECIMAL |
MySQL | DATE | DATE |
MySQL | DATETIME | TIMESTAMPTZ |
MySQL | TEXT | TEXT |
MySQL | SMALLINT | INT4 |
MySQL | TINYINT | INT4 |
MySQL | TIMESTAMP | TIMESTAMP |
MySQL | DATETIME | TIMESTAMP |
MySQL | CHAR | CHAR |
Oracle | INTEGER | INT8 |
Oracle | CHAR | CHAR |
Oracle | BLOB | BYTEA |
Oracle | NVARCHAR2 | VARCHAR |
Oracle | NCHAR | CHAR |
Oracle | DOUBLE PRECISION | FLOAT8 |
Oracle | NUMBER | DECIMAL |
Oracle | BINARY_FLOAT | FLOAT4 |
Oracle | BOOLEAN | BOOL |
Oracle | BINARY_DOUBLE | FLOAT8 |
Oracle | DATE | DATE |
Oracle | TIMESTAMP | TIMESTAMP |
Oracle | DECIMAL | DECIMAL |
Oracle | TIMESTAMPTZ | TIMESTAMPTZ |
Oracle | TIMESTAMP | TIMESTAMPTZ |
Oracle | VARCHAR | VARCHAR |
Oracle | VARCHAR2 | VARCHAR |
Oracle | INTEGER | INT4 |
Oracle | FLOAT | FLOAT4 |
PostgreSQL | CHARACTER | CHAR |
PostgreSQL | BOOLEAN | BOOL |
PostgreSQL | DECIMAL | DECIMAL |
PostgreSQL | REAL | FLOAT4 |
PostgreSQL | INT4 | INT4 |
PostgreSQL | SMALLINT | INT4 |
PostgreSQL | TIMESTAMPTZ | TIMESTAMPTZ |
PostgreSQL | DATE | DATE |
PostgreSQL | TEXT | TEXT |
PostgreSQL | TIMESTAMP | TIMESTAMP |
PostgreSQL | VARCHAR | VARCHAR |
PostgreSQL | NUMERIC | DECIMAL |
PostgreSQL | CHAR | CHAR |
PostgreSQL | BIGINT | INT8 |
PostgreSQL | INTEGER | INT4 |
PostgreSQL | DOUBLE PRECISION | FLOAT8 |
PostgreSQL | CHARACTER VARYING | VARCHAR |
PostgreSQL | TIMESTAMP | TIMESTAMPTZ |
PostgreSQL | INT8 | INT8 |
PostgreSQL | BYTEA | BYTEA |
SQLServer | NTEXT | TEXT |
SQLServer | TINYINT | INT4 |
SQLServer | NVARCHAR | VARCHAR |
SQLServer | BINARY | BYTEA |
SQLServer | TIMESTAMP | TIMESTAMP |
SQLServer | BIGINT | INT8 |
SQLServer | DATE | DATE |
SQLServer | DECIMAL | DECIMAL |
SQLServer | NCHAR | CHAR |
SQLServer | TIMESTAMPTZ | TIMESTAMPTZ |
SQLServer | DATETIME | TIMESTAMP |
SQLServer | DATETIME2 | TIMESTAMP |
SQLServer | SMALLDATETIME | TIMESTAMP |
SQLServer | VARCHAR | VARCHAR |
SQLServer | INT | INT4 |
SQLServer | REAL | FLOAT4 |
SQLServer | TEXT | TEXT |
SQLServer | FLOAT | FLOAT8 |
SQLServer | NUMERIC | DECIMAL |
SQLServer | SMALLDATETIME | TIMESTAMPTZ |
SQLServer | DATETIME2 | TIMESTAMPTZ |
SQLServer | DATETIME | TIMESTAMPTZ |
SQLServer | CHAR | CHAR |
SQLServer | TIMESTAMP | TIMESTAMPTZ |
SQLServer | VARBINARY | BYTEA |
SQLServer | SMALLINT | INT4 |
ElasticSearch | DATE | TIMESTAMPTZ |
ElasticSearch | DATE | TIMESTAMP |
ElasticSearch | DATE | DATE |
ElasticSearch | GEO_SHAPE | GEOMETRY |
ElasticSearch | BINARY | BYTEA |
ElasticSearch | TEXT | XML |
ElasticSearch | TEXT | TEXT |
ElasticSearch | TEXT | CHAR |
ElasticSearch | TEXT | VARCHAR |
ElasticSearch | OBJECT | JSON |
ElasticSearch | SCALED_FLOAT | DECIMAL |
ElasticSearch | FLOAT | FLOAT4 |
ElasticSearch | DOUBLE | FLOAT8 |
ElasticSearch | LONG | INT8 |
ElasticSearch | BOOLEAN | BOOL |
ElasticSearch | INTEGER | INT4 |