字段映射配置
字段映射配置
使用场景:当配置字段映射时,平台内置的字段类型映射集无法涵盖所有字段类型之间的映射关系,超级管理员可手动配置不同字段类型之间的映射关系,保证数据集成正常运行。
使用角色:超级管理员。
功能描述:平台支持手动配置平台与第三方数据库之间的字段映射关系,可作用于 DDL 建表、库表导入、库表导出、实时数据同步、数据信道作业等字段映射。
新建
操作流程:
登录超管账号,进入字段映射配置界面,点击页面上方“新建字段映射”并按要求填写信息后“保存”即可新建字段映射。
注意
新增字段映射保存时,系统自动与已有的映射进行校验(含内置),相同的平台字段类型、映射库类型、映射库字段类型只能有一个,不可重复创建。
- 填写项说明:
- 字段类型:仅下拉选择目前平台支持的数据类型;
- 映射库类型:下拉选择,当前支持目标库与数据导出目标库一致,包括MySQL、Oracle、PostgreSQL、SQL Server、DM、KingbaseES、HighGO、ElasticSearch;
- 映射库字段类型:手动输入需要与平台进行字段映射的字段名称。
修改
点击字段映射操作列中“修改”按钮可修改字段类型、映射库类型和映射库字段类型。
删除
点击字段映射操作列中“删除”按钮后二次确认即可删除字段映射信息。
注意
- 内置映射不允许修改、删除;
- 字段映射删除后视为不兼容,在进行映射配置时,将无法映射连线。
优先映射转换
内置、自定义映射均可设置优先映射转换,设置后则DDL解析、数据导入快速创建平台内表等场景会优先使用该映射进行自动映射转换。对于同一目标类型的同一字段类型,若一个开启了优先映射转换,则该类型其他映射自动关闭。
字段类型兼容说明
数据集成相关功能进行映射配置时,同名字段映射的判断逻辑之一是字段类型兼容,不兼容字段将无法自动、手动连线,下表为系统内置的字段类型映射集说明。
| 目标类型 | 目标字段类型 | 字段类型 |
|---|---|---|
| DM | FLOAT | FLOAT4 |
| DM | DECIMAL | DECIMAL |
| DM | BOOLEAN | BOOL |
| DM | VARBINARY | BYTEA |
| DM | BIGINT | INT8 |
| DM | TIMESTAMP | TIMESTAMP |
| DM | VARCHAR | VARCHAR |
| DM | INT | INT4 |
| DM | NUMBER | DECIMAL |
| DM | BOOL | BOOL |
| DM | CHAR | CHAR |
| DM | TEXT | TEXT |
| DM | LONGVARCHAR | TEXT |
| DM | TIMESTAMPTZ | TIMESTAMPTZ |
| DM | DATE | DATE |
| DM | DOUBLE | FLOAT8 |
| DM | NUMERIC | DECIMAL |
| DM | TIMESTAMP | TIMESTAMPTZ |
| DM | DEC | DECIMAL |
| DM | BINARY | BYTEA |
| DM | INTEGER | INT4 |
| DM | TINYINT | INT4 |
| DM | SMALLINT | INT4 |
| HIVE2 | TIMESTAMPTZ | TIMESTAMPTZ |
| HIVE2 | CHAR | CHAR |
| HIVE2 | DOUBLE | FLOAT8 |
| HIVE2 | BIGINT | INT8 |
| HIVE2 | TINYINT | INT4 |
| HIVE2 | VARCHAR | VARCHAR |
| HIVE2 | TIMESTAMP | TIMESTAMP |
| HIVE2 | BOOLEAN | BOOL |
| HIVE2 | DECIMAL | DECIMAL |
| HIVE2 | FLOAT | FLOAT4 |
| HIVE2 | SMALLINT | INT4 |
| HIVE2 | INT | INT4 |
| HIVE2 | STRING | VARCHAR |
| HIVE2 | DATE | DATE |
| HIVE2 | TIMESTAMP | TIMESTAMPTZ |
| HIVE3 | VARCHAR | VARCHAR |
| HIVE3 | TIMESTAMPTZ | TIMESTAMPTZ |
| HIVE3 | TIMESTAMP | TIMESTAMPTZ |
| HIVE3 | DOUBLE | FLOAT8 |
| HIVE3 | FLOAT | FLOAT4 |
| HIVE3 | BIGINT | INT8 |
| HIVE3 | SMALLINT | INT4 |
| HIVE3 | INT | INT4 |
| HIVE3 | DATE | DATE |
| HIVE3 | DECIMAL | DECIMAL |
| HIVE3 | CHAR | CHAR |
| HIVE3 | TIMESTAMP | TIMESTAMP |
| HIVE3 | BOOLEAN | BOOL |
| HIVE3 | TINYINT | INT4 |
| HIVE3 | STRING | VARCHAR |
| HIVE4 | TINYINT | INT4 |
| HIVE4 | SMALLINT | INT4 |
| HIVE4 | FLOAT | FLOAT4 |
| HIVE4 | DOUBLE | FLOAT8 |
| HIVE4 | TIMESTAMP | TIMESTAMPTZ |
| HIVE4 | DATE | DATE |
| HIVE4 | TIMESTAMPTZ | TIMESTAMPTZ |
| HIVE4 | TIMESTAMP | TIMESTAMP |
| HIVE4 | STRING | VARCHAR |
| HIVE4 | INT | INT4 |
| HIVE4 | CHAR | CHAR |
| HIVE4 | VARCHAR | VARCHAR |
| HIVE4 | DOUBLE PRECISION | FLOAT8 |
| HIVE4 | DECIMAL | DECIMAL |
| HIVE4 | BIGINT | INT8 |
| HIVE4 | BOOLEAN | BOOL |
| HIVE5 | BOOLEAN | BOOL |
| HexaDB | DATE | DATE |
| HexaDB | INT4 | INT4 |
| HexaDB | DECIMAL | DECIMAL |
| HexaDB | BOOL | BOOL |
| HexaDB | TEXT | TEXT |
| HexaDB | BYTEA | BYTEA |
| HexaDB | TIMESTAMPTZ | TIMESTAMPTZ |
| HexaDB | VARCHAR | VARCHAR |
| HexaDB | TIMESTAMP | TIMESTAMPTZ |
| HexaDB | INT8 | INT8 |
| HexaDB | FLOAT4 | FLOAT4 |
| HexaDB | FLOAT8 | FLOAT8 |
| HexaDB | CHAR | CHAR |
| HexaDB | TIMESTAMP | TIMESTAMP |
| HighGo | BIGINT | INT8 |
| HighGo | DATE | DATE |
| HighGo | TIMESTAMP | TIMESTAMP |
| HighGo | INT | INT4 |
| HighGo | DECIMAL | DECIMAL |
| HighGo | BYTEA | BYTEA |
| HighGo | INT8 | INT8 |
| HighGo | FLOAT4 | FLOAT4 |
| HighGo | VARCHAR | VARCHAR |
| HighGo | SMALLINT | INT4 |
| HighGo | INTEGER | INT4 |
| HighGo | REAL | FLOAT4 |
| HighGo | DOUBLE PRECISION | FLOAT8 |
| HighGo | NUMERIC | DECIMAL |
| HighGo | BOOLEAN | BOOL |
| HighGo | BOOL | BOOL |
| HighGo | CHAR | CHAR |
| HighGo | TEXT | TEXT |
| HighGo | CHARACTER | CHAR |
| HighGo | CHARACTER VARYING | VARCHAR |
| HighGo | FLOAT8 | FLOAT8 |
| HighGo | INT4 | INT4 |
| HighGo | TIMESTAMP | TIMESTAMPTZ |
| HighGo | TIMESTAMPTZ | TIMESTAMPTZ |
| KingBaseES | MEDIUMINT | INT4 |
| KingBaseES | NUMBER | DECIMAL |
| KingBaseES | DECIMAL | DECIMAL |
| KingBaseES | DATETIME | TIMESTAMP |
| KingBaseES | INTEGER | INT4 |
| KingBaseES | INT3 | INT4 |
| KingBaseES | MIDDLEINT | INT4 |
| KingBaseES | TINYTEXT | TEXT |
| KingBaseES | SMALLINT | INT4 |
| KingBaseES | MEDIUMTEXT | TEXT |
| KingBaseES | LONGTEXT | TEXT |
| KingBaseES | TEXT | TEXT |
| KingBaseES | VARCHAR | VARCHAR |
| KingBaseES | BOOLEAN | BOOL |
| KingBaseES | NUMERIC | DECIMAL |
| KingBaseES | DOUBLE PRECISION | FLOAT8 |
| KingBaseES | BIGINT | INT8 |
| KingBaseES | TINYINT | INT4 |
| KingBaseES | CHARACTER VARYING | VARCHAR |
| KingBaseES | FLOAT | FLOAT8 |
| KingBaseES | FLOAT | FLOAT4 |
| KingBaseES | REAL | FLOAT4 |
| KingBaseES | DATE | DATE |
| KingBaseES | DATETIME | TIMESTAMPTZ |
| KingBaseES | TIMESTAMP | TIMESTAMPTZ |
| KingBaseES | TIMESTAMPTZ | TIMESTAMPTZ |
| KingBaseES | TIMESTAMP | TIMESTAMP |
| KingBaseES | CHARACTER | CHAR |
| KingBaseES | CHAR | CHAR |
| MongoDB | DATE | DATE |
| MongoDB | BOOLEAN | BOOL |
| MongoDB | INT | INT4 |
| MongoDB | DOUBLE | FLOAT8 |
| MongoDB | STRING | VARCHAR |
| MongoDB | LONG | INT8 |
| MySQL | DOUBLE | FLOAT8 |
| MySQL | INT | INT4 |
| MySQL | BIGINT | INT8 |
| MySQL | BINARY | BYTEA |
| MySQL | TIMESTAMP | TIMESTAMPTZ |
| MySQL | TIMESTAMPTZ | TIMESTAMPTZ |
| MySQL | MEDIUMINT | INT4 |
| MySQL | VARCHAR | VARCHAR |
| MySQL | VARBINARY | BYTEA |
| MySQL | LONGTEXT | TEXT |
| MySQL | MEDIUMTEXT | TEXT |
| MySQL | TINYTEXT | TEXT |
| MySQL | DECIMAL | DECIMAL |
| MySQL | FLOAT | FLOAT4 |
| MySQL | INTEGER | INT4 |
| MySQL | DEC | DECIMAL |
| MySQL | DATE | DATE |
| MySQL | DATETIME | TIMESTAMPTZ |
| MySQL | TEXT | TEXT |
| MySQL | SMALLINT | INT4 |
| MySQL | TINYINT | INT4 |
| MySQL | TIMESTAMP | TIMESTAMP |
| MySQL | DATETIME | TIMESTAMP |
| MySQL | CHAR | CHAR |
| Oracle | INTEGER | INT8 |
| Oracle | CHAR | CHAR |
| Oracle | BLOB | BYTEA |
| Oracle | NVARCHAR2 | VARCHAR |
| Oracle | NCHAR | CHAR |
| Oracle | DOUBLE PRECISION | FLOAT8 |
| Oracle | NUMBER | DECIMAL |
| Oracle | BINARY_FLOAT | FLOAT4 |
| Oracle | BOOLEAN | BOOL |
| Oracle | BINARY_DOUBLE | FLOAT8 |
| Oracle | DATE | DATE |
| Oracle | TIMESTAMP | TIMESTAMP |
| Oracle | DECIMAL | DECIMAL |
| Oracle | TIMESTAMPTZ | TIMESTAMPTZ |
| Oracle | TIMESTAMP | TIMESTAMPTZ |
| Oracle | VARCHAR | VARCHAR |
| Oracle | VARCHAR2 | VARCHAR |
| Oracle | INTEGER | INT4 |
| Oracle | FLOAT | FLOAT4 |
| PostgreSQL | CHARACTER | CHAR |
| PostgreSQL | BOOLEAN | BOOL |
| PostgreSQL | DECIMAL | DECIMAL |
| PostgreSQL | REAL | FLOAT4 |
| PostgreSQL | INT4 | INT4 |
| PostgreSQL | SMALLINT | INT4 |
| PostgreSQL | TIMESTAMPTZ | TIMESTAMPTZ |
| PostgreSQL | DATE | DATE |
| PostgreSQL | TEXT | TEXT |
| PostgreSQL | TIMESTAMP | TIMESTAMP |
| PostgreSQL | VARCHAR | VARCHAR |
| PostgreSQL | NUMERIC | DECIMAL |
| PostgreSQL | CHAR | CHAR |
| PostgreSQL | BIGINT | INT8 |
| PostgreSQL | INTEGER | INT4 |
| PostgreSQL | DOUBLE PRECISION | FLOAT8 |
| PostgreSQL | CHARACTER VARYING | VARCHAR |
| PostgreSQL | TIMESTAMP | TIMESTAMPTZ |
| PostgreSQL | INT8 | INT8 |
| PostgreSQL | BYTEA | BYTEA |
| SQLServer | NTEXT | TEXT |
| SQLServer | TINYINT | INT4 |
| SQLServer | NVARCHAR | VARCHAR |
| SQLServer | BINARY | BYTEA |
| SQLServer | TIMESTAMP | TIMESTAMP |
| SQLServer | BIGINT | INT8 |
| SQLServer | DATE | DATE |
| SQLServer | DECIMAL | DECIMAL |
| SQLServer | NCHAR | CHAR |
| SQLServer | TIMESTAMPTZ | TIMESTAMPTZ |
| SQLServer | DATETIME | TIMESTAMP |
| SQLServer | DATETIME2 | TIMESTAMP |
| SQLServer | SMALLDATETIME | TIMESTAMP |
| SQLServer | VARCHAR | VARCHAR |
| SQLServer | INT | INT4 |
| SQLServer | REAL | FLOAT4 |
| SQLServer | TEXT | TEXT |
| SQLServer | FLOAT | FLOAT8 |
| SQLServer | NUMERIC | DECIMAL |
| SQLServer | SMALLDATETIME | TIMESTAMPTZ |
| SQLServer | DATETIME2 | TIMESTAMPTZ |
| SQLServer | DATETIME | TIMESTAMPTZ |
| SQLServer | CHAR | CHAR |
| SQLServer | TIMESTAMP | TIMESTAMPTZ |
| SQLServer | VARBINARY | BYTEA |
| SQLServer | SMALLINT | INT4 |
| ElasticSearch | DATE | TIMESTAMPTZ |
| ElasticSearch | DATE | TIMESTAMP |
| ElasticSearch | DATE | DATE |
| ElasticSearch | GEO_SHAPE | GEOMETRY |
| ElasticSearch | BINARY | BYTEA |
| ElasticSearch | TEXT | XML |
| ElasticSearch | TEXT | TEXT |
| ElasticSearch | TEXT | CHAR |
| ElasticSearch | TEXT | VARCHAR |
| ElasticSearch | OBJECT | JSON |
| ElasticSearch | SCALED_FLOAT | DECIMAL |
| ElasticSearch | FLOAT | FLOAT4 |
| ElasticSearch | DOUBLE | FLOAT8 |
| ElasticSearch | LONG | INT8 |
| ElasticSearch | BOOLEAN | BOOL |
| ElasticSearch | INTEGER | INT4 |
| Doris | TINYINT | INT4 |
| Doris | SMALLINT | INT4 |
| Doris | INT | INT4 |
| Doris | BIGINT | INT8 |
| Doris | LARGEINT | INT8 |
| Doris | FLOAT | FLOAT4 |
| Doris | DOUBLE | FLOAT8 |
| Doris | DECIMAL | DECIMAL |
| Doris | DATE | DATE |
| Doris | DATETIME | TIMESTAMP |
| Doris | CHAR | CHAR |
| Doris | VARCHAR | VARCHAR |
| Doris | STRING | TEXT |
| Doris | BOOLEAN | BOOLEAN |