Squashed commit of the following:

commit 9d161d2 Author: lizhenglei <[email protected]> Date: Mon Aug 12 14:03:21 2024 +0800 [Fix] Fix http e2e case (apache#7356) * 1 * fix * fix * fix * fix * fix --------- Co-authored-by: lizhenglei <[email protected]> commit 2489f64 Author: hailin0 <[email protected]> Date: Mon Aug 12 13:36:15 2024 +0800 [Improve][Connector] Add multi-table sink option check (apache#7360) * [Improve][Connector] Add multi-table sink option check * fix commit fa34ac9 Author: Jia Fan <[email protected]> Date: Mon Aug 12 13:35:43 2024 +0800 [Improve][API] Check catalog table fields name legal before send to downstream (apache#7358) * [Improve][API] Check catalog table fields name legal before send to downstream * update commit 068c5e3 Author: Tyrantlucifer <[email protected]> Date: Mon Aug 12 12:55:41 2024 +0800 [Core][Flink] refactor flink proxy source/sink (apache#7355) commit e23e3ac Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Sun Aug 11 17:40:02 2024 +0800 Bump org.apache.activemq:activemq-client (apache#7323) Bumps org.apache.activemq:activemq-client from 5.14.5 to 5.15.16. commit d46cf16 Author: Jarvis <[email protected]> Date: Sat Aug 10 23:47:12 2024 +0800 [Feature] Split transform and move jar into connectors directory (apache#7218) commit 862e205 Author: Jia Fan <[email protected]> Date: Sat Aug 10 15:21:36 2024 +0800 [Improve][Document] Change deprecated connector name in setup.md (apache#7366) commit 2769ed5 Author: hailin0 <[email protected]> Date: Sat Aug 10 09:58:03 2024 +0800 [Hotfix][Connector] Fix jdbc compile error (apache#7359) commit 3130ae0 Author: xxsc0529 <[email protected]> Date: Fri Aug 9 20:02:06 2024 +0800 [Fix][Connector-V2][OceanBase] Remove OceanBase catalog's dependency on mysql driver (apache#7311) commit 9216627 Author: chaos <[email protected]> Date: Fri Aug 9 13:53:28 2024 +0800 Update ConsoleSinkFactory.java (apache#7350) Add existing rules to the optionRule commit dc3c239 Author: dailai <[email protected]> Date: Fri Aug 9 13:11:30 2024 +0800 [Improve][Jdbc] Skip all index when auto create table to improve performance of write (apache#7288) commit 16950a6 Author: Jia Fan <[email protected]> Date: Thu Aug 8 17:27:47 2024 +0800 [Improve][Connector-V2] Improve doris error msg (apache#7343) commit a18fca8 Author: Alex Ting <[email protected]> Date: Thu Aug 8 11:22:41 2024 +0800 [Fix][Connector-tdengine] Fix sql exception and concurrentmodifyexception when connect to taos and read data commit 064fcad Author: lizhenglei <[email protected]> Date: Wed Aug 7 21:57:57 2024 +0800 [Improve][Transform] Improve DynamicCompile transform (apache#7319) commit 16eeb1c Author: He Wang <[email protected]> Date: Wed Aug 7 14:54:46 2024 +0800 [Improve][Jdbc] Remove MysqlType references in JdbcDialect (apache#7333) commit 191d9e1 Author: ChunFuWu <[email protected]> Date: Wed Aug 7 14:53:51 2024 +0800 [FIX][SFTP] Fix username parameter error in sftp sink document (apache#7334) commit 764d8b0 Author: Jia Fan <[email protected]> Date: Wed Aug 7 12:46:30 2024 +0800 [Improve][API] Make sure the table name in TablePath not be null (apache#7252) commit 8916523 Author: hailin0 <[email protected]> Date: Wed Aug 7 12:46:12 2024 +0800 [Hotfix][Connector] Fix kafka consumer log next startup offset (apache#7312) commit 819c685 Author: hailin0 <[email protected]> Date: Wed Aug 7 12:45:54 2024 +0800 [Improve][Jdbc] Merge user config primary key when create table (apache#7313) commit 7c3cd99 Author: hailin0 <[email protected]> Date: Wed Aug 7 12:44:41 2024 +0800 [Improve] Remove unused code (apache#7324) commit 460e73e Author: hailin0 <[email protected]> Date: Wed Aug 7 12:44:24 2024 +0800 [E2E] Enable fakesource e2e of spark/flink (apache#7325) commit f6a1e51 Author: hailin0 <[email protected]> Date: Wed Aug 7 12:44:13 2024 +0800 [E2E] Enable JdbcPostgresIdentifierIT (apache#7326) commit a12786b Author: Carl-Zhou-CN <[email protected]> Date: Wed Aug 7 12:27:50 2024 +0800 [DOC][Oss] fix document configuration is rectified when the oss is selected as the checkpoint base (apache#7332) commit a4db64d Author: zhangdonghao <[email protected]> Date: Wed Aug 7 11:52:19 2024 +0800 [Improve][E2E] Support windows for the e2e of paimon (apache#7329) commit 855254e Author: Jia Fan <[email protected]> Date: Wed Aug 7 11:03:06 2024 +0800 [Feature][Transform] Add LLM transform (apache#7303) * [Feature][Transform] Add LLM transform * update * update * retrigger commit f0cefbe Author: Arin <[email protected]> Date: Tue Aug 6 19:23:38 2024 +0530 [Feature] [Activemq] Added activemq sink (apache#7251) commit bb2c912 Author: Guangdong Liu <[email protected]> Date: Tue Aug 6 21:46:12 2024 +0800 [Fix][Doris] Fix the abnormality of deleting data in CDC scenario. (apache#7315) commit c94ea32 Author: Jia Fan <[email protected]> Date: Tue Aug 6 11:23:52 2024 +0800 [Fix][Doc] Fix miss sink-options-placeholders.md in sidebars (apache#7310) commit 73632ba Author: hailin0 <[email protected]> Date: Tue Aug 6 10:08:45 2024 +0800 [Hotfix][Zeta] Fix task cannot be stopped when system is busy (apache#7292) commit 9d56cc3 Author: virvle <[email protected]> Date: Mon Aug 5 17:51:26 2024 +0800 Update Oracle-CDC.md (apache#7285) commit 4f120ff Author: Jia Fan <[email protected]> Date: Mon Aug 5 14:34:01 2024 +0800 [Improve] Update snapshot version to 2.3.7 (apache#7305) commit 2fd4eec Author: Jia Fan <[email protected]> Date: Mon Aug 5 11:35:02 2024 +0800 [Fix][Doc] Fix hybrid cluster deployment document display error (apache#7306) commit 82f5d8c Author: hailin0 <[email protected]> Date: Sat Aug 3 12:02:19 2024 +0800 [Improve][SQL-Transform] Remove escape identifier from output fields (apache#7297) commit 34a6b8e Author: Jast <[email protected]> Date: Wed Jul 31 14:43:11 2024 +0800 [hotfix][connector-v2-hbase]fix and optimize hbase source problem (apache#7148) * [hotfix][improve][doc]optimize connector hbase source * [doc]add dependent document * [doc]update dependent document * [improve]improve static use * [hotfix]add test case * [hotfix]add test case --------- Co-authored-by: Jia Fan <[email protected]> commit 9df557c Author: lizhenglei <[email protected]> Date: Tue Jul 30 21:37:04 2024 +0800 [Improve][Transform] Improve DynamicCompile transform (apache#7264) commit b9acb57 Author: hailin0 <[email protected]> Date: Tue Jul 30 16:12:57 2024 +0800 [Feature][Transforms] Support cast to bytes function of sql (apache#7284) commit ec1c319 Author: Nothing. <[email protected]> Date: Mon Jul 29 21:53:01 2024 +0800 [Docs]translate event-listener doc into chinese (apache#7274) commit f012b2a Author: dailai <[email protected]> Date: Mon Jul 29 21:51:59 2024 +0800 [Improve][Connector-v2] Optimize the way of databases and tables are checked for existence (apache#7261) commit 4897491 Author: 卢宗柱 <[email protected]> Date: Mon Jul 29 17:29:23 2024 +0800 fix [Bug] Unable to create a source for identifier 'Iceberg'. apache#7182 (apache#7279) Co-authored-by: luzongzhu <[email protected]> commit 21c4f52 Author: corgy-w <[email protected]> Date: Mon Jul 29 17:28:10 2024 +0800 [Improve][Core] Improve base on plugin name of lookup strategy (apache#7278) * [bug][plugin-discovery] fix multi plugin discovery * [bug][plugin-discovery] optimize code --------- Co-authored-by: wangchao <[email protected]> commit 3ccc6a8 Author: hailin0 <[email protected]> Date: Mon Jul 29 10:41:09 2024 +0800 [Hotfix][Zeta] Fix task cannot be stopped when system is busy (apache#7280) commit d886495 Author: Guangdong Liu <[email protected]> Date: Fri Jul 26 10:45:32 2024 +0800 [Fix][Connector-V2] Fix doris TRANSFER_ENCODING header error (apache#7267) commit 31e59cd Author: Xuzz <[email protected]> Date: Fri Jul 26 10:44:50 2024 +0800 [Feature][Jdbc] Support hive compatibleMode add inceptor dialect (apache#7262) commit d003bd8 Author: zhangdonghao <[email protected]> Date: Fri Jul 26 10:44:09 2024 +0800 [Feature][Zeta] Added the metrics information of table statistics in multi-table mode (apache#7212) commit 876d2f0 Author: Jia Fan <[email protected]> Date: Thu Jul 25 10:24:55 2024 +0800 [Fix][Dist] Remove aws jar dependency in release package (apache#7257) * [Fix][Dist] Remove aws jar dependency in release package * [Fix][Dist] Remove aws jar dependency in release package commit 0d08b20 Author: dailai <[email protected]> Date: Thu Jul 25 10:00:13 2024 +0800 [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc (apache#7248) commit cc59499 Author: Jia Fan <[email protected]> Date: Tue Jul 23 14:27:07 2024 +0800 [Improve][Core] Move MultiTableSink to seatunnel-api module (apache#7243) * [Improve][Core] Move MultiTableSink to seatunnel-api module * [Improve][Core] Move MultiTableSink to seatunnel-api module commit fe0c477 Author: Eric <[email protected]> Date: Tue Jul 23 08:36:58 2024 +0800 [Hotfix][Zeta] Fix taskgroup failed log lost (apache#7241) commit b0fe432 Author: hawk9821 <[email protected]> Date: Mon Jul 22 16:12:12 2024 +0800 The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. apache#7231 (apache#7242) commit 4b3af9b Author: Guangdong Liu <[email protected]> Date: Mon Jul 22 13:04:19 2024 +0800 [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema (apache#7229) * 1 * 1 * 1 * Update seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/source/serialization/RowBatch.java Co-authored-by: Jia Fan <[email protected]> --------- Co-authored-by: gdliu3 <[email protected]> Co-authored-by: Jia Fan <[email protected]> commit 4ec25f3 Author: Jia Fan <[email protected]> Date: Mon Jul 22 12:01:36 2024 +0800 [Fix][Zeta] Fix release slot resource twice (apache#7236) commit 7dc3fa8 Author: litiliu <[email protected]> Date: Mon Jul 22 11:41:33 2024 +0800 [Fix][Connector kafka]Fix Kafka consumer stop fetching after TM node restarted (apache#7233) commit 063f83c Author: Guangdong Liu <[email protected]> Date: Mon Jul 22 10:40:58 2024 +0800 [Improve][Restapi] Add ip and port to monitoring information (apache#7203) commit c4ca741 Author: hailin0 <[email protected]> Date: Sat Jul 20 21:00:06 2024 +0800 [Feature][Core] Support using upstream table placeholders in sink options and auto replacement (apache#7131) 、 commit 821dfc8 Author: lizhenglei <[email protected]> Date: Sat Jul 20 20:25:50 2024 +0800 [Feature][Transform] DynamicCompile add transform (apache#7170) commit 1e7c78d Author: hilo <[email protected]> Date: Fri Jul 19 19:44:18 2024 +0800 [Improve][Doc] Add IMap OSS config jars into document (apache#7029) commit d39ad93 Author: Jia Fan <[email protected]> Date: Fri Jul 19 19:42:03 2024 +0800 [Fix][Zeta] Fix hybrid deployment can not get worker when init (apache#7235) commit 2058f5d Author: ChunFuWu <[email protected]> Date: Fri Jul 19 14:21:23 2024 +0800 [Chore][NOTICE] Correct year in NOTICE file (apache#7232) commit 6e33a97 Author: Jia Fan <[email protected]> Date: Thu Jul 18 23:03:27 2024 +0800 [Fix] Fix Hana type converter decimal scale is 0 convert to int error (apache#7167) commit d1b4a7f Author: Jia Fan <[email protected]> Date: Thu Jul 18 15:31:30 2024 +0800 [Improve][Zeta] Add check for submit duplicate job id (apache#7021) commit e44e8b9 Author: hailin0 <[email protected]> Date: Thu Jul 18 15:30:49 2024 +0800 [Improve][Jdbc] Support write unicode text into sqlserver (apache#7159) commit f40f11a Author: tcodehuber <[email protected]> Date: Thu Jul 18 00:03:33 2024 +0800 [Docs] Update engine related docs info (apache#7228)
jovezhong · Aug 12, 2024 · e8e887b · e8e887b
1 parent 1fa8770
commit e8e887b
Show file tree

Hide file tree

Showing 441 changed files with 14,588 additions and 2,895 deletions.
diff --git a/.github/workflows/backend.yml b/.github/workflows/backend.yml
@@ -553,6 +553,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run seatunnel zeta integration test
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -609,6 +611,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run transform-v2 integration test (part-1)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -633,6 +637,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run transform-v2 integration test (part-2)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -657,6 +663,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run connector-v2 integration test (part-1)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -684,6 +692,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run connector-v2 integration test (part-2)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -711,6 +721,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run connector-v2 integration test (part-3)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -738,6 +750,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run connector-v2 integration test (part-4)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -765,6 +779,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run connector-v2 integration test (part-5)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -792,6 +808,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run connector-v2 integration test (part-6)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -819,6 +837,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run connector-v2 integration test (part-7)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -898,6 +918,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run jdbc connectors integration test (part-3)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -922,6 +944,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run jdbc connectors integration test (part-4)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -946,6 +970,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run jdbc connectors integration test (part-5)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -996,6 +1022,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run jdbc connectors integration test (part-7)
         if: needs.changes.outputs.api == 'true'
         run: |
@@ -1020,6 +1048,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run kudu connector integration test
         run: |
           ./mvnw -B -T 1 verify -DskipUT=true -DskipIT=false -D"license.skipAddThirdParty"=true --no-snapshot-updates -pl :connector-kudu-e2e -am -Pci
@@ -1043,6 +1073,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run amazonsqs connector integration test
         run: |
           ./mvnw -B -T 1 verify -DskipUT=true -DskipIT=false -D"license.skipAddThirdParty"=true --no-snapshot-updates -pl :connector-amazonsqs-e2e -am -Pci
@@ -1066,6 +1098,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run kafka connector integration test
         run: |
           ./mvnw -B -T 1 verify -DskipUT=true -DskipIT=false -D"license.skipAddThirdParty"=true --no-snapshot-updates -pl :connector-kafka-e2e -am -Pci
@@ -1089,6 +1123,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run rocket connector integration test
         run: |
           ./mvnw -B -T 1 verify -DskipUT=true -DskipIT=false -D"license.skipAddThirdParty"=true --no-snapshot-updates -pl :connector-rocketmq-e2e -am -Pci
@@ -1139,6 +1175,8 @@ jobs:
           java-version: ${{ matrix.java }}
           distribution: 'temurin'
           cache: 'maven'
+      - name: free disk space
+        run: tools/github/free_disk_space.sh
       - name: run oracle cdc connector integration test
         run: |
           ./mvnw -B -T 1 verify -DskipUT=true -DskipIT=false -D"license.skipAddThirdParty"=true --no-snapshot-updates -pl :connector-cdc-oracle-e2e -am -Pci
diff --git a/.github/workflows/labeler/label-scope-conf.yml b/.github/workflows/labeler/label-scope-conf.yml
@@ -252,6 +252,11 @@ Milvus:
       - changed-files:
           - any-glob-to-any-file: seatunnel-connectors-v2/connector-milvus/**
           - all-globs-to-all-files: '!seatunnel-connectors-v2/connector-!(milvus)/**'
+activemq:
+  - all:
+      - changed-files:
+          - any-glob-to-any-file: seatunnel-connectors-v2/connector-activemq/**
+          - all-globs-to-all-files: '!seatunnel-connectors-v2/connector-!(activemq)/**'
 Zeta Rest API:
   - changed-files:
       - any-glob-to-any-file: seatunnel-engine/**/server/rest/**

diff --git a/.github/workflows/update_build_status.yml b/.github/workflows/update_build_status.yml
@@ -105,4 +105,4 @@ jobs:
                   }
                 }
               }
-            }
+            }
diff --git a/NOTICE b/NOTICE
@@ -1,5 +1,5 @@
 Apache SeaTunnel
-Copyright 2021-2023 The Apache Software Foundation
+Copyright 2021-2024 The Apache Software Foundation
 
 This product includes software developed at
 The Apache Software Foundation (http://www.apache.org/).

diff --git a/bin/install-plugin.cmd b/bin/install-plugin.cmd
@@ -22,8 +22,8 @@ REM Get seatunnel home
 set "SEATUNNEL_HOME=%~dp0..\"
 echo Set SEATUNNEL_HOME to [%SEATUNNEL_HOME%]
 
-REM Connector default version is 2.3.6, you can also choose a custom version. eg: 2.1.2:  install-plugin.bat 2.1.2
-set "version=2.3.6"
+REM Connector default version is 2.3.7, you can also choose a custom version. eg: 2.1.2:  install-plugin.bat 2.1.2
+set "version=2.3.7"
 if not "%~1"=="" set "version=%~1"
 
 REM Create the lib directory

diff --git a/bin/install-plugin.sh b/bin/install-plugin.sh
@@ -23,8 +23,8 @@
 # get seatunnel home
 SEATUNNEL_HOME=$(cd $(dirname $0);cd ../;pwd)
 
-# connector default version is 2.3.6, you can also choose a custom version. eg: 2.1.2:  sh install-plugin.sh 2.1.2
-version=2.3.6
+# connector default version is 2.3.7, you can also choose a custom version. eg: 2.1.2:  sh install-plugin.sh 2.1.2
+version=2.3.7
 
 if [ -n "$1" ]; then
     version="$1"

diff --git a/config/plugin_config b/config/plugin_config
@@ -86,4 +86,5 @@ connector-rocketmq
 connector-tdengine
 connector-web3j
 connector-milvus
+connector-activemq
 --end--
diff --git a/docs/en/concept/connector-v2-features.md b/docs/en/concept/connector-v2-features.md
@@ -69,3 +69,7 @@ For sink connector, the sink connector supports exactly-once if any piece of dat
 ### cdc(change data capture)
 
 If a sink connector supports writing row kinds(INSERT/UPDATE_BEFORE/UPDATE_AFTER/DELETE) based on primary key, we think it supports cdc(change data capture).
+
+### support multiple table write
+
+Supports write multiple tables in one SeaTunnel job, users can dynamically specify the table's identifier by [configuring placeholders](./sink-options-placeholders.md).
diff --git a/docs/en/concept/sink-options-placeholders.md b/docs/en/concept/sink-options-placeholders.md
@@ -0,0 +1,110 @@
+# Sink Options Placeholders
+
+## Introduction
+
+The SeaTunnel provides a sink options placeholders feature that allows you to get upstream table metadata through placeholders.
+
+This functionality is essential when you need to dynamically get upstream table metadata (such as multi-table writes).
+
+This document will guide you through the usage of these placeholders and how to leverage them effectively.
+
+## Support Those Engines
+
+> SeaTunnel Zeta<br/>
+> Flink<br/>
+> Spark<br/>
+
+## Placeholder
+
+The placeholders are mainly controlled by the following expressions:
+
+- `${database_name}`
+  - Used to get the database in the upstream catalog table
+  - Default values can also be specified via expressions：`${database_name:default_my_db}`
+- `${schema_name}`
+  - Used to get the schema in the upstream catalog table
+  - Default values can also be specified via expressions：`${schema_name:default_my_schema}`
+- `${table_name}`
+  - Used to get the table in the upstream catalog table
+  - Default values can also be specified via expressions：`${table_name:default_my_table}`
+- `${schema_full_name}`
+  - Used to get the schema full path(database & schema) in the upstream catalog table
+- `${table_full_name}`
+  - Used to get the table full path(database & schema & table) in the upstream catalog table
+- `${primary_key}`
+  - Used to get the table primary-key fields in the upstream catalog table
+- `${unique_key}`
+  - Used to get the table unique-key fields in the upstream catalog table
+- `${field_names}`
+  - Used to get the table field keys in the upstream catalog table
+
+## Configuration
+
+*Requires*:
+- Make sure the sink connector you are using has implemented `TableSinkFactory` API
+
+### Example 1
+
+```hocon
+env {
+  // ignore...
+}
+source {
+  MySQL-CDC {
+    // ignore...
+  }
+}
+
+transform {
+  // ignore...
+}
+
+sink {
+  jdbc {
+    url = "jdbc:mysql://localhost:3306"
+    driver = "com.mysql.cj.jdbc.Driver"
+    user = "root"
+    password = "123456"
+
+    database = "${database_name}_test"
+    table = "${table_name}_test"
+    primary_keys = ["${primary_key}"]
+  }
+}
+```
+
+### Example 2
+
+```hocon
+env {
+  // ignore...
+}
+source {
+  Oracle-CDC {
+    // ignore...
+  }
+}
+
+transform {
+  // ignore...
+}
+
+sink {
+  jdbc {
+    url = "jdbc:mysql://localhost:3306"
+    driver = "com.mysql.cj.jdbc.Driver"
+    user = "root"
+    password = "123456"
+
+    database = "${schema_name}_test"
+    table = "${table_name}_test"
+    primary_keys = ["${primary_key}"]
+  }
+}
+```
+
+We will complete the placeholder replacement before the connector is started, ensuring that the sink options is ready before use.
+If the variable is not replaced, it may be that the upstream table metadata is missing this option, for example:
+- `mysql` source not contain `${schema_name}`
+- `oracle` source not contain `${databse_name}`
+- ...
-Original file line number
+Diff line change
@@ Expand Up / @@ -105,4 +105,4 @@ jobs: @@
                       }
                     }
                   }
-                }
+                }