DATAX多线程调用,结果同时结束了的问题

多线程调用DATAX,执行四个JSON文件,结果四个job同时结束,后台查数据,只有一个job执行结束了,另外3个数据还没同步完就停了,想问下这是什么问题。
#datax

【相关推荐】



  • 这篇博客: 数据同步工具datax中的 3.编写job的json文件 部分也许能够解决你的问题, 你可以仔细阅读以下内容或跳转源博客中阅读:
    #mysql -> postgresql
    {
        "job": {
            "content": [
                {
                    "reader": {	
                        "name": "mysqlreader", 			 
                        "parameter": {		
                            "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"], 
                            "connection": [
                                {
                                    "jdbcUrl": ["jdbc:mysql://10.1.1.184:3306/nrd_server_dev?allowMultiQueries=true&useUnicode=true&characterEncoding=UTF-8"], 
                                    "table": ["action_log"]
                                }
                            ], 
                            "password": "root", 
                            "username": "root", 
                            "where": "tenant_id is not null and tenant_id <> 0 and create_tm > \'${startTm}\' and create_tm <= \'${endTm}\' "
                        }
                    }, 
                    "writer": {
                        "name": "postgresqlwriter", 
                        "parameter": {
                            "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"],
                            "connection": [
                                {
                                    "jdbcUrl": "jdbc:postgresql://192.168.88.170:5432/datax", 
                                    "table": ["\"model1\".\"action_log\""]
                                }
                            ], 
                            "password": "123456", 
                            "postSql": [], 
                            "preSql": [], 
                            "username": "postgres"
                        }
                    }
                }
            ], 
            "setting": {
                "speed": {
                    "channel": "3" 
                }
            }
        }
    }
    
    
    #mysql -> mpp
    
    {
        "job": {
            "content": [
                {
                    "reader": {	
                        "name": "mysqlreader", 			 
                        "parameter": {		
                            "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"], 
                            "connection": [
                                {
                                    "jdbcUrl": ["jdbc:mysql://10.1.1.184:3306/nrd_server_dev?allowMultiQueries=true&useUnicode=true&characterEncoding=UTF-8"], 
                                    "table": ["action_log"]
                                }
                            ], 
                            "password": "root", 
                            "username": "root", 
                            "where": ""
                        }
                    }, 
                    "writer": {
                        "name": "postgresqlwriter", 
                        "parameter": {
                            "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"],
                            "connection": [
                                {
                                    "jdbcUrl": "jdbc:postgresql://220.194.43.5:5432/test", 
                                    "table": ["\"datax_test\".\"action_log\""]
                                }
                            ], 
                            "password": "123456", 
                            "preSql": [], 
                            "postSql": [],     
                            "username": "test"
                        }
                    }
                }
            ], 
            "setting": {
                "speed": {
                    "channel": "3" 
                }
            }
        }
    }
    
    
    
    
    

如果你已经解决了该问题, 非常希望你能够分享一下解决方案, 写成博客, 将相关链接放在评论区, 以帮助更多的人 ^-^