登录
当前位置： 首页 > 知识库问答 >
问题：

定向数据库 - 使用 ETL 导入顶点和边时出现的问题

梅庆
2023-03-14
  • 2.2.5版
  • []Linux

使用ETL导入顶点和边时，加载一些顶点和边后会出现超时异常。

-year . CSV:id _ year | year 1 | 2010年2 | 2011年3 | 2012年4 | 2013年5 | 2014年6 | 2015年7 | 2016年8 | 2017年

- 月.csv：id_month |月 |第|季度年
1 || 年 1 月日本金融|2010
2 |2 月 | 日日本金融|2010
3 || 年 3 月日本金融|2010
4 ||年4月|2010
5 |五月 ||2010
6 ||年6月|2010
7 |七月 |贾斯|2010
8 |八月 |贾斯|2010
9 |九月 |贾斯|2010
10 ||年10月|2010
年 11|十一月 ||2010
年 12||年12月|2010
13 || 年 1 月日本金融|2011
14 |2 月 | 日日本金融|2011
年 15|| 年 3 月日本金融|2011
年 16 ||年4月|2011
年 17|五月 ||2011
年 18||年6月|2011
年 19|七月 |贾斯|2011
20 |八月 |贾斯|2011
21 |九月 |贾斯|2011
年 22||年10月|2011
23 |十一月 ||2011
年 24||年12月|2011
年 25|| 年 1 月日本金融|2012
26 |2 月 | 日日本金融|2012
年 27|| 年 3 月日本金融|2012
28 ||年4月|2012
年 29|五月 ||2012
30 ||年6月|2012
年 31|七月 |贾斯|2012
32 |八月 |贾斯|2012
年 33|九月 |贾斯|2012
34 ||年10月|2012
35 |十一月 ||2012
36 ||年12月|2012
年 37|| 年 1 月日本金融|2013
38 |2 月 | 日日本金融|2013
39 || 年 3 月日本金融|2013
40 ||年4月|2013
41 |五月 ||2013
42 ||年6月|2013
43 |七月 |贾斯|2013
44 |八月 |贾斯|2013
45 |九月 |贾斯|2013
46 ||年10月|2013
47 |十一月 ||2013
48 ||年12月|2013
49 || 年 1 月日本金融|2014
50 |2 月 | 日日本金融|2014
51 || 年 3 月日本金融|2014
52 ||年4月|2014
53 |五月 ||2014
54 ||年6月|2014
55 |七月 |贾斯|2014
56 |八月 |贾斯|2014
57 |九月 |贾斯|2014
58 ||年10月|2014
59 |十一月 ||2014
60 ||年12月|2014
61 || 年 1 月日本金融|2015
62 |2 月 | 日日本金融|2015
63 || 年 3 月日本金融|2015
64 ||年4月|2015
65 |五月 ||2015
66 ||年6月|2015
67 |七月 |贾斯|2015
68 |八月 |贾斯|2015
69 |九月 |贾斯|2015
70 ||年10月|2015
71 |十一月 ||2015
72 ||年12月|2015
73 || 年 1 月日本金融|2016
74 |2 月 | 日日本金融|2016
75 || 年 3 月日本金融|2016
76 ||年4月|2016
77 |五月 ||2016
78 ||年6月|2016
79 |七月 |贾斯|2016
80 |八月 |贾斯|2016
81 |九月 |贾斯|2016
82 ||年10月|2016
83 |十一月 ||2016
84 ||年12月|2016
85 || 年 1 月日本金融|2017
86 |2 月 | 日日本金融|2017
87 || 年 3 月日本金融|2017
88 ||年4月|2017
89 |五月 ||2017
90 ||年6月|2017
91 |七月 |贾斯|2017
92 |八月 |贾斯|2017
93 |九月 |贾斯|2017
94 ||年10月|2017
95 |十一月 ||2017
96 ||年12月|2017年

-ETL JSONYear.csv：

{
    "source": {
        "file": {
            "path": "../testdb/data/year.csv"
        }
    },
    "extractor": {
        "row": {

        }
    },
    "transformers": [{
        "csv": {
            "separator": ",",
            "skipFrom": 1,
            "skipTo": 0,
            "nullValue": "Null",
            "columnsOnFirstLine": true
        }
    },
    {
        "vertex": {
            "class": "Year"
        }
    }
    ],
    "loader": {
        "orientdb": {
            "dbURL": "remote:1.2.3.4/testdb",
            "dbUser": "orientdb",
            "dbPassword": "orientdb",
            "serverUser": "orientdb",
            "serverPassword": "orientdb",
            "dbType": "graph",
            "classes": [{
                "name": "Year",
                "extends": "V"
            }],
            "indexes": [
                {"class":"Year", "fields":["year:string"], "type":"UNIQUE" }
            ]
        }
    }
}

- 月份的 ETL JSON：

{
    "config": {
        "log":"debug",
        "parallel":true
    },
    "source": {
        "file": {
            "path": "../testdb/data/month.csv"
        }
    },
    "extractor": {
        "row": {
        }
    },
    "transformers": [{
        "csv": {
            "separator": ",",
            "skipFrom": 1,
            "skipTo": 0,
            "nullValue": "Null",
            "columnsOnFirstLine": true
        }
    },
    {
        "vertex": {
            "class": "Month"
        }
    },
    {
        "edge": {
            "class":"BelongsTo",
            "joinFieldName":"year",
            "lookup":"Year.year",
            "direction":"out",
            "unresolvedLinkAction":"WARNING"
        }
    }],
    "loader": {
        "orientdb": {
            "dbURL": "remote:1.2.3.4/testdb",
            "dbUser": "orientdb",
            "dbPassword": "orientdb",
            "serverUser": "orientdb",
            "serverPassword": "orientdb",
            "dbType": "graph",
            "classes": [{
                "name": "Month",
                "extends": "V"
            }]
        }
    }
}

- 年份的 ETL JSON .csv已正确加载。- 加载 ETL JSON 当月出错.csv如下所示：

C:\orientdb-community-2.2.5\bin>oetl.bat ..\testdb\etl\loadMonth.json
BEGIN ETL PROCESSOR
[file] INFO Reading from file ../testdb/data/month.csv with encoding UTF-8
Started execution with 1 worker threads
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 1000ms 
[0 warnings, 0 errors]
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 2s [0 
warnings, 0 errors]
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 3s [0 
warnings, 0 errors]
[orientdb] DEBUG - OrientDBLoader: created vertex class 'Month' extends 'V'
[orientdb] DEBUG orientdb: found 0 vertices in class 'null'
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 4s [0 
warnings, 0 errors]
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 5s [0 
warnings, 0 errors]
Start extracting
[0:csv] DEBUG Transformer input: id_month,month,quarter,year
[0:csv] DEBUG parsing=id_month,month,quarter,year
[0:csv] DEBUG Transformer output: null
2016-08-17 12:56:22:964 WARNI Transformer [csv] returned null, skip rest of pipeline execution 
[OETLPipeline][1:csv] DEBUG Transformer input: 1,January,JFM,2010
[1:csv] DEBUG parsing=1,January,JFM,2010
[1:csv] DEBUG document={id_month:1,month:January,quarter:JFM,year:2010}
[1:csv] DEBUG Transformer output: {id_month:1,month:January,quarter:JFM,year:2010}
[1:vertex] DEBUG Transformer input: {id_month:1,month:January,quarter:JFM,year:2010}
[1:vertex] DEBUG Transformer output: v(Month)[#45:0]
[1:edge] DEBUG Transformer input: v(Month)[#45:0]
+ extracted 97 rows (97 rows/sec) - 97 rows -> loaded 0 vertices (0 vertices/sec) Total time: 6s [0 
warnings, 0 errors]
[1:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
[1:edge] DEBUG created new edge=e[#53:0][#45:0-BelongsTo->#41:0]
[1:edge] DEBUG Transformer output: v(Month)[#45:0]
[2:csv] DEBUG Transformer input: 2,February,JFM,2010
[2:csv] DEBUG parsing=2,February,JFM,2010
[2:csv] DEBUG document={id_month:2,month:February,quarter:JFM,year:2010}
[2:csv] DEBUG Transformer output: {id_month:2,month:February,quarter:JFM,year:2010}
[2:vertex] DEBUG Transformer input: {id_month:2,month:February,quarter:JFM,year:2010}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 1 vertices (1 vertices/sec) Total time: 7s [0 
warnings, 0 errors]
[2:vertex] DEBUG Transformer output: v(Month)[#46:0]
[2:edge] DEBUG Transformer input: v(Month)[#46:0]
[2:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 1 vertices (0 vertices/sec) Total time: 8s [0 

warnings, 0 errors]
[2:edge] DEBUG created new edge=e[#54:0][#46:0-BelongsTo->#41:0]
[2:edge] DEBUG Transformer output: v(Month)[#46:0]
[3:csv] DEBUG Transformer input: 3,March,JFM,2010
[3:csv] DEBUG parsing=3,March,JFM,2010
[3:csv] DEBUG document={id_month:3,month:March,quarter:JFM,year:2010}
[3:csv] DEBUG Transformer output: {id_month:3,month:March,quarter:JFM,year:2010}
[3:vertex] DEBUG Transformer input: {id_month:3,month:March,quarter:JFM,year:2010}
[3:vertex] DEBUG Transformer output: v(Month)[#45:1]
[3:edge] DEBUG Transformer input: v(Month)[#45:1]
[3:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 2 vertices (1 vertices/sec) Total time: 9s [0 

warnings, 0 errors]
[3:edge] DEBUG created new edge=e[#53:1][#45:1-BelongsTo->#41:0]
[3:edge] DEBUG Transformer output: v(Month)[#45:1]
[4:csv] DEBUG Transformer input: 4,April,AMJ,2010
[4:csv] DEBUG parsing=4,April,AMJ,2010
[4:csv] DEBUG document={id_month:4,month:April,quarter:AMJ,year:2010}
[4:csv] DEBUG Transformer output: {id_month:4,month:April,quarter:AMJ,year:2010}
[4:vertex] DEBUG Transformer input: {id_month:4,month:April,quarter:AMJ,year:2010}
[4:vertex] DEBUG Transformer output: v(Month)[#46:1]
[4:edge] DEBUG Transformer input: v(Month)[#46:1]
[4:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 3 vertices (0 vertices/sec) Total time: 

10014ms [0 warnings, 0 errors]
[4:edge] DEBUG created new edge=e[#54:1][#46:1-BelongsTo->#41:0]
[4:edge] DEBUG Transformer output: v(Month)[#46:1]
[5:csv] DEBUG Transformer input: 5,May,AMJ,2010
[5:csv] DEBUG parsing=5,May,AMJ,2010
[5:csv] DEBUG document={id_month:5,month:May,quarter:AMJ,year:2010}
[5:csv] DEBUG Transformer output: {id_month:5,month:May,quarter:AMJ,year:2010}
[5:vertex] DEBUG Transformer input: {id_month:5,month:May,quarter:AMJ,year:2010}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 4 vertices (1 vertices/sec) Total time: 
11014ms [0 warnings, 0 errors]
[5:vertex] DEBUG Transformer output: v(Month)[#45:2]
[5:edge] DEBUG Transformer input: v(Month)[#45:2]
[5:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 4 vertices (0 vertices/sec) Total time: 
12014ms [0 warnings, 0 errors]
[5:edge] DEBUG created new edge=e[#53:2][#45:2-BelongsTo->#41:0]
[5:edge] DEBUG Transformer output: v(Month)[#45:2]
[6:csv] DEBUG Transformer input: 6,June,AMJ,2010
[6:csv] DEBUG parsing=6,June,AMJ,2010
[6:csv] DEBUG document={id_month:6,month:June,quarter:AMJ,year:2010}
[6:csv] DEBUG Transformer output: {id_month:6,month:June,quarter:AMJ,year:2010}
[6:vertex] DEBUG Transformer input: {id_month:6,month:June,quarter:AMJ,year:2010}
[6:vertex] DEBUG Transformer output: v(Month)[#46:2]
[6:edge] DEBUG Transformer input: v(Month)[#46:2]
[6:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 5 vertices (1 vertices/sec) Total time: 
13014ms [0 warnings, 0 errors]
[6:edge] DEBUG created new edge=e[#54:2][#46:2-BelongsTo->#41:0]
[6:edge] DEBUG Transformer output: v(Month)[#46:2]
[7:csv] DEBUG Transformer input: 7,July,JAS,2010
[7:csv] DEBUG parsing=7,July,JAS,2010
[7:csv] DEBUG document={id_month:7,month:July,quarter:JAS,year:2010}
[7:csv] DEBUG Transformer output: {id_month:7,month:July,quarter:JAS,year:2010}
[7:vertex] DEBUG Transformer input: {id_month:7,month:July,quarter:JAS,year:2010}
[7:vertex] DEBUG Transformer output: v(Month)[#45:3]
[7:edge] DEBUG Transformer input: v(Month)[#45:3]
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 6 vertices (1 vertices/sec) Total time: 

14014ms [0 warnings, 0 errors]
[7:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
[7:edge] DEBUG created new edge=e[#53:3][#45:3-BelongsTo->#41:0]
[7:edge] DEBUG Transformer output: v(Month)[#45:3]
[8:csv] DEBUG Transformer input: 8,August,JAS,2010
[8:csv] DEBUG parsing=8,August,JAS,2010
[8:csv] DEBUG document={id_month:8,month:August,quarter:JAS,year:2010}
[8:csv] DEBUG Transformer output: {id_month:8,month:August,quarter:JAS,year:2010}
[8:vertex] DEBUG Transformer input: {id_month:8,month:August,quarter:JAS,year:2010}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 7 vertices (1 vertices/sec) Total time: 

15014ms [0 warnings, 0 errors]
[8:vertex] DEBUG Transformer output: v(Month)[#46:3]
[8:edge] DEBUG Transformer input: v(Month)[#46:3]
[8:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 7 vertices (0 vertices/sec) Total time: 

16014ms [0 warnings, 0 errors]
[8:edge] DEBUG created new edge=e[#54:3][#46:3-BelongsTo->#41:0]
[8:edge] DEBUG Transformer output: v(Month)[#46:3]
[9:csv] DEBUG Transformer input: 9,September,JAS,2010
[9:csv] DEBUG parsing=9,September,JAS,2010
[9:csv] DEBUG document={id_month:9,month:September,quarter:JAS,year:2010}
[9:csv] DEBUG Transformer output: {id_month:9,month:September,quarter:JAS,year:2010}
[9:vertex] DEBUG Transformer input: {id_month:9,month:September,quarter:JAS,year:2010}
[9:vertex] DEBUG Transformer output: v(Month)[#45:4]
[9:edge] DEBUG Transformer input: v(Month)[#45:4]
[9:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 8 vertices (1 vertices/sec) Total time: 
17014ms [0 warnings, 0 errors]
[9:edge] DEBUG created new edge=e[#53:4][#45:4-BelongsTo->#41:0]
[9:edge] DEBUG Transformer output: v(Month)[#45:4]
[10:csv] DEBUG Transformer input: 10,October,OND,2010
[10:csv] DEBUG parsing=10,October,OND,2010
[10:csv] DEBUG document={id_month:10,month:October,quarter:OND,year:2010}
[10:csv] DEBUG Transformer output: {id_month:10,month:October,quarter:OND,year:2010}
[10:vertex] DEBUG Transformer input: {id_month:10,month:October,quarter:OND,year:2010}
[10:vertex] DEBUG Transformer output: v(Month)[#46:4]
[10:edge] DEBUG Transformer input: v(Month)[#46:4]
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 9 vertices (1 vertices/sec) Total time: 
18014ms [0 warnings, 0 errors]
[10:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
[10:edge] DEBUG created new edge=e[#54:4][#46:4-BelongsTo->#41:0]
[10:edge] DEBUG Transformer output: v(Month)[#46:4]
[11:csv] DEBUG Transformer input: 11,November,OND,2010
[11:csv] DEBUG parsing=11,November,OND,2010
[11:csv] DEBUG document={id_month:11,month:November,quarter:OND,year:2010}
[11:csv] DEBUG Transformer output: {id_month:11,month:November,quarter:OND,year:2010}
[11:vertex] DEBUG Transformer input: {id_month:11,month:November,quarter:OND,year:2010}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 10 vertices (1 vertices/sec) Total time: 
19014ms [0 warnings, 0 errors]
[11:vertex] DEBUG Transformer output: v(Month)[#45:5]
[11:edge] DEBUG Transformer input: v(Month)[#45:5]
[11:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 10 vertices (0 vertices/sec) Total time: 
20014ms [0 warnings, 0 errors]
[11:edge] DEBUG created new edge=e[#53:5][#45:5-BelongsTo->#41:0]
[11:edge] DEBUG Transformer output: v(Month)[#45:5]
[12:csv] DEBUG Transformer input: 12,December,OND,2010
[12:csv] DEBUG parsing=12,December,OND,2010
[12:csv] DEBUG document={id_month:12,month:December,quarter:OND,year:2010}
[12:csv] DEBUG Transformer output: {id_month:12,month:December,quarter:OND,year:2010}
[12:vertex] DEBUG Transformer input: {id_month:12,month:December,quarter:OND,year:2010}
[12:vertex] DEBUG Transformer output: v(Month)[#46:5]
[12:edge] DEBUG Transformer input: v(Month)[#46:5]
[12:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 11 vertices (1 vertices/sec) Total time: 
21014ms [0 warnings, 0 errors]
[12:edge] DEBUG created new edge=e[#54:5][#46:5-BelongsTo->#41:0]
[12:edge] DEBUG Transformer output: v(Month)[#46:5]

**<-- Skipped some rows with similar output due to space limitation-->**

[35:csv] DEBUG Transformer input: 35,November,OND,2012
[35:csv] DEBUG parsing=35,November,OND,2012
[35:csv] DEBUG document={id_month:35,month:November,quarter:OND,year:2012}
[35:csv] DEBUG Transformer output: {id_month:35,month:November,quarter:OND,year:2012}
[35:vertex] DEBUG Transformer input: {id_month:35,month:November,quarter:OND,year:2012}
[35:vertex] DEBUG Transformer output: v(Month)[#45:17]
[35:edge] DEBUG Transformer input: v(Month)[#45:17]
[35:edge] DEBUG joinCurrentValue=2012, lookupResult=#41:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 34 vertices (1 vertices/sec) Total time: 

52072ms [0 warnings, 0 errors]
[35:edge] DEBUG created new edge=e[#53:17][#45:17-BelongsTo->#41:1]
[35:edge] DEBUG Transformer output: v(Month)[#45:17]
[36:csv] DEBUG Transformer input: 36,December,OND,2012
[36:csv] DEBUG parsing=36,December,OND,2012
[36:csv] DEBUG document={id_month:36,month:December,quarter:OND,year:2012}
[36:csv] DEBUG Transformer output: {id_month:36,month:December,quarter:OND,year:2012}
[36:vertex] DEBUG Transformer input: {id_month:36,month:December,quarter:OND,year:2012}
[36:vertex] DEBUG Transformer output: v(Month)[#46:17]
[36:edge] DEBUG Transformer input: v(Month)[#46:17]
[36:edge] DEBUG joinCurrentValue=2012, lookupResult=#41:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 35 vertices (1 vertices/sec) Total time: 

53072ms [0 warnings, 0 errors]
[36:edge] DEBUG created new edge=e[#54:17][#46:17-BelongsTo->#41:1]
[36:edge] DEBUG Transformer output: v(Month)[#46:17]
[37:csv] DEBUG Transformer input: 37,January,JFM,2013
[37:csv] DEBUG parsing=37,January,JFM,2013
[37:csv] DEBUG document={id_month:37,month:January,quarter:JFM,year:2013}
[37:csv] DEBUG Transformer output: {id_month:37,month:January,quarter:JFM,year:2013}
[37:vertex] DEBUG Transformer input: {id_month:37,month:January,quarter:JFM,year:2013}
[37:vertex] DEBUG Transformer output: v(Month)[#45:18]
[37:edge] DEBUG Transformer input: v(Month)[#45:18]
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 36 vertices (1 vertices/sec) Total time: 

54072ms [0 warnings, 0 errors]
[37:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 36 vertices (0 vertices/sec) Total time: 

55074ms [0 warnings, 0 errors]
[37:edge] DEBUG created new edge=e[#53:18][#45:18-BelongsTo->#42:1]
[37:edge] DEBUG Transformer output: v(Month)[#45:18]
[38:csv] DEBUG Transformer input: 38,February,JFM,2013
[38:csv] DEBUG parsing=38,February,JFM,2013
[38:csv] DEBUG document={id_month:38,month:February,quarter:JFM,year:2013}
[38:csv] DEBUG Transformer output: {id_month:38,month:February,quarter:JFM,year:2013}
[38:vertex] DEBUG Transformer input: {id_month:38,month:February,quarter:JFM,year:2013}
[38:vertex] DEBUG Transformer output: v(Month)[#46:18]
[38:edge] DEBUG Transformer input: v(Month)[#46:18]
[38:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 37 vertices (1 vertices/sec) Total time: 

56074ms [0 warnings, 0 errors]
[38:edge] DEBUG created new edge=e[#54:18][#46:18-BelongsTo->#42:1]
[38:edge] DEBUG Transformer output: v(Month)[#46:18]
[39:csv] DEBUG Transformer input: 39,March,JFM,2013
[39:csv] DEBUG parsing=39,March,JFM,2013
[39:csv] DEBUG document={id_month:39,month:March,quarter:JFM,year:2013}
[39:csv] DEBUG Transformer output: {id_month:39,month:March,quarter:JFM,year:2013}
[39:vertex] DEBUG Transformer input: {id_month:39,month:March,quarter:JFM,year:2013}
[39:vertex] DEBUG Transformer output: v(Month)[#45:19]
[39:edge] DEBUG Transformer input: v(Month)[#45:19]
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 38 vertices (1 vertices/sec) Total time: 

57074ms [0 warnings, 0 errors]
[39:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
[39:edge] DEBUG created new edge=e[#53:19][#45:19-BelongsTo->#42:1]
[39:edge] DEBUG Transformer output: v(Month)[#45:19]
[40:csv] DEBUG Transformer input: 40,April,AMJ,2013
[40:csv] DEBUG parsing=40,April,AMJ,2013
[40:csv] DEBUG document={id_month:40,month:April,quarter:AMJ,year:2013}
[40:csv] DEBUG Transformer output: {id_month:40,month:April,quarter:AMJ,year:2013}
[40:vertex] DEBUG Transformer input: {id_month:40,month:April,quarter:AMJ,year:2013}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 39 vertices (1 vertices/sec) Total time: 

58074ms [0 warnings, 0 errors]
[40:vertex] DEBUG Transformer output: v(Month)[#46:19]
[40:edge] DEBUG Transformer input: v(Month)[#46:19]
[40:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 39 vertices (0 vertices/sec) Total time: 

59074ms [0 warnings, 0 errors]
[40:edge] DEBUG created new edge=e[#54:19][#46:19-BelongsTo->#42:1]
[40:edge] DEBUG Transformer output: v(Month)[#46:19]
[41:csv] DEBUG Transformer input: 41,May,AMJ,2013
[41:csv] DEBUG parsing=41,May,AMJ,2013
[41:csv] DEBUG document={id_month:41,month:May,quarter:AMJ,year:2013}
[41:csv] DEBUG Transformer output: {id_month:41,month:May,quarter:AMJ,year:2013}
[41:vertex] DEBUG Transformer input: {id_month:41,month:May,quarter:AMJ,year:2013}
[41:vertex] DEBUG Transformer output: v(Month)[#45:20]
[41:edge] DEBUG Transformer input: v(Month)[#45:20]
[41:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 40 vertices (1 vertices/sec) Total time: 

60074ms [0 warnings, 0 errors]
[41:edge] DEBUG created new edge=e[#53:20][#45:20-BelongsTo->#42:1]
[41:edge] DEBUG Transformer output: v(Month)[#45:20]
[42:csv] DEBUG Transformer input: 42,June,AMJ,2013
[42:csv] DEBUG parsing=42,June,AMJ,2013
[42:csv] DEBUG document={id_month:42,month:June,quarter:AMJ,year:2013}
[42:csv] DEBUG Transformer output: {id_month:42,month:June,quarter:AMJ,year:2013}
[42:vertex] DEBUG Transformer input: {id_month:42,month:June,quarter:AMJ,year:2013}
[42:vertex] DEBUG Transformer output: v(Month)[#46:20]
[42:edge] DEBUG Transformer input: v(Month)[#46:20]
[42:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 41 vertices (1 vertices/sec) Total time: 

61074ms [0 warnings, 0 errors]
[42:edge] DEBUG created new edge=e[#54:20][#46:20-BelongsTo->#42:1]
[42:edge] DEBUG Transformer output: v(Month)[#46:20]
[43:csv] DEBUG Transformer input: 43,July,JAS,2013
[43:csv] DEBUG parsing=43,July,JAS,2013
[43:csv] DEBUG document={id_month:43,month:July,quarter:JAS,year:2013}
[43:csv] DEBUG Transformer output: {id_month:43,month:July,quarter:JAS,year:2013}
[43:vertex] DEBUG Transformer input: {id_month:43,month:July,quarter:JAS,year:2013}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 42 vertices (0 vertices/sec) Total time: 

62076ms [0 warnings, 0 errors]
[43:vertex] DEBUG Transformer output: v(Month)[#45:21]
[43:edge] DEBUG Transformer input: v(Month)[#45:21]
[43:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 42 vertices (0 vertices/sec) Total time: 

63081ms [0 warnings, 0 errors]
[43:edge] DEBUG created new edge=e[#53:21][#45:21-BelongsTo->#42:1]
[43:edge] DEBUG Transformer output: v(Month)[#45:21]
[44:csv] DEBUG Transformer input: 44,August,JAS,2013
[44:csv] DEBUG parsing=44,August,JAS,2013
[44:csv] DEBUG document={id_month:44,month:August,quarter:JAS,year:2013}
[44:csv] DEBUG Transformer output: {id_month:44,month:August,quarter:JAS,year:2013}
[44:vertex] DEBUG Transformer input: {id_month:44,month:August,quarter:JAS,year:2013}
[44:vertex] DEBUG Transformer output: v(Month)[#46:21]
[44:edge] DEBUG Transformer input: v(Month)[#46:21]
[44:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 43 vertices (1 vertices/sec) Total time: 

64081ms [0 warnings, 0 errors]
[44:edge] DEBUG created new edge=e[#54:21][#46:21-BelongsTo->#42:1]
[44:edge] DEBUG Transformer output: v(Month)[#46:21]
[45:csv] DEBUG Transformer input: 45,September,JAS,2013
[45:csv] DEBUG parsing=45,September,JAS,2013
[45:csv] DEBUG document={id_month:45,month:September,quarter:JAS,year:2013}
[45:csv] DEBUG Transformer output: {id_month:45,month:September,quarter:JAS,year:2013}
[45:vertex] DEBUG Transformer input: {id_month:45,month:September,quarter:JAS,year:2013}
[45:vertex] DEBUG Transformer output: v(Month)[#45:22]
[45:edge] DEBUG Transformer input: v(Month)[#45:22]
[45:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 44 vertices (1 vertices/sec) Total time: 

65081ms [0 warnings, 0 errors]
ETL process has problem: java.util.concurrent.TimeoutException
END ETL PROCESSOR
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 44 vertices (0 vertices/sec) Total time: 

65225ms [0 warnings, 0 errors]
Error in Pipeline execution: com.orientechnologies.orient.core.exception.ODatabaseException: Error 

during saving of record with rid #45:22
    DB name="testdb"
C:\orientdb-community-2.2.5\bin>
  1. 导入年份的JSON。csv使用ETL（加载无错误）**
  2. 导入月份的JSON。csv使用ETL（加载一些顶点和边，然后在大约64000毫秒后抛出错误）

共有1个答案

松鸣
2023-03-14

我试过

"config": {
        "log":"debug",
        "maxRetries":10,
        "parallel":true
    },

它奏效了。

 类似资料：
  • 有向图顶点和边的反转

    所以我正在研究这个问题： 这是我目前所掌握的 首先，我想对我的答案再作核实。我对有向图不是那么熟悉，对算法的效率/复杂度也不是特别熟练。我想我做得对，但如果我需要的话，我想要一些帮助。我也在寻找任何想法，使它更有效率。这些是我脑海中最先出现的算法，所以我觉得可能有更好的方法来实现它。 谢谢

  • Python和sqlite3-导入和导出数据库

    问题内容： 我正在尝试编写脚本来导入数据库文件。我编写了脚本来导出文件，如下所示： 现在，我希望能够导入该数据库。我试过了 ： 但是我不允许执行多个语句。有没有办法让它直接运行SQL脚本？ 问题答案： 文件资料。

  • Gremlin 3-获取所有传入和传出顶点，包括它们的边和方向，包括没有边的顶点

    我试图组合一个查询来获取所有传入和传出的顶点，包括它们的边和方向，但这也会返回那些没有边的顶点。 我现在可以通过强制所有东西都至少有一个边缘来解决这个问题，但这是我想要避免的。 也许值得注意的是，我使用Azure CosmosDB的图形API：https://docs.microsoft.com/en-us/azure/cosmos-db/gremlin-support 这是我用来返回所有顶点及其

  • 图的边和顶点

    本文向大家介绍图的边和顶点，包括了图的边和顶点的使用技巧和注意事项，需要的朋友参考一下 图是一组称为节点或顶点的点，它们由一组称为edge的线互连。图形或图形理论的研究是数学，工程学和计算机科学领域中许多学科的重要组成部分。 图论 定义-图形（表示为G =(V,E)）由一组非空的顶点或节点V和一组边缘E组成。顶点a 表示边缘的端点。一条边连接两个顶点a，b ，并由其连接的一组顶点表示。 示例-让我

  • 数据仓库：ELT和ETL

    主要内容：1.ETL,2.ELT,3.ELT的演变,4.ELT的工作原理,5.什么时候我们选择ELT,6.数据湖是不是很好的ELT落脚点,7.总结ETL 和 ELT 有很多共同点，从本质上讲，每种集成方法都可以将数据从源端抽取到数据仓库中，两者的区别在于数据在哪里进行转换 1.ETL ETL - 抽取、转换、加载 从不同的数据源抽取信息，将其转换为根据业务定义的格式，然后将其加载到其他数据库或数据仓库中。另一种 ETL 集成方法是反向 ETL，它将结构化数据从数据仓库中加载到业务数据库中，如我们

  • 使用PHP和Mysqli使用LIKE搜索数据库时出现问题

    我运行下面的脚本时出错，我不知道如何更正它。本质上，我在mysql中有一个名为gamestbl的表。我希望用户输入一些关于游戏名称或游戏描述的关键词，然后php将正确的游戏显示为下拉列表（理想情况下）甚至信息表。 错误显示： 警告：mysqli_query（）至少需要2个参数，其中1个参数在第29行的C:\xampp\htdocs\introductiongphp\Email.php中给出 警告：

相关问答

Android将现有数据库导入project时出错tinkerpop/gremlin：选择顶点和输出边计数使用SPRING引导（SOAP服务）连接Oracle数据库时出现问题使用spring数据访问neo4j数据时出现的问题使用Excel:：Writer:：XLSX导出大型数据集时出现问题

相关文章

Oracle 使用TOAD实现导入导出Excel数据你们数据库怎么导入hive 的,有没有出现问题一次导出和导入所有MySQL数据库数据库导入和导出在Android Pie中不起作用linux下导入、导出mysql数据库命令的实现方法

相关阅读

Pycharm导出数据Matlab数据导出MariaDB导出数据Matlab数据导入MySQL导出表数据

相关工具

SQL Server 数据库发布向导bitcoin-etlethereum-etlScriptella ETLPalo ETL Server

相关文档

IBM DB2 数据库快速入门数据库教程Access 数据库教程DB2 数据库教程Hadoop 数据库教程
快捷导航： 新手教程 算法原理 架构设计 Java进阶 数据库进阶 大厂专栏 面试经验 编程笔记 编程问答 所有专题 文档资料 工具软件 电子书籍 小牛导航
在线工具： 房贷计算器 个税计算器 Linux命令查询 Json格式化 正则表达式 颜色转换 AES加解密 SHA1加密 MD5加密 毒鸡汤 字数统计 随机密码生成 进制转换 Base64编解码 励志句子
Copyright © 2019-2024 小牛知识库@xnip.cn. All Rights Reserved.