复制版本5.1到7.0的elasticsearch索引的映射和设置时出错

Question

我正在尝试将整个索引数据从远程服务器复制到我的本地ElasticSearch。

按照页面，要使用_reindex，我们必须首先复制源索引的映射和设置

在运行curl-xget x.x.x.x:9200/modified_taxonomy/时，结果给出了索引的映射和设置

{ "mappings": {"keywords": {"properties": {"Commodities": {"properties": {"Code": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "Title": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "code": {"type": "long"}, "title": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } } } }, "Keyword": {"type": "text", "fields": {"analyzed": {"type": "text", "analyzer": "analyzer_keyword", "search_analyzer": "analyzer_shingle"}, "keyword": {"type": "keyword", "ignore_above": 256 } }, "analyzer": "analyzer_keyword", "search_analyzer": "analyzer_shingle"}, "KeywordType": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "Occupations": {"properties": {"Code": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "Title": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "code": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "title": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } } } }, "Source": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "from": {"type": "long"}, "query": {"properties": {"bool": {"properties": {"must": {"properties": {"match_all": {"type": "object"} } } } }, "match": {"properties": {"Keyword": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } } } } } }, "scroll": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "scroll_id": {"type": "text", "fields": {"keyword": {"type": "keyword", "ignore_above": 256 } } }, "size": {"type": "long"} } } }, "settings": {"index": {"number_of_shards": "5", "blocks": {"write": "false"}, "analysis": {"filter": {"my_shingle_filter": {"max_shingle_size": "8", "min_shingle_size": "2", "output_unigrams": "true", "type": "shingle"} }, "analyzer": {"analyzer_keyword": {"filter": ["lowercase"], "char_filter": ["code_mapping"], "type": "custom", "tokenizer": "keyword"}, "analyzer_shingle": {"filter": ["lowercase", "my_shingle_filter"], "char_filter": ["code_mapping"], "tokenizer": "standard"} }, "char_filter": {"code_mapping": {"type": "mapping", "mappings": ["++ => plusplus", "c# => csharp", "C# => csharp", "F# => fsharp", "f# => fsharp", ".net => dotnet", ".Net => dotnet", ".NET => dotnet", "( => map_lp", ") => map_rp", "& => and", "# => hash", "+ => plus"] } } }, "number_of_replicas": "2"} } }

所以我尝试使用上面的JSON来curl-xput localhost:9200/mytaxonomy/。

它给了我一个不可用的错误索引。因此，我创建了索引curl-xputhttp://localhost:9200/taxomony_1，并尝试重复该过程。

这给了我一个错误

{"error": {"root_cause": [{"type": "illegal_argument_exception", "reason": "In Shingle TokenFilter the difference between max_shingle_size and min_shingle_size (and +1 if outputting unigrams) must be less than or equal to: [3] but was [7]. This limit can be set by changing the [index.max_shingle_diff] index level setting."} ], "type": "illegal_argument_exception", "reason": "In Shingle TokenFilter the difference between max_shingle_size and min_shingle_size (and +1 if outputting unigrams) must be less than or equal to: [3] but was [7]. This limit can be set by changing the [index.max_shingle_diff] index level setting."}, "status": 400 }

虽然我更改了“max_shingle_size”：2和“min_shingle_size”：2,但它再次给我带来错误,

{"error": {"root_cause": [{"type": "mapper_parsing_exception", "reason": "Root mapping definition has unsupported parameters:  [keywords : {properties={KeywordType={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Keyword={search_analyzer=analyzer_shingle, analyzer=analyzer_keyword, type=text, fields={analyzed={search_analyzer=analyzer_shingle, analyzer=analyzer_keyword, type=text}, keyword={ignore_above=256, type=keyword}}}, size={type=long}, Occupations={properties={code={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Code={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}, Commodities={properties={code={type=long}, Title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Code={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}, query={properties={bool={properties={must={properties={match_all={type=object}}}}}, match={properties={Keyword={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}}}, scroll={type=text, fields={keyword={ignore_above=256, type=keyword}}}, from={type=long}, scroll_id={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Source={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}]"} ], "type": "mapper_parsing_exception", "reason": "Failed to parse mapping [_doc]: Root mapping definition has unsupported parameters:  [keywords : {properties={KeywordType={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Keyword={search_analyzer=analyzer_shingle, analyzer=analyzer_keyword, type=text, fields={analyzed={search_analyzer=analyzer_shingle, analyzer=analyzer_keyword, type=text}, keyword={ignore_above=256, type=keyword}}}, size={type=long}, Occupations={properties={code={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Code={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}, Commodities={properties={code={type=long}, Title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Code={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}, query={properties={bool={properties={must={properties={match_all={type=object}}}}}, match={properties={Keyword={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}}}, scroll={type=text, fields={keyword={ignore_above=256, type=keyword}}}, from={type=long}, scroll_id={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Source={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}]", "caused_by": {"type": "mapper_parsing_exception", "reason": "Root mapping definition has unsupported parameters:  [keywords : {properties={KeywordType={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Keyword={search_analyzer=analyzer_shingle, analyzer=analyzer_keyword, type=text, fields={analyzed={search_analyzer=analyzer_shingle, analyzer=analyzer_keyword, type=text}, keyword={ignore_above=256, type=keyword}}}, size={type=long}, Occupations={properties={code={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Code={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}, Commodities={properties={code={type=long}, Title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, title={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Code={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}, query={properties={bool={properties={must={properties={match_all={type=object}}}}}, match={properties={Keyword={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}}}, scroll={type=text, fields={keyword={ignore_above=256, type=keyword}}}, from={type=long}, scroll_id={type=text, fields={keyword={ignore_above=256, type=keyword}}}, Source={type=text, fields={keyword={ignore_above=256, type=keyword}}}}}]"} }, "status": 400 }

虽然我没有修改源映射的任何内容，但它给了我不支持的参数。会有什么问题？如何复制源索引的设置和映射？

Answer 1

嗨，我认为这是因为在弹性7删除类型特性和重新索引，你需要有相同的版本和更大的集群工作，我认为你需要logstash或一些脚本复制你的数据

您必须使用相同大小或更大的群集，以及相同的Elasticsearch版本。根据旧集群的安全设置,