2017-01-30 170 views
1

我们已经创建了新的ES集群v5.x.我们添加了新的备份存储库来恢复(旧的ES 2.x)。 我们已从我们的快照中恢复,一切都很好。我们有ES快照的保留期限。 我们使用s3存储和repository-s3插件进行备份。 虽然我们的保留期限删除该快照,我们得到了一个错误:从ES 2.x迁移到ES 5.x Elasticsearch

{ 

    "error": { 
     "root_cause": [ 
      { 
       "type": "snapshot_missing_exception", 
       "reason": "[s3_repository:snapshot_201701040203/snapshot_201701040203] is missing" 
      } 
     ], 
     "type": "snapshot_exception", 
     "reason": "[s3_repository:snapshot_201701040203/snapshot_201701040203] Snapshot could not be read", 
     "caused_by": { 
      "type": "snapshot_missing_exception", 
      "reason": "[s3_repository:snapshot_201701040203/snapshot_201701040203] is missing", 
      "caused_by": { 
       "type": "no_such_file_exception", 
       "reason": "Blob object [snap-snapshot_201701040203.dat] not found: The specified key does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchKey; Request ID: DB308DF310809F58)" 
      } 
     } 
    }, 
    "status": 500 

} 

完整的日志:

[2017-01-30T13:18:57,344][WARN ][r.suppressed    ] path: /_snapshot/s3_repository/_all, params: {repository=s3_repository, snapshot=_all} 
org.elasticsearch.snapshots.SnapshotException: [s3_repository:snapshot_201701040203/snapshot_201701040203] Snapshot could not be read 
     at org.elasticsearch.snapshots.SnapshotsService.snapshots(SnapshotsService.java:187) ~[elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.action.admin.cluster.snapshots.get.TransportGetSnapshotsAction.masterOperation(TransportGetSnapshotsAction.java:122) [elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.action.admin.cluster.snapshots.get.TransportGetSnapshotsAction.masterOperation(TransportGetSnapshotsAction.java:50) [elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.action.support.master.TransportMasterNodeAction.masterOperation(TransportMasterNodeAction.java:86) [elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction$3.doRun(TransportMasterNodeAction.java:170) [elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:527) [elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.1.2.jar:5.1.2] 
     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_111] 
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_111] 
     at java.lang.Thread.run(Thread.java:745) [?:1.8.0_111] 
Caused by: org.elasticsearch.snapshots.SnapshotMissingException: [s3_repository:snapshot_201701040203/snapshot_201701040203] is missing 
     at org.elasticsearch.repositories.blobstore.BlobStoreRepository.getSnapshotInfo(BlobStoreRepository.java:566) ~[elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.snapshots.SnapshotsService.snapshots(SnapshotsService.java:182) ~[elasticsearch-5.1.2.jar:5.1.2] 
     ... 9 more 
Caused by: java.nio.file.NoSuchFileException: Blob object [snap-snapshot_201701040203.dat] not found: The specified key does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchKey; Request ID: 38087D5B4A20B627) 
     at org.elasticsearch.cloud.aws.blobstore.S3BlobContainer.readBlob(S3BlobContainer.java:92) ~[?:?] 
     at org.elasticsearch.repositories.blobstore.ChecksumBlobStoreFormat.readBlob(ChecksumBlobStoreFormat.java:100) ~[elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.repositories.blobstore.BlobStoreFormat.read(BlobStoreFormat.java:89) ~[elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.repositories.blobstore.BlobStoreRepository.getSnapshotInfo(BlobStoreRepository.java:560) ~[elasticsearch-5.1.2.jar:5.1.2] 
     at org.elasticsearch.snapshots.SnapshotsService.snapshots(SnapshotsService.java:182) ~[elasticsearch-5.1.2.jar:5.1.2] 

我试图删除此快照库,删除所有的indeces。但是,如果我将再次添加此存储库,我收到相同的错误。 我该如何恢复ES? ES在哪里获取关于旧快照的信息?

此致敬礼。

+0

我已经重新创建ES-集群,并得到同样的错误。所以这个问题在AWS s3中有些地方。 – Oleksandr

回答

0

今天我遇到了这个问题。我的情况稍有不同,但也许这会帮助你。看起来,ES 5在ES 2.x不存在的存储桶中维护快照的索引。

在我的场景中,我正在从2.x转换到5.x.昨天,我将由我的2.x环境创建的一系列快照恢复到5.x环境中。昨晚我的2.x环境创建了另一个快照。当我去恢复快照时,出现快照不存在的错误(即使它存在)。

如果我重命名s3存储桶中的两个文件,ES 5将重建其索引并查看新快照。这两个文件是:index-0和index.latest。

希望有所帮助。