Commit 0e3490d4 authored by Jonas Waeber's avatar Jonas Waeber
Browse files

Update reporting steps whitelist for group log aggregator.

parent 70b7cb14
gi-drupal-syncer
import-process-bridge-groups
gi-record-set-es-transform
gi-institution-es-transform
indexer-record-sets-v7
indexer-institutions-v6
indexer-documents-v21-update
\ No newline at end of file
01-gi-drupal-syncer
02-import-process-bridge-groups
03-gi-record-set-es-transform
03-gi-institution-es-transform
IS-04.01-indexing-institutions
IS-04.02-indexing-institutions-backup
RS-04.01-indexing-record-sets
RS-04.02-indexing-record-sets-backup
RS-04.03-indexing-record-set-updates
RS-04.04-indexing-record-set-updates-backup
\ No newline at end of file
gi-drupal-syncer
import-process-bridge-groups
gi-record-set-es-transform
gi-institution-es-transform
indexer-record-sets-stage-v1
indexer-institutions-stage-v1
indexer-documents-stage-v1-update
\ No newline at end of file
01-gi-drupal-syncer
02-import-process-bridge-groups
03-gi-record-set-es-transform
03-gi-institution-es-transform
IS-04.01-indexing-institutions
IS-04.02-indexing-institutions-backup
RS-04.01-indexing-record-sets
RS-04.02-indexing-record-sets-backup
RS-04.03-indexing-record-set-updates
RS-04.04-indexing-record-set-updates-backup
\ No newline at end of file
01-gi-drupal-syncer
02-import-process-bridge-groups
03-gi-record-set-es-transform
03-gi-institution-es-transform
IS-04.01-indexing-institutions
IS-04.02-indexing-institutions-backup
RS-04.01-indexing-record-sets
RS-04.02-indexing-record-sets-backup
RS-04.03-indexing-record-set-updates
RS-04.04-indexing-record-set-updates-backup
\ No newline at end of file
#!/usr/bin/env bash
kubectl delete configmap stage-reports-consumer-step-whitelist
kubectl create configmap stage-reports-consumer-step-whitelist --from-file ./reports-consumer-step-whitelist/
\ No newline at end of file
from simple_elastic import ElasticIndex
if __name__ == '__main__':
backup_index = ElasticIndex('record-sets-v7', url='localhost:8081')
prod_index = ElasticIndex('record-sets-v7', url='localhost:8080')
for item in prod_index.scroll():
backup_index.bulk(item, identifier_key='id', keep_id_key=True)
\ No newline at end of file
backup_index = ElasticIndex('documents-v21', url='localhost:8081')
prod_index = ElasticIndex('documents-v21', url='localhost:8080')
total = 416398
current = 1000
for item in prod_index.scroll(size=1000):
backup_index.bulk(item, identifier_key='id', keep_id_key=True)
print(f"Loaded {current}/{total}")
current += 1000
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment