Skip to content
GitLab
Menu
Projects
Groups
Snippets
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
memoriav
Memobase 2020
services
postprocessing
rico-edm-transformer
Commits
4281ab02
Commit
4281ab02
authored
Apr 12, 2021
by
Günter Hipler
Browse files
more testdata and some notes
parent
e95fd176
Changes
4
Expand all
Hide whitespace changes
Inline
Side-by-side
gh/kafkacatnotes.txt
View file @
4281ab02
...
...
@@ -14,6 +14,7 @@ kafkacat -b localhost:9092 -t <my_topic> -T -P -l /tmp/msgs
Export des topic
kafkacat -C -b mb-ka1:9092 -t fedora-output-json-records -K '\t' -o beginning | gzip > fedora-output1.json.gz
kafkacat -L -b dd-ka1:9092 -t fedora-output-json-records -K '\t' -o beginning | gzip > fedora-output1.json.gz
Import des topic
docker run --rm -v /home/swissbib/environment/code/repositories/memoriav/gitlab/services/postprocessing/rico-edm-transformer/data:/data -it --network host edenhill/kafkacat:1.6.0 -P -b VPN:9092 -t fedora-output-json-records1 -K '\t' -l /data/fedora-output-20210409.json
...
...
gh/todos.txt
View file @
4281ab02
doppelte Einträge für die Indexierung ok??
{"id" : "rxb-003-D0023240D63E9125D22535201_mpg", "message" : "", "status" : "SUCCESS", "step" : "indexer-oai-v2", "timestamp" : "2021-03-22T17:39:24.711"}
{"id" : "rxb-003-D0023240D63E9125D22535201_mpg", "message" : "", "status" : "SUCCESS", "step" : "indexer-oai-v2", "timestamp" : "2021-03-22T17:39:42.178"}
\ No newline at end of file
{"id" : "rxb-003-D0023240D63E9125D22535201_mpg", "message" : "", "status" : "SUCCESS", "step" : "indexer-oai-v2", "timestamp" : "2021-03-22T17:39:42.178"}
https://oai.memobase.k8s.unibas.ch/?verb=GetRecord&identifier=apf-001-1193&metadataPrefix=edm
bei medium erscheint: http://www.wikidata.org/entity/Q194383
\ No newline at end of file
src/test/resources/fehler.last.update.json
0 → 100644
View file @
4281ab02
This diff is collapsed.
Click to expand it.
src/test/resources/wikidata.id.json
0 → 100644
View file @
4281ab02
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment