Skip to content
GitLab
Menu
Projects
Groups
Snippets
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
memoriav
Memobase 2020
services
postprocessing
rico-edm-transformer
Commits
872c75b4
Commit
872c75b4
authored
Mar 22, 2021
by
Günter Hipler
Browse files
changed invalid chracter (Chrome stumbled upon)
parent
94934207
Changes
6
Expand all
Hide whitespace changes
Inline
Side-by-side
Dockerfile
View file @
872c75b4
FROM
amd64/adoptopenjdk:11-jre
#FROM openjdk:8-jre-alpine
ADD
target/scala-2.13/app.jar /app/app.jar
CMD
java -jar /app/app.jar
CMD
java -jar /app/app.jar
\ No newline at end of file
gh/env.txt
0 → 100644
View file @
872c75b4
JOB_ID=rico-2-edm-transfromer
KAFKA_BOOTSTRAP_SERVERS=localhost:9092,localhost:9093,localhost:9094
APPLICATION_ID=rico-2-edm-transfromer-03-22
TOPIC_IN=fedora-output-json-records
TOPIC_OUT=edm-es-records
TOPIC_PROCESS=import-process-reporting
gh/kafkacatnotes.txt
View file @
872c75b4
...
...
@@ -13,8 +13,18 @@ kafkacat -b localhost:9092 -t <my_topic> -T -P -l /tmp/msgs
Export des topic
kafkacat -C -b mb-ka1:9092 -t fedora-output-json-records -K '\t' -o beginning > fedora-output.json
kafkacat -C -b mb-ka1:9092 -t fedora-output-json-records -K '\t' -o beginning
| gzip
> fedora-output
1
.json
.gz
Import des topic
docker run -v /home/swissbib/environment/code/repositories/memoriav/gitlab/services/postprocessing/rico-edm-transformer/data:/data -it --network host edenhill/kafkacat:1.6.0 -P -b VPN:9092 -t fedora-output-json-records -K '\t' -l /data/fedora-output.json
export auf mb-ka1
kafkacat -C -b mb-ka1:9092 -t fedora-output-json-records -K '\t' -o beginning > fedora-output1.json
import lokal
docker run -v /home/swissbib/environment/code/repositories/memoriav/gitlab/services/postprocessing/rico-edm-transformer/data:/data -it --network host edenhill/kafkacat:1.6.0 -P -b VPN:9092 -t fedora-output-json-records -K '\t' -l /data/fedora-output1.json
docker run -it --network host edenhill/kafkacat:1.6.0 -C -b VPN:9092 -t import-process-reporting -K '\t'
k8s-manifests/test/deployment.yml
View file @
872c75b4
...
...
@@ -18,7 +18,7 @@ spec:
spec
:
containers
:
-
name
:
pp-rico2edmtransfromer-container
image
:
cr.gitlab.switch.ch/memoriav/memobase-2020/services/postprocessing/rico-edm-transformer:
latest
image
:
cr.gitlab.switch.ch/memoriav/memobase-2020/services/postprocessing/rico-edm-transformer:
0.2.7
imagePullPolicy
:
Always
command
:
[
"
java"
]
args
:
[
"
-Xmx128m"
,
"
-Xmx256m"
,
"
-jar"
,
"
/app/app.jar"
]
...
...
@@ -35,7 +35,7 @@ spec:
-
name
:
KAFKA_BOOTSTRAP_SERVERS
value
:
mb-ka1.memobase.unibas.ch:9092,mb-ka2.memobase.unibas.ch:9092,mb-ka3.memobase.unibas.ch:9092
-
name
:
APPLICATION_ID
value
:
rico-2-edm-transfromer
value
:
rico-2-edm-transfromer
-03-16
-
name
:
TOPIC_IN
value
:
fedora-output-json-records
-
name
:
TOPIC_OUT
...
...
src/main/scala/ch/memobase/rico2edm/rdf/Helper.scala
View file @
872c75b4
...
...
@@ -36,7 +36,7 @@ object Helper {
.
setNamespace
(
"rdf"
,
"http://www.w3.org/1999/02/22-rdf-syntax-ns#"
)
.
setNamespace
(
"foaf"
,
"http://xmlns.com/foaf/0.1/"
)
.
setNamespace
(
"wgs84_pos"
,
"http://www.w3.org/2004/02/skos/core#"
)
.
setNamespace
(
"crm"
,
"http://www.cidoc
‐
crm.org/cidoc
‐
crm/"
)
.
setNamespace
(
"crm"
,
"http://www.cidoc
-
crm.org/cidoc
-
crm/"
)
.
setNamespace
(
"cc"
,
"http://creativecommons.org/ns#"
)
.
build
()
}
...
...
src/main/scala/ch/memobase/rico2edm/rdf/test.xml
0 → 100644
View file @
872c75b4
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment