Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
memoriav
Memobase 2020
services
Deletion Components
Import Process Delete
Commits
ef2f2a0a
Unverified
Commit
ef2f2a0a
authored
Apr 15, 2021
by
Sebastian Schüpbach
Browse files
update kafka version; provide jobs for stage & test
parent
777da88d
Pipeline
#24833
passed with stages
in 5 minutes and 3 seconds
Changes
4
Pipelines
3
Hide whitespace changes
Inline
Side-by-side
k8s-manifests/test/job.yml
→
k8s-manifests/test/job
-prod
.yml
View file @
ef2f2a0a
apiVersion
:
batch/v1
kind
:
Job
metadata
:
name
:
import-process-delete
name
:
dd-marker-prod
namespace
:
memobase
labels
:
app
:
import-process-delete
-app
app
:
dd-marker-prod
-app
spec
:
template
:
metadata
:
labels
:
app
:
import-process-delete-app
tier
:
web
app
:
dd-marker-prod-app
group
:
documents-delete
environment
:
prod
spec
:
containers
:
-
name
:
import-process-delete
-container
-
name
:
dd-marker-prod
-container
args
:
[
# Customise to match your needs
"
--record-set-filter"
,
"
<id>"
,
"
--record-filter"
,
"
<id>"
,
...
...
@@ -30,11 +31,11 @@ spec:
-
name
:
"
prod-kafka-bootstrap-servers"
env
:
-
name
:
CLIENT_ID
value
:
import-process-delete
value
:
dd-marker-prod
-
name
:
TOPIC_IN
value
:
import-process
-transactions-records
value
:
mb-di
-transactions-records
-prod
-
name
:
TOPIC_OUT
value
:
delete-pro
cess-deletes
value
:
mb-dd-
delete
s
-pro
d
-
name
:
POLL_TIMEOUT
value
:
"
20000"
restartPolicy
:
Never
...
...
k8s-manifests/test/job-stage.yml
0 → 100644
View file @
ef2f2a0a
apiVersion
:
batch/v1
kind
:
Job
metadata
:
name
:
dd-marker-stage
namespace
:
memobase
labels
:
app
:
dd-marker-stage-app
spec
:
template
:
metadata
:
labels
:
app
:
dd-marker-stage-app
group
:
documents-delete
environment
:
stage
spec
:
containers
:
-
name
:
dd-marker-stage-container
args
:
[
# Customise to match your needs
"
--record-set-filter"
,
"
<id>"
,
"
--record-filter"
,
"
<id>"
,
"
--institution-filter"
,
"
<id>"
,
"
--session-filter"
,
"
<id>"
,
"
--created-after"
,
"
<datetime>"
,
"
--created-before"
,
"
<datetime>"
"
<your-session-id>"
]
image
:
cr.gitlab.switch.ch/memoriav/memobase-2020/services/deletion-components/import-process-delete:latest
imagePullPolicy
:
Always
envFrom
:
-
configMapRef
:
-
name
:
"
prod-kafka-bootstrap-servers"
env
:
-
name
:
CLIENT_ID
value
:
dd-marker-stage
-
name
:
TOPIC_IN
value
:
mb-di-transactions-records-stage
-
name
:
TOPIC_OUT
value
:
mb-dd-deletes-stage
-
name
:
POLL_TIMEOUT
value
:
"
20000"
restartPolicy
:
Never
backoffLimit
:
1
k8s-manifests/test/job-test.yml
0 → 100644
View file @
ef2f2a0a
apiVersion
:
batch/v1
kind
:
Job
metadata
:
name
:
dd-marker-test
namespace
:
memobase
labels
:
app
:
dd-marker-test-app
spec
:
template
:
metadata
:
labels
:
app
:
dd-marker-test-app
group
:
documents-delete
environment
:
test
spec
:
containers
:
-
name
:
dd-marker-test-container
args
:
[
# Customise to match your needs
"
--record-set-filter"
,
"
<id>"
,
"
--record-filter"
,
"
<id>"
,
"
--institution-filter"
,
"
<id>"
,
"
--session-filter"
,
"
<id>"
,
"
--created-after"
,
"
<datetime>"
,
"
--created-before"
,
"
<datetime>"
"
<your-session-id>"
]
image
:
cr.gitlab.switch.ch/memoriav/memobase-2020/services/deletion-components/import-process-delete:latest
imagePullPolicy
:
Always
envFrom
:
-
configMapRef
:
-
name
:
"
test-kafka-bootstrap-servers"
env
:
-
name
:
CLIENT_ID
value
:
dd-marker-test
-
name
:
TOPIC_IN
value
:
mb-di-transactions-records-prod
-
name
:
TOPIC_OUT
value
:
mb-dd-deletes-prod
-
name
:
POLL_TIMEOUT
value
:
"
20000"
restartPolicy
:
Never
backoffLimit
:
1
project/Dependencies.scala
View file @
ef2f2a0a
...
...
@@ -19,7 +19,7 @@
import
sbt._
object
Dependencies
{
lazy
val
kafkaV
=
"2.
3.1
"
lazy
val
kafkaV
=
"2.
7.0
"
lazy
val
log4jV
=
"2.11.2"
lazy
val
scalatestV
=
"3.1.2"
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment