In order to mitigate against the brute force attacks against Gitlab accounts, we are moving to all edu-ID Logins. We would like to remind you to link your account with your edu-id. Login will be possible only by edu-ID after November 30, 2021. Here you can find the instructions for linking your account.

If you don't have a SWITCH edu-ID, you can create one with this guide here

kind regards

Commit 11e66118 authored by Jonas Waeber's avatar Jonas Waeber
Browse files

Update README.md

parent da08faa1
Pipeline #8482 failed with stages
in 1 minute and 24 seconds
...@@ -12,27 +12,23 @@ Checks the files present in the `app.directory` folder on the sFTP server. ...@@ -12,27 +12,23 @@ Checks the files present in the `app.directory` folder on the sFTP server.
### Requirements ### Requirements
- Execute command `./gradlew addKtlintFormatGitPreCommitHook` - Execute command `./gradlew addKtlintFormatGitPreCommitHook`
- Access to a Kafka Server
- Access to a SFTP Server
- Set environment variable $SFTP_PASSWORD
- Set environment variable $HOST_KEY_VERIFIER (fingerprint is posted in the logs when running the connection for the first time.)
### Configuration ### Configuration
```yaml ```yaml
sftp: sftp:
host: <host-name> host: localhost
port: "22" port: 22000
user: <user-name> user: user
password: ${SFTP_PASSWORD:?nopass} password: password
fingerprint: ${HOST_KEY_VERIFIER:?nofinger}
app: app:
directory: ./test_institution_1/test_record_set_1 directory: /memobase/test_institution_1/test_record_set_1
kafka: kafka:
producer: producer:
bootstrap.servers: localhost:9092 bootstrap.servers: localhost:12345
client.id: sftp-reader-p1-j1 client.id: sftp-reader-p1-j1
value.serializer: "org.apache.kafka.common.serialization.StringSerializer"
topic: topic:
out: process-1-job-1-sftp-reader out: sftp-reader-p1-j1
``` ```
...@@ -35,7 +35,6 @@ class Producer(props: Properties, private val topic: String) : Closeable { ...@@ -35,7 +35,6 @@ class Producer(props: Properties, private val topic: String) : Closeable {
fun sendMessage(key: String, message: String, format: String) { fun sendMessage(key: String, message: String, format: String) {
log.info("Sending message $message to $topic.") log.info("Sending message $message to $topic.")
instance.send(ProducerRecord(topic, key, JsonObject(mapOf(Pair("path", message), Pair("format", format))).toJsonString())) instance.send(ProducerRecord(topic, key, JsonObject(mapOf(Pair("path", message), Pair("format", format))).toJsonString()))
count += 1 count += 1
} }
...@@ -46,7 +45,6 @@ class Producer(props: Properties, private val topic: String) : Closeable { ...@@ -46,7 +45,6 @@ class Producer(props: Properties, private val topic: String) : Closeable {
override fun close() { override fun close() {
instance.flush() instance.flush()
// TODO: Add report for messages sent count. // TODO: Add report for messages sent count.
instance.close() instance.close()
} }
} }
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment