Unverified Commit 6b811c95 authored by Sebastian Schüpbach's avatar Sebastian Schüpbach
Browse files

log length of hashset


Signed-off-by: Sebastian Schüpbach's avatarSebastian Schüpbach <sebastian.schuepbach@unibas.ch>
parent 7d06da03
Pipeline #22258 passed with stages
in 5 minutes and 38 seconds
/*
* Import Process Delete
* Copyright (C) 2020 Memoriav
* Copyright (C) 2021 Memoriav
*
* This program is free software: you can redistribute it and/or modify
* it under the terms of the GNU Affero General Public License as published by
......@@ -54,7 +54,13 @@ object App
}
}
.filter(record => filters.forall(f => f(record)))
.foldLeft(HashSet[DeleteMessage]())((agg, record) => agg + DeleteMessage(record, sessionId))
.foldLeft(HashSet[DeleteMessage]())((agg, record) => {
logger.info(s"Length of delete messages: ${agg.size}")
agg + DeleteMessage(record, sessionId)
}
)
)
.foreach(id => sendDelete(id, dryRun))
} catch {
......
......@@ -44,7 +44,7 @@ trait AppSettings {
props.put("group.id", clientId)
props.put("allow.auto.create.topics", "false")
props.put("auto.offset.reset", "earliest")
props.put("max.poll.records", "500")
props.put("max.poll.records", "5000")
props
}
}
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment