Explore projects

A small flink job to merge, filter and sort dbpedia output triples. Reads a file and outputs to a kafka topic.

Microservice to analyze n-triple data sets. Reads a kafka topic with ntriples resources per message and output a analyzable data profile for each resource in json.

Template for Kotlin Kafka Streams applications.

Flink job for grouping Ntriples with same subject

A client for managing Kafka topics

Reads various file formats and produces messages.

Model, serializer and deserializer for a simple Kafka metadata wrapper format

Endpoint for soap messages in general but normally sent by OCLC CBS pusher functionality Based on Play framework (https://www.playframework.com/) so soap messages are processed via modern REST endpoint

Aggregates "work" clusters and sends changelog.

Creates work concept by joining bibliographic resources with work clusters

Removes obsolete person and organisation documents in Elasticsearch index for linked-swissbib

Comprises configurations and docker-compose files for running microservices on our hosts

A set of commands extending the core functionalities of Metafacture

Kafka streams application which extracts different entities out of bibliographic resources (in MARC-XML) and transforms them to JSON-LD documents

Consumer to read messages from kafka topics and bulk indexing, updating or deleting in elasticsearch.

Manages the different workflows for transforming, enriching and indexing the bibliographic metadata in linked-swissbib

Library to extract specific datafields from MARCXML records

Volumes record enrichment workflow based on Apache Flink

2 hours presentation about docker container technolgy In the end they will see a running docker-compose environment which includes the components:

php-apache mysql solr with three nodes zookeeper ensemble with three nodes

Presentation "Microservices based on the Kafka Event Hub" held at ELAG 2019, on May 10th, 2019 https://swissbib.gitlab.io/presentations/microservices-and-kafka