Explore projects
-
swissbib / linked / Dbpedia Global URI Indexer
GNU Affero General Public License v3.0A small workflow which creates clusters from the dbpedia global ID management file.
Updated -
swissbib / linked / kafka-consumer-files
GNU Affero General Public License v3.0Mircoservice that writes messages into files (with compression)
Updated -
swissbib / linked / Dbpedia N-Triples Sorter
GNU Affero General Public License v3.0A small flink job to merge, filter and sort dbpedia output triples. Reads a file and outputs to a kafka topic.
Updated -
swissbib / linked / linking / Wikidata Downloader
GNU Affero General Public License v3.0Downloads and saves the latest wikidata dump. Will check once a day for a new dump.
Updated -
swissbib / linked / N-Triples Analyzer
GNU Affero General Public License v3.0Microservice to analyze n-triple data sets. Reads a kafka topic with ntriples resources per message and output a analyzable data profile for each resource in json.
Updated -
swissbib / linked / linking / Swissbib Enricher
GNU Affero General Public License v3.0Micro Service to enrich metadata for swissbib persons with existing links to Wikidata, VIAF, GND or DBpedia.
Updated -
swissbib / linked / linking / Swissbib Linker
GNU Affero General Public License v3.0An application which searches or creates links between swissbib data and various data sources (viaf, gnd, wikidata, dbpedia).
Updated -
swissbib / slsp / series-transformation / marcxml-fields
GNU General Public License v3.0 or laterLibrary to extract specific datafields from MARCXML records
Updated -
swissbib / slsp / series-transformation / volumes-series-enrichment-flink
GNU General Public License v3.0 or laterVolumes record enrichment workflow based on Apache Flink
Updated -
swissbib / linked / linking / Wikidata API Stream Reader
GNU Affero General Public License v3.0A micro service to read the change stream from the wikimedia API for wikidata. Publishes each change to a kafka topic.
Updated -
swissbib / linked / streams-app-kotlin-skeleton
GNU Affero General Public License v3.0Template for Kotlin Kafka Streams applications.
Updated -
swissbib / linked / VIAF N-Triple Sorter
GNU Affero General Public License v3.0Flink job for grouping Ntriples with same subject
Updated -
swissbib / linked / linking / GND Downloader
GNU Affero General Public License v3.0A simple micro service which downloads the GND Datasets needed for enrichment / linking.
Updated -
swissbib / linked / linking / Wikidata Import
GNU Affero General Public License v3.0Micro service to transform wikidata items from n-triples into json-ld including some data cleaning. The json-ld dataset is then indexed in elasticsearch.
Updated -
swissbib / linked / linking / GND Import
GNU Affero General Public License v3.0A micro service to import the data from lobid GND into our elasticsearch data hub.
Updated -
swissbib / linked / kafka-topics-administrator
GNU Affero General Public License v3.0A client for managing Kafka topics
Updated -
swissbib / linked / linking / VIAF Links Import
GNU Affero General Public License v3.0This micro service takes a single viaf link and turns it into a json statement.
Updated -
Presentation "Microservices based on the Kafka Event Hub" held at ELAG 2019, on May 10th, 2019 https://swissbib.gitlab.io/presentations/microservices-and-kafka
Updated -
swissbib / linked / linking / Id Hub Merger Service
GNU Affero General Public License v3.0A small application which takes owl:sameAs statements from source data sets and merges them into the IdHub.
Updated -
swissbib / linked / kafka-producer-files
Apache License 2.0Reads various file formats and produces messages.
Updated