Cluster on Micha Kops' Tech Notes

Quick Kafdrop Setup with Helm Charts

Thu, 10 Aug 2023 00:00:00 +0200

Figure 1. Kafdrop Topic Viewer

In the ever-expanding world of data streaming and event-driven architecture, Apache Kafka has emerged as a cornerstone for reliable and scalable data processing. However, managing and monitoring Kafka clusters can often present its own set of challenges. This is where Kafdrop, a web-based Kafka consumer group and topic viewer, comes to the rescue. With its intuitive interface and insightful visualizations, Kafdrop offers developers and operators an efficient way to gain valuable insights into Kafka clusters.

Elasticsearch Integration Testing with Java

Tue, 23 Aug 2016 00:00:00 +0200

When building up search engines, indexing tons of data into a schema-less, distributed data store, Elasticsearch has always been a favourite tool of mine.

In addition to its core features, it also offers tools and documentation for us developers when we need to write integration tests for our Elasticsearch powered Java applications.

In the following tutorial I’d like to demonstrate how to implement a small sample application using Elasticsearch under the hood and how to write integration-tests with these tools for this application afterwards.

Kubernetes Snippets

Mon, 01 Mar 2010 00:00:00 +0100

Rerun existing completed Job

kubectl replace deletes the old job, if there is any error, your job definition is lost, don’t forget to save it first!

Replace an existing Job with itself

kubectl get job JOBNAME -o yaml | kubectl replace --force -f -

Sometimes there are errors importing the job template due to auto-generated labels or selectors .. a quick and dirty hack is to filter them out using jq