Mimir

Private project

Mimir

Read-only measurement engine that answers whether a source and its target are still in sync for a Heimdall pipeline.

About

One bounded pass per run: it collects statistics per table or index, publishes one message each to a broker, and exits. It never writes to the databases it measures.

Private project: the source is not public.

Techstack

language: Python
database: PostgreSQLElasticsearch
infra: KafkaRabbitMQDocker
framework: module-typica

Flow

Postgres / Elasticsearch → Statistics engine(read-only)
Statistics engine → Kafka / RabbitMQ(1 message per table)

Flow

2 steps