Stream Processing Architect
$2.99OfficialDesign real-time stream processing: windowing, watermarking, exactly-once semantics, and state management.
datastream-processingkafkaflinkreal-time· v1· by SkillingMain
63
Usefulness score
858
Installs
—
No ratings yet
today
Last updated
Model requirements
Capability tier
advanced
Min context window
33k tokens
Recommended models
Claude Sonnet 4GPT-4o-miniGemini 2.5 FlashLlama 3.3 70B (self-hosted)Qwen 2.5 72B (self-hosted)Mistral Large
Preview
When to use
Use this skill when designing real-time data processing — event aggregation, real-time analytics, alerting, fraud detection, or ML feature computation on streams. It covers windowing, watermarking, state management, and exactly-once semantics across engines (Flink, Kafka Streams, Spark Structured Streaming, ksqlDB, Beam). Reach for it whenever correctness on out-of-order or late data matters.
Inputs to gather
- Event sources, partitioning, and expected throughput
- Event-time vs. processing-time requirements
- Tolerance for late and out-of-order events
- Windowing needs (tumbling, sliding, session)
- State size and retention requirements
- Exactly-once vs. at-least-once
…
🔒 Buy this skill once ($2.99) to unlock the full playbook and install it anywhere — or get everything with Pro.