You need Kafka-compatible streaming with minimal cluster administration on AWS. Which service fits?
Why C is the answer
Amazon MSK
Amazon MSK provides managed Apache Kafka.
In detail
- Amazon MSK is managed Kafka.
- Existing Kafka clients keep working.
Use case
An illustrative scenario, not a real incident.
A team already uses Kafka clients, and it moves to MSK so that AWS manages the clusters.
See it in different ways
flowchart TD
A{"What do you need?"} -->|"Deliver to S3 or Redshift, no consumer code"| B["Amazon Data Firehose"]
A -->|"Custom consumers and replay"| C["Kinesis Data Streams"]
A -->|"Kafka compatibility"| D["Amazon MSK"]mindmap
root((Ingestion))
Streams
Kinesis Data Streams
Amazon MSK
Delivery
Data Firehose
Databases
AWS DMS
Files
S3 eventsflowchart TD
Q{"What are your tools?"}
Q -->|"Kafka clients"| A0["Amazon MSK"]
Q -->|"AWS-native streams"| A1["Kinesis Data Streams"]Key point: MSK is managed Apache Kafka.
Why the other options are wrong
- A. AWS Glue crawlers scheduled every minute
- Crawlers read metadata.
- B. AWS Step Functions Express Workflows alone
- Step Functions orchestrates work.
- D. Amazon S3 Transfer Acceleration for each topic
- Transfer Acceleration speeds uploads.