👨‍🔧
The Ops Compendium
  • The Ops Compendium
  • Definitions
    • Ops Definition Comparisons
  • ML & DL Compendium
  • MLOps
    • MLOps Intro
    • MLOps Teams
    • MLOps Literature
    • MLOps Course
    • MLOps Patterns
    • ML Experiment Management
    • ML Model Monitoring & Alerts
    • MLOps Tools
    • MLOps Deployment
    • Feature Stores & Feature Pipelines
    • Model Formats
    • AI As Data
    • MLOps Interview Questions
    • ML Architecture
  • DataOps
    • SQL
    • Tools
    • Databases
    • Database Modeling
    • Data Analytics
    • Data Engineering
    • Data Pipelines
    • Data Strategy
    • Data Vision
    • Data Teams
    • Data Catalogs
    • Data Governance
    • Data Quality
    • Data Observability
    • Data Program Management
    • Data KPIs
    • Data Mesh
    • Data Contract
    • Data Product
    • Data Engineering Questions & Training
    • Data Patterns
    • Data Architecture
    • Data Platforms
    • Data Lineage
  • DevOps
    • DevOps Strategy
    • DevOps Tools
      • Tutorials
      • Continuous Integration
      • Docker
      • Kubernetes
      • Cloud Objects
      • Key Value DB
      • API Gateway
      • Infrastructure As code
      • Logs
      • ELK
      • SLO
    • DevOps Courses
  • DevSecOps
    • Definitions
    • Tools
    • Concepts
  • Architecture
    • Problems
    • Development Concepts
    • System Design
Powered by GitBook
On this page
  • RabbitMQ
  • ActiveMQ
  • Kafka
  • KSQLDB
  • Zoo keeper

Was this helpful?

Edit on GitHub
  1. DevOps
  2. DevOps Tools

Key Value DB

PreviousCloud ObjectsNextAPI Gateway

Last updated 2 years ago

Was this helpful?

RabbitMQ

"RabbitMQ is an open-source message-broker software that originally implemented the Advanced Message Queuing Protocol and has since been extended with a plug-in architecture to support Streaming Text Oriented Messaging Protocol, MQ Telemetry Transport, and other protocols."

  • - python code

  • - managing

Apache ActiveMQ™ is the most popular open source, multi-protocol, Java-based messaging serve

Kafka

Apache Kafka is a distributed event store and stream-processing platform.

  • , with Kafka - confluent

  • , ,

  • - But even these solutions came up short in some cases. For example, RabbitMQ stores messages in DRAM until the DRAM is completely consumed, at which point messages are written to disk, .

Also, the routing logic of AMQP can be fairly complicated as opposed to Apache Kafka. For instance, each consumer simply decides which messages to read in Kafka.

In addition to message routing simplicity, there are places where developers and DevOps staff prefer Apache Kafka for its high throughput, scalability, performance, and durability; although, developers still swear by all three systems for various reasons.

KSQLDB

Zoo keeper

is a pub-sub messaging system. It uses Zookeeper to detect crashes, to implement topic discovery, and to maintain production and consumption state for topics.

with code.

KSQLDB 101 uses Kafka streams to run queries over kafka,

Intro , , ,

What is ,

It is a

Producer broker, consumer - a tutorial on what is RMQ
Part2.3
Part 3
Part 4
ActiveMQ
Kafka 101 youtube
event sourcing & event storage
Web
Medium - really good short intro
Intro
Intro 2
Kafka in a nutshell
severely impacting performance
Apache Kafka Kafka
Tutorial on putting a model in Kafka and using zoo keeper
youtube
1
2 - use cases
3*
4
1
2
service discovery in a nutshell, Kafka is using it to allow discovery, registration etc of services. So that customers can subscribe and get their publication.