Azure Event Hubs "Role Based Access Control" in action
Azure Event Hubs is streaming platform and event ingestion service that can receive and process millions of events per second. In this blog, we are going to cover one of the security aspects related to...
View ArticleTutorial: How to use MongoDB Change Streams [Part 1]
This blog post demonstrates how to use Change Streams in MongoDB with the official Go driver. I will be using Azure Cosmos DB since it has wire protocol support for the MongoDB API (server version 3.6)...
View ArticleMost commonly asked questions about Dapr
Dapr is "An event-driven, portable runtime for building microservices on cloud and edge." Being an exciting open source project, it attracts a lot of developers and with them, lots of questions :)I...
View ArticleTutorial: Set up a Change Data Capture architecture on Azure using Debezium,...
Change Data Capture (CDC) is a technique used to track row-level changes in database tables in response to create, update and delete operations. Different databases use different techniques to expose...
View ArticleKafka on Kubernetes, the Strimzi way! (Part 3)
Over the course of the first two parts of this blog series, we setup a single-node Kafka cluster on Kubernetes, secured it using TLS encryption and accessed the broker using both internal and external...
View ArticleTutorial: How to use MongoDB Change Streams [Part 2]
This is the second part of a blog series that covers MongoDB Change Streams and how it can be used with Azure Cosmos DB which has wire protocol support for MongoDB server version 3.6 (including the...
View ArticleManage Azure Event Hubs with Azure Service Operator on Kubernetes
Azure Service Operator is an open source project to help you provision and manage Azure services using Kubernetes. Developers can use it to provision Azure services from any environment, be it Azure,...
View ArticleTutorial: Getting started with Azure Data Explorer using the Go SDK
With the help of an example, this blog post will walk you through how to use the Azure Data explorer Go SDK to ingest data from a Azure Blob storage container and query it programmatically using the...
View ArticleKafka on Kubernetes, the Strimzi way! (Part 4)
Welcome to part four of this blog series! So far, we have a Kafka single-node cluster with TLS encryption on top of which we configured different authentication modes (TLS and SASL SCRAM-SHA-512),...
View ArticleHow to use Azure Go SDK to manage Azure Data Explorer clusters
Getting started with Azure Data Explorer using the Go SDK covered how to use the Azure Data Explorer Go SDK to ingest and query data from azure data explorer to ingest and query data. In this blog you...
View ArticleUsing PostgreSQL pgoutput plugin for change data capture with Debezium on Azure
Set up a Change Data Capture architecture on Azure using Debezium, Postgres and Kafka was a tutorial on how to use Debezium for change data capture from Azure PostgreSQL and send them to Azure Event...
View ArticleTutorial: How to Ingest data from Kafka into Azure Data Explorer
This blog will cover data ingestion from Kafka to Azure Data Explorer (Kusto) using Kafka Connect. Azure Data Explorer is a fast and scalable data exploration service that lets you collect, store, and...
View ArticleTutorial: Build a pipeline to join streams of real time data
With traditional architectures, it's quite hard to counter challenges imposed by real-time streaming data – one such use case is joining streams of data from disparate sources. For example, think about...
View ArticleBuild fault tolerant applications with Cassandra API for Azure Cosmos DB
Azure Cosmos DB is a resource governed system that allows you to execute a certain number of operations per second based on the provisioned throughput you have configured. If clients exceed that limit...
View ArticleData Ingestion into Azure Data Explorer using Kafka Connect
In this blog, we will go over how to ingest data into Azure Data Explorer using the open source Kafka Connect Sink connector for Azure Data Explorer running on Kubernetes using Strimzi. Kafka Connect...
View ArticleChange Data Capture from PostgreSQL to Azure Data Explorer using Kafka Connect
This blog post demonstrates how you can use Change Data Capture to stream database modifications from PostgreSQL to Azure Data Explorer (Kusto) using Apache Kafka.Change Data Capture (CDC) can be used...
View ArticlePicking the Right Distributed Database [Create: Data]
"In God we trust, all others must bring data" William Edwards DemingWell, Microsoft is bringing to you, Data Week🙌 A celebration of Data & Data Technologies, running throughout the week, starting...
View ArticleBuild a Serverless app using Go and Azure Functions
Webhook backend is a popular use case for FaaS (Functions-as-a-service) platforms. They could be used for many use cases such as sending customer notifications to responding with funny GIFs! Using a...
View ArticleIntegrate Kafka and Cassandra using Kafka Connect
This blog post demonstrates how you can use an open source solution (connector based) to ingest data from Kafka into Azure Cosmos DB Cassandra API. It uses a simple yet practical scenario along with a...
View ArticleLearn how to setup data pipeline from PostgreSQL to Cassandra using Kafka...
Apache Kafka often serves as a central component in the overall data architecture with other systems pumping data into it. But, data in Kafka (topics) is only useful when consumed by other applications...
View Article