Kafka Connector

Showing 14

Retry/reconnect mechanism Mongodb Source Connectors on MongoTimeoutException

The MongoDB Kafka Source and Sink connectors for the data streaming are working fine seamlessly until there are any errors in Kafka Source connectors. If there is any error occurs, the connectors are not recovered from the timeout exceptions and ...

Guest almost 2 years ago in Kafka Connector 0 Submitted

4 VOTE

CFLE support for Kafka connector

Using MongoDB CFLE, The data need to be passed to downstream using Kafka connector which is consumed by downstream datalake for further processing. When data is pushed into Kafka it will remain encrypted and same encrypted data will land into the ...

Guest over 2 years ago in Kafka Connector 0 Submitted

1 VOTE

Built-in Partial Update $push Strategy for MongoDB Kafka Connector

We would like the official MongoDB Kafka Connector to natively support partial updates that append (\$push) records into an array in an upsert scenario—specifically, a built-in WriteModelStrategy to handle use cases where: We match on a configura...

Guest 8 months ago in Kafka Connector 0 Submitted

4 VOTE

Ignore heartbeats-mongodb topic by default

As per KAFKA-208, SMTs can't be applied to the heartbeats-mongodb topic. Users should not have to configure each connector to ignore this topic. Please either ignore this topic by default or provide a command-line switch so it can be ignored.

Guest about 4 years ago in Kafka Connector 0 Submitted

4 VOTE

Get schema validation "feedback" in Kafka Mongo Sink Connector

Objective : We want to be able to validate that data matches some requirements. We would like to to perform this data validation by adding a JSON schema in Mongo (such as it is described here : https://docs.mongodb.com/manual/core/schema-validat...

Guest almost 5 years ago in Kafka Connector 1 Submitted

4 VOTE

MongoDB Sink Connector CDC default handler

I would like to have a default CDC handler that can process data produced from MongoDB Source Connector without Debezium https://docs.mongodb.com/kafka-connector/master/kafka-sink-cdc#cdc-handler-configuration

Guest almost 5 years ago in Kafka Connector 2 Submitted

4 VOTE

Kafka source connector once only semantics

Added as a suppport case here : https://support.mongodb.com/case/00634630 When using the connector as a Source, i.e we capture change streams from the Source Mongo DB and stream that to a Kafka endpoint. Imagine these are updates on financial tr...

Guest over 5 years ago in Kafka Connector 1 Submitted

1 VOTE

Kafka Sink Connector ObjectId Support

The sink connector should support ObjectIds for the document.id.strategy. In other words, if a ObjectId hex string is provided for _id, the sink connector should be able to convert this to an ObjectId. I've scoured the documentation and the rest o...

Guest over 1 year ago in Kafka Connector 0 Submitted

2 VOTE

Kafka connector to support Kafka Schema Registry

One of the issues that our team has been talking about is when getting data from MongoDB, via a Kafka connector, and sending it through to Kafka we try to enforce schemas in Kafka but that schema is not enforced on the MongoDB data. This leads to ...

Guest almost 4 years ago in Kafka Connector 1 Submitted

1 VOTE

support regex in topic.namespace.map ( kafka source connector )

Currently, `topic.namespace.map` supports wildcard ( * ). It will be helpful if it also support regex as well. Or, since it can be breaking change, it would be nice if a new mapping is introduced that supports regex format. The workaround can be ...

Guest over 2 years ago in Kafka Connector 0 Submitted

Please enter your email address

FILTER BY CATEGORY