/
Cannot create new topic in Confluent Cloud Kafka cluster
Cannot create new topic in Confluent Cloud Kafka cluster
Problem
I created an mqtt-to-kafka-transformer, which should dynamically create a new topic in Kafka. However, this fails:
WARN - [Producer clientId=hivemq-kafka-extension-producer-1] Error while fetching metadata with correlation id 1 : {my-new-topic=UNKNOWN_TOPIC_OR_PARTITION}
Solution
Go to the Confluent Cloud Kafka cluster and verify how many partitions the topic there has.
If it is different from the default 3, then adjust this setting in the kafka-extension configuration file
<kafka-configuration> ... ... <internal> <option> <key>kafka.topic.default.replication-factor</key> <value>3</value> </option> <option> <key>kafka.topic.default.partitions</key> <value>6</value> </option> </internal> </kafka-configuration>
Restart the kafka-extension and test again.
If the error persists, copy the error message and exception stack trace and contact HiveMQ Support for further investigation.
Related articles
, multiple selections available,
Related content
Outdated glibc results in ERROR upon startup
Outdated glibc results in ERROR upon startup
Read with this
Creating Dynamic topics for Confluent Kafka using HiveMQ Cloud Broker
Creating Dynamic topics for Confluent Kafka using HiveMQ Cloud Broker
More like this
Setting Up HiveMQ Kafka Extension for Redpanda Cluster Connectivity
Setting Up HiveMQ Kafka Extension for Redpanda Cluster Connectivity
More like this
Use Confluent.io with HiveMQ Cloud Confluent Integration
Use Confluent.io with HiveMQ Cloud Confluent Integration
More like this
Serialization of kafka metrics failed - Message size to large
Serialization of kafka metrics failed - Message size to large
More like this
HiveMQ Kafka Extension - Cluster Authorization Failed / RANGER-3809
HiveMQ Kafka Extension - Cluster Authorization Failed / RANGER-3809
More like this