4 Building custom connectors with Kafka Connect
This chapter covers
- Developing a custom source connector with Kafka Connect
- Handling errors in connectors
- Persisting connector offsets with Kafka Connect
- Testing connectors with unit tests
The last chapter introduced Kafka Connect and showed how to use community connectors for integrating Kafka topics with external data systems without writing code. In particular, we applied the Debezium source connector for streaming order data from Excellent Toy’s PostgreSQL database to Kafka and used a sink connector for integrating Kafka with Excellent Toy’s data warehouse.