concept public key in category apache pulsar

appears as: public key
Apache Pulsar in Action

This is an excerpt from Manning's book Apache Pulsar in Action.

5.1.2   Programming Model

While the Pulsar IO framework already provides a collection of built-in connectors for some of the most popular data systems, it was designed with extensibility in mind. Allowing users to add new connectors as new systems and APIs are developed. The programming model behind Pulsar IO Connectors is very straightforward, which greatly simplifies the development process. As shown in Figure 5.2, Pulsar IO Sink Connectors receive messages from one or more input topics, and every time a message is published to any of the input topics, the sink’s write method is called. In this example, the sink connector is listening on multiple topics and based on the message contents will update the corresponding table in Influx DB.

Listing 5.17 Output of the available-sinks command inside the Pulsar Docker container
bin/pulsar-admin sink available-sinks
aerospike
Aerospike database sink
----------------------------------------
cassandra
Writes data into Cassandra
----------------------------------------
data-generator
Test data generator source
----------------------------------------
elastic_search
Writes data into Elastic Search
----------------------------------------
hbase
Writes data into hbase table
----------------------------------------
hdfs2
Writes data into HDFS 2.x
----------------------------------------
hdfs3
Writes data into HDFS 3.x
----------------------------------------
jdbc
Jdbc sink
----------------------------------------
kafka
Kafka source and sink connector
----------------------------------------
kinesis
Kinesis sink connector
----------------------------------------
mongo
Writes data into MongoDB
----------------------------------------

However, as we mentioned earlier, the built-in connectors are not including in a standard Pulsar distribution and must be downloaded an installed manually. The available-sinks and available-sinks commands can help you confirm that you have successfully installed a built-in connector manually.