Run Connectors on Cloud
Check the Hub for a library of connectors that you can download and run. This document will guide you through downloading and running a certified connector in InfinyOn Cloud.
Prerequisites
This document assumes that you have provisioned a Cluster in your InfinyOn Cloud account. If you have not done so, please use the following instructions.
1. Create a Connector Configuration File
Let's create new directory for the connector configuration file:
$ mkdir http-source-cloud; cd http-source-cloud
Create quotes-config.yml
and paste the following configuration:
# quotes-config.yaml
apiVersion: 0.1.0
meta:
version: 0.3.8
name: http-quotes
type: http-source
topic: quotes
http:
endpoint: https://demo-data.infinyon.com/api/quote
interval: 2s
The configuration file ask the http-source
connector to read a new quote quote
from the demo-data
server every 2 seconds.
2. Run the http-source
Connector
Use the configuration file and create a new connector:
$ fluvio cloud connector create -c quotes-config.yaml
Switch the log level --log-level debug
. The log level can be set to trace
, debug
, info
, warn
, error
.
To check if the connector is running:
$ fluvio cloud connector list
The connector provisioned the quotes
topic and it periodically sends a new quote.
3. Check the Result
Read from the fluvio topic:
$ fluvio consume quotes
Show the logs:
$ fluvio cloud connector log http-quotes
4. Clean-up
The connector will continue to run and consume your credits. Let's shut it down:
$ fluvio cloud connector delete http-quotes
We can also delete the topic
$ fluvio topic delete quotes
References
- SmartModules to apply transformations
- Tutorials to see additional examples