Let's build a #Grafana Data Source for #TheThingsNetwork! (MQTT)
Why connect #Grafana to #TheThingsNetwork? So that we can instantly visualise the Sensor Data transmitted by IoT Devices
We'll take this brand new #Grafana Data Source for MQTT ... And mod it for the MQTT Server at #TheThingsNetwork
#TheThingsNetwork MQTT Messages are really complex ... Our #Grafana Data Source shall extract the Base64 Payload that's deep inside the message
https://github.com/lupyuen/the-things-network-datasource#mqtt-log
Here's how our #Grafana Data Source extracts the Message Payload from #TheThingsNetwork MQTT ... Pardon my ghastly GoLang 🙏
https://github.com/lupyuen/the-things-network-datasource/blob/main/pkg/plugin/message.go#L43-L154
#Grafana Log shows our #TheThingsNetwork Data Source has extracted the Message Payload correctly yay!
https://github.com/lupyuen/the-things-network-datasource#grafana-log
Remember that #LoRa Messages are super tiny ... We shall encode Sensor Data in CBOR ... And our #Grafana Data Source needs to decode the CBOR Payload
https://lupyuen.github.io/articles/ttn#fair-use-of-the-things-network
Here's how we compress 10 bytes of JSON into 6 bytes of CBOR
How our #Grafana Data Source decodes CBOR Payloads from #TheThingsNetwork
https://github.com/lupyuen/the-things-network-datasource/blob/main/pkg/plugin/message.go#L100-L116
Cleaned up the CBOR Decoding ... In our #Grafana Data Source for #TheThingsNetwork
https://github.com/lupyuen/the-things-network-datasource/blob/main/pkg/plugin/message.go#L131-L189
How our #Grafana Data Source transforms #TheThingsNetwork MQTT Messages ... Into Grafana Data Frames
https://github.com/lupyuen/the-things-network-datasource/blob/main/pkg/plugin/message.go#L46-L129
CBOR Payloads now decoded OK ... By our #Grafana Data Source for #TheThingsNetwork yay! 🎉
Our Data Source for #TheThingsNetwork MQTT ... On a #Grafana Dashboard 🎉
We have just visualised #TheThingsNetwork Sensor Data in #Grafana with our custom data source
But to visualise historical Sensor Data from #TheThingsNetwork, we should store the data in Prometheus and push to #Grafana
Visualising #TheThingsNetwork Sensor Data with #Grafana ... All shall be explained in this article
Here's how we install #Grafana ... And our Custom Data Source for #TheThingsNetwork
https://lupyuen.github.io/articles/grafana?3#appendix-install-grafana-and-data-source
Adding the #Grafana Data Source for our MQTT Server at #TheThingsNetwork
https://lupyuen.github.io/articles/grafana?4#configure-grafana-data-source
Why we encode #TheThingsNetwork Sensor Data with CBOR (instead of JSON)
https://lupyuen.github.io/articles/grafana?7#cbor-concise-binary-object-representation
How our #Grafana Data Source talks to the MQTT Server at #TheThingsNetwork
https://lupyuen.github.io/articles/grafana?9#mqtt-integration
Transforming MQTT Messages to #Grafana Data Frames
https://lupyuen.github.io/articles/grafana?10#transform-mqtt-messages
Decoding CBOR Payloads from #TheThingsNetwork ... In our #Grafana Data Source
https://lupyuen.github.io/articles/grafana?11#decode-cbor-payload
Storing Sensor Data with Prometheus ... And visualising with #Grafana
https://lupyuen.github.io/articles/grafana?12#store-data-with-prometheus
Tips for compressing Sensor Data with #CBOR
Here's how we visualise #TheThingsNetwork Sensor Data in #Grafana ... With a Custom MQTT Data Source
@lupyuen Floating point numbers compress great with CBOR, you just gotta know the precision you want. (Mostly into 16bit halfs: 12.34 has as much precision there as in decimal, and takes exactly as many bytes as 1234).
Then again, floats on embedded are annoying. (But if it was just that, 1234x10**-2 is just 6 bytes of CBOR and usable w/o needing to know your sensor's scaling factor).
@chrysn Cool I'll add that to the article thanks!
Filtering Sensor Data with #Grafana
https://lupyuen.github.io/articles/grafana?6#filter-data