Project TTN Daten in InfluxDB für Grafana - Revision history

Joachim: /* Tips and Tricks for InfluxDB */

2025-02-23T11:58:46Z

Tips and Tricks for InfluxDB

← Older revision		Revision as of 11:58, 23 February 2025
Line 63:		Line 63:
	=== Tips and Tricks for InfluxDB ===		=== Tips and Tricks for InfluxDB ===

			==== Compactify data ====

			unfortunately it doesn't do miracles, but better than nothing.

			sudo systemctl stop influxdb
			sudo -u influxdb influx_inspect buildtsi -compact-series-file -datadir /var/lib/influxdb/data -waldir /var/lib/influxdb/wal
			sudo systemctl start influxdb

			last time (2025-02-23) it saved 0.5 GB of 10 GB

	==== Delete measurements ====		==== Delete measurements ====

2025-02-05T22:03:06Z

Grafana via Apache Proxy

@@ Line 190: / Line 190: @@
     ProxyPassReverse "http://localhost:3000"
   </Location>
 === Start Grafana ===

2023-04-15T17:47:33Z

Install Grafana

@@ Line 176: / Line 176: @@
 It complains about missing urw-fonts, but they are not really required -> ignore.
 Also accept there is no signing key
 === Start Grafana ===

2023-01-13T10:36:51Z

Flexible Visualization of TTN Data

← Older revision		Revision as of 10:36, 13 January 2023
Line 5:		Line 5:
	It uses a TTN HTTP integration for a device like https://github.com/joba-1/ATTiny84TTN to store it in an InfluxDB database.		It uses a TTN HTTP integration for a device like https://github.com/joba-1/ATTiny84TTN to store it in an InfluxDB database.
	Finally it shows an example Grafana dashboard to display the data from the InfluxDB.		Finally it shows an example Grafana dashboard to display the data from the InfluxDB.

			Tested with my (The Things ID joba1) devices registered on https://eu1.cloud.thethings.network/console/

	== InfluxDB ==		== InfluxDB ==

2021-10-29T14:40:23Z

Use Python to rework InfluxDB data

← Older revision		Revision as of 14:40, 29 October 2021
Line 78:		Line 78:
	==== Use Python to rework InfluxDB data ====		==== Use Python to rework InfluxDB data ====

	Example code (to copy fields into tags with same name)		Example code (to copy fields into tags with same name). See also https://github.com/joba-1/Stromableser/blob/main/fixStromableser.py


	from influxdb import InfluxDBClient		from influxdb import InfluxDBClient

2021-10-24T21:00:17Z

Delete measurements

← Older revision		Revision as of 21:00, 24 October 2021
Line 65:		Line 65:
	Sometimes invalid data gets into the database and needs to be cleaned.		Sometimes invalid data gets into the database and needs to be cleaned.
	InfluxDB does not allow to delete existing values, so brute force is the only option I know		InfluxDB does not allow to delete existing values, so brute force is the only option I know
	The "group by *" is required to preserve tags		The "group by *" is required to preserve tags according to docs,

			but it did NOT work for me:

	influx --database ttn -execute 'SELECT * INTO temp FROM "measurements" WHERE pres_hPa > 700'		influx --database ttn -execute 'SELECT * INTO temp FROM "measurements" WHERE pres_hPa > 700'
Line 71:		Line 73:
	influx --database ttn -execute 'SELECT * INTO "measurements" FROM temp group by *'		influx --database ttn -execute 'SELECT * INTO "measurements" FROM temp group by *'
	influx --database ttn -execute 'drop measurement temp'		influx --database ttn -execute 'drop measurement temp'

			use the following python code

	==== Use Python to rework InfluxDB data ====		==== Use Python to rework InfluxDB data ====

2021-10-06T14:06:44Z

Use Python to rework InfluxDB data

← Older revision		Revision as of 14:06, 6 October 2021
Line 117:		Line 117:
	}		}
	data.append(item)		data.append(item)
			if len(data) == 10000:
			print("Add {} items".format(len(data)))
			client.write_points(data, time_precision='s')
			data = []
	print("Add {} items".format(len(data)))		print("Add {} items".format(len(data)))
	client.write_points(data, time_precision='s')		client.write_points(data, time_precision='s')

2021-05-14T13:42:10Z

Alternat InfluxDB Query Language Flux

← Older revision		Revision as of 13:42, 14 May 2021
Line 200:		Line 200:
	** Select the region around the dot, repeat the zoom until you see the single values.		** Select the region around the dot, repeat the zoom until you see the single values.

	=== ~~Alternat~~ InfluxDB Query Language Flux ===		=== Datasource with InfluxDB Query Language Flux ===
	Supported at least since InfluxDB 1.8.5 with Grafana 7.4.2, needs to be enabled in influxdb.conf		Supported at least since InfluxDB 1.8.5 with Grafana 7.4.2, needs to be enabled in influxdb.conf
	* URL: unchanged, e.g. http://localhost:8086		* URL: unchanged, e.g. http://localhost:8086

2021-05-14T13:41:40Z

Test Grafana

← Older revision		Revision as of 13:41, 14 May 2021
Line 181:		Line 181:
	* Add datasource		* Add datasource
	** Select InfluxDB		** Select InfluxDB
	** Check use as default		** Check use as default (optional)
			** Select Query Language InfluxQL (Flux is also possible, but has no graphical query editor)
	** Enter URL of your InfluxDB, e.g. http://localhost:8086		** Enter URL of your InfluxDB, e.g. http://localhost:8086
	** Enter our test db in InfluxDB Details: my_test_db		** Enter our test db in InfluxDB Details: my_test_db
Line 198:		Line 199:
	** We could add more panels, but for now: select Save dashboard icon and give it a name: My counts		** We could add more panels, but for now: select Save dashboard icon and give it a name: My counts
	** Select the region around the dot, repeat the zoom until you see the single values.		** Select the region around the dot, repeat the zoom until you see the single values.

			=== Alternat InfluxDB Query Language Flux ===
			Supported at least since InfluxDB 1.8.5 with Grafana 7.4.2, needs to be enabled in influxdb.conf
			* URL: unchanged, e.g. http://localhost:8086
			* Access: unchanged (Server)
			* Cookies: can stay empty
			* Auth: can all stay disabled
			* Custom HTTP headers: not needed
			* Organization: like configured for Grafana (I use Banzhaf)
			* Token: user:password
			* Default Bucket: database name
			* Min interval and max serias not needed

	== Python and Apache ==		== Python and Apache ==

2021-05-14T13:22:36Z

Install Grafana

← Older revision		Revision as of 13:22, 14 May 2021
Line 155:		Line 155:

	=== Install Grafana ===		=== Install Grafana ===

			I now use leap supplied grafana 7.4. No need for the below

	Here are the [https://grafana.com/grafana/download installation instructions]. Basically just do		Here are the [https://grafana.com/grafana/download installation instructions]. Basically just do