tyler.durden
/
icinga2
mirror of https://github.com/Icinga/icinga2.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
icinga2/lib/perfdata/influxdbwriter.hpp

64 lines
1.6 KiB
C++
Raw Normal View History

Replace Copyright header with a short version, part I CLion -> replace in path
2019-02-25 14:48:22 +01:00
/* Icinga 2 | (c) 2012 Icinga GmbH | GPLv2+ */
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
#ifndef INFLUXDBWRITER_H
#define INFLUXDBWRITER_H
Fix compatibility with CMake < 3.1
2018-01-18 13:50:38 +01:00
#include "perfdata/influxdbwriter-ti.hpp"
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
#include "icinga/service.hpp"
#include "base/configobject.hpp"
#include "base/tcpsocket.hpp"
#include "base/timer.hpp"
InfluxdbWriter: Use a work queue for async message processing; add stats log/api
2017-05-04 10:29:49 +02:00
#include "base/workqueue.hpp"
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
#include <fstream>
namespace icinga
{
/**
* An Icinga InfluxDB writer.
*
* @ingroup perfdata
*/
Add the final keyword to classes
2018-01-04 06:11:04 +01:00
class InfluxdbWriter final : public ObjectImpl<InfluxdbWriter>
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
{
public:
DECLARE_OBJECT(InfluxdbWriter);
DECLARE_OBJECTNAME(InfluxdbWriter);
static void StatsFunc(const Dictionary::Ptr& status, const Array::Ptr& perfdata);
Avoid accessing attributes for validators where not necessary
2018-01-11 07:08:09 +01:00
void ValidateHostTemplate(const Lazy<Dictionary::Ptr>& lvalue, const ValidationUtils& utils) override;
void ValidateServiceTemplate(const Lazy<Dictionary::Ptr>& lvalue, const ValidationUtils& utils) override;
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
protected:
Apply clang-tidy fix 'modernize-use-override'
2018-01-04 05:12:56 +01:00
void OnConfigLoaded() override;
Implement HA functionality for InfluxDB feature
2018-10-24 13:38:06 +02:00
void Resume() override;
void Pause() override;
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
private:
Apply clang-tidy fix 'modernize-use-default-member-init'
2018-01-04 09:43:49 +01:00
WorkQueue m_WorkQueue{10000000, 1};
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
Timer::Ptr m_FlushTimer;
InfluxdbWriter: Use a work queue for async message processing; add stats log/api
2017-05-04 10:29:49 +02:00
std::vector<String> m_DataBuffer;
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
void CheckResultHandler(const Checkable::Ptr& checkable, const CheckResult::Ptr& cr);
Fix performance issues for InfluxdbWriter
2017-10-24 15:23:58 +02:00
void CheckResultHandlerWQ(const Checkable::Ptr& checkable, const CheckResult::Ptr& cr);
Improve logging of InfluxdbWriter
2019-03-19 08:35:55 +01:00
void SendMetric(const Checkable::Ptr& checkable, const Dictionary::Ptr& tmpl,
const String& label, const Dictionary::Ptr& fields, double ts);
Apply clang-tidy fix 'modernize-redundant-void-arg'
2018-01-04 04:25:35 +01:00
void FlushTimeout();
void FlushTimeoutWQ();
void Flush();
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
Fix performance issues for InfluxdbWriter
2017-10-24 15:23:58 +02:00
static String EscapeKeyOrTagValue(const String& str);
static String EscapeValue(const Value& value);
Update InfluxDB line formatting Fixes a couple issues to do with line formatting of influx DB data points. All keys and values need commas and white space escaping. Values are also checked for type. If a numeric or scientific value is detected this is output as an Influx floating point/scientific number. Booleans are detected and output in a canonical format. All other values are strings, which have double quotes escaped and the entire string is wrapped in double quotes. The handling of thresholds has changed before this becomes officially released. These values if available are passed to the accumulation function in a dictionary, said dictionary builds a single data point with multiple fields, rather than the existing 5 data points, thus saving bandwidth costs. fixes #11904 Signed-off-by: Gunnar Beutner <gunnar.beutner@netways.de>
2016-06-07 14:35:16 +02:00
Fix TLS Race Connecting to InfluxDB Rather than leaving stale connections about we tried to poll for data coming in from InfluxDB and timeout if it didn't repond in a timely manner. This introduced a race where the timeout triggers, a context switch occurs where data is actually available and the TlsStream spins trying to asynchronously notify that data is available, but which never gets read. Not only does this use up 100% of a core, but it also slowly starves the system of handler threads at which point metrics stop being delivered. This basically removes the poll and timeout, any TLS socket erros should be detected by TCP keep-alives. Fixes #5460 #5469
2017-08-14 17:20:45 +02:00
Stream::Ptr Connect();
InfluxdbWriter: Use a work queue for async message processing; add stats log/api
2017-05-04 10:29:49 +02:00
Apply clang-tidy fix 'modernize-redundant-void-arg'
2018-01-04 04:25:35 +01:00
void AssertOnWorkQueue();
InfluxdbWriter: Use a work queue for async message processing; add stats log/api
2017-05-04 10:29:49 +02:00
void ExceptionHandler(boost::exception_ptr exp);
Add InfluxDB Writer Adds an Icinga2 object to directly interface with InfluxDB's native HTTP API. This supports optional basic authorization, and TLS transport. InfluxDB didn't appear to like having the TLS stream kept open, so instead this object buffers data points which are then flushed to InfluxDB as a batch write, either driven by a configurable timeout or threshold. As InfluxDB is a schema-less database the host and service templates are user configurable allowing both the measurement field and tags to be set by the end user via macro expansion. This allows access to tag fields from arbitrary data associated with host.vars or service.vars. If a particular value is unable to be resolved, the tag will be dropped and not transmitted to InfluxDB. Also alters URL handling to omit array brackets when only a single value is attached to a key, otherwise InfluxDB has a strop with non-standard syntax. fixes #10480 Signed-off-by: Michael Friedrich <michael.friedrich@netways.de>
2016-04-19 13:54:41 +02:00
};
}
#endif /* INFLUXDBWRITER_H */