40 Commits

Author SHA1 Message Date
Thomas Gelf
36141c5f98 Import: validated encoding on DB error
MySQL gives useless error messages for invalid UTF8 characters and
confuses users with an 'Invalid datetime format' message.

Once storing imported data fails, the original data will now be scanned
for invalid UTF-8 characters. If such are found, a dedicated exception
with more details is thrown. Otherwise the original exception will be
forwarded

fixes #2143
2020-07-10 17:16:08 +02:00
Thomas Gelf
f0b96674c9 Import: distinct fetch from store in benchmark 2020-01-10 12:36:13 +01:00
Thomas Gelf
be8c1101f2 travis: use phpcs 3.5.2 2019-11-28 07:13:22 +01:00
Markus Frosch
58c0689005 Import: Improve exception info during storing rows 2018-12-14 09:58:55 +01:00
Thomas Gelf
cf6e4536ea Util: drop bin2hex/hex2bin helpers
We dropped support for PHP 5.3, this is no longer required
2018-10-30 15:32:17 +01:00
Thomas Gelf
765b08f597 Import: apply modifiers only when fetching data 2018-01-26 13:01:39 +01:00
Thomas Gelf
a943b0c70f ImportSourceHook: use new static factory 2017-08-16 11:18:13 +02:00
Thomas Gelf
b7a10d296c phpcs: mostly new PSR-2 SpacingAfter/Before checks 2017-01-13 20:54:52 +01:00
Thomas Gelf
fae2a57ed5 Import: fix some type hints and comments 2016-12-30 10:20:24 +01:00
Thomas Gelf
f12e4b2033 ImportSource: provide applyModifiers helper method 2016-07-20 14:25:18 +02:00
Thomas Gelf
29564ab742 ImportSource: take over duplicated transform logic 2016-07-20 14:19:20 +02:00
Thomas Gelf
38bf19eb92 ImportSource: take over modifier loading logic 2016-07-20 13:40:43 +02:00
Thomas Gelf
225e9beec6 ImportRowModifier: reduce instantiated objects 2016-07-20 12:59:02 +02:00
Thomas Gelf
7cf1af15cb Import/Sync: cleanly rollback transactions
Helps to avoid side-effects
2016-06-28 12:56:53 +02:00
Markus Frosch
44ea86cca5 Import: Do not run modifiers on unset properties 2016-05-25 11:25:09 +02:00
Thomas Gelf
dee5c422f2 Import: pass through integer and float types 2016-05-18 21:52:22 +02:00
Thomas Gelf
deea18f8df Import: keep boolean values 2016-05-17 15:46:20 +02:00
Thomas Gelf
5b8dcc44db Import: one more protection against braindead "AI" 2016-03-16 11:52:47 +01:00
Thomas Gelf
b4ed770651 Import: avoid stream resources for PostgreSQL
I'd like to change this back to binary data later on, but for now
the fix should be fine.

fixes #11321
2016-03-14 12:07:57 +01:00
Thomas Gelf
66c8d7628f PropertyModifierHook: provide db connection 2016-03-08 22:09:59 +01:00
Thomas Gelf
9ede46f839 Import: various fixes for PostgreSQL
refs #11315
2016-03-05 20:01:31 +01:00
Thomas Gelf
348aebcf41 Import: apply row modifiers 2016-02-19 09:15:47 +01:00
Thomas Gelf
c6cd99f9db Hooks: remove last traces of Web\Hook 2016-02-17 11:49:56 +01:00
Thomas Gelf
d347a18ac6 Import: add missing semicolon 2015-12-15 11:08:04 +01:00
Thomas Gelf
ab597ba958 Import: workaround for ZF1 binary data corrpution 2015-12-10 17:17:49 +01:00
Thomas Gelf
c070c77611 Import: no longer show raw row on exception 2015-11-06 09:20:13 +01:00
Thomas Gelf
39b58d24b7 Import: refine API, code cleanup 2015-11-03 12:52:38 +01:00
Thomas Gelf
2ac0d2d6f5 Import: start to split functionality 2015-11-03 10:31:44 +01:00
Thomas Gelf
eee48e3238 Import: comment and move sort methods to the bottom 2015-11-03 10:18:24 +01:00
Thomas Gelf
5f333b0ea7 Import: always store dictionaries ordered 2015-11-02 09:25:39 +01:00
Thomas Gelf
139b52079f Import: allow for simple objects (hashes, dicts) 2015-10-28 22:31:37 +01:00
Thomas Gelf
1bbd07efe1 Import: use IcingaException, add a TODO 2015-10-21 07:45:08 +02:00
Thomas Gelf
dd06be4a58 Import: handle empty sets 2015-08-29 01:10:56 +02:00
Thomas Gelf
0b4bb9979b Import: work with data formats 2015-08-28 23:53:56 +02:00
Thomas Gelf
c456f79c4c Import: do nothing if matching last import 2015-08-28 23:48:14 +02:00
Thomas Gelf
c9e5f16d3e Import: exception for missing key column...
...but skip check for now
2015-07-26 15:38:29 +02:00
Thomas Gelf
80b2974372 Import: ignore null properties for now 2015-07-24 15:26:09 +02:00
Thomas Gelf
3dfec6b8bd Import: allow for differing imports w/o new rows 2015-07-22 13:13:00 +02:00
Stefan Scheungrab
2076d6b9a7 Import: renamed column imported_rowset_checksum TO rowset_checksum resolves: #9700 2015-07-22 11:13:52 +02:00
Thomas Gelf
bc49af2685 Import: implement import runs
* Trigger import run and store data
* Add new table showing related information
2015-07-22 10:12:50 +02:00