Commit Graph

40 Commits

Author SHA1 Message Date
Thomas Gelf 36141c5f98 Import: validated encoding on DB error
MySQL gives useless error messages for invalid UTF8 characters and
confuses users with an 'Invalid datetime format' message.

Once storing imported data fails, the original data will now be scanned
for invalid UTF-8 characters. If such are found, a dedicated exception
with more details is thrown. Otherwise the original exception will be
forwarded

fixes #2143
2020-07-10 17:16:08 +02:00
Thomas Gelf f0b96674c9 Import: distinct fetch from store in benchmark 2020-01-10 12:36:13 +01:00
Thomas Gelf be8c1101f2 travis: use phpcs 3.5.2 2019-11-28 07:13:22 +01:00
Markus Frosch 58c0689005 Import: Improve exception info during storing rows 2018-12-14 09:58:55 +01:00
Thomas Gelf cf6e4536ea Util: drop bin2hex/hex2bin helpers
We dropped support for PHP 5.3, this is no longer required
2018-10-30 15:32:17 +01:00
Thomas Gelf 765b08f597 Import: apply modifiers only when fetching data 2018-01-26 13:01:39 +01:00
Thomas Gelf a943b0c70f ImportSourceHook: use new static factory 2017-08-16 11:18:13 +02:00
Thomas Gelf b7a10d296c phpcs: mostly new PSR-2 SpacingAfter/Before checks 2017-01-13 20:54:52 +01:00
Thomas Gelf fae2a57ed5 Import: fix some type hints and comments 2016-12-30 10:20:24 +01:00
Thomas Gelf f12e4b2033 ImportSource: provide applyModifiers helper method 2016-07-20 14:25:18 +02:00
Thomas Gelf 29564ab742 ImportSource: take over duplicated transform logic 2016-07-20 14:19:20 +02:00
Thomas Gelf 38bf19eb92 ImportSource: take over modifier loading logic 2016-07-20 13:40:43 +02:00
Thomas Gelf 225e9beec6 ImportRowModifier: reduce instantiated objects 2016-07-20 12:59:02 +02:00
Thomas Gelf 7cf1af15cb Import/Sync: cleanly rollback transactions
Helps to avoid side-effects
2016-06-28 12:56:53 +02:00
Markus Frosch 44ea86cca5 Import: Do not run modifiers on unset properties 2016-05-25 11:25:09 +02:00
Thomas Gelf dee5c422f2 Import: pass through integer and float types 2016-05-18 21:52:22 +02:00
Thomas Gelf deea18f8df Import: keep boolean values 2016-05-17 15:46:20 +02:00
Thomas Gelf 5b8dcc44db Import: one more protection against braindead "AI" 2016-03-16 11:52:47 +01:00
Thomas Gelf b4ed770651 Import: avoid stream resources for PostgreSQL
I'd like to change this back to binary data later on, but for now
the fix should be fine.

fixes #11321
2016-03-14 12:07:57 +01:00
Thomas Gelf 66c8d7628f PropertyModifierHook: provide db connection 2016-03-08 22:09:59 +01:00
Thomas Gelf 9ede46f839 Import: various fixes for PostgreSQL
refs #11315
2016-03-05 20:01:31 +01:00
Thomas Gelf 348aebcf41 Import: apply row modifiers 2016-02-19 09:15:47 +01:00
Thomas Gelf c6cd99f9db Hooks: remove last traces of Web\Hook 2016-02-17 11:49:56 +01:00
Thomas Gelf d347a18ac6 Import: add missing semicolon 2015-12-15 11:08:04 +01:00
Thomas Gelf ab597ba958 Import: workaround for ZF1 binary data corrpution 2015-12-10 17:17:49 +01:00
Thomas Gelf c070c77611 Import: no longer show raw row on exception 2015-11-06 09:20:13 +01:00
Thomas Gelf 39b58d24b7 Import: refine API, code cleanup 2015-11-03 12:52:38 +01:00
Thomas Gelf 2ac0d2d6f5 Import: start to split functionality 2015-11-03 10:31:44 +01:00
Thomas Gelf eee48e3238 Import: comment and move sort methods to the bottom 2015-11-03 10:18:24 +01:00
Thomas Gelf 5f333b0ea7 Import: always store dictionaries ordered 2015-11-02 09:25:39 +01:00
Thomas Gelf 139b52079f Import: allow for simple objects (hashes, dicts) 2015-10-28 22:31:37 +01:00
Thomas Gelf 1bbd07efe1 Import: use IcingaException, add a TODO 2015-10-21 07:45:08 +02:00
Thomas Gelf dd06be4a58 Import: handle empty sets 2015-08-29 01:10:56 +02:00
Thomas Gelf 0b4bb9979b Import: work with data formats 2015-08-28 23:53:56 +02:00
Thomas Gelf c456f79c4c Import: do nothing if matching last import 2015-08-28 23:48:14 +02:00
Thomas Gelf c9e5f16d3e Import: exception for missing key column...
...but skip check for now
2015-07-26 15:38:29 +02:00
Thomas Gelf 80b2974372 Import: ignore null properties for now 2015-07-24 15:26:09 +02:00
Thomas Gelf 3dfec6b8bd Import: allow for differing imports w/o new rows 2015-07-22 13:13:00 +02:00
Stefan Scheungrab 2076d6b9a7 Import: renamed column imported_rowset_checksum TO rowset_checksum resolves: #9700 2015-07-22 11:13:52 +02:00
Thomas Gelf bc49af2685 Import: implement import runs
* Trigger import run and store data
* Add new table showing related information
2015-07-22 10:12:50 +02:00