1
0
Fork 0
Commit Graph

1269 Commits

Author SHA1 Message Date
Jan 4477bd1ed1 Bug fix 3.4/issue 10078 (#10083)
* fixed issue #10078: FULLTEXT with sort on same field not working

* added test

* simplify the implementation
2019-09-27 16:59:42 +03:00
Matthew Von-Maszewski d1d2edba57 Bugfix 3.4: Calculate Write Amplification / Flag to disable StatisticsWorker (#9874)
* release version 3.4.8

* [3.4] fix agency lockup when removing 404-ed callbacks (#9839)

* add write amplification statistic

* add --server.statistics-history flag that blocks StatisticsWorker

* no longer disable statistics for Agency

* update for statistics changes

* correct grammar

* correct grammar and only force statistical history off on Agent when option not explicitly used.

* correct grammar and only force statistical history off on Agent when option not explicitly used.

* correct variable naming
2019-09-11 12:54:33 +03:00
Jan 34481860a9 cover more cases of "unique constraint violated" issues during replication (#9828)
* release version 3.4.8

* cover more cases of "unique constraint violated" issues during
replication

* add more testing
2019-09-11 12:48:08 +03:00
Tobias Gödderz 4ada35f20c [3.4] Bug fix 3.4/add shard id to replication client identifier (#9466)
* Bug fix/add shard id to replication client identifier (#9366)

* Fixed compile (but not linker) errors

* Backported ReplicationClientProgressTracker

* Fixed compile errors, fixed hash function

* No longer use SyncerId for real asynchronous replication

* Updated docu

* Try to fix compile error on windows

* Fixed a bug

* Removed old code

* Fixed CHANGELOG entry
2019-09-11 12:45:57 +03:00
Dan Larkin-York 4a0383849f [3.4] Minimize unnecessary dropping of followers due to poorly set synchronous replication timeouts (#9811)
* Minimize unnecessary dropping of followers due to poorly set synchronous replication timeouts.

* Add changelog entry.

* Add setIntroducedIn version.
2019-08-27 11:45:37 +03:00
Jan eb5f4241a5 issue #9654 (#9752) 2019-08-19 23:18:57 +03:00
Matthew Von-Maszewski 38b9ec80b8
Bugfix 3.4: Clean up rocksdb getStatistics() (#9703)
* clean up basic rocksdb statistics.  More clean-up needed.

* add rocksdb throttle value to statistics

* update comments about rocksdb properties

* rename function per PR comments
2019-08-13 13:10:45 -04:00
Jan 49ad6fd290
fixed issue #9679 (#9683) 2019-08-12 14:59:22 +02:00
Jan fdbf2eb1e8
various replication improvements: (#9674)
- better debuggability (more log details)
- shorter minimum wait delay in active failover
- fixed too early pruning of WAL files on leaders
2019-08-12 10:44:50 +02:00
Dronplane 592063c503 Bug fix 3.4/data loss in view (#9658)
* Added full index iterator utilization in case of some documents was not found in collection

* Added index operations reversal in case of insertion failure in rocksdb

* Removed singleop optimization as rollback possible even for such operations (in case of index operation failure on insert)

* Added tests for insert rollback in views

* Added catch tests for view block

* Added changelog entry

* fixed jslint errors

* fixed linux build

* Added test for update

* Fix CHANGELOG sequence

* Add line

* Added reverts for update and remove failures

* Cleanup in test. Added throwing error in case of failed reversal

* fixed typo

Co-Authored-By: Simran <Simran-B@users.noreply.github.com>

* fixed build

* Applied review comments

* Applied review comments
2019-08-09 17:30:17 +03:00
Simon 5eb4951d29 use a lock when calling unload (#9367) 2019-07-03 16:21:00 +02:00
Simon 17468f1dc9 do not buffer index estimates (#9338) 2019-06-26 17:27:01 +02:00
Jan 2de2d92054
remove archived RocksDB WAL files on agent servers (#9230) 2019-06-08 19:40:07 +02:00
Jan 4d86dd5fa8
handle incomplete reads (#9019) 2019-05-17 11:17:51 +02:00
Simon 185c8724a3 Pregel various fixes (#8879) 2019-05-07 09:53:18 +02:00
Simon 11aa075747 Backport fix for truncate selectivity (#8863) 2019-04-29 17:10:02 +02:00
Simon b58bf82871 Fix tick overflow (#8840) (#8856) 2019-04-26 19:20:38 +02:00
jsteemann 5b66fa7aa0 RocksDB returns certain statistics values as strings. honor that 2019-04-26 19:05:58 +02:00
Dan Larkin-York ce82a512d1 [3.4] Fix RocksDB recovery ticks (#8654) 2019-04-11 11:37:29 +02:00
Jan a540b795b5
this addresses an issue described in ES-260, and is a forward-port of https://github.com/facebook/rocksdb/pull/5160 (#8697) 2019-04-08 18:20:50 +02:00
Jan d29d65face
Bug fix 3.4/cleanup 31032019 (#8633) 2019-04-01 17:02:00 +02:00
KVS85 c88c4d1416 Remove USE_IRESEARCH definition and usage (#8612) 2019-03-28 17:22:11 +01:00
Dan Larkin-York ea6a854b45 Add RocksDB background error listener. (#8537) 2019-03-23 20:46:07 +01:00
Simon 89a7591d00 Bug fix 3.4/rocksdb truncate asan (#8525) 2019-03-22 17:15:03 +01:00
Jan 3f3f0c6fe3
Feature 3.4/ncc1701 (#8441) 2019-03-21 14:53:28 +01:00
Jan dbfa483374
add RocksDB options `--rocksdb.allow-fallocate` and `--rocksdb.limit-open-files-at-startup` (#8492) 2019-03-21 12:05:57 +01:00
Jan db7fcdce7a
don't run compact() on a collection after a truncate() was done in the same transaction (#8471)
running compact() in the same transaction will only increase the data size on disk due to
  RocksDB not being able to remove any documents physically due to the snapshot that is
  taken at transaction start.

  This change also exposes db.<collection>.compact() in the arangosh, in order to manually
  run a compaction on the data range of a collection should it be needed for maintenance.
2019-03-20 17:44:06 +01:00
Jan 1c54830310
don't attempt to remove non-existing WAL files, because such attempt will trigger unnecessary error log messages in the RocksDB library (#8476) 2019-03-20 17:02:34 +01:00
Wilfried Goesgens 68ce741b13 Bug fix 3.4/arrayindex unique update (#8422) 2019-03-14 18:13:05 +01:00
Jan 13148e661a simplify internal struct for edge index lookups (#8367) 2019-03-11 16:23:14 +01:00
Jan cd5c9edce1
various replication improvements (#8300) 2019-03-11 13:07:43 +01:00
Vasiliy e536f2ab1f issue 525.1: backport 3.4: ensure RocksDB CreateIndex/DropIndex WAL markers are properly written during recovery (#8279)
* issue 525.1: backport 3.4: ensure RocksDB CreateIndex/DropIndex WAL markers are properly writen during recovery

* backport: skip writing DropIndex marker in recovery
2019-03-01 15:57:42 +03:00
Jan 8e3fb5dfc7
Feature 3.4/improve replication speed (#8268) 2019-02-28 14:37:40 +01:00
Simon a52e6fa3d3 Sync Foxx Queues (#8254) 2019-02-25 17:16:26 +01:00
Jan fbc1e5b35f
use PutUntracked (#8126) 2019-02-13 16:04:27 +01:00
Simon 1c77bc37d6 Reduce timeout for write-lock (#8036) 2019-01-28 09:23:52 +01:00
Frank Celler 9477af198b big reformat 2018-12-26 00:57:05 +01:00
Dan Larkin-York 05d158a689 Fix issue with geo iterator reset. (#7838) 2018-12-23 00:41:37 +01:00
Jan 0574393d52
fixed issue #7757 (#7806) 2018-12-19 14:06:11 +01:00
Michael Hackstein ddd5226d13
Feature3.4/improve edgeindex covered (#7750)
* Allow the RocksDB edge index to return the already covered opposite vertex.

* Updated tests
2018-12-12 22:03:47 +01:00
Jan 2f48d03c19
speed up remove ops for RocksDB engine (#7638)
* speed up remove ops for RocksDB engine

* add more tests and improve queries a bit for single remote AQL operations
2018-12-06 17:48:42 +01:00
Jan 677522991e
Feature/internal 3306 (#7683) (#7688) 2018-12-06 17:46:58 +01:00
Simon 4132870e49 Document RocksDB exclusive option (#7517) (#7538) 2018-11-29 18:42:43 +01:00
Jan b708edd059
fix assertion (#7526) 2018-11-29 15:43:06 +01:00
Simon 933ca8a775 Bug fix/restore index refactor (#7470) (#7491)
(cherry picked from commit d0efd95a37)
2018-11-29 14:08:29 +01:00
Jan f1086bac4f
added option `--rocksdb.enforce-block-cache-size-limit` (#7508) 2018-11-28 20:40:20 +01:00
Jan 2d4b38600f
prevent operations from overtaking each other (#7498) 2018-11-28 14:30:54 +01:00
Simon 8ddb9a063b Micro-Optimize AQL CXX calls (#7486) 2018-11-27 20:22:18 +01:00
Jan ffc823e1c8
Bug fix 3.4/backport optimizations (#7434) 2018-11-26 19:16:05 +01:00
Michael Hackstein 8098bb4eed
Bug fix 3.4/syncing of followers (#7377)
* Added some DEBUG output for replication rest handler

* Some more debug logging.

* Increased the priority of the ReplicationHandler. This way we will not get stuck with locks that cannot be canceled. Also cancel the lock on the correct database.

* Added extensive log output for replication thins

* Added tombstones to RestReplicationHandler. In a very unlikely case the cancel of a lock can be executed BEFORE the code that actually registers the lock, in this case we will now write a tombstone and do not lock.

* Revert "Added extensive log output for replication thins"

This reverts commit 6d4e37ea1e59e3b3457336019cc7dbc4c979504d.

* Added extensive log output for replication things, now in ERR level instead of MAINTAINER only

* Now actually use hours for synchronization

* React to errors under soft lock if they show up.

* Added a retry loop to increase the read-lock timer.

* Added more timeing output in RocksDB collection internals to figure out why the followers are dropped

* Tweaked RocksDB options

* Revert "Tweaked RocksDB options"

This reverts commit 2bf9c43280beda4792c47d079387fe5154cdd896.

* Removed debug output

* Applied all requested changes by goedderz

* Deleted unused variable
2018-11-23 16:08:27 +01:00