1
0
Fork 0
Commit Graph

16577 Commits

Author SHA1 Message Date
Max Neunhöffer 42fd0825ab
Fix timeouts for write operations from coordinator to leader. (#7081)
* Improve logging on coordinator when doing `arangorestore`.

* Return more error information in `mergeResults`.

* Longer timeout for communication coordinator -> leader for writes.

This is taking into account possible write stops from followers needed
to get in sync.

* Fix compilation.

* Get rid of numbers in exception log messages.

* Fix compilation.

* Fix indentation.
2018-10-31 14:39:48 +01:00
Andrey Abramov 8225003861
[3.4] arangosearch speedup removals (#7158)
* Feature/arangosearch speedup removals (#7134)

* speedup document removals and optimize data model

* fix invalid constexpr

* reduce number of heap allocations for removals (#7157)
2018-10-31 15:54:16 +03:00
Jan aa385c2bbc
increase the maximum allowed number of collections in an AQL query (#7155) 2018-10-31 10:08:32 +01:00
Vasiliy 2458705607 issue 496.2: backport 3.4: allow customization of segment size limits on arangosearch view creation, minor code cleanup (#7141)
* issue 496.2: backport 3.4: allow customization of segmentsize lmts on arangosearch view creation, minor code clanup

* backport: fix incorrect condition
2018-10-30 23:41:15 +03:00
Simon f2602cb96f Remove unused bindings (#7142) 2018-10-30 19:41:45 +01:00
Matthew Von-Maszewski 87c4d99eea Bugfix 3.4: Allow libcurl time to retry DNS request (#7126)
* open up connect limit to allow one DNS retry

* add CHANGELOG entry for dns retry fix

* update warning message wording

* Add lock line that was missed in recent scheduler merge
2018-10-30 18:39:48 +01:00
Michael Hackstein b280142efa
Revert "fixes some misbehaviour within the coordinator agency callbacks (#7104)" (#7150)
This reverts commit 9ee7a0e955.
2018-10-30 16:48:56 +01:00
Heiko 9ee7a0e955 fixes some misbehaviour within the coordinator agency callbacks (#7104)
* fixes some misbehaviour within the coordinator agency callbacks

* changelog
2018-10-30 16:47:37 +01:00
Jan f7fd02695c
fix path to node_modules after copying files (#7087) 2018-10-30 13:50:42 +01:00
Simon c073b9dbbe Make ensureIndexOnCoordinator more robust (#7110) (#7130) 2018-10-30 11:25:06 +01:00
Simon 9271a11441 RocksDB replication thread safety (#7088) (#7131) 2018-10-30 11:24:17 +01:00
Vasiliy e6a6025818 backport: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion (#7106)
* backport: switch scope of responsibility between a TRI_vocbase_t and a LogicalView in respect to view creation/deletion

* backport: ensure arangosearch links get exported in the dump

* backport: ensure view is created during restore on the coordinator

* Updates for ArangoSearch DDL tests, IResearchView unregistration and known issues

* Add fix for internal issue 483
2018-10-30 12:50:29 +03:00
Simon c644adc7da Fix undefined behaviour (#7109) 2018-10-29 18:59:51 +01:00
Jan 889cee0dae
speed up query string parsing (#7116) 2018-10-29 14:42:39 +01:00
Tobias Gödderz e9388ab710 [3.4] Stop curl from trying to POST stdin (#7097)
* Stop libcurl from trying to POST stdin

* Stop relocking every iteration in wait

* Remove unimplemented function

* Restrict setting of empty POSTFIELDS to POST requests

* Revert locking change
2018-10-29 14:41:23 +01:00
Michael Hackstein e05880895a
Bug fix 3.4/shorter foot in door (#7084)
* Implement `syncCollectionCatchup` in DatabaseTailingSyncer.

First stab, might not even compile.

* Fixed a typo.

* Fix a typo and a compilation problem.

* Further compilation fix.

* Implement two stage catchup.

* Two small corrections.

* Unified error messages in Synchronize shard job.

* Improved a code comment.

* Fixed autocasting bool->double and double->bool issue. That is truely one of the best features ever invented... </irony>

* Renamed doHardLock => toSoftLockOnly and inverted default value

* Merged soft/hard foot logic with Transaction splits

* Use scopeguards to cancel readlocks
2018-10-26 16:16:52 +02:00
Simon 78132bc2e5 Next try at truncate (#7090) (#7096) 2018-10-26 15:06:36 +02:00
Jan fac788bb89
fix nullptr access to usermanager object (#7094) 2018-10-26 12:59:00 +02:00
Max Neunhoeffer 015275a724
Emergency fix to compile on gcc 8. 2018-10-26 11:13:56 +02:00
Jan b0bff0a7da
potentially fix failing Windows catch test (#7080) 2018-10-26 10:11:02 +02:00
Max Neunhöffer 8564a08bbb
Try to fix timeout in drop collection. (#7058)
* Try to fix timeout in drop collection.
* Fix compilation.
2018-10-25 16:51:16 +02:00
Heiko e1480cfd11 Bug fix 3.4/agency loop wrong credentials (#7072)
* arangod now exits when used wrong credentials during the startup process

* changelog
2018-10-25 14:17:20 +02:00
Michael Hackstein 94a793fe61
Removed incorrect skipping of Batches in RocksDB Tailing syncer (#7021)
* Removed incorrect skipping of Batches in RocksDB Tailing syncer. This caused issues, whenever one transaction was spiltted.

* Added a test for Splitting a large transaction in RocksDB

* Reactivated skipping in RocksDB Wal Tailing (reverts initial fix)

* Actually include lastScannedTick in CollectionFinalize. Proper fix, kudos to @jsteemann.

* Fixed healFollower task in split-large-transaction test
2018-10-25 14:13:40 +02:00
Jan 6eeb9eab86
backport some replication debugging from devel (#7069) 2018-10-25 14:08:26 +02:00
Jan 2d0fce0fec
add option `--rocksdb.total-write-buffer-size` (#7024) 2018-10-25 13:12:27 +02:00
Jan b903f1f8ff
Bug fix 3.4/fix catch test issues (#7045) 2018-10-25 12:49:00 +02:00
jsteemann f0cc698872 try to fix "caught exception during statistics processing: Expecting Object" errors that may happen right after upgrading from 3.3 2018-10-25 11:24:17 +02:00
jsteemann 435c014a15 Merge branch '3.4' of https://github.com/arangodb/arangodb into 3.4 2018-10-25 00:00:00 +02:00
jsteemann 5e6a267296 remove unneeded string value 2018-10-24 23:59:51 +02:00
Simon e87b42a0c3 Silence tsan warnings (#7051) 2018-10-24 23:58:47 +02:00
Matthew Von-Maszewski a1af2e305f Bugfix 3.4: update Scheduler thread logic based upon testing (#7056) 2018-10-24 22:49:28 +02:00
Simon 6eb9e38b08 Better agency pool update (#7036) 2018-10-24 16:23:10 +02:00
Vasiliy 52e2c97693 backport missed changes (#7016) 2018-10-24 15:43:45 +03:00
Jan 613d9a3811
fix release-3.4 issue 109 (#7030) 2018-10-23 22:59:11 +02:00
Simon 3e5f90dcd3 Truncate index extimate fix (#7017) 2018-10-23 18:06:55 +02:00
Simon 8b19d40136 Properly compare velocypack objects in Agency operations (#6922) 2018-10-23 11:52:22 +02:00
Matthew Von-Maszewski 43016cf04f Bugfix 3.4: address concerns from prior scheduler PR (#7005) 2018-10-23 11:30:45 +02:00
Tobias Gödderz 183f9194f1 [3.4] Fixed optimize-traversals and added a regression test (#6975)
* Fixed optimize-traversals and added a regression test

* Updated CHANGELOG
2018-10-23 09:46:59 +02:00
Andrey Abramov dc98852dda
Bug fix 3.4/internal issue #2921 (#7008)
* issue 494: update iresearch to changeset 6ff909851c760c2111dca5074ab17d35114bee97 (20181022)

* issue 2921: make error message more detailed (#7004)

* issue 2921: make error message more detailed

* upgrade iresearch

# Conflicts:
#	arangod/RestHandler/RestViewHandler.cpp

* fix compilation

* and another fix
2018-10-23 02:41:25 +03:00
Jan 4e7f56a532
attempt to fix truncation (#7002) 2018-10-22 16:44:21 +02:00
Jan 169fb8edb7
do not copy node_modules directory on startup (#6946) 2018-10-22 16:43:26 +02:00
Jan 3d01c09ea2
Bug fix 3.4/fix array sorting (#6988) 2018-10-22 12:30:47 +02:00
jsteemann 2b86d9a0e4 Merge branch 'bug-fix-3.4/increase-setup-timeout' of https://github.com/arangodb/arangodb into 3.4 2018-10-22 09:43:33 +02:00
Andrey Abramov 2b46285b3b
Feature/backport arangosearch 3.4 (#6985)
* issue 485.1: reduce scope of lock in FlushFeature (#6943)

* issue 493.1: update iresearch to changeset 15f561dee5865ead83663ef056d7bbcc38636fb2 (#6947)

* issue 493.2: trigger termination of long-running consolidation on shutdown request

* Feature/update iresearch 2 (#6984)

* update iresearch sources

* another update

* update iresearch

* fix segfault in log message

* update iresearch

* update iresearch

* update iresearch

* remove noexcept

* improve logging

* update iresearch
2018-10-20 13:24:29 +03:00
jsteemann 6b971f50a3 increase query setup timeout 2018-10-19 17:41:09 +02:00
Jan 1002928b5f
fix https://github.com/arangodb/release-3.4/issues/99 (#6951) 2018-10-19 15:26:23 +02:00
Simon c0455e9c60 Add engine specific collection APIs (#6962) 2018-10-19 15:23:55 +02:00
Michael Hackstein 9599eb9b9f
Bug fix 3.4/sync replication allow soft and hard lock (#6864)
* First attempt to not block the thread that requires the EXCLUSIVE sync-up lock

* Fixed insertion of query into registry in rest replication handler.

* Removed unnecessary / false asserts as suggested in review. Fixed code comments.

* Replaced auto with a correct type as suggested in review

* Added a helper function to validate if a query is in use in the registry

* Fixed logic bug in usage of query registry

* Fixed compile issue

* Implemented optional 'doHardLock' parameter in the replication acquire read-lock call. A hard-lock guarntees to stop all writes, a soft-lock may not.

* Fixed compile issue

* Automaticly transfrom int -> bool in initializerlist sucks...

* Inverted boolen logic bug hidden due to int->bool beeing logically inverted.

* Today it seems that bools are too complicated for my brain.

* Removed failure point, didn't write a test for it, and it is hard to write it in the current test environment. Need to find a better solution in future

* Applied chenges required by @goedderz in review

* Renamed doHardLock => toSoftLockOnly and inverted default value
2018-10-19 14:11:34 +02:00
Michael Hackstein 875185e6c1
Bug fix 3.4/sync repl release thread (#6784)
* First attempt to not block the thread that requires the EXCLUSIVE sync-up lock

* Fixed insertion of query into registry in rest replication handler.

* Removed unnecessary / false asserts as suggested in review. Fixed code comments.

* Replaced auto with a correct type as suggested in review

* Added a helper function to validate if a query is in use in the registry

* Fixed logic bug in usage of query registry

* Fixed compile issue

* Automaticly transfrom int -> bool in initializerlist sucks...

* Inverted boolen logic bug hidden due to int->bool beeing logically inverted.

* Today it seems that bools are too complicated for my brain.

* Removed failure point, didn't write a test for it, and it is hard to write it in the current test environment. Need to find a better solution in future

* Applied chenges required by @goedderz in review
2018-10-19 13:48:22 +02:00
Lars Maier d7863b4583 Bug fix 3.4/cluster comm threads start stop (#6939)
* Start ClusterComm threads in `ClusterFeature::start`. Stop ClusterComm threads in `ClusterFeature::stop`.

* Do not free objects in `Scheduler::shutdown`. Let the `unique_ptr` do their job. Stop ClusterComm threads in `ClusterFeature::stop`, but free instance in `ClusterFeature::unprepare`.

* `io_context` may contains lambdas that hold `shared_ptr`s to `Tasks` the required a functional `VocBase` in their destructor.

* Clean up.
2018-10-19 13:12:51 +02:00