1
0
Fork 0
Commit Graph

3430 Commits

Author SHA1 Message Date
Max Neunhöffer 95ae2eeb11 Port latest shutdown hanger bug to 3.4. (#10122) 2019-10-09 16:34:16 +03:00
Max Neunhöffer d0d4d8d815 Fix a shutdown hanger because of a collection status lock. (#10034)
* Fix a shutdown hanger because of a collection status lock.

* Fix compilation.

* Fix logic.

* CHANGELOG:
2019-09-19 11:54:25 +03:00
Jan 36614efb52 * Harden database creation against spurious "duplicate name" errors (#9949)
that were caused by other parallel operations lazily creating required
system collections in the same database.
2019-09-11 13:03:16 +03:00
Tobias Gödderz 4ada35f20c [3.4] Bug fix 3.4/add shard id to replication client identifier (#9466)
* Bug fix/add shard id to replication client identifier (#9366)

* Fixed compile (but not linker) errors

* Backported ReplicationClientProgressTracker

* Fixed compile errors, fixed hash function

* No longer use SyncerId for real asynchronous replication

* Updated docu

* Try to fix compile error on windows

* Fixed a bug

* Removed old code

* Fixed CHANGELOG entry
2019-09-11 12:45:57 +03:00
Michael Hackstein b14259b55e
Fix missed callbacks race condition (#9183)
* If we miss a callback in CollectionCreation also test if we missed later callbacks.

* Updated changelog

* Fixed callback lockers

* Remove lockers vector alltogether, we are protected by mutex anyways

* Fixed include guard

* Do not recheck the Collection that has woken us up

* Fixed recursive lock gathering
2019-06-06 14:07:41 +02:00
Simon e1fdc04193 Bug fix 3.4/jobs indexes (#9099) 2019-05-27 11:43:05 +02:00
Jan e440a1c7d2
fix various small annoyances (#9078) 2019-05-23 17:37:34 +02:00
Wilfried Goesgens 8e0ebb00c6 Bugfix/backport fs changes (#9024) 2019-05-23 12:46:47 +02:00
Jan 6d0e2e58e7 fix VERSION file handling on upgrade (#9077) 2019-05-22 22:43:37 +03:00
Michael Hackstein 4d4c23c302
Bug fix 3.4/collection babies (#9033)
* Prepare API to create multiple collections in a single request to ClusterMethods to improve speedup

* Added counter on how many collections are successfully created

* Allow multi collection creation one level higher

* CollectionMethods now allow batch createion of Collections

* Improved array size assertions

* Now a graph is createad within a single roundtrip in the agency.

* Added new header files

* Insert collections in the AGENCY with TTL and a isBuilding flag, collections with this flag should not be visisible in the coordinator

* Added forgotten C++ file

* Fixed a rare race condition, and the failing IResearch Tests

* readded callback on DONE, otherwise lists are out of sync

* Fixed assertions to let mocked tests pass...

* Fixed community cluster
2019-05-21 08:41:12 +02:00
Lars Maier 3c9cba32ae Retry updating user collection. (#8999) 2019-05-14 17:39:00 +02:00
Jan 4ea195f6a2
less locking for ClusterSelectivityEstimates (#8891) 2019-05-06 13:23:33 +02:00
Jan 1b36a68742
fix misleading instruction in error message (#8821) 2019-04-26 11:40:01 +02:00
Jan a3c2e88fc9
preserve smart-join attribute in DC2DC as well (#8686) 2019-04-08 08:45:38 +02:00
Jan d29d65face
Bug fix 3.4/cleanup 31032019 (#8633) 2019-04-01 17:02:00 +02:00
Max Neunhöffer 54f84cab92 Performance tuning for many shards. (#8577) 2019-03-29 21:34:45 +01:00
KVS85 c88c4d1416 Remove USE_IRESEARCH definition and usage (#8612) 2019-03-28 17:22:11 +01:00
Simon 776c0c0f22 Fix edge index selectivity (#8499) 2019-03-22 05:18:34 +01:00
Jan 3f3f0c6fe3
Feature 3.4/ncc1701 (#8441) 2019-03-21 14:53:28 +01:00
Jan db7fcdce7a
don't run compact() on a collection after a truncate() was done in the same transaction (#8471)
running compact() in the same transaction will only increase the data size on disk due to
  RocksDB not being able to remove any documents physically due to the snapshot that is
  taken at transaction start.

  This change also exposes db.<collection>.compact() in the arangosh, in order to manually
  run a compaction on the data range of a collection should it be needed for maintenance.
2019-03-20 17:44:06 +01:00
Jan 8e3fb5dfc7
Feature 3.4/improve replication speed (#8268) 2019-02-28 14:37:40 +01:00
Jan 304948f30d
when creating a new database with an initial user, set the database p… (#8185) 2019-02-18 16:16:23 +01:00
Jan 4a1f25ed46
use JobGuard when querying users from DB in cluster (#8057)
* use JobGuard when querying users from DB in cluster

* fix test crashes
2019-01-30 12:00:50 +01:00
Matthew Von-Maszewski 474f0cde31 Bug fix 3.4/scheduler empty reformat (#7872)
* added check for empty scheduler

* removed log, old is 1 not 0

* require running in this thread

* test

* added isDirect to callback

* signature fixed

* added drain

* added allowDirectHandling

* disabled for testing

* Add ExecContextScope object to direct call.

* try alternate initialization of ExecContextScope

* remove ExecContextScope, no help.  try _fifoSize as part of direct decision.

* strand management to minimize reuse of same strand per listen socket

* blind attempt to address Jenkins shutdown lock up.  may remove quickly.

* add filename and line to existing error log message

* Adjust queueOperation() to stop accepting items once isStopping() becomes true.

* revert previous check-in to MMFilesCollectorThread.cpp

* big reformat

* fixed merge conflicts

* Add CHANGELOG entry.
2019-01-08 20:39:42 +01:00
Jan 9c099ba5da
multiplex REPLICATION-APPLIER-STATE files for RocksDB engine (#7897) 2019-01-08 14:26:09 +01:00
Frank Celler 9477af198b big reformat 2018-12-26 00:57:05 +01:00
Simon 1498c08084 fix restrictCollections parameter on database level replication (#7808) 2018-12-19 18:00:10 +01:00
Jan 3fa3170462
fix invalid handling of `_lastValue` in case of multiple coordinators (#7735) 2018-12-12 12:22:52 +01:00
jsteemann b64826065c fix LDAP tests 2018-12-10 15:57:21 +01:00
Tobias Gödderz a1b925c655 Added tests for parseVersion (#7676) 2018-12-10 12:47:20 +01:00
Jan 1a4a6e7d2b
minor fixes (#7691) 2018-12-07 16:22:32 +01:00
Jan b43b600a33
try again in case of a conflict when updating users (#7615) 2018-12-06 16:36:05 +01:00
Heiko 8d171b2c51 parse version fix (#7652) 2018-12-05 13:01:24 +01:00
jsteemann 0b9a8da7af fix segfault 2018-12-04 08:56:40 +01:00
Simon 933ca8a775 Bug fix/restore index refactor (#7470) (#7491)
(cherry picked from commit d0efd95a37)
2018-11-29 14:08:29 +01:00
Jan 2d4b38600f
prevent operations from overtaking each other (#7498) 2018-11-28 14:30:54 +01:00
Andrey Abramov 822e15e770
issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes (#7370) (#7451)
* issue 153: ensure views are dropped in Agency when database is dropped in cluster, minor fixes

* backport: add test to ensure views are dropped when database is dropped from plan, fix some issues in ClusterInfo

* optimize primary key lookups in ArangoSearch

* fix test

* Add JS tests

* temporary comment optimizations

# Conflicts:
#	arangod/Cluster/ClusterInfo.cpp
2018-11-26 00:33:58 +03:00
Wilfried Goesgens c50d346453 add alternative to ClusterInfo::getCollection() that doesn't throw (#7413)
* add alternative to ClusterInfo::getCollection() that doesn't throw (#7339)

* handle more potential nullptrs, fix try/catch scope
2018-11-23 11:15:25 +01:00
Simon ebad3c3c83 Fix restore of views, add --view option (#7425) (#7427)
(cherry picked from commit c584527d79)
2018-11-23 09:11:33 +01:00
Simon ef239cbe4e Make recovery more reliable (#7297) (#7367) 2018-11-21 16:51:38 +01:00
Jan d27c4cc113
Bug fix 3.4/aql speedup (#7378) 2018-11-20 16:08:16 +01:00
Tobias Gödderz 3d1c643e23 [3.4] MMFiles replication: get followers under lock (#7298)
* Fix resign order

* Fixed a typo

* Get followers later, add TODOs

* Added a callback parameter to collection insert methods

* Get followers under the lock if necessary

* Extracted the replication of inserts into a separate method

* Move shortcut into replicate method

* Added callbacks for remove, replace and update

* Added missing overrides

* Extracted replication code from modifyLocal and removeLocal

* Update followers under lock also during replace, update, remove

* Fix changes from the last commit for update/replace

* Update comments, add asserts

* Remove changes for document-level locks that will be done in another PR

* Unify replication

* Adapt log messages to the devel ones

* Move common methods from its descendants to TransactionCollection, fix Mock on the way

* More IResearch test / mock fixes

* Relax asserts for nested transactions

* Reformat

* Fix non-babies remove and modify replication
2018-11-19 13:03:07 +01:00
Dan Larkin-York 4210d9eab6 [3.4] Updates to collection versioning. (#7260) 2018-11-19 09:45:09 +01:00
Simon 0d955554f2 Use shared_ptr for LogicalCollection (#7220) (#7244) 2018-11-07 10:43:08 +01:00
Tobias Gödderz a194326688 Restore /_api/view to return internal view names again (#7221) 2018-11-06 11:41:43 +01:00
Dan Larkin-York e5243f9254 [3.4] Upgrade old MMFiles collections for compatibility with ArangoSearch (#7133) 2018-11-06 11:12:54 +01:00
Vasiliy 1ba23cd39b issue 496.5: backport 3.4: minor API cleanup and error reportin enhancements, update iresearch to commit d69f7bd184e009da7bf0a478efd34a0c85b74291 (#7217)
* issue 496.5: backport 3.4: minor API cleanup and error reportin enhancements, update iresearch to commit d69f7bd184e009da7bf0a478efd34a0c85b74291

* add workaround for shell-collection-rocksdb-noncluster.js::testSystemSpecial test failure

* fix typo
2018-11-05 16:17:41 +03:00
Vasiliy d644561f1f issue 496.4.1: backport 3.4: move StorageEngine-specific flag out of the genric API and closer to the storage engine (#7213)
* issue 496.4.1: backport 3.4: move StorageEngine-specific flag out of the genric API and closer to the storage engine

* address merge issue
2018-11-04 16:52:54 +03:00
Simon 9c53d045be Server stream cursor (#7186) (#7210) 2018-11-03 20:17:52 +01:00
Vasiliy 850919178f issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca (#7167)
* issue 496.3: backport 3.4: move more coordinator-related logic out of TRI_vocbase_t, rename some arangosearch view configuration parameters, remove some consolidation policies, update iresearch to revision 6fd9760d81b136f769e277ea5b8f53996ed7a1ca

* address merge issue

* backport: remove code causing nullptr access

* invalidate payload for each field in FieldIterator before setting a value

* address compilation issues
2018-11-01 23:12:39 +03:00