1
0
Fork 0
Commit Graph

1027 Commits

Author SHA1 Message Date
Kaveh Vahedipour 627f344266 fixed a bug, where when servers failed, when also agency leadership c… (#3189)
* fixed a bug, where when servers failed, when also agency leadership changes

* redid entire design of checkDBServers/checkCoordinators.

* comparison in supervision must be between oldPersisted and newHealth

* UI stuff

* UI stuff

* FailedServer test needed adjustment

* Hopefully final round

* fixed supervision failure detection

* FailedServer tests back to origin devel

* oldNot documented among preconditions in Agency HTTP API docs

* changed only look for status updated

* non action line in api-cluster
2017-09-07 16:10:23 +02:00
Simon Grätzer 88d01b89b5 Optimizations for Caches and Graph Traversals (#3169) 2017-08-31 18:33:10 +02:00
Wilfried Goesgens c662dfc863 Cleanup after each testrun (#3109)
* Cleanup after each testrun

 - add a success testsuite next to the fail testsuite
 - create temporary directories in the fail & success testsuites
 - add a function to cleanup the last unshifted directory
 - don't say we're crashed when exiting with the help message

* Specify temp path for SUT so its files will be removed after cleanup.

 - cleanup
 - don't use getTempFile(), it will create another subdirectory that we don't clean up afterwards...

* Fix temp path usage

 - creating a 'bundles' directory wherein we would keep our temporary bundle files would collide if we'd clean it up.
 - create 'bundles-tmpxxxx' instead so its individual to us and we can remove it when done without problems.

* properly create & pass in a temporary directory - as we now require this.

* Remove intermediate directory recursive - for some unknown reason there may be temp files created.

* we need to unify tempfilenames here too.

* use individual suite names

* use the standart performTests to run the backup tests - so we have the proper directory and server handling from the infrastructure.

* fix temporary directory handling in the recovery tests.

* script to build debugging debian packages

* Improve test shutdown

 - handle a set of options globally per testsuite, so they don't need to clone them inside.
 - properly cleanup the slave instance of the replication tests after each run.
 - The per testsuite options vector will fix the behaviour that after one failed testsuite
   all other suites won't be cleaned up anymore.

* don't call the overal cleanup if anything failed.

* fix cleaning up of directories.

* cleanup, fix directory creation / deletion / dummy creation.

* cleanup, fix directory creation / deletion / dummy creation.

* fix tempdir handling for the recovery tests
2017-08-30 10:48:24 +02:00
Jan 14389e856d remove obsolete, dysfunctional endpoints (#3135)
according to the manual and CHANGELOG we should have removed these endpoints in 3.0 already...
2017-08-25 14:00:34 +02:00
Jan a212f45a86 Bug fix/issues 2308 (#3117)
* remove API docs for endpoints that were deleted in 3.0

* remove unused variable

* set all scalar values in the ctor, so check tools do not complain

* move Result objects

* prevent potential nullptr access

* remove ambiguous boolean parameter with no clear meaning

* make code check tools happy

* don't allow copying cache Findings, allow moving Results

* the debug functionality for counting RocksDB key ranges was broken

this produced sporadic test failures

* remove superfluous iostream include

* fix range checks

* don't leak if an error happens during database removal

* try to simplify Result a bit

* try to deletion checks a bit more robust
2017-08-24 14:47:22 +02:00
Kaveh Vahedipour 9cad75e4e8 Feature/cluster id and extended health (#3073)
* added unique id to cluster, added access to Health

* added agents to health api

* added agents to health api

* added agents to health api

* transaction information for api

* agents listed like other servers

* missing line through merge conflict

* fixed git merge glitch
2017-08-18 11:36:53 +02:00
Kaveh Vahedipour 1d1e0f5a50 Feature/cluster id and extended health (#3046)
* added unique id to cluster, added access to Health

* added agents to health api

* added agents to health api

* added agents to health api

* transaction information for api

* agents listed like other servers

* missing line through merge conflict
2017-08-18 11:13:23 +02:00
Mark 39d5cc9aac Fix foxx github url (#3042) 2017-08-17 21:30:20 +02:00
Jan e6ba5713ca fixed issue #2943 (#2945) 2017-08-04 13:37:35 +02:00
Kaveh Vahedipour 0b6d6d9287 Fixed distributeShardsLike bug in creating collections. numberOfShard… (#2895) 2017-08-03 19:38:16 +02:00
Dan Larkin 5f772b09a7 Converted rest handler for explain from JS to C++. (#2907) 2017-08-01 22:10:39 +02:00
Dan Larkin 4cc46f9b96 Converted a portion of the admin routing API from JS to C++ (#2919)
* Added a partial C++ implementation for admin routing API.

* Finished C++ implementation for admin routing API.
2017-08-01 17:14:08 +02:00
Dan Larkin 750fc96ab4 Converted endpoint handler from JS to C++ (#2905)
* Added native C++ rest handler for endpoints.

* Added test of rest endpoint interface and removed JS handler.
2017-08-01 09:53:04 +02:00
Jan 5e1813c5d6 fixed invalid object access, added a test (#2862) 2017-07-25 22:26:51 +02:00
Frank Celler a692577f5b Feature/auth context (#2815) 2017-07-16 09:39:03 +02:00
Kaveh Vahedipour 231a360b3b fixes for secondaries 2017-07-11 14:05:51 +02:00
Frank Celler bbe7484521 Feature/auth context (#2704)
* added read-only users
2017-07-02 23:15:57 +02:00
Frank Celler 2807ef559c Feature/move shard fix (#2626)
Major overhaul of handling of synchronous replication.
2017-06-26 16:55:01 +02:00
Simon Grätzer 492d832695 Refactored /_api/index and /_api/database (#2582)
* working documents rest handler

* fixed cluster tests

* Consolidating database APIs

* clang-format

* Fixing issue with user creation through db._createDatabase

* replaced and refactored api-index and index api

* fixed cluster

* renaming some files

* added user methods

* removed files intended for later

* Fixed CC build

* Fixed method signature

* Fixing shell_server, shell_client tests
2017-06-19 23:47:40 +02:00
Michael Hackstein 9edb884bc8 Feature/planning issue 188 (#2547)
* add warmup documentation - #188

* warn when relinking build directory

* add warmup documentation - #188

* warn when relinking build directory

* Renamed warmup to loadIndexesInMemory which is a better name for the current implementation of this feature.

* Adapted WebUI to state 'load indexes in memory' instead of 'warmup'

* Added loadIndexesInMemory documentation.

* Renamed loadIndexesInMemory => loadIndexesIntoMemory
2017-06-12 18:54:45 +02:00
Michael Hackstein b9d2faa7cc Added warmup function for indexes.
Squashed commit of the following:

commit bc0472d212b2efef0d7b1b8a36f2b43e8432ba86
Merge: eb47631 5f87674
Author: Michael Hackstein <michael@arangodb.com>
Date:   Mon May 29 09:39:31 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit eb476310b0ca6165be10b37b960933886c2757f5
Merge: d725f21 32149d2
Author: Michael Hackstein <michael@arangodb.com>
Date:   Mon May 29 09:00:41 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit d725f21f7d61f7c79ba31fc0338881e35f4d8f48
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 15:53:23 2017 +0200

    Activated collection warmup in Cluster Mode. Added a test for collection warmup (SingleServerOnly)

commit 132bf4f9565b0dcf4ec9f84e93897b482a67ce7f
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 12:46:20 2017 +0200

    Implemented client-side warmup. It can now be triggered via http and arangosh

commit 78ea449dff86118814a2f87bdb59dc16544d92b6
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:25:40 2017 +0200

    Fixed assertion.

commit dae80f6277dde1a52eadda506858cc36e235bd55
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:08:46 2017 +0200

    Improved the CuckooIndexEstimator computeEstimate function. It is now much better on collections with many different values

commit 7abf57876511ba369d7a577e1995d4575e98c7c8
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:06:43 2017 +0200

    Edge index warmup will now first check if a document is stored and if not will insert it. Furthermore it resizes the cache with an estimate of how many documents will be most likely inserted

commit 890d8ad4cdfd155249f060fedd5c798b9531d556
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:04:47 2017 +0200

    Adjusted thresholds in transactional cache. Wastly increased the amount of tries to get the lock. Lowered the fill-grade boundaries

commit 60972ab7151a3acb78e1aae4149de11d0da7aceb
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 10:45:38 2017 +0200

    Added new Logtpopic CACHE that should be used to log important information regarding caches, like debug ouput on evictions / resizing, or memory-pressure resizing going on

commit 2dfacb9aef6e3fde169032514baca386786d059c
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 10:44:21 2017 +0200

    Fixed an assertion in index iterator. It expected _from/_to to be cached but we modified to cache entire document

commit f05beccef65853c30eda1859a39c28ea2295bc71
Merge: 13c6abf 5c46430
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 07:56:58 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit 13c6abfbc2ddb451a689011110411df68247435e
Author: Michael Hackstein <michael@arangodb.com>
Date:   Wed May 24 09:52:01 2017 +0200

    Added a getExtra feature for the edgeIndex. It now returns the complete edge as extra (temporary). Modified the EdgeCache to cache token and edge document (temporary). Added a warmup Function to collections that is used to warmup the index caches on demand.
2017-05-29 09:40:58 +02:00
Jan Christoph Uhde 02da6fc4ca fix getIndex(withStats) for arangosh 2017-05-17 13:50:03 +02:00
Alan Plum dfbc5aafe9
Correctly expose errors in old Foxx API 2017-05-17 13:07:20 +02:00
Alan Plum 5d017d733c Improve Foxx cluster resilience (#2479)
* Improve Foxx cluster resilience

Fixes #2083
Fixes #2384
Fixes #2408
Addresses #1892

* Port old Foxx API

* Implement single-file services

* Add console.errorStack/warnStack/infoStack helpers

* Simplify serviceInfo validation

* Extract github/upload logic into Aardvark and old FM API
* Move generator logic into Aardvark
* Move zip/js buffer logic into FM core

* Add Foxxmanager tests

* Send empty response when no README

* Disambiguate script arg format

Historically we allow passing an array of positional arguments or an arbitrary first argument.
This is surprising behaviour, so we should just always treat the value as a first argument.

* Rebuild bundle in development mode

* Nicer HTTP docs formatting

* Create Foxx HTTP docs

* Simplify service upload handling

* Remove inline swagger docs

* Implement public download route

* Consistency

* Rebuild aardvark

* Move bundle route into /_api/foxx/_local

* Rebuild Swagger API docs

* Add changes to CHANGELOG

* More docs
2017-05-16 17:41:29 +02:00
Andreas Streichardt 7f8ff26f41 Fix jslint 2017-05-11 15:34:56 +02:00
Andreas Streichardt 9ec902ace8 Allow removing dbnodes 2017-05-11 15:18:29 +02:00
hkernbach d7bfe4dfc7 Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-10 14:26:45 +02:00
hkernbach 38a3bab42e added api cluster api routes 2017-05-10 14:26:26 +02:00
Andreas Streichardt 23911d66d0 Finally fix the error where suddenly an array of dbservers are being called 2017-05-10 12:10:09 +02:00
Max Neunhoeffer ed13ee7973 Merge branch 'devel' of ssh://github.com/ArangoDB/ArangoDB into devel 2017-04-26 10:10:06 +02:00
Max Neunhoeffer bf2e5f30ca Port 3.1 fixes to devel, shortName translation. 2017-04-26 10:02:14 +02:00
Max Neunhoeffer bf082b8e2c Port 3.1 fixes to devel, <coll>.properties() method. 2017-04-26 10:01:41 +02:00
Andreas Streichardt dad5a1429e Add waitForSyncReplication as a _create() option 2017-04-26 09:57:40 +02:00
Kaveh Vahedipour aefe90f89b distributeShardsLike port from 3.1 app.js 2017-04-25 16:56:51 +02:00
Kaveh Vahedipour 6e7843897b distributeShardsLike port from 3.1 app.js 2017-04-25 16:55:40 +02:00
Michael Hackstein d49e22f691 HTTP collection API now finally exposes distributeShardsLike 2017-04-25 15:08:14 +02:00
jsteemann 42aefaa8bf fixed require 2017-03-16 15:19:41 +01:00
Simon Grätzer d909c415aa Fixing jslint in pretzel 2017-03-15 16:14:13 +01:00
Simon Grätzer 1c5c616875 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-15 14:12:18 +01:00
Max Neunhoeffer c8a205b1aa New /_api/cluster/endpoints.
Also fix documentation (and deprecate) /_api/endpoint.
2017-03-15 13:33:50 +01:00
Simon Grätzer 529cb4ae85 Integer ID for testing 2017-03-15 10:20:48 +01:00
Simon Grätzer 67066c64ad Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-08 18:20:44 +01:00
jsteemann 3ed19e291d added "shardIds" option for AQL queries to restrict queries to specific shards 2017-03-08 15:07:10 +01:00
Simon Grätzer dfd3cc3869 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangosh/Import/ImportHelper.cpp
2017-03-04 02:08:27 +01:00
jsteemann 3a39921147 fixed documentation and added tests for grants API 2017-03-03 12:33:13 +01:00
jsteemann 4baff0e2d9 issue #2348 2017-03-03 10:50:13 +01:00
Simon Grätzer 27c617fe10 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	3rdParty/V8/v8
#	arangod/Transaction/Methods.h
#	arangod/Utils/UserTransaction.h
#	arangod/V8Server/v8-collection.cpp
2017-03-01 14:52:35 +01:00
jsteemann 107620708c remove now useless decodeURIComponent calls 2017-02-14 11:29:08 +01:00
Andreas Streichardt e345415879 Allow removing dbservers which are no longer in use 2017-02-13 17:23:39 +01:00
Andreas Streichardt 1b92c8e46b Allow removing dbservers 2017-02-13 17:23:39 +01:00
jsteemann 5a1fe3a341 jslint 2017-02-13 14:35:14 +01:00
Andreas Streichardt 1bb8f97773 Fix secondaries 2017-02-13 14:00:19 +01:00
jsteemann 8b273b5eaf Merge branch 'devel' of https://github.com/arangodb/arangodb into engine-api 2017-02-13 08:37:41 +01:00
Andreas Streichardt cf39ddd39a Fix jslint 2017-02-10 19:43:04 +01:00
Andreas Streichardt bc1df86ddd remove lock queries 2017-02-10 19:34:29 +01:00
Simon Grätzer edab268572 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/Aql/FunctionDefinitions.cpp
#	arangod/Aql/Functions.h
#	arangod/Utils/ExplicitTransaction.h
2017-02-10 15:21:24 +01:00
jsteemann 8ea56170a9 fix API for big ids 2017-02-09 17:30:07 +01:00
jsteemann e83d554947 fix index API for big ids 2017-02-09 16:55:09 +01:00
Andreas Streichardt f1da0c54f6 jslint 2017-02-08 15:07:47 +01:00
Andreas Streichardt edd27e7eff more remove checks 2017-02-08 15:07:47 +01:00
Andreas Streichardt ad1c7e7c13 oh jslint 2017-02-08 10:49:36 +01:00
Andreas Streichardt 2e3026db91 Make it possible to remove failed coordinators 2017-02-08 10:26:13 +01:00
Simon Grätzer 64343cd579 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	scripts/startLocalCluster.sh
2017-01-27 15:58:22 +01:00
Alan Plum c268b2db91
Keep stacktraces out of error messages
They are already reported much more consistently via 'cause' so methods logging them should exploit that instead.
2017-01-27 01:57:29 +01:00
Simon Grätzer dd14b7b2dd Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-20 15:56:11 +01:00
Kaveh Vahedipour d2760f4ef1 pushing avoidServers property 2017-01-20 15:15:03 +01:00
Simon Grätzer d857f01d6a Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-11 11:29:54 +01:00
hkernbach 4ae274fbd3 fixed cluster parsing issue when node information is not available 2017-01-10 17:07:51 +01:00
Simon Grätzer 20d32d05b2 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/VocBase/LogicalCollection.cpp
2017-01-09 13:34:37 +01:00
Andreas Streichardt 975e7a65b2 Fix cluster internal requests in authentication enabled cluster 2017-01-05 16:20:15 +01:00
Simon Grätzer e4951835aa Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-14 10:40:03 +01:00
jsteemann 4d76ef962b added count(details = true) for sharded collections 2016-12-13 16:03:49 +01:00
Simon Grätzer 0689ccaabb fixed some stuff, stopping still not working 2016-12-05 01:18:05 +01:00
Simon Grätzer 34714f8743 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-01 14:11:14 +01:00
Kaveh Vahedipour 805f894368 fixed faulty output when primary db server from changeSecondary api could not be found 2016-11-30 11:27:54 +01:00
Simon Grätzer cbaca25ba1 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-11-22 15:15:33 +01:00
Andreas Streichardt 2abc46f3e6 fix shardview...no more endless loops during shard rebalancing...also
fix error management when trying to reach dbservers
2016-11-21 17:47:06 +01:00
Simon Grätzer e4bc60a755 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-11-21 17:44:12 +01:00
jsteemann aa5bd85b4f fix log message 2016-11-21 14:06:10 +01:00
jsteemann 63f0b53db5 removed useless log message 2016-11-21 14:04:16 +01:00
Simon Grätzer c97a0b825c Runtime Statistics, fix in javascript 2016-11-16 11:09:09 +01:00
Simon Grätzer 84ca321fe5 Fixed javascript API 2016-11-15 23:19:44 +01:00
Simon Grätzer 4b3a5a414e More js APIs 2016-11-15 21:19:36 +01:00
Simon Grätzer 5b08879209 Added pregel arangosh code 2016-11-15 18:14:35 +01:00
hkernbach 23e15889c7 fixed shardDistribution info route 2016-10-25 13:40:28 +02:00
Alan Plum 245819ea9c
Add Foxx HTTP API 2016-10-20 15:09:36 +02:00
Alan Plum 6aaa55f9dc
app -> service 2016-10-20 15:08:18 +02:00
Frank Celler d22408f027 allow users to get information about themselves 2016-10-14 11:31:10 +02:00
Kaveh Vahedipour 72bf15c118 Fixed moveShard to do distributeShardsLike in start instead of create 2016-10-06 15:32:41 +02:00
Kaveh Vahedipour ce8c1a0cac revisiting all supervision jobs 2016-10-05 17:16:02 +02:00
Kaveh Vahedipour 595fc9b84e moveShard with distributeShardsLike 2016-10-04 11:41:26 +02:00
Frank Celler f83f6a7114 more authentication events, fixed changePassword 2016-10-03 19:54:54 +02:00
Kaveh Vahedipour ef551f1b8b shell handles the smart graph parameters for collection creation 2016-09-29 10:11:49 +02:00
hkernbach c471f643a4 added functionality to see the movement status of a shard 2016-09-28 15:52:11 +02:00
jsteemann 7ae36773ec moved implementation of `/_admin/wal` REST handlers to C++ 2016-09-07 13:48:52 +02:00
jsteemann 6ddf8bab54 Merge branch 'devel' of https://github.com/arangodb/arangodb into generic-col-types 2016-09-06 11:22:14 +02:00
Jan Steemann af149e8b7b fix deletion of users/permissions 2016-09-05 15:13:08 +02:00
jsteemann 396ab41736 allow dropping system collections in some rare cases 2016-08-25 12:47:06 +02:00
Andreas Streichardt 46817601e4 Remove obsolete actions (cluster 3.0 made them obsolete) 2016-07-28 18:46:37 +02:00
Andreas Streichardt 6ee1f6d14a Reformat code 2016-06-30 16:57:17 +02:00