1
0
Fork 0
Commit Graph

14195 Commits

Author SHA1 Message Date
Simon Grätzer 885ea3dd5f Remove attribute option for arangoimp (#3141)
* Adding a remove attribute option to arangoimp (only for csv)

* Adding documentation

* Fixed log statement

* Update CHANGELOG
2017-08-30 10:45:02 +02:00
Kaveh Vahedipour 00650e6a3f Bug fix/agency mt fixes (#3158)
* added debugging methods

* try to fix invalid access in case of error

* remove unused members

* bugfixes and comments

* all agency fixes in

* merge bug

* partially unguarded Agent::lead fixed

* all agency fixes in

* added nrBlocked to thread startup eval

* added nrBlocked to thread startup eval

* recombination of cases in State::get

* some maps replaced with unordered_maps

* optimized maps some
2017-08-30 10:43:51 +02:00
Jan c29a2745d2 Bug fix/fixes 2808 (#3156)
* fixed jslint warnings

* fix undefined behavior

* move check into if, so check tools do not complain
2017-08-28 15:16:41 +02:00
Wilfried Goesgens d0f159e848 Don't use global static variables as collection caches - this may cau… (#3150)
* Don't use global static variables as collection caches - this may cause troubles.

* cleanup: remove old cluster kickstarter UI remaints.

* cleanup - remove references to long gone tests
2017-08-28 15:04:05 +02:00
Michael Hackstein 0f1b6e32eb Bug fix/issue 3106 orphans in general graph (#3147)
* Added a test-case for #3106

* Added a fix for #3106
2017-08-28 15:02:15 +02:00
Mark d611414682 Fix HTTP Foxx API Json parsing (#3129) 2017-08-28 14:55:13 +02:00
Michael Hackstein 4674db78e1 Bug fix/foxx queue auth (devel) (#3122)
* Add Foxx queue authentication test

* Fixed runAsUser in Foxx queues. In the successful case there was always a silent error thrown...
2017-08-28 14:49:52 +02:00
Heiko 696bd7357b fixed wrong ui cluster health information (#3151) 2017-08-28 14:44:32 +02:00
Jan 14389e856d remove obsolete, dysfunctional endpoints (#3135)
according to the manual and CHANGELOG we should have removed these endpoints in 3.0 already...
2017-08-25 14:00:34 +02:00
Frank Celler 6d08d4f4aa Bug fix/scheduler delete (#3077)
* removed delete call

* cleanup

* lower cpu activity of log thread too

* fix log messages

* do not enter threads into unordered_set, as it is unneeded

* do not compile in calls to disabled plan cache

* moved AQL regex cache from thread local variables to a class of its own

* more sensible thread creation and destruction
2017-08-25 12:00:17 +02:00
Wilfried Goesgens 0c2261445b use indices on our foxx queues queries; Migrate queries away from aqb… (#3101)
* use indices on our foxx queues queries; Migrate queries away from aqb; style guide cleanup.

* update CHANGELOG
2017-08-24 17:06:03 +02:00
Wilfried Goesgens 2a82cf8667 when running the client tests on an already running server we have to specify the server root directory. (#3102) 2017-08-24 17:05:51 +02:00
Mark 3f0026d016 Fix foxx queue test (#3119) 2017-08-24 14:48:20 +02:00
Jan a212f45a86 Bug fix/issues 2308 (#3117)
* remove API docs for endpoints that were deleted in 3.0

* remove unused variable

* set all scalar values in the ctor, so check tools do not complain

* move Result objects

* prevent potential nullptr access

* remove ambiguous boolean parameter with no clear meaning

* make code check tools happy

* don't allow copying cache Findings, allow moving Results

* the debug functionality for counting RocksDB key ranges was broken

this produced sporadic test failures

* remove superfluous iostream include

* fix range checks

* don't leak if an error happens during database removal

* try to simplify Result a bit

* try to deletion checks a bit more robust
2017-08-24 14:47:22 +02:00
Jan 5c5b5e548d Feature/unique vpack index lookup performance improvements (#3087)
* fixed issue #3075

* update the known issues document, as some issues have already been fixed

* speed up equality lookups in unique vpack indexes

* fixed wording
2017-08-24 14:39:09 +02:00
Frank Celler 4933eb4fea Revert "fixed return code"
This reverts commit 776ca8d406.
2017-08-23 14:57:32 +02:00
Frank Celler 776ca8d406 fixed return code 2017-08-23 14:19:24 +02:00
Jan 74f9f9d4fc use filename conventions so the test only gets executed where it should be xecuted (#3108) 2017-08-22 23:22:01 +02:00
Simon Grätzer a14ffcd26e Relaxing edge cache test asserts (#3103)
* fixing cache resizing bug

* reenabling test

* relaxing test asserts
2017-08-22 15:52:48 +02:00
Jan 39465193c2 fix replication (#3099) 2017-08-22 15:51:50 +02:00
Dan Larkin 84f11c223d Fixed issue with periodic syncing and WAL file retention. (#3098) 2017-08-22 15:51:12 +02:00
Frank Celler 536625a50a Bug fix/foxx queue registration (#3097)
* Fix Foxx queue registration

Multiple registration of the same queue was possible. The queue document in _queue was saved multiple times with the same key/id

* Add additional foxx queue test
2017-08-22 11:56:07 +02:00
Jan Christoph Uhde df76bbc690 Bug fix/planning issue 514 replication api (#3021)
* add "cluster selectivity estimates" to CHANGELOG

* add some documentation to RocksDBRestReplicationHandler

* fix building with relative paths

* add some more doc

* add some tests for the replication api

* fix RocksDBRestReplicationHandler and add tests

* update documentation

* remove obsolete parameter

* fix error message

* Implementing logger-first-tick, logger-tick-ranges. Fixing dump `chunkSize` documentation
2017-08-22 10:46:06 +02:00
Dan Larkin 5708fc8fab Added test to ensure RocksDB recovers keygen data outside WAL. (#3072) 2017-08-22 10:42:46 +02:00
Simon Grätzer b76b53d87a Fix edge cache behaviour (#3079)
* fixing cache resizing bug

* reenabling test
2017-08-22 10:40:52 +02:00
Mark 16f2788b6b Fix Foxx queue registration (#3089)
Multiple registration of the same queue was possible. The queue document in _queue was saved multiple times with the same key/id
2017-08-22 10:38:46 +02:00
Kaveh Vahedipour 15a87b2982 removed database loop around rebalancing of shards; thus rebalance shards now only affects current database (#3091)
This is UI only
2017-08-21 17:13:27 +02:00
Jan 47e29e6e1f Bug fix/issues 1806 (#3069)
* fix buffer overruns in linenoise for long input lines

* don't make historian repeatedly print the same error messages that nothing can be done about

* make the implementations of the logging operator<<s not throw exceptions, so that logging does throw exceptions as an unintended side effect

* update CHANGELOG

* improve error message

* don't copy strings, but pass them by const reference
2017-08-18 22:58:09 +02:00
Kaveh Vahedipour 9cad75e4e8 Feature/cluster id and extended health (#3073)
* added unique id to cluster, added access to Health

* added agents to health api

* added agents to health api

* added agents to health api

* transaction information for api

* agents listed like other servers

* missing line through merge conflict

* fixed git merge glitch
2017-08-18 11:36:53 +02:00
Kaveh Vahedipour 1d1e0f5a50 Feature/cluster id and extended health (#3046)
* added unique id to cluster, added access to Health

* added agents to health api

* added agents to health api

* added agents to health api

* transaction information for api

* agents listed like other servers

* missing line through merge conflict
2017-08-18 11:13:23 +02:00
m0ppers 0dfea58d54 Feature/remove manual zippery (#3036) 2017-08-17 23:30:27 +02:00
Mark 136faad9b8 Fix issue #3037: Foxx, internal server error when I try to add a new service (#3056) 2017-08-17 21:47:27 +02:00
Jan e612aad2a3 fixed issue #3044 (#3048) 2017-08-17 21:34:57 +02:00
Jan 19d872dcee fixed issue #3039 (#3045) 2017-08-17 21:33:20 +02:00
Mark 39d5cc9aac Fix foxx github url (#3042) 2017-08-17 21:30:20 +02:00
Simon Grätzer fadafa6384 Fixing engine stats in arangosh (#3038) 2017-08-17 21:26:06 +02:00
Jan 1d6b7abc80 fix and extend journal-related tests (#3043) 2017-08-16 17:39:56 +02:00
Jan 6180fcfdd1 Bug fix/prevent multiple journals (#3027)
* prevent multiple journals

* fix documentation

* remove _nrDesired, as it is not used anymore
2017-08-15 23:02:08 +02:00
Jan 79d76c89fb Bug fix/use count for checksum (#3033)
* Count as checksum

* Make readLockId optional as well so upgrades are possible

* fix option name in startup script

* fix some replication issues with RocksDB engine
2017-08-15 11:24:54 +02:00
Wilfried Goesgens 4187e179a3 fix documentation - add missing files. 2017-08-14 13:04:20 +02:00
Jan 8e4dac4fc4 fix fulltext index removal performance, simplified code (#3015)
* simplify index API a bit

* fix fulltext index removal performance, simplified code

* updated CHANGELOG

* fix hanging test

* try to fix shutdown problem

* improve fulltext query performance

* fixed duplicate var

* removed obsolete code

* fix some shutdown races

* do not call ensureIndex that often
2017-08-12 09:25:30 +02:00
Jan Christoph Uhde 0eaf4cabd9 Feature/js to cpp transaction handler (#2985)
* implement transaction handler in c++

* add fake request object

* move general code into extra file

* improve error messages for RestJobHandler

* support cancel operation for async jobs with RestTransactionHandler

* fix integration test and add some optional debugging output

* fix returning of context

* fix error type

* fix code in cluster test

* remove unused variable
2017-08-11 09:29:34 +02:00
Heiko a22fcd2d38 ui: fixed a bug when success event triggers twice in a modal (#2983) 2017-08-10 22:15:36 +02:00
Heiko ce96113d61 fixed the appearance of the documents filter (#2984) 2017-08-10 22:14:35 +02:00
Heiko 286db19df2 graph vertex collections not restricted to 10 anymore (#2987) 2017-08-10 22:13:45 +02:00
Heiko e06c85886e UI detection of JWT token in case of server restart or upgrade (#3001)
* UI detection of JWT token in case of server restart or upgrade

* added jwt verify check if response is unauthorized
2017-08-10 22:12:45 +02:00
Jan Christoph Uhde ab5f5f488d fix building with relative paths (#2979)
* fix building with relative paths

* fix locating of configuratin files
2017-08-10 09:41:15 +02:00
Jan e6c6c5acda Bug fix/pre release woes (#2988)
* fixed issue #2982

* updated CHANGELOG
2017-08-10 09:39:28 +02:00
Jan e8d6ff21d0 fix failing recovery test (called undefined function) (#2994) 2017-08-10 09:38:20 +02:00
Michael Hackstein 8b19d63ec7 Merge pull request #2809 from arangodb/bug-fix/trav-filter-optimizer-tests
Fixed Traverser Bug in edge-case where minDepth is lower than filter conditions depth.
2017-08-10 08:44:25 +02:00
Jan 40cbc5ebab Bug fix/fix issue 3011 (#3012) 2017-08-09 17:38:44 +02:00
mchacki 0b4374ead5 Fixed invalid optimisation for variables/references used in traversal 2017-08-09 17:01:18 +02:00
Jan 0238d651fb Bug fix/3.2.1 issues (#3009)
* fix documentation

* fix crash in explain
2017-08-09 16:49:24 +02:00
mchacki 3f5c97c8c0 Merge branch 'devel' of github.com:arangodb/arangodb into bug-fix/trav-filter-optimizer-tests 2017-08-09 14:58:52 +02:00
Michael Hackstein 7ab117f5f8 Bug fix/dump restore auth (#2917)
* Added a backup test suite. This suite is supposed to entirely drop an ArangoDB _system and restore it into a fresh one. This also includes system collections.

* Added more test cases for backup suite. Now tests several authorization/rights cenarios

* Fixed RestReplication Handlers to restore _user collections Properly.

* Updated Changelog

* Added special handling of _users in Restore for MMFiles as well.

* Added JWT secret for cluster execution of this test, also added JWT secret to shutdown call
2017-08-09 12:59:51 +02:00
Jan Christoph Uhde ae9e716423 remove debugging output (#2955) 2017-08-08 16:27:15 +02:00
Heiko 32836b04b7 Bug fix/ui moving documents (#2981)
* ui - added bind parameters to slow query history view

* also added bind params to running query view

* ui: fixed a bug when moving multiple documents was not possible
2017-08-08 16:08:29 +02:00
Manuel B 9c268ec815 aql char length null returns now 0 (#2973)
* aql char length null returns now 0

* Update CHANGELOG
2017-08-08 09:33:31 +02:00
Heiko ae00d3500a Feature/ui service single file upload (#2869)
* ui now supports single js file upload in addition to zip files

* changelog

* updated foxx service description
2017-08-08 09:25:20 +02:00
Simon Grätzer 8878729f8b Adding `db._engineStats` for arangosh 2017-08-07 17:00:15 +02:00
Michael Hackstein a885da6190 Added more test cases for associative filter conditions 2017-08-05 10:35:23 -06:00
Michael Hackstein 67e6b7d9b9 Merge branch 'devel' of github.com:arangodb/arangodb into bug-fix/trav-filter-optimizer-tests 2017-08-05 09:30:46 -06:00
Michael Hackstein 48bbc667f7 Added tests for optimization of mindepth. 2017-08-04 17:59:30 -05:00
Jan ce2425cade Bug fix/daily fixes (#2958)
* do not rely on non-existing feature "AQL"

using such feature makes the server throw two exceptions (which will be caught) on startup, but its silly for debugging

* use condition variable for signalling shutdown

* do not hard-code the log levels for recovery tests

this has taken so many developers so much of their time that it is about time to fix it

* ensure the 'unittests' script properly finds 'arangosh' and the build directory
2017-08-04 20:46:08 +02:00
Jan bfa1051345 Feature/slow queries log bind vars (#2954)
* add bind variables when logging slow queries, and make this configurable

* added bind variable tracking
2017-08-04 20:45:12 +02:00
Jan e6ba5713ca fixed issue #2943 (#2945) 2017-08-04 13:37:35 +02:00
Jan 40c5b94d68 Bug fix/nightly fixes (#2946)
* fix internal documentation (thanks @Simran-B)

* fixed issue #2810

* potential fix for issue #2939

* updated CHANGELOG

* updated CHANGELOG
2017-08-04 13:34:12 +02:00
Simon Grätzer fde091587e Fixing occasional foxx errors (#2953)
* fixing occasional foxx errors

* fixing jslint
2017-08-04 13:32:15 +02:00
Jan 52d5941897 fix potential deadlock errors in collector thread (#2933)
* fix potential deadlock errors in collector thread

* add test
2017-08-03 22:47:24 +02:00
Jan a10832d41e do not allow the creation of volatile collections in the RocksDB stor… (#2900)
* do not allow the creation of volatile collections in the RocksDB storage engine

* only create a volatile collection for mmfiles in test

* fix tests
2017-08-03 22:45:17 +02:00
Simon Grätzer 3f58a44e3b Fix cases where the root user has access to excluded collections (#2856) 2017-08-03 21:16:08 +02:00
Manuel B 9917a8d471 aql upper lower cpp (#2936)
* initial aql upper lower

* aql upper lower test for cpp and v8
2017-08-03 21:10:13 +02:00
Kaveh Vahedipour 0b6d6d9287 Fixed distributeShardsLike bug in creating collections. numberOfShard… (#2895) 2017-08-03 19:38:16 +02:00
Jan 80730cd5f4 fixed issue #2928 (#2934) 2017-08-03 13:39:01 +02:00
Dan Larkin 5f772b09a7 Converted rest handler for explain from JS to C++. (#2907) 2017-08-01 22:10:39 +02:00
Dan Larkin 4cc46f9b96 Converted a portion of the admin routing API from JS to C++ (#2919)
* Added a partial C++ implementation for admin routing API.

* Finished C++ implementation for admin routing API.
2017-08-01 17:14:08 +02:00
Jan 62f9231aa5 Bug fix/predictable results data modifcation multiple fors (#2921) 2017-08-01 17:08:35 +02:00
Manuel B f0a24218e3 Feature/cpp aql char length (#2883)
* redirect aql char_length to length

* aql function CHAR_LENGTH in C++, fixed test

* adding table

* fix crlf

* docu table

* remove alternative fact

* docu

* fix string length calculation for aql length
2017-08-01 15:39:25 +02:00
Jan Christoph Uhde ed8efe3566 Feature/issue 387 cluster index estimates (#2866) 2017-08-01 09:53:58 +02:00
Dan Larkin 750fc96ab4 Converted endpoint handler from JS to C++ (#2905)
* Added native C++ rest handler for endpoints.

* Added test of rest endpoint interface and removed JS handler.
2017-08-01 09:53:04 +02:00
mchacki 7d8b79b208 Merge branch 'devel' of github.com:arangodb/arangodb into bug-fix/trav-filter-optimizer-tests 2017-07-31 18:54:40 +02:00
Jan 6820ec3891 fixed issue #2868: cname missing from logger-follow results in rocksdb (#2901) 2017-07-28 18:52:30 +02:00
Frank Celler 8fa8bbe5fd Merge branch 'devel' of https://github.com/arangodb/arangodb into bug-fix/trav-filter-optimizer-tests 2017-07-28 15:20:55 +02:00
m0ppers 9a0bc716d0 Do not allow replication to create/drop collections (#2898)
In the cluster case the only one who is allowed to do this is the schmutz
2017-07-28 14:24:02 +02:00
Frank Celler 6613ecda72 Merge branch 'devel' of https://github.com/arangodb/arangodb into bug-fix/trav-filter-optimizer-tests 2017-07-28 09:30:26 +02:00
m0ppers 589ffd5c59 Feature/improve logging (#2881)
* Improve logging in various places

* Fix jslint
2017-07-28 09:23:18 +02:00
Manuel B fe8b9b70c4 Feature/planning 580 arangoexport with query (#2882)
* added query export capability

* test for export --query

* docu

* document export with query

* Update CHANGELOG
2017-07-28 08:41:53 +02:00
m0ppers 6fefe5ab31 In high concurrency situations double checking checksums is a must have (#2890) 2017-07-28 00:43:21 +02:00
Jan 56143bc186 fix issue #2879 (#2885) 2017-07-27 23:30:05 +02:00
Frank Celler 00a6cbab64 fixed jslint error messages 2017-07-27 16:01:45 +02:00
Simon Grätzer 9786b198c2 Allow pregel jobs to interrupt on shutdown (#2855) 2017-07-27 15:29:01 +02:00
Wilfried Goesgens 7e03187123 When a transaction aborts, add the error messages to the returned sta… (#2848)
* When a transaction aborts, add the error messages to the returned status to aid the development process (as suggested by @DeShadow)

* If we are an arangoerror log out the ArangoError code

* don't send the stacktraces via the 'net, but have better error messages anyway

* static is wrong here - we want to use it with per threads individual values now.

* restructure source just to have one stacktrace processing function.

* Pull array from javascript logging functions up to c++

* js_log now can handle an array of v8-strings, converts it to a vector of std::strings, feeds them one by one into logging for now.

* the stacktraces now don't do individual calls to js_log, but one with an array of log lines.
2017-07-27 12:01:30 +02:00
Heiko 14ec3dea17 allows now to edit default access level for collections in database _system for all users except the root user. (#2864) 2017-07-25 22:28:48 +02:00
Jan 5e1813c5d6 fixed invalid object access, added a test (#2862) 2017-07-25 22:26:51 +02:00
m0ppers 1addb727ed Fix frontend hiding replicationFactor in community version (#2851) 2017-07-25 22:19:49 +02:00
Heiko 1bb9265ee3 fixed general graph module when options attribute is missing (#2842) 2017-07-19 18:18:30 +02:00
Mark 3a59ea553b Add catch when propagateSelfHeal (#2839) 2017-07-19 17:03:52 +02:00
Heiko 56febfd721 Bug fix/from and to ui document view refs (#2834)
* general graph module and UI now supporting sharded and replicated graph

* fixed a bug when the _from and _to refs in the document view ui were not working for special characters

* CHANGELOG
2017-07-19 13:44:33 +02:00
Heiko b11fb4e084 fixed issue #2764 - adapted ui to api changes (#2836) 2017-07-19 13:43:54 +02:00
Heiko d5e85bf987 general graph module and UI now supporting sharded and replicated graph (#2825) 2017-07-19 12:49:04 +02:00
Simon Grätzer f50a36181d Various authentication related issues (#2824) 2017-07-18 22:22:09 +02:00
Heiko 4c6ede7395 fixed the create new document button in documents view (#2826) 2017-07-18 21:43:44 +02:00
Frank Celler 30708a59bf fixed spelling error (#2827) 2017-07-18 19:39:16 +02:00
Wilfried Goesgens 65c88e493e add generated examples 2017-07-17 18:33:50 +02:00
Frank Celler ba276467c0 cloned options (#2819) 2017-07-17 17:36:24 +02:00
Frank Celler a692577f5b Feature/auth context (#2815) 2017-07-16 09:39:03 +02:00
mchacki dd13944264 Added some test cases where filter optimization in Traverser could have yield wrong results. 2017-07-15 17:49:00 +02:00
Max Neunhöffer 442be8faad 60s timeout for syncCollectionFinalize. (#2805) 2017-07-14 23:14:04 +02:00
Manuel B df7051f2cb server / client side db._parse added (#2789) 2017-07-14 14:31:51 +02:00
Frank Celler a5a25754ed Feature/reduce extraction to projection (#2792)
* reduce extractions to projections

* recycle string buffers in SocketTask

* micro optimizations for mmfiles indexes

* added special lookup function for _key

* moved function into the correct file

* speed up key buffer allocations a bit

* added noexcept specifier

* correctly name variable

* explicitly move bounds

* fix and speedup from/toPersistent functions

* reuse string from ManagedDocumentResult for multiple lookups

* use move-assign

* a bit less work for single server

* speedup AQL function HASH

* single fetch optimization

* performance optimization for the case when no documents need to be returned

* make reduce-extraction-to-projection a RocksDB-only optimizer rule

* cppcheck

* try to fix compile error on MacOS

* bug fix for MacOSX

* missing namespace (in Windows compile)
2017-07-14 08:40:29 +02:00
Jan a240976713 fix gzip-encoding test (#2790) 2017-07-13 11:53:39 +02:00
Max Neunhöffer 2f874249bb Bug fix/adjust agency comm timeouts (#2765)
* Take out 503 timeouts altogether.
* Overhaul of AgencyComm::sendWithFailover loop.
* Let performRequests optionally ignore 404 coll not found.
* Fix error message "database not found" when AgencyComm failed.
* Add log entries in Agency if locks are acquired too slowly.
* Reexecute the javascript cluster sync stuff even if there was no plan/current change...So failed sync jobs can retry later...
* Cover callbacks in Communicator by lock. This fixes https://github.com/arangodb/planning/issues/370
* Put in delay in waiting for leader in agency test.
* Schmutz logging to heartbeat topic.
* Add more lock time diagnostic in agent.
* Switch on agencycomm tracing in coordinator.
2017-07-13 00:44:28 +02:00
Heiko 9fddc52312 fixed one medium prio and two low priority zap scan issues (#2775)
* fixed one medium prio and two low priority zap scan issues

* changelog

* modified manifest
2017-07-12 22:13:09 +02:00
Heiko 71434ef566 added index deduplicate option to the ui (#2781)
* added index deduplicate option to the ui

* changelog
2017-07-12 22:10:22 +02:00
Heiko afe88f9fbb ui: fixed renaming of collections based on rocksdb storage engine (#2784) 2017-07-12 22:08:17 +02:00
Frank Celler 40d73d5a8b Revert "[WIP] Feature/reduce extraction to projection (#2735)"
This reverts commit 5bfcff30cd.
2017-07-12 12:52:14 +02:00
Jan 5bfcff30cd [WIP] Feature/reduce extraction to projection (#2735)
* reduce extractions to projections

* recycle string buffers in SocketTask

* micro optimizations for mmfiles indexes

* added special lookup function for _key

* moved function into the correct file

* speed up key buffer allocations a bit

* added noexcept specifier

* correctly name variable

* explicitly move bounds

* fix and speedup from/toPersistent functions

* reuse string from ManagedDocumentResult for multiple lookups

* use move-assign

* a bit less work for single server

* speedup AQL function HASH

* single fetch optimization

* performance optimization for the case when no documents need to be returned

* make reduce-extraction-to-projection a RocksDB-only optimizer rule
2017-07-12 11:22:29 +02:00
Kaveh Vahedipour d98481f889 Merge pull request #2769 from arangodb/feature/fix-jslint-aql-graph-traverser.js
missing assertTrue entry in global
2017-07-11 16:04:37 +02:00
Kaveh Vahedipour 774ebae638 missing assertTrue entry in global 2017-07-11 16:02:02 +02:00
Kaveh Vahedipour 231a360b3b fixes for secondaries 2017-07-11 14:05:51 +02:00
Michael Hackstein 2cd48e614b Feature/optimizer rule remove filter covered by traversal (#2731)
* Added a first test for remove-filter-covered-by-traverser rule.

* initial try at adding the functions

* Initial try at fixing all cases

* Fixing optimizer rule order

* Changing rule

* excluding quantifier ANY

* Fixing assertion error

* quick fix for some failed traverser cases

* Fixing quantifier related tests

* Adding upper limit for scannedIndex in cluster

* Fixing the mmfiles asserts

* Allow the coordinator to do condition checking on edges again. Used in enterprise.

* Fix naming of optimizer rules (#2739)
2017-07-10 10:15:17 +02:00
Frank Celler 545e861829 Bug fix/agency prepare leading bug (#2752) 2017-07-08 17:08:30 +02:00
Heiko fbb8189d2a fixed a bug when the user defined query limit in the ui was not recognized correctly (#2733) 2017-07-06 18:11:19 +02:00
Jan Christoph Uhde 562cc77b59 Bug fix/issue 2499 insert 9 instead of 1 (#2727)
* Add testcase to demonstrate #2499

  - In subqueries inserts get pushed to the DB-Servers

  - these create documents documents on each DB-Server that don't respect the shard-key
  
- subsequent deletes will fail to detect the shard correctly and will also fail.

* fix for #2499
2017-07-06 09:53:39 +02:00
Jan 27dc53b451 Bug fix/cleanup stuff (#2734)
* cppcheck

* remove unused files

* cppcheck just sucks

* add _FORTIFY_SOURCE
2017-07-05 19:34:16 +02:00
Wilfried Goesgens 5ea18952b0 In `mergeHistory` we check for valid coordinators.map replies as being an object. If we don't have a proper reply, rather return false, than an empty object twhich mergeHistory would trip over. (#2726) 2017-07-04 22:26:22 +02:00
Heiko 820c4271f8 fixed missing function within ie (#2728) 2017-07-04 17:36:36 +02:00
Jan 852f91f32c it would have told us of about a missing semicolon (#2729) 2017-07-04 17:35:42 +02:00
Jan d334455bbf remove a non-deterministic part of a test (#2730) 2017-07-04 17:33:31 +02:00
Frank Celler 82ffead1cc Feature/auth context (#2721)
* fixed no access ui bug
* grunt
* optimized user permission view
* changed breadcrumb in document view
* optimized user permissions view
2017-07-04 17:32:51 +02:00
Frank Celler 6b47544611 Revert "Feature/optimizer rule remove filter covered by traversal" (#2724)
* Revert "Feature/authorization query cache (#2720)"

This reverts commit 83712b7b4a.

* Revert "properly return index in case of unique constraint violation (#2716)"

This reverts commit c3f346e0a5.

* Revert "fix https://github.com/arangodb/planning/issues/388 (#2714)"

This reverts commit 1d944b97a4.

* Revert "fix typo (#2718)"

This reverts commit 61a80ed697.

* Revert "Feature/optimizer rule remove filter covered by traversal (#2676)"

This reverts commit c54b81fb69.
2017-07-04 11:13:36 +02:00
Manuel B 83712b7b4a Feature/authorization query cache (#2720)
* check authorization when accessing query cache
2017-07-04 08:37:14 +02:00
Jan 1d944b97a4 fix https://github.com/arangodb/planning/issues/388 (#2714)
also fix jslint issues
2017-07-03 18:41:54 +02:00
Simon Grätzer c54b81fb69 Feature/optimizer rule remove filter covered by traversal (#2676) 2017-07-03 18:39:32 +02:00
Frank Celler bbe7484521 Feature/auth context (#2704)
* added read-only users
2017-07-02 23:15:57 +02:00
Frank Celler bec7c089fb fixed path (#2710) 2017-07-02 22:50:55 +02:00
Jan a5afdf9437 Bug fix/small issues (#2696)
* remove unused code

* print values of all options

* don't print "warning(s):" if there are none

* remove remainders of old file deletion functionality

* remove unused function
2017-07-01 00:30:45 +02:00
Jan 94b4a9ec4b added "deduplicate" attribute for array indexes (#2644) 2017-06-30 17:53:50 +02:00
Michael Hackstein b73c0dfda4 Merge pull request #2670 from arangodb/feature/issue-277-nextExtra
Feature/issue 277 next extra
2017-06-29 17:24:55 +02:00
Dan Larkin ee8cb749bb Added recovery tests for views and fixed a few related bugs. (#2682)
* Added recovery tests for views and fixed a few related bugs.

* Added more view recovery tests.

* Modified view recovery tests to add a waitForSync operation after.

* fixed usage of wrong view type

* fixed recovery of view change markers
2017-06-29 17:09:43 +02:00
Michael Hackstein 6901a9b53f Fixed a misplaced edge filter It checked for a condition on the wrong depth. 2017-06-29 17:03:05 +02:00
Alan Plum 7f585af4c3 Explicitly return 204 status code on commit (#2694) 2017-06-29 15:13:09 +02:00
Alan Plum bf9c018f7b Add idiomatic flag to Foxx tests (#2693) 2017-06-29 15:12:58 +02:00
Heiko 7043af264c fixed database view event unresponsivess (#2674) 2017-06-28 15:16:14 +02:00
Alan Plum bbca34b210 Allow passing plain JSON data for config/deps (#2688) 2017-06-28 14:08:54 +02:00
Jan Christoph Uhde 828ab6db23 update unittests 2017-06-28 13:45:17 +02:00
Mark a033eef12d Fix issue 2684: Legacy service UI not working (#2685) 2017-06-28 12:09:15 +02:00
Mark 2ba5ee87c2 Fix issue #2677 (#2678)
Foxx disabling development mode creates non-deterministic service bundle
2017-06-27 16:38:42 +02:00
Frank Celler 2807ef559c Feature/move shard fix (#2626)
Major overhaul of handling of synchronous replication.
2017-06-26 16:55:01 +02:00
Mark 50ad6fbd76 Foxx service CRUD optimizations (#2657)
* Pass config/deps on _install so setup can see them

* Only register service when install succeeded

* Don't throw after point of no return: breaky install is breaky

* Delete service files during install if service validation fail

* Delete service files during install if service execution fails

* Fix commitLocalState with invalide services

* Remove deprecated test
2017-06-26 09:28:59 +02:00
Jan cfbd8ed93c Bug fix/rocksdb autoincrement (#2648)
* Added autoincrement keygen support to RocksDB engine with test.

* fixed key generator state keeping for mmfiles engine
2017-06-23 15:27:09 +02:00
Simon Grätzer 52fa4f450a Bugfix for cluster bug (#2649) 2017-06-22 17:34:01 +02:00
Jan c77a6fd738 fix one more limit issue in traversal (#2634) 2017-06-22 12:32:47 +02:00
Jan ebaeb639b2 Bug fix/incremental replication syncs too much (#2631)
* fix too much synchronization
* fix incremental sync for RocksDB engine
2017-06-21 14:56:33 +02:00
Mark 7743db32b9 Fix #2613 (#2614)
Reduce log level when Foxx manager tries to self heal missing database
2017-06-20 12:41:45 +02:00
Simon Grätzer 492d832695 Refactored /_api/index and /_api/database (#2582)
* working documents rest handler

* fixed cluster tests

* Consolidating database APIs

* clang-format

* Fixing issue with user creation through db._createDatabase

* replaced and refactored api-index and index api

* fixed cluster

* renaming some files

* added user methods

* removed files intended for later

* Fixed CC build

* Fixed method signature

* Fixing shell_server, shell_client tests
2017-06-19 23:47:40 +02:00
Heiko 2f8cd2455d fixed all results query bug (#2607) 2017-06-19 17:48:14 +02:00
Jan 9396d4d952 fix query execution times that may have different between batches (#2606)
* fix query execution times that may have different between batches

* applied query statistic change to ui

* do not expose state "finished", as it is useless
2017-06-19 17:47:32 +02:00
Jan f38ba7c84d fix invalid results (too many) when a skipping LIMIT was used for a traversal (#2603)
`LIMIT x` or `LIMIT 0, x` were not affected, but `LIMIT s, x` may have returned too many results
2017-06-19 17:34:47 +02:00
Heiko 4d7720b471 ui - added satellite collection creation (#2584) 2017-06-19 17:29:06 +02:00
Frank Celler 16f1f5e507 changed to signal 6 (#2583) 2017-06-16 09:50:34 +02:00
Jan 9bebd33ba3 fix invalid first group results for sorted AQL COLLECT when LIMIT was used (#2577) 2017-06-16 09:44:14 +02:00
Michael Hackstein 830769dcb5 Fixed test file still calling warmup 2017-06-12 23:46:43 +02:00
Michael Hackstein 9edb884bc8 Feature/planning issue 188 (#2547)
* add warmup documentation - #188

* warn when relinking build directory

* add warmup documentation - #188

* warn when relinking build directory

* Renamed warmup to loadIndexesInMemory which is a better name for the current implementation of this feature.

* Adapted WebUI to state 'load indexes in memory' instead of 'warmup'

* Added loadIndexesInMemory documentation.

* Renamed loadIndexesInMemory => loadIndexesIntoMemory
2017-06-12 18:54:45 +02:00
Max Neunhoeffer 29921d32a8 Fix behaviour of synchronous replication in dropFollower case.
If we are already in shutdown, we do not drop a follower.
If we cannot drop a follower (no contact to agency), we error out.
2017-06-09 13:06:02 +02:00
Max Neunhoeffer 2e9d525256 Merge branch 'devel' of ssh://github.com/ArangoDB/ArangoDB into devel 2017-06-09 10:46:47 +02:00
Max Neunhoeffer cc985becd3 One more logging line in resilience test output. 2017-06-09 10:46:26 +02:00
Alan Plum 57487d6f4d Expose internal.time (#2530) 2017-06-09 10:44:29 +02:00
jsteemann 9b77aae857 fixed some tests 2017-06-08 17:56:58 +02:00
Wilfried Goesgens 7224e7515c Implement testcases, this fixes #1806 2017-06-08 15:59:05 +02:00
Kaveh Vahedipour e55d3e92a9 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-06-08 12:44:50 +02:00
Kaveh Vahedipour 371cca765f very very long timeout for compaction tests in agency seem necessary
for agency tests to succeed under ultra-high-load scenarios
2017-06-08 12:44:00 +02:00
Andreas Streichardt 7250ba29ee Disable communicator and abort all requests when shutting down 2017-06-08 11:58:15 +02:00
Andreas Streichardt a2f5871ee6 Keep retrying coordinator bootstrap 2017-06-07 18:22:08 +02:00
Simon Grätzer fba82fc516 Forgot test case 2017-06-07 17:20:37 +02:00
Max Neunhoeffer 38a7530900 Temporarily disable huge transaction pack test. 2017-06-07 14:49:10 +02:00
Michael Hackstein ac79f7d7c6 Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-06-07 11:14:02 +02:00
Michael Hackstein db0dcd5579 Reverted API name change on _getConnectingEdges 2017-06-07 11:13:52 +02:00
Max Neunhoeffer 47a7e8e421 Further improve error handling and increase timeout. 2017-06-07 10:19:29 +02:00
Max Neunhoeffer b0ce80834d Reduce transaction package size in agency log compaction test.
Also add new test with a huge transaction package.
2017-06-07 09:45:45 +02:00
hkernbach 4568818b83 grunt build 2017-06-06 19:06:57 +02:00
hkernbach 3bb96b6bbb ui - removed console logs 2017-06-06 19:05:22 +02:00
hkernbach f0a9a07e8e ui - added csv export to query editor if flat tabular data is returned 2017-06-06 19:04:31 +02:00
hkernbach 47ae4f4901 Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-06-06 15:46:45 +02:00
hkernbach d3b2b20813 grunt build 2017-06-06 15:46:35 +02:00
hkernbach f02419d387 ui - improved editors cleanup 2017-06-06 15:44:49 +02:00
jsteemann 210a4e485b fix path to version file 2017-06-06 15:42:42 +02:00
hkernbach ac4eea878e ui - more detail about figures 2017-06-06 15:41:06 +02:00
Kaveh Vahedipour cc821c6216 agency write handles large++ collections of transactions at once 2017-06-06 10:42:44 +02:00
Max Neunhoeffer 7abd21f2eb Fix new agency log compaction test using smaller chunks. Reactivate. 2017-06-02 20:19:50 +02:00
Max Neunhoeffer 9b4c01f54c Temporarily deactivate failing agency test. 2017-06-02 18:47:26 +02:00
Max Neunhoeffer 222af93bb8 Fix and reactivate agency compaction test. 2017-06-02 18:22:12 +02:00
Kaveh Vahedipour 7abcfab41a compaction tests have keepalive issues 2017-06-02 16:28:38 +02:00
Kaveh Vahedipour da0cc3490c Squashed commit of the following:
commit 3d9cf792912db1974b9ac5e00ca2b4c9245b7d34
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Fri Jun 2 15:32:43 2017 +0200

    optimise for single writes in agency log

commit 65056ab9026f9b4b211dda0f17c75602b978f2bf
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Fri Jun 2 15:01:15 2017 +0200

    More tests, taking agency log compaction interval into account.

commit 6600d707784e8fd5b62c0c75fd1826af09b8e13f
Merge: cf46882 02f00cc
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Fri Jun 2 14:50:38 2017 +0200

    Merge branch 'agency-log-compaction-overhaul' of ssh://github.com/ArangoDB/ArangoDB into agency-log-compaction-overhaul

commit 02f00cc271d027f02b0625afb76745bfa76bf833
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Fri Jun 2 14:34:41 2017 +0200

    compaction step and keep size defaults for 3.2

commit 03fc8fbff8f0ac701f7d7f94521c0c3152dd6f92
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Fri Jun 2 14:32:46 2017 +0200

    Constituent fatally exists if eletion ballot cannot be persisted

commit cf4688226fc897e74bb2d9ebdfca3ce4578c3b70
Merge: c727fc4 724bd1e
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Fri Jun 2 13:08:15 2017 +0200

    Merge branch 'agency-log-compaction-overhaul' of ssh://github.com/ArangoDB/ArangoDB into agency-log-compaction-overhaul

commit 724bd1efe19e2e9dbfc14cd819f180816b6d62d0
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Fri Jun 2 13:02:51 2017 +0200

    persistence success in agency state is properly evaluated

commit c727fc48bb93e7b135b3ca929c03221c7bcaddb9
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Fri Jun 2 12:04:55 2017 +0200

    Set default compaction step size in agency to 20000 and 10000 keep size.

commit ded16ae6945e9c1479e99bc2e7ccb4d6feca19a6
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Fri Jun 2 11:11:12 2017 +0200

    Fix help page in startStandAloneAgency.sh for --use-persistence.

commit 13ae9f40f649a8f92eeca4b16bbb5647b540722d
Merge: 834c7c9 aa3e8c1
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Thu Jun 1 23:41:34 2017 +0200

    Merge remote-tracking branch 'origin/devel' into agency-log-compaction-overhaul

commit 834c7c920d36db3579def66c38fb04870936f8bd
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Thu Jun 1 16:56:03 2017 +0200

    Handle error in recvAppendEntriesRPC properly.

commit bd9c8d03b76ad25d4078740b5bf994fdba3845d0
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Thu Jun 1 16:55:35 2017 +0200

    Handle errors in persist() and log() properly.

commit 5b4d2c3d9af078d6a1b5626af20dc9abf2546baa
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Thu Jun 1 16:25:22 2017 +0200

    Improve error reporting.

commit d60697c5f26d6592eecefc9b9a43e9b699d1773d
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Thu Jun 1 12:16:39 2017 +0200

    Agency must not responds to any requests after startup util leader has RAFT commited up to pre shutdown state

commit 92b8ede5fa022ace1596607abcf8fad1130504c8
Merge: 9340e74 d24455c
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Wed May 31 16:54:45 2017 +0200

    Merge remote-tracking branch 'origin/devel' into agency-log-compaction-overhaul

commit 9340e7461130a4783c09ad8d91e5a07f9500a045
Merge: 7b7ce9d 63a9d60
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Wed May 31 12:13:55 2017 +0200

    agency tests to cover compaction

commit 63a9d604c474eda4302032629dff1f0f69fa0813
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 31 11:59:11 2017 +0200

    Set agency.compaction-keep-size to at least 0.

commit ef842260968a4769d9502a701b7251da32647e52
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 31 11:49:34 2017 +0200

    Fix agent size 1 case (thread already gone).

commit 7b7ce9d79f6e8208c13f153b1b9a395b780d6ce1
Merge: 24e2e7e ff306bf
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Wed May 31 11:39:58 2017 +0200

    Merge branch 'agency-log-compaction-overhaul' of https://github.com/arangodb/arangodb into agency-log-compaction-overhaul

commit ff306bf547bc4f528c9b66e222271ac143029508
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 31 11:11:06 2017 +0200

    Move compaction into the future when we take a snapshot from leader.

commit 24e2e7e00f960928a79ce4008b8031d6b9b07fd9
Merge: 84034ac b3ea17a
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Wed May 31 11:01:13 2017 +0200

    Merge branch 'agency-log-compaction-overhaul' of https://github.com/arangodb/arangodb into agency-log-compaction-overhaul

commit b3ea17a219baa2abd5892819012fb59f440cdeb8
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 31 09:42:59 2017 +0200

    Get rid of double nonsense.

commit 035c8d1b34e1b73a381d5468422adf13b2ebc36a
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 31 09:25:28 2017 +0200

    Sort out Agent::load sequence.

commit 84034ac2809a77145d6b1d23bf44857b3a0c4651
Merge: eb34a2e 3180a9d
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Tue May 30 17:07:20 2017 +0200

    merging in

commit eb34a2e64e6ac8dc6571b92cb853c38b7022c833
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Tue May 30 16:58:05 2017 +0200

    keep persistence for restarts in standalone agency

commit 3180a9d9ce4a4401a55ef02606b020316d43cbe5
Merge: 5d60524 28b9580
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Tue May 30 16:56:56 2017 +0200

    Merge branch 'agency-log-compaction-overhaul' of ssh://github.com/ArangoDB/ArangoDB into agency-log-compaction-overhaul

commit 5d60524429d8ddda4491beecb931c3b9e3cc1d8a
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Tue May 30 16:56:36 2017 +0200

    Implement snapshot sending in AppendEntriesRCV.

commit 28b958054f51c9cb36706df4e4345aa0f726ed15
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Tue May 30 14:20:13 2017 +0200

    state machine should not advance _committed if empty

commit df18f326acea7f5bc2660a37e22f1503952e4b41
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 23:39:47 2017 +0200

    Store term with compaction snapshot, recover again.

commit 2551a48b6fb513c9ea934bce755f8c364dae2f05
Author: Kaveh Vahedipour <kaveh@vahedipour.de>
Date:   Mon May 29 17:45:26 2017 +0200

    indices renamed to closely match RAFT documentation

commit e62dcdecf6e8650cfa5725d91b809d05591b48a4
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 16:37:43 2017 +0200

    More cleanup.

commit 9f4787c46621375f0361138a8961431eb21ce5c0
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 14:50:25 2017 +0200

    Revise loadLastCompactedSnapshot to return 0 without a snapshot.

commit 13285e1d70c8a4ac8c79a08de6f8fbc0f8d242bf
Merge: 3393c43 6c5f23e
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 12:06:20 2017 +0200

    Merge branch 'agency-log-compaction-overhaul' of ssh://github.com/ArangoDB/ArangoDB into agency-log-compaction-overhaul

commit 3393c43c75520c74d20df09c74fbbbd8b1af5976
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 12:03:47 2017 +0200

    More cleanup around Store::apply and friends.

commit 4ccb41d1839748c98e11403fa04f6a7d6af5e95b
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 09:45:41 2017 +0200

    Document apply methods in Store with comments.

commit ea05c4880fedb6fe535e24761ac5cb3c26ccfc20
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 09:45:18 2017 +0200

    Intentionally keep one log entry more to prevent empty log.

commit 67fb62f2259cc3c6368319917c7257ebcc177d3f
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 09:44:42 2017 +0200

    Improve plausibility checks at compaction time.

commit 0bafc368785b15a94f8783c4c929f4208f87d09c
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Thu May 25 00:51:51 2017 +0200

    Sort out (re-)building of agency K/V store(s) from compaction snapshots.

    This is in case of (re-)start, becoming a leader and when serving
    /_api/agency/store.

commit 46b0750bc6c597ec388aac0cdca32082c0cc54b8
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Thu May 25 00:50:54 2017 +0200

    Set compaction interval to 200 and keep to 0.

    This is way to small but tests should run with it.
    Will later increase numbers again.

commit 024dc0846ae30248b464dd481a8bbc1134f56983
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 24 23:29:57 2017 +0200

    Add a trivial test for agency log compaction.

commit e12fd3b46833419d7b436eeadd7246304324b891
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 24 23:26:03 2017 +0200

    First part of cleanup of agency log compaction.

    Now the right compaction snapshots are taken and persisted.
    Furthermore, the right log entries and old snapshots are removed
    after compaction, both the volatile and the persisted ones.
    The readDB and spearHead stay unchanged at compaction time as it
    should be.

commit d59901aea0c3ca31ef253299d2adc3353b79e664
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 24 12:18:26 2017 +0200

    Remove unused member variable.

commit 6c5f23eb7b42d9f20d4dadb2932a63add99f9c76
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 09:45:41 2017 +0200

    Document apply methods in Store with comments.

commit 670899f72d215e0fcc0ca0389cea9250a291e83b
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 09:45:18 2017 +0200

    Intentionally keep one log entry more to prevent empty log.

commit 660f61029917bbc2ce1fae3e4fc903095b023297
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Mon May 29 09:44:42 2017 +0200

    Improve plausibility checks at compaction time.

commit e2802e4b36d1f67d8361c1d8b0c92fbff696f439
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Thu May 25 00:51:51 2017 +0200

    Sort out (re-)building of agency K/V store(s) from compaction snapshots.

    This is in case of (re-)start, becoming a leader and when serving
    /_api/agency/store.

commit 12b43f1b91284a1185390d6dcfbd1e838522d392
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Thu May 25 00:50:54 2017 +0200

    Set compaction interval to 200 and keep to 0.

    This is way to small but tests should run with it.
    Will later increase numbers again.

commit c8b9a37a690b8e7e8bfa1276a3f9ba4b6b5a9c27
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 24 23:29:57 2017 +0200

    Add a trivial test for agency log compaction.

commit cf0c8c1fff666f76411082f87efe685a412ecebb
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 24 23:26:03 2017 +0200

    First part of cleanup of agency log compaction.

    Now the right compaction snapshots are taken and persisted.
    Furthermore, the right log entries and old snapshots are removed
    after compaction, both the volatile and the persisted ones.
    The readDB and spearHead stay unchanged at compaction time as it
    should be.

commit 0a4255359a57b8686133e6014e2b82b8079f36fa
Author: Max Neunhoeffer <max@arangodb.com>
Date:   Wed May 24 12:18:26 2017 +0200

    Remove unused member variable.
2017-06-02 16:13:03 +02:00
Simon Grätzer e5386aef30 fixing compiler warnings and edge cache test 2017-06-02 16:00:41 +02:00
Simon Grätzer 634254b80f adding load and unload 2017-06-02 14:44:38 +02:00
Andreas Streichardt 07364e857d Remove useless debug 2017-06-02 11:47:05 +02:00
Michael Hackstein ce9812d8fa Added proper sorting in test code. Not deterministic otherwise 2017-06-02 09:33:30 +02:00
Mop 619eae9be5 Revert "Squashed commit of the following:"
This reverts commit 2252088572.
2017-06-01 18:37:45 +02:00
Andreas Streichardt 2252088572 Squashed commit of the following:
commit f3d0fd6584b0e451b8c97abcb4ba8d9f2fc6f560
Author: Andreas Streichardt <andreas@arangodb.com>
Date:   Thu Jun 1 17:31:36 2017 +0200

    fix unittest

commit 7cd3544a39e1b78af9d4175cb3b978799b9bbfff
Author: Andreas Streichardt <andreas@arangodb.com>
Date:   Thu Jun 1 17:10:00 2017 +0200

    Remove debug comment

commit fb6b10dac15be49a72dbff80030a7d22abdfc3e0
Merge: 055eb1d269 6b18cc64fe
Author: Andreas Streichardt <andreas@arangodb.com>
Date:   Thu Jun 1 17:00:21 2017 +0200

    Merge branch 'devel' into shardorganizer

commit 055eb1d2693a583d21ea59ec8b6ba95ab0db57ac
Merge: 1ff7998ebf 8ea89b7677
Author: Mop <andreas@arangodb.com>
Date:   Thu Jun 1 16:56:30 2017 +0200

    Merge branch 'shardorganizer' of https://github.com/arangodb/arangodb into shardorganizer

commit 8ea89b76777c75b6a77bf695c3f074a0c4643c29
Author: Andreas Streichardt <andreas@arangodb.com>
Date:   Thu Jun 1 16:55:41 2017 +0200

    Fix shardmapping bug

commit 1ff7998ebfd691598ec5b455ca5bc2bfd7020fb4
Author: Mop <andreas@arangodb.com>
Date:   Wed May 31 17:26:08 2017 +0200

    more output

commit 68e88aa0e14316c4929d05b2c151bee6421d754d
Merge: 0978ad1d9e 44a6a78ec3
Author: Mop <andreas@arangodb.com>
Date:   Wed May 31 17:03:33 2017 +0200

    Merge branch 'shardorganizer' of https://github.com/arangodb/arangodb into shardorganizer

commit 44a6a78ec338a1e7cabb15464500d96b84c68f1d
Author: Andreas Streichardt <andreas@arangodb.com>
Date:   Wed May 31 07:42:43 2017 -0700

    Fix namespace

commit 0978ad1d9e2f01b86204990e74b66958f25eba66
Merge: f98582ccff d74e5989ad
Author: Mop <andreas@arangodb.com>
Date:   Wed May 31 16:40:35 2017 +0200

    Merge branch 'shardorganizer' of https://github.com/arangodb/arangodb into shardorganizer

commit f98582ccff3448f6c2388dab4cc2dc38034271b0
Author: Mop <andreas@arangodb.com>
Date:   Wed May 31 16:39:03 2017 +0200

    Revert "Revert "Next attempt at merging ShardOrganizer...distributeShardsLike fixed""

    This reverts commit fed45b7b10.

commit d74e5989ad478efe7d66d196715c05f4f41c9c29
Author: Andreas Streichardt <andreas@arangodb.com>
Date:   Wed May 31 16:31:31 2017 +0200

    Make it an error

commit 0a6a9ef9464df4f24ad205bbab5b9f8ded50054f
Author: Andreas Streichardt <andreas@arangodb.com>
Date:   Wed May 31 12:42:51 2017 +0200

    distributeShardsLike has to be saved as a cidString
2017-06-01 17:32:40 +02:00
jsteemann 9015e4ca7c don't print empty warnings 2017-06-01 16:47:41 +02:00
jsteemann d13144f389 fixed issue #2515 2017-06-01 13:45:47 +02:00
Alan Plum 4b4b9f8c55 Fix Foxx API error (#2517)
* Fix Foxx API error
* Manager should distinguish between errors and services
* Foxx API should not require service to exist for uninstall
  if force option is used
* Respect options.force in FM _install
2017-06-01 11:59:04 +02:00
jsteemann 3df0940c7e jslint 2017-06-01 10:31:42 +02:00
Akshesh Doshi 46b50c266c Add tests and docs for REGEX_REPLACE AQL function (#2518)
* Fixed #1902: Add tests and documentation for REGEX_REPLACE

* Cleanup
2017-06-01 10:29:43 +02:00
mpv1989 e277051f5e Generate swagger docs 2017-06-01 10:11:02 +02:00
Mark f832dd0388 Implement endpoint "commit coordinator state" (#2513)
Implement endpoint "commit coordinator state" (also see #2479)
2017-05-31 18:21:50 +02:00
Alan Plum 7608cde674 Implement clusterfoxx mounting logic (#2514)
* Serve error when service is out of sync
* Don't check system services for bundles
* Use appropriate errorNum if Foxx blows up
* Only check checksum when file exists
* Don't expose stack traces
2017-05-31 18:21:40 +02:00
Michael Hackstein 52406567cd Replaced EdgeCursors callback to return cid,rev instead of _id. Does less costly copying and comparision internally 2017-05-31 17:49:46 +02:00
jsteemann 62c944d8a8 added more tests for transaction parameters 2017-05-31 17:28:28 +02:00
Alan Plum ca52aa17b3
Make legacy test less flakey 2017-05-31 11:27:31 +02:00
Andreas Streichardt 3fb571baaa Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-30 20:33:08 +02:00
Alan Plum 83310c12d7
Move FM.listJson into aardvark 2017-05-30 20:19:58 +02:00
Alan Plum d06a72f4a9
Remove unused legacy FM test 2017-05-30 20:19:15 +02:00
Andreas Streichardt dded5abb6c Merge remote-tracking branch 'origin' into shardorganizer 2017-05-30 20:17:07 +02:00
Alan Plum 5fc4a17b24
Make sure the bundle doesn't exist before loading it from db 2017-05-30 20:09:58 +02:00
Alan Plum 23ac54183c
More meaningful object logging
Don't log inherited attributes.
Do log constructor name for class instances.
Use _PRINT methods if available except when using console.dir.
2017-05-30 20:09:58 +02:00
Alan Plum ab177612a5
Response -> IncomingResponse 2017-05-30 20:09:58 +02:00
Alan Plum c4305897cf
More realistic binary document test 2017-05-30 18:39:56 +02:00
Alan Plum cceccf59da Simplified Foxx self healing (#2511)
* Implement new self-heal
* Add error codes for 503, service missing/outdated
* Detect changes to service via rev
* Pretty print incoming response object in log
2017-05-30 18:27:32 +02:00
Michael Hackstein eecdcd4e96 Made shortest path OOM test deterministic 2017-05-30 17:41:07 +02:00
hkernbach 2a0d2bfc8c adjusted ui to internal cluster api 2017-05-30 15:02:57 +02:00
jsteemann f43eb4f9df Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-05-30 13:00:59 +02:00
Kaveh Vahedipour 67179d57d6 id and name disambiguation 2017-05-30 12:22:54 +02:00
jsteemann 63d035761e Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-05-30 12:04:30 +02:00
jsteemann 53b150b206 added tests for intermediate commits 2017-05-30 12:03:58 +02:00
Kaveh Vahedipour bc9aba5754 fixing glitch in dbservers aardvark route 2017-05-30 10:42:02 +02:00
jsteemann ed21022f55 added test for shardids restriction 2017-05-29 17:02:16 +02:00
jsteemann a35f85bcc7 added proper docs for --query.fail-on-warning 2017-05-29 15:46:48 +02:00
hkernbach 3bbd7d8ab4 added json editor svg icons 2017-05-29 13:54:45 +02:00
hkernbach a1dacc3e29 fixed issue #2509, updated jsoneditor lib 2017-05-29 13:37:42 +02:00
hkernbach e83c1dce26 added warmup function - ui 2017-05-29 10:25:54 +02:00
Michael Hackstein b9d2faa7cc Added warmup function for indexes.
Squashed commit of the following:

commit bc0472d212b2efef0d7b1b8a36f2b43e8432ba86
Merge: eb47631 5f87674
Author: Michael Hackstein <michael@arangodb.com>
Date:   Mon May 29 09:39:31 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit eb476310b0ca6165be10b37b960933886c2757f5
Merge: d725f21 32149d2
Author: Michael Hackstein <michael@arangodb.com>
Date:   Mon May 29 09:00:41 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit d725f21f7d61f7c79ba31fc0338881e35f4d8f48
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 15:53:23 2017 +0200

    Activated collection warmup in Cluster Mode. Added a test for collection warmup (SingleServerOnly)

commit 132bf4f9565b0dcf4ec9f84e93897b482a67ce7f
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 12:46:20 2017 +0200

    Implemented client-side warmup. It can now be triggered via http and arangosh

commit 78ea449dff86118814a2f87bdb59dc16544d92b6
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:25:40 2017 +0200

    Fixed assertion.

commit dae80f6277dde1a52eadda506858cc36e235bd55
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:08:46 2017 +0200

    Improved the CuckooIndexEstimator computeEstimate function. It is now much better on collections with many different values

commit 7abf57876511ba369d7a577e1995d4575e98c7c8
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:06:43 2017 +0200

    Edge index warmup will now first check if a document is stored and if not will insert it. Furthermore it resizes the cache with an estimate of how many documents will be most likely inserted

commit 890d8ad4cdfd155249f060fedd5c798b9531d556
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 11:04:47 2017 +0200

    Adjusted thresholds in transactional cache. Wastly increased the amount of tries to get the lock. Lowered the fill-grade boundaries

commit 60972ab7151a3acb78e1aae4149de11d0da7aceb
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 10:45:38 2017 +0200

    Added new Logtpopic CACHE that should be used to log important information regarding caches, like debug ouput on evictions / resizing, or memory-pressure resizing going on

commit 2dfacb9aef6e3fde169032514baca386786d059c
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 10:44:21 2017 +0200

    Fixed an assertion in index iterator. It expected _from/_to to be cached but we modified to cache entire document

commit f05beccef65853c30eda1859a39c28ea2295bc71
Merge: 13c6abf 5c46430
Author: Michael Hackstein <michael@arangodb.com>
Date:   Fri May 26 07:56:58 2017 +0200

    Merge branch 'devel' of github.com:arangodb/arangodb into feature/rocks-index-warmup

commit 13c6abfbc2ddb451a689011110411df68247435e
Author: Michael Hackstein <michael@arangodb.com>
Date:   Wed May 24 09:52:01 2017 +0200

    Added a getExtra feature for the edgeIndex. It now returns the complete edge as extra (temporary). Modified the EdgeCache to cache token and edge document (temporary). Added a warmup Function to collections that is used to warmup the index caches on demand.
2017-05-29 09:40:58 +02:00
Frank Celler ee1c60c67a added _binaryDocument and _binaryInsert (#2506) 2017-05-27 22:49:22 +02:00
Simon Grätzer 36503af230 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/RocksDBEngine/RocksDBReplicationTailing.cpp
2017-05-24 18:38:34 +02:00
Simon Grätzer 2f2d07ab9a Multihreaded import 2017-05-24 18:37:45 +02:00
Andreas Streichardt b70644440b Do not allow creation of user collection when there are not enough
servers
2017-05-24 18:04:35 +02:00
Andreas Streichardt b5fcd15214 Fix linter 2017-05-24 14:53:06 +02:00
Andreas Streichardt f08cae2028 Explicitly wait for unloaded 2017-05-24 14:37:30 +02:00
jsteemann 0c6b3cfd46 fix non-deterministic behavior in cluster_sync test 2017-05-24 12:51:27 +02:00
jsteemann 4ee75af662 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-05-24 11:59:49 +02:00
jsteemann e946a0c0b4 added diagnostic output 2017-05-24 11:52:33 +02:00
Max Neunhoeffer 9ce9db63fc Merge branch 'devel' of ssh://github.com/ArangoDB/ArangoDB into devel 2017-05-24 11:50:27 +02:00
mpv1989 379521de53 Add adler32 test 2017-05-24 09:09:08 +02:00
Max Neunhoeffer 11e6b9ea7f Merge branch 'devel' of ssh://github.com/ArangoDB/ArangoDB into devel 2017-05-23 20:38:38 +02:00
Andreas Streichardt d8dc3c85e7 Call version instead of foxx status to save a v8 context 2017-05-22 19:07:24 +02:00
Max Neunhoeffer 03c5766a6d Merge branch 'devel' of ssh://github.com/ArangoDB/ArangoDB into devel 2017-05-22 15:37:12 +02:00
Max Neunhoeffer 4bddb0c1ad Handle errors in loadScript for JS, use in cluster-bootstrap.
This recognizes errors that happen during the global cluster bootstrap.
If an error happens, the bootstrap is tried again later. The cluster
does not start until the cluster bootstrap has been finished
successfully.
2017-05-22 15:34:41 +02:00
mpv1989 cdfd41f9b9 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-05-22 13:54:08 +02:00
mpv1989 66fa98e14d Add alder32 tests 2017-05-22 13:54:02 +02:00
jsteemann bbdb191797 remove unused error code 2017-05-22 13:53:10 +02:00
jsteemann a5070978da fixed issue #2488 2017-05-19 15:57:47 +02:00
Wilfried Goesgens 5a3317efdd new autogenerated files 2017-05-18 12:23:21 +02:00
Michael Hackstein ae3a1d6dcc Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-18 10:07:50 +02:00
Michael Hackstein 592508125b Deactivated index cache test im cluster. It is not supposed to work 2017-05-18 10:05:39 +02:00
jsteemann b68482bcaa Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-05-18 00:17:55 +02:00
jsteemann 226920d7fa optimizations 2017-05-17 23:41:16 +02:00
Michael Hackstein ca737edd97 Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-17 18:53:35 +02:00
Michael Hackstein 0d18821705 Adapted the shell-index-figures test to honor that the primary index does not have a cache anymore. 2017-05-17 18:52:09 +02:00
Andreas Streichardt 69f32f9292 fix test :S 2017-05-17 18:31:55 +02:00
Andreas Streichardt 83dff84be7 Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-17 18:19:26 +02:00
Andreas Streichardt 49328dcecb Add authorizedflag fixing cluster internal foxx requests 2017-05-17 18:14:11 +02:00
Alan Plum 9b8a641e77
loadServiceFromDisk was renamed 2017-05-17 16:51:28 +02:00
Alan Plum 8a1286ac1c
Service constructor changed a bit 2017-05-17 16:48:06 +02:00
Jan Christoph Uhde 02da6fc4ca fix getIndex(withStats) for arangosh 2017-05-17 13:50:03 +02:00
Jan Christoph Uhde 55175386e7 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
* 'devel' of https://github.com/arangodb/arangodb:
  Lint
  No more need to wrap legacy errors in new Foxx HTTP API
  fixed initializing bug in dashboard ui at initial startup
  Correctly expose errors in old Foxx API
  Fix error expecations
2017-05-17 13:49:45 +02:00
Alan Plum b67ab7088b
Lint 2017-05-17 13:38:53 +02:00
Alan Plum 30524bbb84
No more need to wrap legacy errors in new Foxx HTTP API 2017-05-17 13:22:11 +02:00
hkernbach 0d0fdf949a Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-17 13:08:36 +02:00
hkernbach ecdbf8939d fixed initializing bug in dashboard ui at initial startup 2017-05-17 13:08:30 +02:00
Alan Plum dfbc5aafe9
Correctly expose errors in old Foxx API 2017-05-17 13:07:20 +02:00
Jan Christoph Uhde d7a1b98117 fix liniting errors 2017-05-17 12:47:37 +02:00
Alan Plum 599ed214c6
Fix error expecations 2017-05-17 12:33:41 +02:00
Jan Christoph Uhde 0423b75137 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
* 'devel' of https://github.com/arangodb/arangodb:
  Throw correct errors in Foxx management internals
  Make build flag easier to find in docs
2017-05-17 12:23:23 +02:00
Jan Christoph Uhde 415cbfea60 fix figures and add tests 2017-05-17 12:22:43 +02:00
Alan Plum 819a1194ba
Throw correct errors in Foxx management internals 2017-05-17 12:22:16 +02:00
Michael Hackstein 6a2ae1af8c Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-17 09:55:35 +02:00
Michael Hackstein b19549f5e4 RocksDB now properly reports EdgeIndex estimates to the user. Also reactivated edgeIndex tests for the estimate in RocksDB. 2017-05-17 09:52:25 +02:00
Jan Christoph Uhde 1f4e90ec17 add test for index figures 2017-05-17 09:51:50 +02:00
Michael Hackstein 9569b67e8d Reactivated hash-index tests on rocksdb. Mostly checking estimates. 2017-05-17 09:14:06 +02:00
Alan Plum 5d017d733c Improve Foxx cluster resilience (#2479)
* Improve Foxx cluster resilience

Fixes #2083
Fixes #2384
Fixes #2408
Addresses #1892

* Port old Foxx API

* Implement single-file services

* Add console.errorStack/warnStack/infoStack helpers

* Simplify serviceInfo validation

* Extract github/upload logic into Aardvark and old FM API
* Move generator logic into Aardvark
* Move zip/js buffer logic into FM core

* Add Foxxmanager tests

* Send empty response when no README

* Disambiguate script arg format

Historically we allow passing an array of positional arguments or an arbitrary first argument.
This is surprising behaviour, so we should just always treat the value as a first argument.

* Rebuild bundle in development mode

* Nicer HTTP docs formatting

* Create Foxx HTTP docs

* Simplify service upload handling

* Remove inline swagger docs

* Implement public download route

* Consistency

* Rebuild aardvark

* Move bundle route into /_api/foxx/_local

* Rebuild Swagger API docs

* Add changes to CHANGELOG

* More docs
2017-05-16 17:41:29 +02:00
Andreas Streichardt 35600c2ca2 Make procdump optional 2017-05-16 16:18:00 +02:00
hkernbach db4cdfef6a fixed event bug in document view 2017-05-16 15:19:24 +02:00
hkernbach e1031e64f7 fixed pagination issue in documentsView 2017-05-16 14:59:59 +02:00
jsteemann 985c3f4bfc also execute tasks in existing databases 2017-05-16 12:11:23 +02:00
jsteemann 499491bee9 use exclusive locks for some transactions 2017-05-15 22:47:50 +02:00
Michael Hackstein 301f5125cf Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-05-15 17:19:35 +02:00
Michael Hackstein d7d650e27d Implemented index estimates for RocksDB. Now the following indexes have
a proper estimate:
* HashIndex
* SkiplistIndex / Persistent
* EdgeIndex
2017-05-15 17:17:58 +02:00
Jan Christoph Uhde c673391387 fix jslint warnings 2017-05-15 17:00:35 +02:00
Jan Christoph Uhde cc2514ca3d Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
* 'devel' of https://github.com/arangodb/arangodb:
  reenable check
  Add test for rolling back indexes
2017-05-15 16:50:52 +02:00
Andreas Streichardt 4dd5e54dc6 reenable check 2017-05-15 16:49:08 +02:00
Andreas Streichardt 41f8185553 Add test for rolling back indexes 2017-05-15 16:49:07 +02:00
Jan Christoph Uhde de6a21f4f2 reduce number of log messages 2017-05-15 16:27:52 +02:00
Jan Christoph Uhde b09b84dcad add test for equality 2017-05-15 15:29:38 +02:00
jsteemann a829fed1bc do not turn off foxx queues 2017-05-15 15:15:29 +02:00
jsteemann 787e71d60f disable foxx queues 2017-05-15 14:35:09 +02:00
Jan Christoph Uhde 2bc60c24bd fix jslint erros 2017-05-15 13:45:13 +02:00
Jan Christoph Uhde 22e2b0fc7e fix edge index test 2017-05-15 13:36:17 +02:00
Jan Christoph Uhde ea386b605f renable edge-index tests 2017-05-15 12:30:34 +02:00
Kaveh Vahedipour 414db971cf allow for deleting array position in agency kv-store 2017-05-15 12:22:15 +02:00