1
0
Fork 0
Commit Graph

12419 Commits

Author SHA1 Message Date
jsteemann 1a2d31d4cb Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-11 13:12:33 +01:00
jsteemann 45be1c94a6 dont readd the same index 2017-01-11 13:12:10 +01:00
jsteemann ac3309ce5d some simplifications 2017-01-11 13:10:42 +01:00
Wilfried Goesgens 071b6c199e remove unused headers 2017-01-11 11:54:15 +01:00
Jan Christoph Uhde 62eda019c2 Revert "switch immediately to async writes when socket would block during write"
This reverts commit 96067a9315.

The change resulted in a stackoverflow instead of a "hanging" connection
we might need to use something like TCP Keep Alive to handle
disconnected clients. The bug we are currently working on might not be
fixed by TCP Keep Alive as we are in a heavy load situation. Still the
socket should not block during write. It could do so if the client does
not receive the data form the network and the server side networkbuffer
runs full at some point. There might be other situations we are not
aware of.
2017-01-11 10:45:18 +01:00
Kaveh Vahedipour 0f3023cfcc Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-11 08:58:40 +01:00
Kaveh Vahedipour 169cf88c0b too short timeouts for load situations 2017-01-11 08:58:31 +01:00
jsteemann dec7e084e5 added diagnostic output 2017-01-11 08:25:17 +01:00
Kaveh Vahedipour f34796b432 move resilience should now be correct as a test 2017-01-10 17:30:09 +01:00
Kaveh Vahedipour d30458b011 Supervision should not exit of empty plan collection 2017-01-10 16:53:24 +01:00
Kaveh Vahedipour 331d074ebe more information from ClusterInfo's dropCollectionCoordinator 2017-01-10 16:25:00 +01:00
Kaveh Vahedipour 168ed22657 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-10 16:21:08 +01:00
Kaveh Vahedipour f699117133 more information from ClusterInfo's dropCollectionCoordinator 2017-01-10 16:19:10 +01:00
Michael Hackstein 0365363090 Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-01-10 15:39:12 +01:00
Michael Hackstein fe7a829592 trx crud with empty arrays now short-circuit and return success with empty array. This lead to errors in cluster, band now is consistent with single-server. 2017-01-10 15:15:15 +01:00
Mark 8875afc1d5 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-10 14:10:30 +01:00
Mark 697962cb6c fixed windows compile errors 2017-01-10 14:10:14 +01:00
Kaveh Vahedipour 90c18e4914 waitFor will report more paranoid 2017-01-10 13:53:31 +01:00
Kaveh Vahedipour 43f7078ded Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-10 13:51:42 +01:00
Kaveh Vahedipour fffba306a1 waitFor will report more paranoid 2017-01-10 13:51:31 +01:00
Jan Christoph Uhde 96067a9315 switch immediately to async writes when socket would block during write 2017-01-10 13:47:31 +01:00
Wilfried Goesgens 8c39c975a4 improve error messages if FOR doesn't find proper values to work with 2017-01-10 13:17:04 +01:00
Kaveh Vahedipour 150ff8a1e3 waitFor will report more paranoid 2017-01-10 10:38:18 +01:00
Kaveh Vahedipour adf3778f34 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-10 09:20:02 +01:00
Kaveh Vahedipour 60bb992b4d agency dump in createCollectionCoordinator 2017-01-10 09:18:50 +01:00
jsteemann d37218d18f improved error message 2017-01-10 09:18:29 +01:00
Kaveh Vahedipour 75052e94f4 collection creation should not fail if 412 collection exists. just move on? 2017-01-10 08:36:39 +01:00
Kaveh Vahedipour dc9d8413c0 searching for broken collection creation in clusterinfo 2017-01-10 08:26:25 +01:00
Andreas Streichardt ff7df7d135 Fixx errormessages 2017-01-09 17:37:06 +01:00
Kaveh Vahedipour 11b83b762b Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-09 17:30:58 +01:00
Kaveh Vahedipour 0875353a26 all ArangoAgency.set rewritten in cluster.js 2017-01-09 17:30:36 +01:00
jsteemann a92b49d46e fix races in VST response handling 2017-01-09 17:06:33 +01:00
jsteemann 75263042c8 added tests for dropping indexes 2017-01-09 15:56:36 +01:00
jsteemann fc1b913791 fixed some issues found by coverity build tool 2017-01-09 12:39:04 +01:00
jsteemann aea9cfae7c shorten critical section code 2017-01-09 11:11:55 +01:00
Kaveh Vahedipour 59dc050070 missing prototypes 2017-01-09 10:38:53 +01:00
Kaveh Vahedipour 55985ed5de missing prototypes 2017-01-09 10:38:34 +01:00
jsteemann eac2756829 small fixes 2017-01-09 10:17:29 +01:00
jsteemann 902a787ca6 added try..catch block for thread 2017-01-09 08:32:45 +01:00
jsteemann 016f3dfb5b added try...catch 2017-01-09 08:27:59 +01:00
jsteemann 0481f5ec8b added define for unaligned memory accesses 2017-01-06 21:09:53 +01:00
Michael Hackstein c206645ebe Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-01-06 18:09:21 +01:00
Michael Hackstein b612e34aa7 Refactoring in RestReplicationHandler. Preparation for Enterprise Restore version. 2017-01-06 18:09:11 +01:00
Andreas Streichardt 466f932701 First steps to low level replication debugging 2017-01-06 17:19:07 +01:00
jsteemann e9f4bd94c4 removed diagnostics 2017-01-06 17:13:05 +01:00
Andreas Streichardt a47a9712af Brake internal, authenticated cluster foxx requests again so we don't
break the normal usecases
2017-01-06 16:43:24 +01:00
jsteemann d5c871564a force closing collection 2017-01-06 16:29:23 +01:00
jsteemann 173d647a5e fixed compile error 2017-01-06 15:44:46 +01:00
Michael Hackstein a307ee57c4 Merge branch 'devel' of github.com:arangodb/arangodb into devel 2017-01-06 15:25:01 +01:00
Michael Hackstein cd83ce24fc In case of INTERNAL_ERROR the restore-data handler will now correctly supply the error message 2017-01-06 15:24:50 +01:00
jsteemann 1dfe817fed removed unintentional return statement 2017-01-06 14:49:39 +01:00
Kaveh Vahedipour c533f311cb Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-06 14:47:02 +01:00
Kaveh Vahedipour a0af781630 to lock or not to lock 2017-01-06 14:46:57 +01:00
jsteemann e4ff3a3611 attempt to fix spurious "permission denied" errors on Windows 2017-01-06 14:35:44 +01:00
Andreas Streichardt 15fab0b7ce Do not initialize clustercomm twice in debug mode 2017-01-06 11:58:26 +01:00
Kaveh Vahedipour 4ac74301d5 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-06 11:10:36 +01:00
jsteemann 3690f3c92e some more optimizations for arithmetic calculations 2017-01-06 11:01:16 +01:00
jsteemann fd9b204442 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-06 10:55:06 +01:00
jsteemann 810209db03 remove unreferenced variable 2017-01-06 10:54:48 +01:00
jsteemann 4de07a067e Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-06 10:52:18 +01:00
jsteemann 5b8fdf99a4 more diagnostics 2017-01-06 10:52:03 +01:00
Andreas Streichardt dafb5d0724 Allow setInitialized within DEBUG_SYNC_REPL mode 2017-01-06 10:44:35 +01:00
jsteemann f9518bcf99 cosmetiscs 2017-01-06 10:33:41 +01:00
jsteemann 25a84faa54 diagnostics 2017-01-06 10:11:46 +01:00
Kaveh Vahedipour fbce62b558 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-06 09:38:43 +01:00
Kaveh Vahedipour e87182d971 more verbose output on failure to create plan 2017-01-06 09:38:37 +01:00
Andreas Streichardt e1b0b9c5f3 Remove useless if 2017-01-05 18:42:04 +01:00
Wilfried Goesgens 0c966bbc65 add debuginfo rpms 2017-01-05 18:15:11 +01:00
Andreas Streichardt 25ee54b156 Only enable basic auth for coordinators and dbservers 2017-01-05 18:13:02 +01:00
jsteemann 3bc02b9aad Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-05 16:53:21 +01:00
jsteemann 9889e9f91f remove revision id from storage engine if write locker cannot be acquired 2017-01-05 16:53:00 +01:00
jsteemann 8d3f411cae remove non-fix 2017-01-05 16:51:52 +01:00
Andreas Streichardt 975e7a65b2 Fix cluster internal requests in authentication enabled cluster 2017-01-05 16:20:15 +01:00
Wilfried Goesgens 0b97b30cd6 add debian package with debug symbols 2017-01-05 16:06:55 +01:00
jsteemann 91d486d1da more diagnostics 2017-01-05 15:50:21 +01:00
jsteemann 190c399e0c removed some dead code 2017-01-05 15:35:50 +01:00
Dan Larkin 4f91661261 Moved insert/readRevision out from big fat lock in LogicalCollection::insert. 2017-01-05 08:22:24 -05:00
jsteemann f413b8383d more diagnostics 2017-01-05 11:50:15 +01:00
jsteemann 5c2dd7d54e also print system error 2017-01-05 10:57:01 +01:00
jsteemann 7359ac44b2 more style cleanup 2017-01-05 10:52:03 +01:00
Andreas Streichardt 06a0fc11cd Add Sync Replication debug code 2017-01-04 15:51:47 +01:00
Wilfried Goesgens 19b8c90bcb fix examples - reset collections cache when working with the graph api
- add dummy cache flush function into the arangod db object
 - call cache flush when creating and deleting graphs
2017-01-04 14:34:26 +01:00
jsteemann 080bef039f fix compile warning 2017-01-04 14:06:32 +01:00
jsteemann a9f749f549 micro optimizations for geo index queries 2017-01-04 12:34:24 +01:00
jsteemann 0a971b5ebe less work inside the transaction 2017-01-04 09:42:59 +01:00
jsteemann 0070b40fbf attempt to fix Windows build 2017-01-04 09:08:13 +01:00
Kaveh Vahedipour f66688c397 visual studio ridiculous once again 2017-01-03 17:45:57 +01:00
Andreas Streichardt 39fc38393e Add followerinfo to single server case so mop can test :S 2017-01-03 16:59:17 +01:00
Andreas Streichardt 8c8a17528c Fix coordinator case 2017-01-03 16:43:54 +01:00
Andreas Streichardt c3ae91b405 Remove unused variable 2017-01-03 16:41:45 +01:00
Andreas Streichardt 8bb3142d19 Rework setRole code 2017-01-03 16:32:43 +01:00
Kaveh Vahedipour 6673093dc6 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-03 15:39:58 +01:00
Kaveh Vahedipour 5b3d95298b agent restart from persistence with complete set of new endpoints 2017-01-03 15:39:52 +01:00
jsteemann 16f16b768d optimizations for geo index 2017-01-03 14:17:49 +01:00
Kaveh Vahedipour 67b53bb91b no need considering reportIn for updating endpoints 2017-01-03 09:40:03 +01:00
Kaveh Vahedipour 449800d922 agent id is in configuration part 2017-01-03 09:35:33 +01:00
Kaveh Vahedipour 466d645545 it is probably a must to continue if leader cannot be reached 2017-01-03 09:26:45 +01:00
Kaveh Vahedipour 202f0636df nolock swap active member in agent configuration not needed 2017-01-03 09:01:53 +01:00
Kaveh Vahedipour bd28896b69 do not resend inception message, if their leaderId and id are the same 2017-01-03 08:43:27 +01:00
Kaveh Vahedipour c5c41a666c agency updates new agent addresses and ports 2017-01-02 19:15:20 +01:00
Kaveh Vahedipour f380ebae31 remove deceased agents from AgencyComm 2017-01-02 18:50:26 +01:00
Kaveh Vahedipour 9d5a5537ce remove deceased agents from AgencyComm 2017-01-02 17:12:00 +01:00
Kaveh Vahedipour 4671f7ce45 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-01-02 15:58:52 +01:00
Kaveh Vahedipour a2ee40d4f3 restarting agents inform rest of their new endpoints 2017-01-02 15:58:38 +01:00
jsteemann 3c9d71fdcf performance fix for locks 2017-01-02 15:36:43 +01:00
jsteemann 62aeddee6a speed up memory management 2017-01-02 13:39:27 +01:00
jsteemann 9dce58e418 slightly speed up conditions optimizer 2017-01-02 12:29:28 +01:00
jsteemann 0d14b52b69 fixed issue #2234 2017-01-02 09:19:15 +01:00
Kaveh Vahedipour 839654d095 collections and current version 2016-12-30 13:56:25 +01:00
Kaveh Vahedipour 55ffd4c55f collections and current version 2016-12-30 13:54:55 +01:00
Kaveh Vahedipour 4928358e04 removing trace of agency locks part 1 2016-12-30 11:21:11 +01:00
Kaveh Vahedipour ab6678eb1f need to fix tests first 2016-12-29 16:25:30 +01:00
Kaveh Vahedipour 3b62ab4b12 doubling the wait interval in agency comm is way too peeimistic 2016-12-29 16:10:14 +01:00
Kaveh Vahedipour ba31d0e4a5 waitinterval should be reset after redirects from agency 2016-12-29 15:28:07 +01:00
Kaveh Vahedipour 6e2394a831 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-29 15:03:33 +01:00
Kaveh Vahedipour ff701ff57c getting rid of locks in cluster.js 2016-12-29 15:03:09 +01:00
jsteemann 7a81798771 allow simplified ternary operator syntax 2016-12-28 21:34:55 +01:00
jsteemann 668c097bb4 cheaper string construction 2016-12-28 21:34:30 +01:00
Kaveh Vahedipour e9f465d13b read/write/transact interface lifted up to js 2016-12-28 15:37:05 +01:00
Kaveh Vahedipour 5db9ec52ec investigation into agency comm errors 2016-12-28 11:45:57 +01:00
Kaveh Vahedipour ce2b221615 investigation into agency comm errors 2016-12-28 11:44:09 +01:00
Kaveh Vahedipour c2f5fb3237 number of max retires is creating the problems? 2016-12-28 11:02:01 +01:00
Kaveh Vahedipour ce687562f2 less rigid expectation on smooth operations through agency comm under worst case scenarios. 2016-12-28 10:32:20 +01:00
Kaveh Vahedipour a3e2eaa8ed Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-28 10:06:26 +01:00
jsteemann dea26c02a9 fix invalid logical expression 2016-12-27 18:44:15 +01:00
jsteemann 47cd7673d1 check return value of file storage function 2016-12-27 18:43:59 +01:00
jsteemann bab9ea38d1 changed copy&paste error message 2016-12-27 18:43:19 +01:00
jsteemann b3309d62db added noexcept 2016-12-27 18:43:08 +01:00
jsteemann 035305ff69 fix nullptr dereference 2016-12-27 18:42:40 +01:00
jsteemann a7616ed0f6 fix potential nullptr dereference 2016-12-27 18:42:22 +01:00
jsteemann b2ba522045 remove dead code 2016-12-27 18:22:13 +01:00
jsteemann 940c23709b fix unintended assertion side-effects 2016-12-27 18:21:54 +01:00
jsteemann f9ca4d2a85 save some more heap allocations 2016-12-27 13:56:19 +01:00
jsteemann fd44f2e493 micro optimizations 2016-12-27 13:44:19 +01:00
Kaveh Vahedipour 3c487165b8 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-23 16:34:10 +01:00
Max Neunhoeffer fc52c04bf4 Improve debug messages in Agency. 2016-12-23 14:25:03 +01:00
Max Neunhoeffer 2b26224c95 Adding _term to log message. 2016-12-23 14:15:48 +01:00
Max Neunhoeffer ba29e21a0c Improve a debug message. 2016-12-23 14:09:01 +01:00
Kaveh Vahedipour fcdc7601f3 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-23 14:06:34 +01:00
Max Neunhoeffer b6ad88d7f8 Do not getUniqueIds when not leading. 2016-12-23 14:02:44 +01:00
Max Neunhoeffer 4580bf1083 Fix bug which triggered an election too many. 2016-12-23 14:02:33 +01:00
Kaveh Vahedipour ca580170bf Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-23 13:28:12 +01:00
Kaveh Vahedipour 770a49d8ca supervision should only collect unique ids in leadership 2016-12-23 13:27:59 +01:00
Max Neunhoeffer a6998744f1 Repair failover loop of AgencyComm. 2016-12-23 13:18:32 +01:00
Max Neunhoeffer 655a6d7c9b Merge branch 'devel' of ssh://github.com/ArangoDB/ArangoDB into devel 2016-12-23 12:11:58 +01:00
Max Neunhoeffer d37e887eb9 Merge conflict. 2016-12-23 12:11:44 +01:00
Kaveh Vahedipour 9a778c7304 coordinators need to know all agency endpoints too through heartbeats 2016-12-23 12:08:53 +01:00
Kaveh Vahedipour 3532fd6af5 endopint needs clearing after failure in agencycomm 2016-12-23 11:47:06 +01:00
Kaveh Vahedipour cf5ae36a14 agency more verbose for fixing cluster tests in jenkins 2016-12-23 11:10:22 +01:00
Max Neunhoeffer 1a30813919 Fix compilation. 2016-12-22 16:00:14 +01:00
Max Neunhoeffer 103cee9d8d Merge branch 'devel' of ssh://github.com/ArangoDB/ArangoDB into devel 2016-12-22 15:54:31 +01:00
Max Neunhoeffer 65c662b3f7 Enforce maximal number of threads. 2016-12-22 15:53:54 +01:00
Kaveh Vahedipour facd58b8b5 replication factor is enforced after failedleader to add new follower 2016-12-22 13:12:16 +01:00
Kaveh Vahedipour 95076d053a Bogus error message 2016-12-22 08:40:21 +01:00
Kaveh Vahedipour 8924cf7852 let's not count failed db servers in replication factor fix 2016-12-21 15:49:56 +01:00
Kaveh Vahedipour 2921ea9c95 trying to fix hanging db server on shutdown 2016-12-21 14:00:56 +01:00
Kaveh Vahedipour 12e54902df agency's supervision must wait grace period after becoming leader before acting on db server failure 2016-12-21 11:17:41 +01:00
Kaveh Vahedipour 5858caabbe endpoint unifiedForm replaces localhost with 127.0.0.1 2016-12-21 09:43:33 +01:00
Kaveh Vahedipour 04912c8907 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-20 17:39:43 +01:00
Kaveh Vahedipour f5e836697a heartbeat adds agents to agencycomm 2016-12-20 17:39:32 +01:00
Kaveh Vahedipour 1dead04c6a proper handling of hidden key-value-store data 2016-12-20 16:44:43 +01:00
jsteemann aa927edbbc Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-20 15:53:59 +01:00
jsteemann 8856caf875 micro optimizations for geo index 2016-12-20 15:53:49 +01:00
Max Neunhoeffer 89b4338943 Merge branch 'devel' of ssh://github.com/ArangoDB/ArangoDB into devel 2016-12-20 14:47:31 +01:00
Max Neunhoeffer e08d8cc1f8 Add a debug message about detected processors. 2016-12-20 14:46:43 +01:00
jsteemann e6743195e8 micro optimizations 2016-12-20 14:09:14 +01:00
Jan Christoph Uhde e393b5338e fix nextBabies for within 2016-12-20 12:32:43 +01:00
Jan Christoph Uhde 9ecd4665c7 distinguish between less and less equal in geoindex filter conditions 2016-12-20 12:15:58 +01:00
jsteemann 12a297281e small fixes 2016-12-20 12:04:40 +01:00
jsteemann 16e2881db1 better don't change mmap flags... instead let mapping a file fail when protection cannot be changed later on 2016-12-20 11:20:43 +01:00
jsteemann 06ab15cc16 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-20 10:42:01 +01:00
jsteemann 0da02e2f4a map memory-mapped datafiles/journals with PROT_READ | PROT_WRITE at the start
Previously, all datafiles/journals that were initially mapped were mapped with PROT_READ only, and later the memory protection was changed to PROT_READ | PROT_WRITE using mprotect().
However, on filesystems that are mounted with NOEXEC, changing the protection from PROT_READ to PROT_READ | PROT_WRITE later may fail. This has been reported in issue #2220.
This change now maps all datafiles/journals with PROT_READ | PROT_WRITE in the beginning, and will later change the mapping to PROT_READ if no writes are required
2016-12-20 10:32:47 +01:00
Max Neunhoeffer 985ccaeb70 Get rid of Supervision::wakeUp(). 2016-12-20 10:19:24 +01:00
Max Neunhoeffer 138dfdea64 Improve debugging output in election. 2016-12-20 09:34:30 +01:00
Max Neunhoeffer 47297624ce Further rearrangement in election loop. 2016-12-20 09:24:19 +01:00
Kaveh Vahedipour dcc015f37a max's criticism 2016-12-20 08:54:53 +01:00
jsteemann 09dc22860e properly clean up 2016-12-20 08:45:17 +01:00
jsteemann bd6d48760c fix memleak 2016-12-19 21:41:29 +01:00
Kaveh Vahedipour 27e4b170cf assuming leadership separated in a preparation part and in a action part 2016-12-19 17:42:07 +01:00
Kaveh Vahedipour f71109a969 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-19 17:20:05 +01:00
Kaveh Vahedipour 034961142a constituent does elections more efficiently 2016-12-19 17:19:58 +01:00
jsteemann e2cea4e773 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-19 15:11:36 +01:00
Kaveh Vahedipour 72d8579a6a Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-19 15:00:38 +01:00
Kaveh Vahedipour 0e29e93816 race condition in agency when leader impaired 2016-12-19 15:00:32 +01:00
jsteemann fc1437d55f fix some startup issues 2016-12-19 14:56:02 +01:00
jsteemann 818ffbdc49 better error reporting 2016-12-19 14:55:52 +01:00
jsteemann 1132d0820e prevent setting revision cache size to 0 by default for very low memory environments 2016-12-19 14:55:27 +01:00
Jan Christoph Uhde 822200ae2c now use traverseAndModify to remove the condition in filter expressions 2016-12-19 14:32:11 +01:00
Jan Christoph Uhde e83ac6e8b9 delete ast node instead of replacing it with true
in some cases.
2016-12-19 12:30:47 +01:00
Jan Christoph Uhde 74cc50bc1a Merge branch 'obi-geo-index' into devel
* obi-geo-index: (49 commits)
  add missing line
  remove debug code
  only do not use geoindex in inner loop if we want to sort
  manually cloning fixes the issue
  another try to fix the plan
  add dump of ExectionPlan.
  add debugging info for geoindex
  better tests
  add tests - sort && filter and add check for IndexNodes
  partial rewrite - now we start at endnodes
  add link to geo-index doc to sourcefile to clarify goals
  move collection acccesspath check to identify section
  prepare to fix filter-sort
  check if nodes are really sorted
  fix geo-index for cluster case
  add cluster to .gitignore
  work on geo-index in cluster
  fixes
  avoid use of geo-index-rule in cases where it could yield an invalid result
  back to performance
  ...

Conflicts:
	arangod/Aql/OptimizerRules.cpp
2016-12-19 11:40:01 +01:00
Jan Christoph Uhde 49fba88487 add missing line 2016-12-19 11:33:45 +01:00
Jan Christoph Uhde 5234ac3621 Squashed commit of the following:
commit 3952bf2009
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 19 11:00:52 2016 +0100

    remove debug code

commit 004da0c614
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 19 10:52:42 2016 +0100

    only do not use geoindex in inner loop if we want to sort

commit 32e1c7eac4
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 19 09:16:09 2016 +0100

    manually cloning fixes the issue

commit 75823fe879
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Fri Dec 16 15:19:10 2016 +0100

    another try to fix the plan

commit 2a404cfabe
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Wed Dec 14 12:21:21 2016 +0100

    add dump of ExectionPlan.

    Index Node seems to be created!

commit 0f8b496c57
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Wed Dec 14 10:46:24 2016 +0100

    add debugging info for geoindex

commit 3d17672feb
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 13 17:03:01 2016 +0100

    better tests

commit 615b85e5f5
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 13 16:09:00 2016 +0100

    add tests - sort && filter and add check for IndexNodes

commit e5fcdb7386
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 13 15:53:44 2016 +0100

    partial rewrite - now we start at endnodes

    and work upward towards singleton node

commit 7d93fe0bdd
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 13 11:48:40 2016 +0100

    add link to geo-index doc to sourcefile to clarify goals

commit aac38c8a00
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 13 11:42:49 2016 +0100

    move collection acccesspath check to identify section

    so we can compare nodes

commit b8cc674219
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 13 10:59:02 2016 +0100

    prepare to fix filter-sort

commit 783a9aff89
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 12 16:24:52 2016 +0100

    check if nodes are really sorted

commit 1d5e28d969
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 12 15:36:43 2016 +0100

    fix geo-index for cluster case

commit 634eeabc0b
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 12 13:46:20 2016 +0100

    add cluster to .gitignore

commit ae33a790fb
Merge: 1acfd65 27099a1
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 12 13:31:54 2016 +0100

    Merge branch 'devel' into obi-geo-index

    * devel:
      Clarify the default value of req.body
      fix VS warning
      moveShard jobs running
      cppcheck
      cppcheck

commit 1acfd65467
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 12 13:30:38 2016 +0100

    work on geo-index in cluster

commit 32d0bdc846
Merge: b660672 ad4ba24
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 12 09:15:36 2016 +0100

    Merge branch 'devel' of github.com:arangodb/arangodb into obi-geo-index

    * 'devel' of github.com:arangodb/arangodb: (132 commits)
      try to fix travis build
      Generate unique Swagger operationIds
      Add support for Swagger tags
      Add swagger route to Foxx API
      Require at least one arg in route def
      ported velocypack compatibility fix from arangodb/velocypack
      use bulk allocator for index elements
      fix memleak
      fix test in cluster
      remove unused code
      fixed resilience
      Update zwagger
      Readd satellite node
      Fix link
      Document OAuth1
      Nicer OAuth2 docs
      properly start the tarball
      fix VS compile errors
      clones method in Jobs more useful
      we don't need the dpkg-shlibdeps workaround anymore.
      ...

commit b6606727ee
Author: jsteemann <jan@arangodb.com>
Date:   Thu Dec 8 11:13:10 2016 +0100

    fixes

commit 5416755049
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Wed Dec 7 15:06:44 2016 +0100

    avoid use of geo-index-rule in cases where it could yield an invalid result

commit 3e24624c6e
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 6 15:56:22 2016 +0100

    back to performance

commit a941808ea8
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 6 10:29:38 2016 +0100

    remove debug code for performance testing

commit 2bae135b84
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 6 10:12:12 2016 +0100

    add test case

commit 71be8c215a
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Dec 6 10:00:11 2016 +0100

    node replacement is now working

commit d1a3e4482d
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 20:18:31 2016 +0100

    condition replace should be almost working

commit 275e36b603
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 19:49:10 2016 +0100

    add pointer that needs to be replaced with true

    in sort or filter condition

commit 6b93b9d2eb
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 19:38:01 2016 +0100

    bring functions in correct order

commit 5aabbb0ac0
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 16:21:21 2016 +0100

    fix const-ness so the condition can be modiefied

commit c84223d598
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 15:31:50 2016 +0100

    Add information if AstNode has been found in subexpression

    this information can be used in rewriting the condition and deciding
    if a sort node can be deleted or not

commit b0b660eb85
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 15:19:06 2016 +0100

    add iterative preorder walk for and conditions

commit 5dcf61c9ba
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 14:00:14 2016 +0100

    now work to a certain degree with binaray/naray-and in FILTER/SORT
    condition

commit 9b4e01eb3b
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 13:17:01 2016 +0100

    move geoIndexRule to a positon before inexes have been touched by
    optimizer

commit 9d04b37e58
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Mon Dec 5 12:46:23 2016 +0100

    within queries are now working

commit d858b9aa71
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Fri Dec 2 16:15:23 2016 +0100

    further implement within

commit 72d4790c68
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Fri Dec 2 12:22:07 2016 +0100

    remove boost::optional and make use of nodetype

commit e0220be12d
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Fri Dec 2 11:53:31 2016 +0100

    stronger split between identification of candidates and application of geo index rule

commit f27a22db06
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Fri Dec 2 11:20:09 2016 +0100

    fix debug code

commit fab9af483e
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Fri Dec 2 11:00:39 2016 +0100

    add extra log topic for development

commit 56b6be851c
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Fri Dec 2 10:44:42 2016 +0100

    add functions providing capability to check ast for parts of geoindex
    rules

commit 08ef943c83
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Thu Dec 1 23:01:50 2016 +0100

    fix tests

commit 56614ac8c8
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Thu Dec 1 16:30:09 2016 +0100

    switch unittests to chai and add failing test for FILTER condition

commit 8bb719c615
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Thu Dec 1 15:59:10 2016 +0100

    add first tests for geoindex

commit e619ef3e4e
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Thu Dec 1 12:21:51 2016 +0100

    now inspect sort and filter nodes

commit 5dbf5e14e3
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Thu Dec 1 10:03:24 2016 +0100

    refactor geoOptimization into smaller fucntions

    this prepares the creation of the within rules

commit 2110736d36
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Wed Nov 30 16:50:02 2016 +0100

    fix logical error in nextBabies

commit 972af3af4c
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Wed Nov 30 15:44:46 2016 +0100

    add within to geoindex iterator

commit 80c89d5f97
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Wed Nov 30 15:25:11 2016 +0100

    geo condition is now build with a extra parameter for within

commit 8bafcdfe92
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Wed Nov 30 14:10:16 2016 +0100

    GeoIndexIterator now takes parameters via ConditionNode

commit 86c21eb733
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Nov 29 14:13:35 2016 +0100

    make use of geo index cursor api

commit 5b3be69e10
Author: Jan Christoph Uhde <Jan@UhdeJC.com>
Date:   Tue Nov 29 11:48:32 2016 +0100

    WIP first working version of geoindex via aql
2016-12-19 11:06:32 +01:00
Jan Christoph Uhde 3952bf2009 remove debug code 2016-12-19 11:00:52 +01:00
Jan Christoph Uhde 004da0c614 only do not use geoindex in inner loop if we want to sort 2016-12-19 10:52:42 +01:00
jsteemann 151ec66bd5 applied fixes from R.A.P.
also made two comparison functions static
2016-12-19 10:04:24 +01:00
Jan Christoph Uhde 32e1c7eac4 manually cloning fixes the issue 2016-12-19 10:02:02 +01:00
jsteemann 789131d9d1 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-19 09:56:44 +01:00
jsteemann a655a0e5c8 removed unused parameter 2016-12-19 09:56:37 +01:00
Kaveh Vahedipour 3068b8ecb5 votes properly accounted for 2016-12-19 09:10:26 +01:00
Kaveh Vahedipour ea3db60b64 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-16 17:55:25 +01:00
Kaveh Vahedipour 0d3c1b16d9 faily confident about sendWithFailover 2016-12-16 17:55:10 +01:00
jsteemann 68a7e7ec13 try to fix devel build 2016-12-16 17:10:44 +01:00
jsteemann 4f10a6fb9c experimental micro optimizations 2016-12-16 15:52:16 +01:00
Kaveh Vahedipour 1312c59b6e 1st stage of fixing sendWithFailover 2016-12-16 15:23:24 +01:00
Jan Christoph Uhde 75823fe879 another try to fix the plan 2016-12-16 15:19:10 +01:00
Kaveh Vahedipour 1c9de86318 isWatch no longer needed after move to arangodb agency 2016-12-16 12:28:11 +01:00
Kaveh Vahedipour dd0146a54d Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-16 12:26:38 +01:00
Kaveh Vahedipour 0df8e4e2cd isWatch no longer needed after move to arangodb agency 2016-12-16 12:26:27 +01:00
jsteemann b4df6577c0 don't copy responses around 2016-12-16 11:00:18 +01:00
jsteemann 1e65d28e5b align memory for ARM 2016-12-15 16:26:27 +01:00
jsteemann 3e6064f772 preliminary fix for issue #2218 2016-12-15 15:45:33 +01:00
jsteemann 39093882e0 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-15 15:45:09 +01:00
Kaveh Vahedipour 043c0bd92f cannot depend on Slice.getDouble 2016-12-15 15:32:09 +01:00
jsteemann 9b42e9cee6 some improvements for memory management
added more memory diagnostics for memory usage:
- collection.figures() now returns a "readCache" attribute which contains the
  number of and memory usage of entries in the document revisions cache for the
  collection, and a "revisions" attribute with the number and memory usage
  of entries in the storage engine's revision lookup table for the collection
- the default value for --database.revision-cache-target-size was changed from
  75% of RAM to 30% of RAM
2016-12-15 15:30:28 +01:00
Kaveh Vahedipour 8251cd46e1 cannot depend on Slice.getDouble 2016-12-15 15:23:45 +01:00
Kaveh Vahedipour ebee9b6752 fixed MoveShard after cppcheck-frenzy 2016-12-15 11:44:36 +01:00
Kaveh Vahedipour 4919a65ee8 fixed MoveShard after cppcheck-frenzy 2016-12-15 11:35:40 +01:00
Kaveh Vahedipour 14ac7a168a correct rordering of agent list in redirect 2016-12-15 10:56:43 +01:00
Kaveh Vahedipour 22f8eab6ea short review and c++11 cosmetics 2016-12-15 08:46:40 +01:00
Kaveh Vahedipour 84fa31a39d agencycommanager ran in locks when ::redirect called ::failed 2016-12-14 17:27:46 +01:00
Kaveh Vahedipour 84415bb508 insecure access to front 2016-12-14 13:56:21 +01:00
Kaveh Vahedipour 486e544732 failed agent problem in AgencyComm resolved 2016-12-14 12:32:32 +01:00
jsteemann 10398b2977 speeds up some use cases of AQL CONTAINS 2016-12-14 12:22:30 +01:00
Jan Christoph Uhde 2a404cfabe add dump of ExectionPlan.
Index Node seems to be created!
2016-12-14 12:21:21 +01:00
Kaveh Vahedipour 9ab9f17cd1 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-14 12:12:16 +01:00
Kaveh Vahedipour a7f88840e7 Fixed redirect issues in AgencyComm 2016-12-14 12:12:00 +01:00
Jan Christoph Uhde 0f8b496c57 add debugging info for geoindex 2016-12-14 10:46:24 +01:00
jsteemann cf04966aba fix count 2016-12-14 10:30:46 +01:00
Jan Christoph Uhde 3d17672feb better tests 2016-12-13 17:03:01 +01:00
jsteemann 4d76ef962b added count(details = true) for sharded collections 2016-12-13 16:03:49 +01:00
Jan Christoph Uhde e5fcdb7386 partial rewrite - now we start at endnodes
and work upward towards singleton node
2016-12-13 15:53:44 +01:00
Kaveh Vahedipour 1c6837d0d9 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-13 15:36:23 +01:00
Kaveh Vahedipour 842d1030f0 Fixed dangling UUID problem in missing database directory 2016-12-13 15:36:19 +01:00
jsteemann 03acaaea47 fixed issue #2217 2016-12-13 14:19:55 +01:00
Jan Christoph Uhde 7d93fe0bdd add link to geo-index doc to sourcefile to clarify goals 2016-12-13 13:20:48 +01:00
Jan Christoph Uhde aac38c8a00 move collection acccesspath check to identify section
so we can compare nodes
2016-12-13 11:42:49 +01:00
jsteemann 5b1b28d0ec fix segfault 2016-12-13 11:38:38 +01:00
Jan Christoph Uhde b8cc674219 prepare to fix filter-sort 2016-12-13 10:59:02 +01:00
jsteemann ac48dbec14 optimization for ItemBlock serialization 2016-12-13 10:00:28 +01:00
jsteemann 12a819fee0 optimizations for AqlValue serialization and deserialization 2016-12-12 20:53:25 +01:00
jsteemann 5320c65bce cppcheck 2016-12-12 15:55:53 +01:00
jsteemann b96897e296 fixed some issues detected by coverity build tool 2016-12-12 15:41:54 +01:00
Jan Christoph Uhde 1d5e28d969 fix geo-index for cluster case 2016-12-12 15:36:43 +01:00
Jan Christoph Uhde ae33a790fb Merge branch 'devel' into obi-geo-index
* devel:
  Clarify the default value of req.body
  fix VS warning
  moveShard jobs running
  cppcheck
  cppcheck
2016-12-12 13:31:54 +01:00
Jan Christoph Uhde 1acfd65467 work on geo-index in cluster 2016-12-12 13:30:38 +01:00
Kaveh Vahedipour ec249e0d06 moveShard jobs running 2016-12-12 10:31:14 +01:00
Kaveh Vahedipour ec18efc80e moveShard jobs running 2016-12-12 10:29:41 +01:00
jsteemann e9322eea8d cppcheck 2016-12-12 10:10:58 +01:00
jsteemann 3e7070dfaa Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2016-12-12 10:10:46 +01:00
Jan Christoph Uhde 32d0bdc846 Merge branch 'devel' of github.com:arangodb/arangodb into obi-geo-index
* 'devel' of github.com:arangodb/arangodb: (132 commits)
  try to fix travis build
  Generate unique Swagger operationIds
  Add support for Swagger tags
  Add swagger route to Foxx API
  Require at least one arg in route def
  ported velocypack compatibility fix from arangodb/velocypack
  use bulk allocator for index elements
  fix memleak
  fix test in cluster
  remove unused code
  fixed resilience
  Update zwagger
  Readd satellite node
  Fix link
  Document OAuth1
  Nicer OAuth2 docs
  properly start the tarball
  fix VS compile errors
  clones method in Jobs more useful
  we don't need the dpkg-shlibdeps workaround anymore.
  ...
2016-12-12 09:15:36 +01:00