1
0
Fork 0
Commit Graph

14046 Commits

Author SHA1 Message Date
Wilfried Goesgens 69dbbf9e2d add more statistical values to the statistics handler (#3344) 2017-09-29 14:22:00 +02:00
Frank Celler 70e206fc25 terminal codes 2017-09-28 22:23:54 +02:00
Max Neunhoeffer 3a4cf41270 Revert "Revert "rework process handling (#3322)""
This reverts commit d2b62c99d6.
2017-09-28 15:53:19 +02:00
Max Neunhoeffer d2b62c99d6 Revert "rework process handling (#3322)"
This reverts commit c56e4949b9.
2017-09-28 15:25:05 +02:00
Wilfried Goesgens c56e4949b9 rework process handling (#3322)
- migrate the process handling to c++ where appropriate
- move code definition / usage closer together
- add function to portably detect external processes (not spawned by us) and whether we may
- send them signals
- add portable code to send signals to processes
- for linux match what impact a signal will have on the process we send it
- check the status of the process we sent the signal, and return if its non-deadly or the process terminated
- after 8 retries with 1 second sleep send a hard kill.
- killExternal() now returns the same structure as statusExternal()
- don't block signals on spawned processes
2017-09-28 13:35:54 +02:00
Max Neunhöffer 22e46978a6 Bug fix/sort out agency locks (#3306)
New locking concept in Agency. Ensure empty heartbeats can be sent, answered and processed without long locks. Adjust logging. Fix compaction bugs.
2017-09-27 15:22:30 +02:00
Max Neunhoeffer e070921bc6 Revert "shut down the second instance properly (#3332)"
This reverts commit 890cd995ef.
2017-09-27 09:22:14 +02:00
Max Neunhoeffer 78ec0ec469 Revert "Bugfix/fix test arangod shutdown command (#3260)"
This reverts commit 3afebaed42.
2017-09-27 09:18:39 +02:00
Frank Celler bc60ebcc5f fixed jslint 2017-09-26 21:28:17 +02:00
Wilfried Goesgens 890cd995ef shut down the second instance properly (#3332) 2017-09-26 18:32:37 +02:00
Wilfried Goesgens c37143b070 During the startup of arangod the client will fail to connect. (#3302)
Since we retry anyways, silence the error message for the first tries
to reduce meaningless log output of testing.js
2017-09-26 14:54:59 +02:00
Jan 2525a3a1bd Feature/mmfiles hash lookup performance (#3265)
* speed up full collection scans in mmfiles engine

* some API cleanup
2017-09-26 14:48:06 +02:00
Wilfried Goesgens 3afebaed42 Bugfix/fix test arangod shutdown command (#3260)
* If our arango-object claims its got a connection to the arangodb server, use it to send a shutdown signal to the server.

If not, fall back to using a download http request.

* don't use kill to shut down the server, we now can use the regular shutdown command.
2017-09-26 14:46:30 +02:00
Jan 43e0fd318e Bug fix/fixes 1909 (#3285)
* remove TRI_ERROR_INTERNAL usage

* prevent assertion failure from occurring

* ensure downwards-compatibility for explain handler

* allow schmutz to drop system collections as well - needed for arangojs tests
2017-09-19 21:56:32 +02:00
Wilfried Goesgens 2c29822afe if we successfully deleted the directory don't re-attempt. (#3288) 2017-09-19 18:16:04 +02:00
Wilfried Goesgens baa7217432 port 7d6f146530e8cfd6d923a3f0a8a0aaa8668ad06d - wait for queue to be actually run. (#3287) 2017-09-19 18:14:16 +02:00
Wilfried Goesgens adeb926065 Work around windows processes not releasing resources (#3284)
- add retry for cleanup when deleting of directory fails
- if we fail 5 times, let the final cleanup handle it.
2017-09-19 12:17:50 +02:00
Jan 0733c04101 remove art (#3282) 2017-09-19 09:55:29 +02:00
Heiko 3390462cba ui: added replicationFactor option during SmartGraph creation. (#3267) 2017-09-17 22:07:47 +02:00
Wilfried Goesgens 0faf9be695 Feature/compaction configuration (#3217)
* make the different values influencing the compaction run configurable

* Compaction statistics handling

 - we mustn't keep the number of dead objects on the compacted datafiles statistics, else it will be compacted again.
 - keep statistics of the compaction runs on the DatafileStatistics object
 - add the new statistics on DatafileStatistics to the figures api
 - implement test that assures only one compaction is run, and the statistic values are maintained

* don't mention the version number

* Implement review

 - fix documentation
 - allow 0 maxfiles to enable users to disable combined of datafiles
 - add statistic element that counts the number of combined datafiles

* Implement review

 - fix documentation
 - use locks to make statistic values consistent.
 - fix typo in variable name

* fix temporary variable unnecessary.

* changelog
2017-09-15 14:37:30 +02:00
Wilfried Goesgens 2833bd6185 Bugfix/cleanup graphs (#3250)
* when running against an external server also setup the proper connection

* cleanup grahs after testing
2017-09-15 14:20:21 +02:00
Heiko a03a86fe46 fixed wrong selection of the database inside the internal cluster js api (#3202) 2017-09-13 17:19:18 +02:00
Jan 5165155ed1 Bug fix/fixes 0609 (#3227)
* do not use V8 variant of AQL functions in early optimization stage when a C++ variant is available

* additionally, simplify AQL function definitions and aliases

* warn when more than 90% of max mappings are in use

* added C++ variant of replication catchup

* added `--log.role` option

* updated CHANGELOG

* removed non-existing scheduler.threads option from config

* removed useless __FILE__, __LINE__ invocations

* updated CHANGELOG

* allow a priority V8 context

* remove TRI_CORE_MEM_ZONE

* try to fix Windows errors & warnings

* cleanup

* removed memory zones altogether

* exclude system collections from collection tests
2017-09-13 16:28:21 +02:00
Jan e1a1427c1e remove shell-database.js from git again, and apply modifications to shell-database.js.in (#3248) 2017-09-13 09:49:05 +02:00
Jan dc46c9db07 more logging so we can find a specific bug (#3247) 2017-09-13 09:19:50 +02:00
jsteemann f8d8a561a4 fix various issues 2017-09-13 09:03:28 +02:00
Wilfried Goesgens 9457395b80 workaround cluster not allowing to drop system collections 2017-09-13 00:02:30 +02:00
Wilfried Goesgens b41cfac17c cleanup 2017-09-13 00:00:32 +02:00
Wilfried Goesgens c18d35dbf0 fix cleanup 2017-09-12 19:32:34 +02:00
Wilfried Goesgens 11437d20a9 fix cleanup 2017-09-12 15:57:33 +02:00
Wilfried Goesgens 5b131450a2 revalidate that tests clean up properly. 2017-09-12 14:49:06 +02:00
Wilfried Goesgens 0a9b9e6025 cleanup after testrun, lintify 2017-09-12 14:48:20 +02:00
Wilfried Goesgens 48c5587c67 only run testsuite when we're on enterprise and actually do have tests 2017-09-12 12:11:13 +02:00
Wilfried Goesgens ad74472c14 Merge pull request #3239 from arangodb/bugfix/cleanup_api-gharial-spec
fix cleanup
2017-09-12 10:11:31 +02:00
Wilfried Goesgens e396681fb8 fix cleanup 2017-09-12 10:11:05 +02:00
Wilfried Goesgens 1f9b322684 fix cleanup 2017-09-11 18:38:26 +02:00
Mark a81e424339 Fix Foxx queue test (#3219) 2017-09-11 14:59:24 +02:00
Kaveh Vahedipour 627f344266 fixed a bug, where when servers failed, when also agency leadership c… (#3189)
* fixed a bug, where when servers failed, when also agency leadership changes

* redid entire design of checkDBServers/checkCoordinators.

* comparison in supervision must be between oldPersisted and newHealth

* UI stuff

* UI stuff

* FailedServer test needed adjustment

* Hopefully final round

* fixed supervision failure detection

* FailedServer tests back to origin devel

* oldNot documented among preconditions in Agency HTTP API docs

* changed only look for status updated

* non action line in api-cluster
2017-09-07 16:10:23 +02:00
Simon Grätzer ffc465433a No access collections Improvements (#3190)
* consolidated EdgeDocumentToken

* optimizing cluster traversal

* adding skip collection checks

* API cleanup

* copying AQLValue to avoid use-after-free bugs

* Fixing rocksdb SingleServerEdgeCursor

* Fixing a collection resolving issue
2017-09-07 14:55:07 +02:00
Simran 741141251a Aardvark: Disable vertical line in query explain editor
Turns off the print margin, which didn't really serve any purpose anyway
2017-09-06 17:31:27 +02:00
Jan eacad99df7 Bug fix/fixes 0409 (#3199)
* some authentication optimizations...

don't query the permissions for one database three times, and don't build up tons of useless temporary strings for each request

* fix some floating point inaccuracies in AstNode value comparisons
2017-09-04 18:04:05 +02:00
Michael Hackstein da4d7966a8 Bug fix/truncate geo (#3173)
* Add geo truncate test

* added a specific truncate method to rocksdb geo index

* Fixing truncate on rocksdb geo-indexes with support for rollbacks
2017-09-04 17:48:04 +02:00
Jan f49e0ca237 execute DOCUMENT function via CXX on coordinator in cluster mode (#3196) 2017-09-04 17:34:24 +02:00
jsteemann b1fd92c438 removed useless explain 2017-09-01 14:14:01 +02:00
Simon Grätzer 829083099d Making foxx-queues test deterministic (#3172) 2017-08-31 18:33:27 +02:00
Simon Grätzer 88d01b89b5 Optimizations for Caches and Graph Traversals (#3169) 2017-08-31 18:33:10 +02:00
Andreas Streichardt 7d2ab6055f Merge with latest changes in improve-jenkins
stashing should work better now
2017-08-31 17:53:48 +02:00
Wilfried Goesgens be8e04295d be more ignorant about existing or missing directories on startup / cleanup. 2017-08-31 15:42:37 +02:00
Jan 2f05b0ffeb jslint (#3167) 2017-08-30 11:28:51 +02:00
Wilfried Goesgens c662dfc863 Cleanup after each testrun (#3109)
* Cleanup after each testrun

 - add a success testsuite next to the fail testsuite
 - create temporary directories in the fail & success testsuites
 - add a function to cleanup the last unshifted directory
 - don't say we're crashed when exiting with the help message

* Specify temp path for SUT so its files will be removed after cleanup.

 - cleanup
 - don't use getTempFile(), it will create another subdirectory that we don't clean up afterwards...

* Fix temp path usage

 - creating a 'bundles' directory wherein we would keep our temporary bundle files would collide if we'd clean it up.
 - create 'bundles-tmpxxxx' instead so its individual to us and we can remove it when done without problems.

* properly create & pass in a temporary directory - as we now require this.

* Remove intermediate directory recursive - for some unknown reason there may be temp files created.

* we need to unify tempfilenames here too.

* use individual suite names

* use the standart performTests to run the backup tests - so we have the proper directory and server handling from the infrastructure.

* fix temporary directory handling in the recovery tests.

* script to build debugging debian packages

* Improve test shutdown

 - handle a set of options globally per testsuite, so they don't need to clone them inside.
 - properly cleanup the slave instance of the replication tests after each run.
 - The per testsuite options vector will fix the behaviour that after one failed testsuite
   all other suites won't be cleaned up anymore.

* don't call the overal cleanup if anything failed.

* fix cleaning up of directories.

* cleanup, fix directory creation / deletion / dummy creation.

* cleanup, fix directory creation / deletion / dummy creation.

* fix tempdir handling for the recovery tests
2017-08-30 10:48:24 +02:00
Jan Christoph Uhde 20e1a673fd Feature/planning 499 different error codes for version check (#3118)
* return different error codes for check-version

* Adds data file for exit codes that can be used by ArangoDB applications

* add some exit codes

* better return codes for centos

* add codes in arangod

* remove test code

* prevent re-downloading of starter and other small improvements

* fix some erros

* finish centos

* update urls

* add info about systemd detection

* move further towards a working systemd setup

* set service type to simple

* add arangodb-update-db script

* start work on debian packages

* a db dir that is already in place (former installation) should be reused now

* fix minor bugs

* Implement exit code translation in the windows installer.

* add autogenerated NSIS exit code mapping
2017-08-30 10:47:31 +02:00
Simon Grätzer 885ea3dd5f Remove attribute option for arangoimp (#3141)
* Adding a remove attribute option to arangoimp (only for csv)

* Adding documentation

* Fixed log statement

* Update CHANGELOG
2017-08-30 10:45:02 +02:00
Kaveh Vahedipour 00650e6a3f Bug fix/agency mt fixes (#3158)
* added debugging methods

* try to fix invalid access in case of error

* remove unused members

* bugfixes and comments

* all agency fixes in

* merge bug

* partially unguarded Agent::lead fixed

* all agency fixes in

* added nrBlocked to thread startup eval

* added nrBlocked to thread startup eval

* recombination of cases in State::get

* some maps replaced with unordered_maps

* optimized maps some
2017-08-30 10:43:51 +02:00
Jan c29a2745d2 Bug fix/fixes 2808 (#3156)
* fixed jslint warnings

* fix undefined behavior

* move check into if, so check tools do not complain
2017-08-28 15:16:41 +02:00
Wilfried Goesgens d0f159e848 Don't use global static variables as collection caches - this may cau… (#3150)
* Don't use global static variables as collection caches - this may cause troubles.

* cleanup: remove old cluster kickstarter UI remaints.

* cleanup - remove references to long gone tests
2017-08-28 15:04:05 +02:00
Michael Hackstein 0f1b6e32eb Bug fix/issue 3106 orphans in general graph (#3147)
* Added a test-case for #3106

* Added a fix for #3106
2017-08-28 15:02:15 +02:00
Mark d611414682 Fix HTTP Foxx API Json parsing (#3129) 2017-08-28 14:55:13 +02:00
Michael Hackstein 4674db78e1 Bug fix/foxx queue auth (devel) (#3122)
* Add Foxx queue authentication test

* Fixed runAsUser in Foxx queues. In the successful case there was always a silent error thrown...
2017-08-28 14:49:52 +02:00
Heiko 696bd7357b fixed wrong ui cluster health information (#3151) 2017-08-28 14:44:32 +02:00
Jan 14389e856d remove obsolete, dysfunctional endpoints (#3135)
according to the manual and CHANGELOG we should have removed these endpoints in 3.0 already...
2017-08-25 14:00:34 +02:00
Frank Celler 6d08d4f4aa Bug fix/scheduler delete (#3077)
* removed delete call

* cleanup

* lower cpu activity of log thread too

* fix log messages

* do not enter threads into unordered_set, as it is unneeded

* do not compile in calls to disabled plan cache

* moved AQL regex cache from thread local variables to a class of its own

* more sensible thread creation and destruction
2017-08-25 12:00:17 +02:00
Wilfried Goesgens 0c2261445b use indices on our foxx queues queries; Migrate queries away from aqb… (#3101)
* use indices on our foxx queues queries; Migrate queries away from aqb; style guide cleanup.

* update CHANGELOG
2017-08-24 17:06:03 +02:00
Wilfried Goesgens 2a82cf8667 when running the client tests on an already running server we have to specify the server root directory. (#3102) 2017-08-24 17:05:51 +02:00
Mark 3f0026d016 Fix foxx queue test (#3119) 2017-08-24 14:48:20 +02:00
Jan a212f45a86 Bug fix/issues 2308 (#3117)
* remove API docs for endpoints that were deleted in 3.0

* remove unused variable

* set all scalar values in the ctor, so check tools do not complain

* move Result objects

* prevent potential nullptr access

* remove ambiguous boolean parameter with no clear meaning

* make code check tools happy

* don't allow copying cache Findings, allow moving Results

* the debug functionality for counting RocksDB key ranges was broken

this produced sporadic test failures

* remove superfluous iostream include

* fix range checks

* don't leak if an error happens during database removal

* try to simplify Result a bit

* try to deletion checks a bit more robust
2017-08-24 14:47:22 +02:00
Jan 5c5b5e548d Feature/unique vpack index lookup performance improvements (#3087)
* fixed issue #3075

* update the known issues document, as some issues have already been fixed

* speed up equality lookups in unique vpack indexes

* fixed wording
2017-08-24 14:39:09 +02:00
Frank Celler 4933eb4fea Revert "fixed return code"
This reverts commit 776ca8d406.
2017-08-23 14:57:32 +02:00
Frank Celler 776ca8d406 fixed return code 2017-08-23 14:19:24 +02:00
Jan 74f9f9d4fc use filename conventions so the test only gets executed where it should be xecuted (#3108) 2017-08-22 23:22:01 +02:00
Simon Grätzer a14ffcd26e Relaxing edge cache test asserts (#3103)
* fixing cache resizing bug

* reenabling test

* relaxing test asserts
2017-08-22 15:52:48 +02:00
Jan 39465193c2 fix replication (#3099) 2017-08-22 15:51:50 +02:00
Dan Larkin 84f11c223d Fixed issue with periodic syncing and WAL file retention. (#3098) 2017-08-22 15:51:12 +02:00
Frank Celler 536625a50a Bug fix/foxx queue registration (#3097)
* Fix Foxx queue registration

Multiple registration of the same queue was possible. The queue document in _queue was saved multiple times with the same key/id

* Add additional foxx queue test
2017-08-22 11:56:07 +02:00
Jan Christoph Uhde df76bbc690 Bug fix/planning issue 514 replication api (#3021)
* add "cluster selectivity estimates" to CHANGELOG

* add some documentation to RocksDBRestReplicationHandler

* fix building with relative paths

* add some more doc

* add some tests for the replication api

* fix RocksDBRestReplicationHandler and add tests

* update documentation

* remove obsolete parameter

* fix error message

* Implementing logger-first-tick, logger-tick-ranges. Fixing dump `chunkSize` documentation
2017-08-22 10:46:06 +02:00
Dan Larkin 5708fc8fab Added test to ensure RocksDB recovers keygen data outside WAL. (#3072) 2017-08-22 10:42:46 +02:00
Simon Grätzer b76b53d87a Fix edge cache behaviour (#3079)
* fixing cache resizing bug

* reenabling test
2017-08-22 10:40:52 +02:00
Mark 16f2788b6b Fix Foxx queue registration (#3089)
Multiple registration of the same queue was possible. The queue document in _queue was saved multiple times with the same key/id
2017-08-22 10:38:46 +02:00
Kaveh Vahedipour 15a87b2982 removed database loop around rebalancing of shards; thus rebalance shards now only affects current database (#3091)
This is UI only
2017-08-21 17:13:27 +02:00
Jan 47e29e6e1f Bug fix/issues 1806 (#3069)
* fix buffer overruns in linenoise for long input lines

* don't make historian repeatedly print the same error messages that nothing can be done about

* make the implementations of the logging operator<<s not throw exceptions, so that logging does throw exceptions as an unintended side effect

* update CHANGELOG

* improve error message

* don't copy strings, but pass them by const reference
2017-08-18 22:58:09 +02:00
Kaveh Vahedipour 9cad75e4e8 Feature/cluster id and extended health (#3073)
* added unique id to cluster, added access to Health

* added agents to health api

* added agents to health api

* added agents to health api

* transaction information for api

* agents listed like other servers

* missing line through merge conflict

* fixed git merge glitch
2017-08-18 11:36:53 +02:00
Kaveh Vahedipour 1d1e0f5a50 Feature/cluster id and extended health (#3046)
* added unique id to cluster, added access to Health

* added agents to health api

* added agents to health api

* added agents to health api

* transaction information for api

* agents listed like other servers

* missing line through merge conflict
2017-08-18 11:13:23 +02:00
m0ppers 0dfea58d54 Feature/remove manual zippery (#3036) 2017-08-17 23:30:27 +02:00
Mark 136faad9b8 Fix issue #3037: Foxx, internal server error when I try to add a new service (#3056) 2017-08-17 21:47:27 +02:00
Jan e612aad2a3 fixed issue #3044 (#3048) 2017-08-17 21:34:57 +02:00
Jan 19d872dcee fixed issue #3039 (#3045) 2017-08-17 21:33:20 +02:00
Mark 39d5cc9aac Fix foxx github url (#3042) 2017-08-17 21:30:20 +02:00
Simon Grätzer fadafa6384 Fixing engine stats in arangosh (#3038) 2017-08-17 21:26:06 +02:00
Jan 1d6b7abc80 fix and extend journal-related tests (#3043) 2017-08-16 17:39:56 +02:00
Jan 6180fcfdd1 Bug fix/prevent multiple journals (#3027)
* prevent multiple journals

* fix documentation

* remove _nrDesired, as it is not used anymore
2017-08-15 23:02:08 +02:00
Jan 79d76c89fb Bug fix/use count for checksum (#3033)
* Count as checksum

* Make readLockId optional as well so upgrades are possible

* fix option name in startup script

* fix some replication issues with RocksDB engine
2017-08-15 11:24:54 +02:00
Wilfried Goesgens 4187e179a3 fix documentation - add missing files. 2017-08-14 13:04:20 +02:00
Jan 8e4dac4fc4 fix fulltext index removal performance, simplified code (#3015)
* simplify index API a bit

* fix fulltext index removal performance, simplified code

* updated CHANGELOG

* fix hanging test

* try to fix shutdown problem

* improve fulltext query performance

* fixed duplicate var

* removed obsolete code

* fix some shutdown races

* do not call ensureIndex that often
2017-08-12 09:25:30 +02:00
Jan Christoph Uhde 0eaf4cabd9 Feature/js to cpp transaction handler (#2985)
* implement transaction handler in c++

* add fake request object

* move general code into extra file

* improve error messages for RestJobHandler

* support cancel operation for async jobs with RestTransactionHandler

* fix integration test and add some optional debugging output

* fix returning of context

* fix error type

* fix code in cluster test

* remove unused variable
2017-08-11 09:29:34 +02:00
Heiko a22fcd2d38 ui: fixed a bug when success event triggers twice in a modal (#2983) 2017-08-10 22:15:36 +02:00
Heiko ce96113d61 fixed the appearance of the documents filter (#2984) 2017-08-10 22:14:35 +02:00
Heiko 286db19df2 graph vertex collections not restricted to 10 anymore (#2987) 2017-08-10 22:13:45 +02:00
Heiko e06c85886e UI detection of JWT token in case of server restart or upgrade (#3001)
* UI detection of JWT token in case of server restart or upgrade

* added jwt verify check if response is unauthorized
2017-08-10 22:12:45 +02:00
Jan Christoph Uhde ab5f5f488d fix building with relative paths (#2979)
* fix building with relative paths

* fix locating of configuratin files
2017-08-10 09:41:15 +02:00
Jan e6c6c5acda Bug fix/pre release woes (#2988)
* fixed issue #2982

* updated CHANGELOG
2017-08-10 09:39:28 +02:00
Jan e8d6ff21d0 fix failing recovery test (called undefined function) (#2994) 2017-08-10 09:38:20 +02:00