1
0
Fork 0
Commit Graph

14094 Commits

Author SHA1 Message Date
Alan Plum be178a39df More consistent config/deps output in Foxx API (3.2) (#3829)
* Correctly expose parsed/raw config

This makes accessing the configuration more consistent by distinguishing between the raw (assigned) and parsed (validated/default) values.
Previously there was no way to recognise default values for unset config options and the "current" value did not actually reflect what the service sees.

* Add minimal option to config/deps routes

The default values are backwards compatible with the existing behaviour but can be overridden to consistently get more/less output.

* Actually merge warnings into non-mininal response
2017-11-29 14:32:32 +01:00
Heiko ee92887387 Bug fix/gv catch graph error and fix renderer cleaanup 3 2 (#3790) 2017-11-27 12:23:59 +01:00
Heiko e4e8e4f09d UI: added a delay within the graph viewer while changing the colors of the graph (#3759) 2017-11-24 12:31:28 +01:00
m0ppers 7378ccf2be Bug fix/🔧 server 🗑️ due to changed cluster ⛑️ 3.2 (#3752) 2017-11-21 15:51:16 +01:00
Frank Celler a4798f52bf release version 3.2.8 2017-11-18 12:03:51 +01:00
Frank Celler 8fcb8bc471 release version 3.2.7 2017-11-15 12:23:07 +01:00
Frank Celler 4538cd83e3 fixed statistic display error 2017-11-15 12:23:06 +01:00
jsteemann fe7394e04d do not pass string "undefined" as cluster id 2017-11-15 12:23:05 +01:00
Michael Hackstein fc05ef43aa Bug fix/issue 3597 bfs filter (#3697) 2017-11-14 16:25:47 +01:00
Frank Celler e0bf8daec8 release version 3.2.7 (RC1) 2017-11-14 16:25:37 +01:00
jsteemann b9908b8caf speed up test by a lot in cluster 2017-11-13 23:03:36 +01:00
Max Neunhöffer 7daae64dc1 Fix agency shutdown bug. (#3684) 2017-11-13 22:48:54 +01:00
jsteemann 6c8d1b0efe fix failing test 2017-11-13 21:12:10 +01:00
Jan 391c090f85 flush the WAL after truncate and rotate journals in order to free space (#3686) 2017-11-13 18:56:28 +01:00
Michael Hackstein 733d75c8b6 Bug fix/speedup shard distribution (#3645) (#3673)
* Bug fix/speedup shard distribution (#3645)

* Added a more sophisticated test for shardDistribution format

* Updated shard distribution test to use request instead of download

* Added a cxx reporter for the shard distribuation. WIP

* Added some virtual functions/classes for Mocking

* Added a unittest for the new CXX ShardDistribution Reporter.

* The ShardDsitributionReporter now reports Plan and Current correctly. However it does not dare to find a good total/current value and just returns a default. Hence these tests are still red

* Shard distribution now uses the cxx variant

* The ShardDistribution reporter now tries to execute count on the shards

* Updated changelog

* Added error case tests. If the servers time out the mechanism will stop bothering after two seconds and just report default values.

* Moved the time computation of shardDistribution to a later point. This improves the speed for many shards collections
2017-11-13 12:11:53 +01:00
Jan e2d5243cbe backport of multiple fixes to 3.2 (#3646) 2017-11-10 16:08:32 +01:00
Jan bbb6f6a956 fixed issue #3618 (#3622) 2017-11-09 10:04:06 +01:00
Jan Christoph Uhde 9cea2fc53c fixes: geoindex type 1 queries (#3611)
Using indexes with a single field is now possible
2017-11-08 17:14:03 +01:00
Jan d70f39d28d fix issue #3581 (#3609) 2017-11-08 17:07:40 +01:00
Frank Celler e8eab2c6fd added buckets to recovery tests 2017-11-07 10:37:13 +01:00
Jan 29f02fb688 fixed issue 3403: How to kill long running AQL queries with the browser console's AQL (#3564) 2017-11-02 14:30:24 +01:00
Heiko 1600804ca1 Origin/bug fix/ui collection settings error notifications 3 2 (#3548) 2017-10-30 17:35:25 +01:00
Wilfried Goesgens 8c59dafe9e release version 3.2.6 2017-10-26 21:01:42 +02:00
jsteemann c2c14e69b3 fix tests for replicationFactor 2017-10-26 20:04:18 +02:00
Heiko 6289f9fada fixed event cleanup in cluster shards view - Bug fix/issue 1123 - 3.2 (#3532)
* ui shard view event not removed properly

* fixed event cleanup in cluster shards view
2017-10-26 18:23:01 +02:00
jsteemann a898af3723 jslint 2017-10-26 14:56:52 +02:00
Simon Grätzer d684eaa7f8 Collection properties update in rocksdb (#3523)
* Allow changing replicationFactor on coordinator

* Fixing logic

* Allowing change of replication factor

* Additional input validation

* grrr

* Testing invalid inputs

* Better document various methods, fixing properties update in rocksdb

* Removing invalid parameter before creating shards

* Changing sleeps to dynamic check in Current
2017-10-26 14:51:18 +02:00
jsteemann 4d223597db jslint 2017-10-26 14:36:25 +02:00
Jan ed3163d920 do not run AQL queries during Foxx queue startup (#3508)
* do not run AQL queries during Foxx queue startup

* always create keyspace
2017-10-26 09:58:34 +02:00
Heiko bf52848538 replicationFactor of a collection is now changeable in a cluster environment (#3502) 2017-10-26 09:56:25 +02:00
Simon Grätzer 47600e1ea1 Changing replication factor in 3.2 (#3513)
* Allow changing replicationFactor on coordinator

* Fixing logic

* Allowing change of replication factor

* Additional input validation

* grrr

* Testing invalid inputs
2017-10-26 09:56:17 +02:00
Heiko cda24ea725 Bug fix/ui event behaviour 3 2 (#3500)
* changed coordshort api behaviour in ui

* reduced cluster dashboard api calls
2017-10-26 09:55:49 +02:00
Max Neunhöffer f66291e690 Bug fix/port agency fixes 32 (#3492)
* Revert "Return the result of the inquiry (#3472)"

This reverts commit 1dc1a9858b.

* Revert "cherry picking of bug-fix/agency-restart-after-compaction-and-holes-i… (#3423)"

This reverts commit 324184d6bf.

* State has to keep log for removeConflicts and acoording log all the way (#3249)

* Bug fix/sort out agency locks (#3306)

New locking concept in Agency. Ensure empty heartbeats can be sent, answered and processed without long locks. Adjust logging. Fix compaction bugs.

* Bug fix/agency compactor deadlock (#3335)

* Fix a deadlock between Agent thread and compactor thread.
* Improve comments in header.
* Organise clean shutdown of agency threads.

* Bug fix/agency leader timeouts (#3373)

* Send out empty heartbeats regardless of non-empty AppendEntriesRPC.
* Also improve logging:
  Note if a log in the empty heartbeat sending takes > 0.01 s.
  Clearly mark places where a leader resigns in logging.
  Log if no empty heartbeat is sent out.
* Make leader more tolerant w.r.t. incoming AppendEntriesRPC responses.
* Add debug logging for _lastAcked and challengeLeadership.
* Remove some unused code. Do not count ourselves in challengeLeadership.
* Removal of entire activation/deactivation mechanisms in agency
* TRI_microtime up to c++11
* added term to response to sendAppendEntries.

* Bug fix/agency restart after compaction and holes in log (#3413)

* State fixes holes in RAFT index range
* Avoid application of entries older than compaction index _cur and guard for unsigned overflow

* Return the result of the inquiry (#3465)

* Add a hidden AGENCY_DUMP for agency emergency recovery. (#3474)

* Port more changes from devel to 3.2.

This could not be cherry-picked, since the changes concerning the agency
were in squash commits which touch a lot of different things.

* Make members private in AgentConfiguration

* Log update of agency configuration.

* Do not deal with active in gossip phase.

* Take out some debugging output.
2017-10-26 09:53:56 +02:00
Heiko cce430eb9a V3.2.5 documentation (#3487)
* make sure we always have properly defined whether we found systemd or… (#3379)

* make sure we always have properly defined whether we found systemd or not.

* fix source file location - we don't pre-process this.

* minify

* added hs to docu

* info arangorestore
2017-10-23 14:42:41 +02:00
Michael Hackstein 76fff5478f Bug fix/general graph cluster fixes (#3444)
* Added a test for cluster options in general graph module

* The general-graph attribute tests are now only executed in cluster. They do not affect single-server. Also added an additional test, when modifing an existing edge definition.

* The general graph now stores and uses information about replicationFactor and numberOfShards when adding collections to it

* Added a http api test for cluster options in general graph

* Fixed HTTP api/gharial tests to check if cluster options (nrShards, repFactor) are preserved

* General graph module is now more resilient differently formed edgeDefinitions. It now allows single collections as string as in addition to an array with one or more elements. Throws a meaningful error if we do not have a valid from/to list.

* Updated Changelog

* Fixed HTTP documentation

* Updated Manual documentation for Graph creation.

* Fixed rev => _rev. Little overseen typo
2017-10-20 14:52:50 +02:00
Jan b93dcb0e2d Bug fix/fix shard state restore display 32 (#3445)
* don't add  items into the array if we have an empty list member.

* we mustn't display 100% here, since its a rounding error. If, the checkmark would be set.

* rather use string cutting to round so we don't get into the 100% trap.
2017-10-17 14:25:33 +02:00
jsteemann 0f3bbe8779 release version 3.2.5 2017-10-16 22:28:51 +02:00
Jan 6581606e79 fixed issue #3395 (#3400) 2017-10-13 12:26:19 +02:00
Heiko 4055731acd Bug fix/issue 3228 3.2 - fixed wrong validation of name user property (#3392)
* fixed issue #3228

* changelog
2017-10-13 12:23:04 +02:00
Heiko acfb0218c6 no default index selected during index creation (#3369) 2017-10-04 14:12:15 +02:00
Heiko 6d6cfd52df fixed unresponsive events in cluster shards view (#3362) 2017-10-03 23:26:50 +02:00
Wilfried Goesgens 4d366f58f2 add more statistical values to the statistics handler (#3344) (#3350) 2017-10-03 21:41:25 +02:00
Wilfried Goesgens 762dfdd65b release version 3.2.4 2017-09-26 12:05:24 +02:00
Frank Celler d733aa925f Merge branch 'devel' of github.com:arangodb/arangodb into 3.2 2017-09-25 17:43:00 +02:00
Jan 43e0fd318e Bug fix/fixes 1909 (#3285)
* remove TRI_ERROR_INTERNAL usage

* prevent assertion failure from occurring

* ensure downwards-compatibility for explain handler

* allow schmutz to drop system collections as well - needed for arangojs tests
2017-09-19 21:56:32 +02:00
Wilfried Goesgens 2c29822afe if we successfully deleted the directory don't re-attempt. (#3288) 2017-09-19 18:16:04 +02:00
Wilfried Goesgens baa7217432 port 7d6f146530e8cfd6d923a3f0a8a0aaa8668ad06d - wait for queue to be actually run. (#3287) 2017-09-19 18:14:16 +02:00
Wilfried Goesgens adeb926065 Work around windows processes not releasing resources (#3284)
- add retry for cleanup when deleting of directory fails
- if we fail 5 times, let the final cleanup handle it.
2017-09-19 12:17:50 +02:00
Jan 0733c04101 remove art (#3282) 2017-09-19 09:55:29 +02:00
Heiko 3390462cba ui: added replicationFactor option during SmartGraph creation. (#3267) 2017-09-17 22:07:47 +02:00
Heiko aff2dea012 ui: added replicationFactor option during SmartGraph creation. (#3268) 2017-09-17 22:07:30 +02:00
Wilfried Goesgens 0faf9be695 Feature/compaction configuration (#3217)
* make the different values influencing the compaction run configurable

* Compaction statistics handling

 - we mustn't keep the number of dead objects on the compacted datafiles statistics, else it will be compacted again.
 - keep statistics of the compaction runs on the DatafileStatistics object
 - add the new statistics on DatafileStatistics to the figures api
 - implement test that assures only one compaction is run, and the statistic values are maintained

* don't mention the version number

* Implement review

 - fix documentation
 - allow 0 maxfiles to enable users to disable combined of datafiles
 - add statistic element that counts the number of combined datafiles

* Implement review

 - fix documentation
 - use locks to make statistic values consistent.
 - fix typo in variable name

* fix temporary variable unnecessary.

* changelog
2017-09-15 14:37:30 +02:00
Wilfried Goesgens 2833bd6185 Bugfix/cleanup graphs (#3250)
* when running against an external server also setup the proper connection

* cleanup grahs after testing
2017-09-15 14:20:21 +02:00
Heiko a03a86fe46 fixed wrong selection of the database inside the internal cluster js api (#3202) 2017-09-13 17:19:18 +02:00
Mark e8f635c21b Fix Foxx queue test (#3220) 2017-09-13 17:10:35 +02:00
Jan 5165155ed1 Bug fix/fixes 0609 (#3227)
* do not use V8 variant of AQL functions in early optimization stage when a C++ variant is available

* additionally, simplify AQL function definitions and aliases

* warn when more than 90% of max mappings are in use

* added C++ variant of replication catchup

* added `--log.role` option

* updated CHANGELOG

* removed non-existing scheduler.threads option from config

* removed useless __FILE__, __LINE__ invocations

* updated CHANGELOG

* allow a priority V8 context

* remove TRI_CORE_MEM_ZONE

* try to fix Windows errors & warnings

* cleanup

* removed memory zones altogether

* exclude system collections from collection tests
2017-09-13 16:28:21 +02:00
Jan e1a1427c1e remove shell-database.js from git again, and apply modifications to shell-database.js.in (#3248) 2017-09-13 09:49:05 +02:00
Jan dc46c9db07 more logging so we can find a specific bug (#3247) 2017-09-13 09:19:50 +02:00
jsteemann f8d8a561a4 fix various issues 2017-09-13 09:03:28 +02:00
Wilfried Goesgens 9457395b80 workaround cluster not allowing to drop system collections 2017-09-13 00:02:30 +02:00
Wilfried Goesgens b41cfac17c cleanup 2017-09-13 00:00:32 +02:00
Wilfried Goesgens c18d35dbf0 fix cleanup 2017-09-12 19:32:34 +02:00
Wilfried Goesgens 11437d20a9 fix cleanup 2017-09-12 15:57:33 +02:00
Wilfried Goesgens 5b131450a2 revalidate that tests clean up properly. 2017-09-12 14:49:06 +02:00
Wilfried Goesgens 0a9b9e6025 cleanup after testrun, lintify 2017-09-12 14:48:20 +02:00
Wilfried Goesgens 48c5587c67 only run testsuite when we're on enterprise and actually do have tests 2017-09-12 12:11:13 +02:00
Wilfried Goesgens ad74472c14 Merge pull request #3239 from arangodb/bugfix/cleanup_api-gharial-spec
fix cleanup
2017-09-12 10:11:31 +02:00
Wilfried Goesgens e396681fb8 fix cleanup 2017-09-12 10:11:05 +02:00
Wilfried Goesgens 1f9b322684 fix cleanup 2017-09-11 18:38:26 +02:00
Mark a81e424339 Fix Foxx queue test (#3219) 2017-09-11 14:59:24 +02:00
Simon Grätzer e067f7d41a Making foxx-queues test deterministic (#3172) 2017-09-08 09:14:54 +02:00
Wilfried Goesgens 9fcd051978 release version 3.2.3 2017-09-07 18:10:50 +02:00
Kaveh Vahedipour 1a88830e46 jslint warnings 2017-09-07 17:04:49 +02:00
Kaveh Vahedipour aa65fb2aa6 cherry picking supervision fixes from devel 2017-09-07 16:32:24 +02:00
Kaveh Vahedipour 627f344266 fixed a bug, where when servers failed, when also agency leadership c… (#3189)
* fixed a bug, where when servers failed, when also agency leadership changes

* redid entire design of checkDBServers/checkCoordinators.

* comparison in supervision must be between oldPersisted and newHealth

* UI stuff

* UI stuff

* FailedServer test needed adjustment

* Hopefully final round

* fixed supervision failure detection

* FailedServer tests back to origin devel

* oldNot documented among preconditions in Agency HTTP API docs

* changed only look for status updated

* non action line in api-cluster
2017-09-07 16:10:23 +02:00
Jan Christoph Uhde fecd1a3d66 Feature/planning 499 different error codes for version check (#3118) (#3208)
* return different error codes for check-version

* Adds data file for exit codes that can be used by ArangoDB applications

* add some exit codes

* better return codes for centos

* add codes in arangod

* remove test code

* prevent re-downloading of starter and other small improvements

* fix some erros

* finish centos

* update urls

* add info about systemd detection

* move further towards a working systemd setup

* set service type to simple

* add arangodb-update-db script

* start work on debian packages

* a db dir that is already in place (former installation) should be reused now

* fix minor bugs

* Implement exit code translation in the windows installer.

* add autogenerated NSIS exit code mapping
2017-09-07 16:08:35 +02:00
Simon Grätzer ffc465433a No access collections Improvements (#3190)
* consolidated EdgeDocumentToken

* optimizing cluster traversal

* adding skip collection checks

* API cleanup

* copying AQLValue to avoid use-after-free bugs

* Fixing rocksdb SingleServerEdgeCursor

* Fixing a collection resolving issue
2017-09-07 14:55:07 +02:00
Simran 741141251a Aardvark: Disable vertical line in query explain editor
Turns off the print margin, which didn't really serve any purpose anyway
2017-09-06 17:31:27 +02:00
Michael Hackstein 611f1472f7 Bug fix/issue 3106 orphans in general graph (#3147)
* Added a test-case for #3106

* Added a fix for #3106
2017-09-06 13:30:07 +02:00
Frank Celler 0c68ab742b generated files 2017-09-05 17:18:08 +02:00
Jan f9b20c784b execute DOCUMENT function via CXX on coordinator in cluster mode (#3201) 2017-09-05 17:10:08 +02:00
Heiko 014356d6a8 Bug fix/fixed cluster js 3 2 (#3203)
* fixed wrong ui cluster health information

* fixed wrong selection of the database inside the internal cluster js api
2017-09-05 17:09:41 +02:00
Jan eacad99df7 Bug fix/fixes 0409 (#3199)
* some authentication optimizations...

don't query the permissions for one database three times, and don't build up tons of useless temporary strings for each request

* fix some floating point inaccuracies in AstNode value comparisons
2017-09-04 18:04:05 +02:00
Michael Hackstein da4d7966a8 Bug fix/truncate geo (#3173)
* Add geo truncate test

* added a specific truncate method to rocksdb geo index

* Fixing truncate on rocksdb geo-indexes with support for rollbacks
2017-09-04 17:48:04 +02:00
Jan f49e0ca237 execute DOCUMENT function via CXX on coordinator in cluster mode (#3196) 2017-09-04 17:34:24 +02:00
Max Neunhöffer 09133306e7 Bug fix/log levels sync repl (#3188)
* Clarify an error message.

* Lower log levels in Schmutz.

Things that can happen in normal life should not be on level error.
Sometimes two servers try concurrently to synchronize a shard, one is
faster, the other removes the shard before the sync is done. This is not
an error condition because we do not want users to worry.
2017-09-01 16:10:59 +02:00
jsteemann b1fd92c438 removed useless explain 2017-09-01 14:14:01 +02:00
Simon Grätzer 829083099d Making foxx-queues test deterministic (#3172) 2017-08-31 18:33:27 +02:00
Simon Grätzer 88d01b89b5 Optimizations for Caches and Graph Traversals (#3169) 2017-08-31 18:33:10 +02:00
Andreas Streichardt 7d2ab6055f Merge with latest changes in improve-jenkins
stashing should work better now
2017-08-31 17:53:48 +02:00
Wilfried Goesgens be8e04295d be more ignorant about existing or missing directories on startup / cleanup. 2017-08-31 15:42:37 +02:00
Jan 2f05b0ffeb jslint (#3167) 2017-08-30 11:28:51 +02:00
Wilfried Goesgens c662dfc863 Cleanup after each testrun (#3109)
* Cleanup after each testrun

 - add a success testsuite next to the fail testsuite
 - create temporary directories in the fail & success testsuites
 - add a function to cleanup the last unshifted directory
 - don't say we're crashed when exiting with the help message

* Specify temp path for SUT so its files will be removed after cleanup.

 - cleanup
 - don't use getTempFile(), it will create another subdirectory that we don't clean up afterwards...

* Fix temp path usage

 - creating a 'bundles' directory wherein we would keep our temporary bundle files would collide if we'd clean it up.
 - create 'bundles-tmpxxxx' instead so its individual to us and we can remove it when done without problems.

* properly create & pass in a temporary directory - as we now require this.

* Remove intermediate directory recursive - for some unknown reason there may be temp files created.

* we need to unify tempfilenames here too.

* use individual suite names

* use the standart performTests to run the backup tests - so we have the proper directory and server handling from the infrastructure.

* fix temporary directory handling in the recovery tests.

* script to build debugging debian packages

* Improve test shutdown

 - handle a set of options globally per testsuite, so they don't need to clone them inside.
 - properly cleanup the slave instance of the replication tests after each run.
 - The per testsuite options vector will fix the behaviour that after one failed testsuite
   all other suites won't be cleaned up anymore.

* don't call the overal cleanup if anything failed.

* fix cleaning up of directories.

* cleanup, fix directory creation / deletion / dummy creation.

* cleanup, fix directory creation / deletion / dummy creation.

* fix tempdir handling for the recovery tests
2017-08-30 10:48:24 +02:00
Jan Christoph Uhde 20e1a673fd Feature/planning 499 different error codes for version check (#3118)
* return different error codes for check-version

* Adds data file for exit codes that can be used by ArangoDB applications

* add some exit codes

* better return codes for centos

* add codes in arangod

* remove test code

* prevent re-downloading of starter and other small improvements

* fix some erros

* finish centos

* update urls

* add info about systemd detection

* move further towards a working systemd setup

* set service type to simple

* add arangodb-update-db script

* start work on debian packages

* a db dir that is already in place (former installation) should be reused now

* fix minor bugs

* Implement exit code translation in the windows installer.

* add autogenerated NSIS exit code mapping
2017-08-30 10:47:31 +02:00
Manuel B 34bd7ddd24 fix setup of read only test (#3165)
* fix setup of read only test

* Update readOnly.js
2017-08-30 10:46:01 +02:00
Simon Grätzer 885ea3dd5f Remove attribute option for arangoimp (#3141)
* Adding a remove attribute option to arangoimp (only for csv)

* Adding documentation

* Fixed log statement

* Update CHANGELOG
2017-08-30 10:45:02 +02:00
Kaveh Vahedipour 00650e6a3f Bug fix/agency mt fixes (#3158)
* added debugging methods

* try to fix invalid access in case of error

* remove unused members

* bugfixes and comments

* all agency fixes in

* merge bug

* partially unguarded Agent::lead fixed

* all agency fixes in

* added nrBlocked to thread startup eval

* added nrBlocked to thread startup eval

* recombination of cases in State::get

* some maps replaced with unordered_maps

* optimized maps some
2017-08-30 10:43:51 +02:00
Jan c29a2745d2 Bug fix/fixes 2808 (#3156)
* fixed jslint warnings

* fix undefined behavior

* move check into if, so check tools do not complain
2017-08-28 15:16:41 +02:00
Wilfried Goesgens d0f159e848 Don't use global static variables as collection caches - this may cau… (#3150)
* Don't use global static variables as collection caches - this may cause troubles.

* cleanup: remove old cluster kickstarter UI remaints.

* cleanup - remove references to long gone tests
2017-08-28 15:04:05 +02:00
Michael Hackstein 0f1b6e32eb Bug fix/issue 3106 orphans in general graph (#3147)
* Added a test-case for #3106

* Added a fix for #3106
2017-08-28 15:02:15 +02:00