1
0
Fork 0
Commit Graph

556 Commits

Author SHA1 Message Date
Jan Christoph Uhde 677a79026c Foxx Security (#8845) 2019-04-25 09:56:29 +02:00
Frank Celler 91dea961f8 safety check 2019-04-21 00:33:46 +02:00
Max Neunhöffer 80bfb85695
Port agency performance tuning for many shards to devel. (#8647)
* Port agency performance tuning for many shards to devel.
* Add more IDs to LOG_TOPIC calls.
* Even more IDs for LOG_TOPIC.
* Fix a duplicate LOG_TOPIC ID.
* Fix an old merging bug in devel.
* Don't hesitate between phases one and two for small clusters.
2019-04-11 11:14:56 +02:00
Simon 348bc5d2cb Revert change in scripts/startLocalCluster.sh (#8527) 2019-03-22 14:26:48 +01:00
Simon 3ada15fc35 The Legendary El Cheapo (#8485) 2019-03-22 11:38:33 +01:00
Kaveh Vahedipour 94784e5639 startLocalCluster in rr debugging mode cannot be started with --console on agents / db servers (#7776) 2018-12-16 16:25:55 +01:00
Michael Hackstein 16d0874da5
Bug fix/synchronous replication catchup (#7146)
* merged fixes from 3.4

* odd fix

* Bug fix 3.4/sync repl release thread (#6784)

* First attempt to not block the thread that requires the EXCLUSIVE sync-up lock

* Fixed insertion of query into registry in rest replication handler.

* Removed unnecessary / false asserts as suggested in review. Fixed code comments.

* Replaced auto with a correct type as suggested in review

* Added a helper function to validate if a query is in use in the registry

* Fixed logic bug in usage of query registry

* Fixed compile issue

* Automaticly transfrom int -> bool in initializerlist sucks...

* Inverted boolen logic bug hidden due to int->bool beeing logically inverted.

* Today it seems that bools are too complicated for my brain.

* Removed failure point, didn't write a test for it, and it is hard to write it in the current test environment. Need to find a better solution in future

* Applied chenges required by @goedderz in review

* Bug fix 3.4/shorter foot in door (#7084)

* Implement `syncCollectionCatchup` in DatabaseTailingSyncer.

First stab, might not even compile.

* Fixed a typo.

* Fix a typo and a compilation problem.

* Further compilation fix.

* Implement two stage catchup.

* Two small corrections.

* Unified error messages in Synchronize shard job.

* Improved a code comment.

* Fixed autocasting bool->double and double->bool issue. That is truely one of the best features ever invented... </irony>

* Renamed doHardLock => toSoftLockOnly and inverted default value

* Merged soft/hard foot logic with Transaction splits

* Use scopeguards to cancel readlocks

* Bug fix 3.4/sync replication allow soft and hard lock (#6864)

* First attempt to not block the thread that requires the EXCLUSIVE sync-up lock

* Fixed insertion of query into registry in rest replication handler.

* Removed unnecessary / false asserts as suggested in review. Fixed code comments.

* Replaced auto with a correct type as suggested in review

* Added a helper function to validate if a query is in use in the registry

* Fixed logic bug in usage of query registry

* Fixed compile issue

* Implemented optional 'doHardLock' parameter in the replication acquire read-lock call. A hard-lock guarntees to stop all writes, a soft-lock may not.

* Fixed compile issue

* Automaticly transfrom int -> bool in initializerlist sucks...

* Inverted boolen logic bug hidden due to int->bool beeing logically inverted.

* Today it seems that bools are too complicated for my brain.

* Removed failure point, didn't write a test for it, and it is hard to write it in the current test environment. Need to find a better solution in future

* Applied chenges required by @goedderz in review

* Renamed doHardLock => toSoftLockOnly and inverted default value
2018-11-23 16:16:34 +01:00
Dan Larkin-York b447f98a7a Upgrade old MMFiles collections for compatibility with ArangoSearch. (#7248) 2018-11-07 15:52:37 +01:00
Tobias Gödderz 129d075d72 Added --rr parameter to startLocalCluster.sh (#6906) 2018-10-16 14:00:16 +02:00
Wilfried Goesgens 94805aad7c add script counting network connections (#6754)
This was added (and is currently not being used) to find a problem where a server in shutdown would hammer the agency with new connections. It was decided to implement a corresponding monitoring directly in the monitoring system (ganglia) rather than in the context of `testing.js`. Nevertheless, the script is retained for posteriority here.
2018-10-08 12:43:22 +02:00
Kaveh Vahedipour 3fd1375db5 Feature/detailed get maintenance feature (#6668)
* add local state output to _admin/actions
* test data generated from maintennace feature
* coordinators not needed for maintenance tests
2018-10-01 14:51:14 +02:00
Kaveh Vahedipour a73023e512 Bug fix/agency update endpoints (#6519)
* update endpoints in agency done the RAFT way
* fix mock interface
* tests functioning with new agent interfacwe
* handling non-leader
2018-09-28 15:14:48 +02:00
Simon 25f5c841b9 Fix recovery tests on MacOS (#6610) 2018-09-27 18:52:28 +02:00
Kaveh Vahedipour 1eab18be2a Feature/generate test data for maintenance script (#6249)
* test data script being fixed
* test data can be generated with expectations
* starting / stopping is done by script
2018-09-24 11:04:00 +02:00
Jan 9edb9dedef
fix logging of stdout for agency nodes (#6376)
also capture stderr as originally intended (was not logged)
2018-09-05 13:48:09 +02:00
Jan 24ca3acf97
rename `tests/js/*/tests/*` to `tests/js/*/*` (#6280) 2018-08-31 19:42:21 +02:00
Frank Celler 53978b6b93
Feature/semantic versioning (#6265) 2018-08-27 23:25:21 +02:00
Kaveh Vahedipour 28754cbf15 Feature/schmutz plus plus (#5972)
- Schmutz now called "Maintenance" and completely implemented in C++
 - Fix index locking bug in mmfiles
 - Fix a bug in mmfiles with silent option and repsert
 - Slightly increase supervision okperiod and graceperiod
2018-08-24 12:15:35 +02:00
Jan 4d4135d25c
Feature/add dbserver as an alias for primary (#6072)
* add "DBSERVER" as an alias for "PRIMARY"

This allows specifying the value "DBSERVER" for `--cluster.my-role`.
"DBSERVER" is only treated as an alias for "PRIMARY", because several
other parts of the code and APIs use the string "PRIMARY".
Changing these from "PRIMARY" to "DBSERVER" would make the change
downwards-incompatible, which we do not want.

The downside of this alias-only solution is that even when specifying
a role value of "DBSERVER", the server will still report its role as
"PRIMARY", which may be a bit confusing. The server will also generate
its id as "PRMR-XXXX" as before:

    2018-08-03T15:23:09Z [9584] INFO {cluster} Starting up with role PRIMARY
    2018-08-03T15:23:09Z [9584] INFO {cluster} Cluster feature is turned on. Agency version: {"server":"arango","version":"3.4.devel","license":"enterprise"}, Agency endpoints: http+tcp://[::]:4001, server id: 'PRMR-f655b728-4cea-44ac-88e9-8b34baa80958', internal address: tcp://[::1]:8629, role: PRIMARY

* adjusted documentation to use "DBSERVER" instead of "PRIMARY"

* api doc

- secondary role not used anymore. stated.
- primary database is not clear. replaced with dbserver
- brief referenced only dbserver and coordinator - better to provide wider description, in line with what is described below, as other roles can be returned

* typo

* typo

* added starting from 3.4

* additional warning

* cited in the release note
2018-08-06 17:20:50 +02:00
Jan 1b9fcb589d
make RocksDB the default engine (#5964) 2018-07-25 11:17:49 +02:00
Kaveh Vahedipour 5b307db85d Better log compaction 2018-07-16 12:09:58 +02:00
Jan d8c887ab61
remove hard-coded thread counts (#5816) 2018-07-10 14:39:09 +02:00
jsteemann bb0b55c318 ignore return value of script - fix supplied by @dothebart 2018-06-08 11:56:28 +02:00
Kaveh Vahedipour 10888f33bb unpacker for inspector reports (#5546) 2018-06-07 13:41:55 +02:00
Kaveh Vahedipour 03edbf44d7 Feature/arangodoc (#5476)
* introducing arangoinspect
2018-06-05 15:38:50 +02:00
Wilfried Goesgens 0b81f003a5 Bug fix/fix cmake warnings (#5503) 2018-06-01 15:51:20 +02:00
Jan Christoph Uhde 2829b3e77d moves -e to XTERMOPTIONS and adds delay (#5297)
* moves -e to XTERMOPTIONS and adds delay
* add delay only when rr is used
2018-06-01 10:07:59 +02:00
Heiko cfdcdc5e9e added prefix variable to build bundle, potentially fixes mac os package builds (#5455) 2018-05-24 20:47:00 +02:00
Heiko 946104f925 Bug fix/mac os build bundle update failure (#4991)
* fixed upgrade failure because of missing symlinks at this point

* removed not needed args in build bundle sh script
2018-05-17 15:54:43 +02:00
Simon a1416e1067 Make v8 optional on startup (#5220) 2018-04-30 12:48:57 +02:00
Wilfried Goesgens ac2a8721e6 Feature/aql native call apply (#5100) 2018-04-13 16:07:06 +02:00
Jan 7cb115a1a9
remove option `--cluster.my-local-info` (#4999) 2018-04-03 17:34:08 +02:00
Simon cde96d97aa RocksDB replication hardening & cleanup (#4639) 2018-02-23 18:15:04 +01:00
Jan 5acaf9b5a3
Bug fix/carnival (#4562) 2018-02-12 09:01:57 +01:00
Wilfried Goesgens ceed0f15e1 Packaging/fix debug config (#4352) 2018-02-08 11:45:43 +01:00
Vasiliy aa041ddfb9 locally tested only (#4476) 2018-02-05 11:24:34 +01:00
Max Neunhöffer e33d8085d4 Make sure docker tag is stored. (#4420) 2018-01-24 15:18:28 +01:00
Max Neunhöffer 7bae6980e8
Bug fix/agent lead hanger (#4147)
* Really enforce the hidden option --server.maximal-threads if given.
* Switch off --log.force-direct in scripts/startStandAloneAgency.sh
* Lower the timeout for sending AppendEntriesRPC to 150s.
* Erase _earliestPackage when becoming a leader.
* Challenge leadership in agent main loop.
* Use steady_clock for _earliestPackage.
* Change _lastAcked and _leaderSince to steady_clock as well.
* time difference calculations based on old readSystemClock to steadyClockToDouble
* All system_clock transitioned to steady_clock in Agent. Remaining system_clock are user input / output or timestamps
* Inception system_clock to steady_clock
2017-12-27 16:45:39 +01:00
Jan 2a96df5ca5
Feature iresearch (#4071) 2017-12-18 15:04:59 +01:00
Dan Larkin 9cd8c47eb7 Renamed arangoimp to arangoimport (with alias for compatibility.) (#4040) 2017-12-14 21:31:21 +01:00
Jan 73bce34174
potentially fix send request timeout (#4026) 2017-12-13 17:54:12 +01:00
Wilfried Goesgens 7dd439f203 add build target to compile the starter if its present (#3679) 2017-12-06 16:33:37 +01:00
jsteemann 0aae349d1d do not restrict to 5 threads 2017-11-17 17:28:46 +01:00
Simon Grätzer 0e485f7441 Fixing collection name collection handling in Syncer (#3710) 2017-11-17 16:36:57 +01:00
Jan Christoph Uhde 89384dd767 fix startLocalCluster for darwin (#3641) 2017-11-09 20:08:35 +01:00
Jan Christoph Uhde 27460a92e1 Store parameters of startLocalCluster.sh (#3593)
Store parameters of startLocalCluster.sh

This should help you to bring the cluster up again when you
continue to work after some time without investigating the
port numbers.

Restore parameters if no arguments are given
2017-11-08 11:26:54 +01:00
m0ppers 19879ff568 Allow custom address to be set from the outside (#3469) 2017-10-20 15:03:22 +02:00
Simon Grätzer 7c31960cf2 Feature/async failover (#3451) 2017-10-18 23:59:29 +02:00
Frank Celler e876d8412c Feature/jenkins pipeline (#3347) 2017-09-29 12:30:22 +02:00
m0ppers e7e3852e0b Feature/branch docker images (#3269)
* Docker images
2017-09-20 00:10:41 +02:00