1
0
Fork 0
Commit Graph

389 Commits

Author SHA1 Message Date
Andrey Abramov 01d9baf359 remove TRI_ERROR_ARANGO_VIEW_NOT_FOUND, rename TRI_ERROR_ARANGO_COLLECTION_NOT_FOUND to TRI_ERROR_ARNANGO_DATA_SOURCE_NOT_FOUND 2018-03-17 19:36:14 +03:00
Vasiliy 148bdb7158 issue 344.6: remove some redundant functions (#4842) 2018-03-15 11:03:35 +01:00
Vasiliy c8739cd3cd manually-merge: cache data-sources in CollectionNameResolver 2018-03-14 10:11:50 +03:00
Simon 35136a89c0 Fix some problems with active failover (#4540) 2018-02-09 15:11:53 +01:00
Jan fe0fca9029
Bug fix/restore unlock (#4387) 2018-01-25 15:56:27 +01:00
Jan b2b6c06cbf
Feature/efficiency (#3736) 2018-01-05 16:51:31 +01:00
Jan 25af4d7f69
try to not fail hard when a collection is dropped while the WAL is tailed (#4226) 2018-01-04 16:31:11 +01:00
Simon Grätzer 81bd732fe1 Pregel: fixing nullptr access (#4055)
* fixing issue with nullptr access

* Fix cluster test
2017-12-15 15:52:24 +01:00
Dan Larkin 9cd8c47eb7 Renamed arangoimp to arangoimport (with alias for compatibility.) (#4040) 2017-12-14 21:31:21 +01:00
Jan c7e9565b4a
hopefully fix logs (#4035) 2017-12-14 14:44:03 +01:00
Simon Grätzer c7ae7a7a2b Fixing nondeterministic behaviour (#4024) 2017-12-13 17:56:01 +01:00
Jan 282be208cc
remove TRI_usleep and TRI_sleep, and use std::this_thread::sleep_for … (#3817) 2017-12-06 18:43:49 +01:00
Jan Christoph Uhde 41a8c581a3 fix windows build (#3855) 2017-12-06 16:35:45 +01:00
Jan b4f6ee9273 Feature/improved index api for unique constraints and replication (#3715) 2017-11-16 21:02:01 +01:00
Jan 151c717d22 fix potential duplicate closing of typed buffer (#3587) 2017-11-07 10:27:51 +01:00
Simon Grätzer 974fa47a87 Fixing Pregel module (#3557)
* Fixing wrong response logic

* fixing rest pregel handler
2017-10-31 20:15:51 +01:00
Simon Grätzer 7c31960cf2 Feature/async failover (#3451) 2017-10-18 23:59:29 +02:00
m0ppers bb1d303473 Cmake 5.0 complains about unused lambda captures (#3390) 2017-10-13 12:20:48 +02:00
Jan 0561bf45ce Bug fix/isrestore (#3283)
* Make isRestore work in the cluster.

This covers sharded collections with default sharding and non-default
sharding.

* always use locally generate revision ids for storing and looking up documents
2017-10-03 11:53:49 +02:00
Jan 2525a3a1bd Feature/mmfiles hash lookup performance (#3265)
* speed up full collection scans in mmfiles engine

* some API cleanup
2017-09-26 14:48:06 +02:00
Jan 5165155ed1 Bug fix/fixes 0609 (#3227)
* do not use V8 variant of AQL functions in early optimization stage when a C++ variant is available

* additionally, simplify AQL function definitions and aliases

* warn when more than 90% of max mappings are in use

* added C++ variant of replication catchup

* added `--log.role` option

* updated CHANGELOG

* removed non-existing scheduler.threads option from config

* removed useless __FILE__, __LINE__ invocations

* updated CHANGELOG

* allow a priority V8 context

* remove TRI_CORE_MEM_ZONE

* try to fix Windows errors & warnings

* cleanup

* removed memory zones altogether

* exclude system collections from collection tests
2017-09-13 16:28:21 +02:00
Simon Grätzer ffc465433a No access collections Improvements (#3190)
* consolidated EdgeDocumentToken

* optimizing cluster traversal

* adding skip collection checks

* API cleanup

* copying AQLValue to avoid use-after-free bugs

* Fixing rocksdb SingleServerEdgeCursor

* Fixing a collection resolving issue
2017-09-07 14:55:07 +02:00
Jan 1ace247273 Bug fix/scheduling et al (#3161)
* added V8 context lifetime control options `--javascript.v8-contexts-max-invocations` and `--javascript.v8-contexts-max-age`

* make thread scheduling take into account most of the tasks dispatched via the io service
2017-08-30 10:40:02 +02:00
Jan 47e29e6e1f Bug fix/issues 1806 (#3069)
* fix buffer overruns in linenoise for long input lines

* don't make historian repeatedly print the same error messages that nothing can be done about

* make the implementations of the logging operator<<s not throw exceptions, so that logging does throw exceptions as an unintended side effect

* update CHANGELOG

* improve error message

* don't copy strings, but pass them by const reference
2017-08-18 22:58:09 +02:00
Simon Grätzer 3f58a44e3b Fix cases where the root user has access to excluded collections (#2856) 2017-08-03 21:16:08 +02:00
Simon Grätzer 9786b198c2 Allow pregel jobs to interrupt on shutdown (#2855) 2017-07-27 15:29:01 +02:00
Simon Grätzer 4f0ad75cef Fixing loading of some multi collection Graphs (#2840) 2017-07-19 20:34:47 +02:00
Simon Grätzer f50a36181d Various authentication related issues (#2824) 2017-07-18 22:22:09 +02:00
Frank Celler a5a25754ed Feature/reduce extraction to projection (#2792)
* reduce extractions to projections

* recycle string buffers in SocketTask

* micro optimizations for mmfiles indexes

* added special lookup function for _key

* moved function into the correct file

* speed up key buffer allocations a bit

* added noexcept specifier

* correctly name variable

* explicitly move bounds

* fix and speedup from/toPersistent functions

* reuse string from ManagedDocumentResult for multiple lookups

* use move-assign

* a bit less work for single server

* speedup AQL function HASH

* single fetch optimization

* performance optimization for the case when no documents need to be returned

* make reduce-extraction-to-projection a RocksDB-only optimizer rule

* cppcheck

* try to fix compile error on MacOS

* bug fix for MacOSX

* missing namespace (in Windows compile)
2017-07-14 08:40:29 +02:00
Max Neunhöffer 2f874249bb Bug fix/adjust agency comm timeouts (#2765)
* Take out 503 timeouts altogether.
* Overhaul of AgencyComm::sendWithFailover loop.
* Let performRequests optionally ignore 404 coll not found.
* Fix error message "database not found" when AgencyComm failed.
* Add log entries in Agency if locks are acquired too slowly.
* Reexecute the javascript cluster sync stuff even if there was no plan/current change...So failed sync jobs can retry later...
* Cover callbacks in Communicator by lock. This fixes https://github.com/arangodb/planning/issues/370
* Put in delay in waiting for leader in agency test.
* Schmutz logging to heartbeat topic.
* Add more lock time diagnostic in agent.
* Switch on agencycomm tracing in coordinator.
2017-07-13 00:44:28 +02:00
Frank Celler 40d73d5a8b Revert "[WIP] Feature/reduce extraction to projection (#2735)"
This reverts commit 5bfcff30cd.
2017-07-12 12:52:14 +02:00
Jan 5bfcff30cd [WIP] Feature/reduce extraction to projection (#2735)
* reduce extractions to projections

* recycle string buffers in SocketTask

* micro optimizations for mmfiles indexes

* added special lookup function for _key

* moved function into the correct file

* speed up key buffer allocations a bit

* added noexcept specifier

* correctly name variable

* explicitly move bounds

* fix and speedup from/toPersistent functions

* reuse string from ManagedDocumentResult for multiple lookups

* use move-assign

* a bit less work for single server

* speedup AQL function HASH

* single fetch optimization

* performance optimization for the case when no documents need to be returned

* make reduce-extraction-to-projection a RocksDB-only optimizer rule
2017-07-12 11:22:29 +02:00
Frank Celler bbe7484521 Feature/auth context (#2704)
* added read-only users
2017-07-02 23:15:57 +02:00
Simon Grätzer 2d3f1d8245 Added assert(false) to force coredump in jenkins 2017-06-07 17:44:52 +02:00
Simon Grätzer 571356a6ae added pregel vertex / edge count checks 2017-06-07 17:18:59 +02:00
Simon Grätzer 53ece582a8 optimized all index iterator 2017-05-31 11:34:32 +02:00
Simon Grätzer 6ecf733585 Merge branch 'devel' of https://github.com/arangodb/arangodb into feature/storage-format-refactoring
# Conflicts:
#	tests/RocksDBEngine/TypeConversionTest.cpp
2017-05-30 13:42:44 +02:00
jsteemann 53b150b206 added tests for intermediate commits 2017-05-30 12:03:58 +02:00
Simon Grätzer f8ab86e160 Begin storage format refactoring 2017-05-29 16:00:55 +02:00
Simon Grätzer 88977d204a Merge branch 'devel' of https://github.com/arangodb/arangodb into column-family
# Conflicts:
#	arangod/RocksDBEngine/RocksDBIndex.cpp
#	arangod/RocksDBEngine/RocksDBIndex.h
#	arangod/RocksDBEngine/RocksDBPrimaryIndex.cpp
#	arangod/RocksDBEngine/RocksDBPrimaryIndex.h
2017-05-23 11:17:30 +02:00
jsteemann a7b3839e6c renamed "getMore" to "next" 2017-05-23 08:53:13 +02:00
Simon Grätzer ad3da410b2 Pregel improvements 2017-05-22 11:10:28 +02:00
Simon Grätzer 45d7c5c715 Various debugging changes 2017-05-20 17:44:28 +02:00
Simon Grätzer 7cd0bc3c62 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/RocksDBEngine/RocksDBPrimaryIndex.cpp
2017-05-19 11:15:36 +02:00
Simon Grätzer 8ae7e00eb5 DMID improvements 2017-05-18 23:27:54 +02:00
Simon Grätzer 2bd2a15cb3 Column family support 2017-05-18 22:08:34 +02:00
Simon Grätzer 6dc5e2617a Fixes to DMID 2017-05-18 15:06:04 +02:00
Simon Grätzer d0f9ea5138 Fixing issue 2017-05-17 14:17:03 +02:00
Simon Grätzer 0c6de98365 Fixed SLPA 2017-05-17 11:50:24 +02:00
Simon Grätzer df3eed2289 Various changes 2017-05-16 10:58:15 +02:00
Simon Grätzer ead7ebcd7b Little changes for SLPA support 2017-05-15 10:42:25 +02:00
Simon Grätzer fe0e296737 RocksDB: fixing WAL tailing issues 2017-05-13 01:08:22 +02:00
Simon Grätzer 958c19de35 stuff 2017-05-12 14:07:30 +02:00
Simon Grätzer 5b79e77128 Begin work on transaction wrapper 2017-05-12 10:52:08 +02:00
Simon Grätzer f101e21328 Geo index update, renaming 2017-05-11 13:19:51 +02:00
Simon Grätzer 5d20b79c0f Incremental Sync 2017-04-25 12:01:58 +02:00
jsteemann 67cd947266 fixed typos 2017-04-18 14:54:48 +02:00
Simon Grätzer bab71f6339 Fixing jslint errors 2017-04-18 12:15:26 +02:00
jsteemann 08cd4ced33 moved class around 2017-04-07 13:13:48 +02:00
Simon Grätzer fce51594ac Fixing hash index semantics 2017-04-06 12:41:47 +02:00
Simon Grätzer a90e62bc02 Conversion errors 2017-04-06 10:50:40 +02:00
Simon Grätzer 1ef373dea7 Fixing some conversion issues 2017-04-05 12:16:53 +02:00
jsteemann 81dcfbbe3d pass trx into numberDocuments 2017-03-31 11:33:16 +02:00
Jan Christoph Uhde 95007fe28e Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api-arango-result
* 'engine-api' of https://github.com/arangodb/arangodb: (46 commits)
  Merged RocksDBPathBasedIndex into RocksDBVPackIndex.
  fix handling of externals
  fix toArray()
  fix returning documents
  Added hash-, skip list, persistent indexes
  harmonize filtering - filter on full filename.
  mini modifications
  standardize starting of servers for replication tests
  Edge index compliant with design doc
  another fix for #2404
  Moved „removeLargeRange“ method to commons
  Added length byte to IndexValue keys.
  fixed issue #2404
  Added drop to primary index
  Added drop() to indexes
  Fixes a coordinator crash in Clustered Traversal. In case of failover during query planning.
  Fixed edge index
  Expand on CORS documentation
  Let ArangoDB handle the allow-credentials header
  make the authentication tests run on directories
  ...
2017-03-30 19:46:17 +02:00
Jan Christoph Uhde b83ae2ab82 refactor some code to make use of arangodb::Result 2017-03-30 09:39:21 +02:00
Simon Grätzer 901abc6705 Fixing some windows conversion warnings 2017-03-29 11:35:37 +02:00
jsteemann e3ca787992 warn before we run out of file descriptors 2017-03-29 02:35:46 +02:00
Simon Grätzer 0b79c69884 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-27 08:56:20 +02:00
Simon Grätzer aadcad3a00 Fix various conversion warnings 2017-03-24 17:52:50 +01:00
Simon Grätzer 2091dae875 Pregel: Fix concurrent creation of aggregator 2017-03-24 15:14:12 +01:00
Simon Grätzer fbbc118160 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-24 11:04:38 +01:00
Simon Grätzer 39b2e349dd Pregel: Coverty Scan fixes 2017-03-24 11:04:15 +01:00
jsteemann 8e4e463239 don't call throwing functions in dtor 2017-03-23 19:40:13 +01:00
Simon Grätzer b69523d736 Pregel: Fixed memory leak warning 2017-03-23 16:14:06 +01:00
Simon Grätzer 6b5a6b4c2b Pregel: Fixed memory leak warning 2017-03-23 15:54:18 +01:00
Simon Grätzer bac7081983 Pregel: Reduced logspam 2017-03-22 17:55:43 +01:00
Simon Grätzer 7bc01b46e0 Pregel: Changed scheduler post call 2017-03-20 12:22:16 +01:00
Simon Grätzer 553421196a Pregel: Migrated to boost deadline_timer 2017-03-17 19:54:33 +01:00
Simon Grätzer 79c2e87bac Pregel: code reformatting 2017-03-17 16:21:25 +01:00
Simon Grätzer 31f30378cf Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-17 15:55:07 +01:00
Simon Grätzer 162a0476c3 Pregel: Removed ThreadPool, added test for memory mapping 2017-03-17 15:55:01 +01:00
jsteemann 650d1afad5 fix leaks during cleanup 2017-03-17 13:38:23 +01:00
Simon Grätzer 68f32177c6 Added test for mapped files in TypedBuffer.h 2017-03-16 17:17:05 +01:00
Simon Grätzer 5cc259e2a1 Pregel micro optimization 2017-03-16 14:12:43 +01:00
Simon Grätzer a823442811 Changed Pregel LogLevels to debug where appropriate 2017-03-16 12:25:24 +01:00
Simon Grätzer 215937a884 Fixing cppcheck and jslint warnings 2017-03-16 11:20:35 +01:00
Simon Grätzer e6ad88f2a3 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-16 10:52:08 +01:00
Simon Grätzer f2c133d5f6 Fix pregel test 2017-03-16 10:52:02 +01:00
jsteemann 22c86744b2 cppcheck 2017-03-16 10:34:09 +01:00
Simon Grätzer f22aec113f Fix typo in summary.md, fix segmentation fault, fix test 2017-03-15 17:47:33 +01:00
Simon Grätzer 3c8a6dbe9e Fixing windows build and warnings 2017-03-15 14:10:54 +01:00
Simon Grätzer 24eaf6a6ef Reverting integer hashing 2017-03-15 12:35:40 +01:00
Simon Grätzer 45fca509a8 Fixing linux build 2017-03-15 10:41:54 +01:00
Simon Grätzer 529cb4ae85 Integer ID for testing 2017-03-15 10:20:48 +01:00
Simon Grätzer ec6eb718f2 Working lazyloading with new memory backend 2017-03-13 23:25:53 +01:00
Simon Grätzer 7e0ed82f0f Memory Mapped files 2017-03-13 15:13:47 +01:00
Simon Grätzer 7b35f75b23 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/CMakeLists.txt
#	arangod/GeneralServer/GeneralServerFeature.cpp
2017-03-13 12:25:28 +01:00
Simon Grätzer f2d77435c6 Added memory mapped file 2017-03-12 00:46:54 +01:00
Simon Grätzer 5f4a8844f5 Fixed parallelism parameter 2017-03-10 13:56:10 +01:00
Simon Grätzer aa156ac28f Micro-Optimizations 2017-03-09 17:00:24 +01:00
Simon Grätzer 00d77cbb5e Fix compiler warnings 2017-03-09 14:38:39 +01:00
Simon Grätzer a1752da492 Added single server support 2017-03-08 18:20:36 +01:00
Simon Grätzer c049576c59 Added single server support 2017-03-07 15:07:51 +01:00
Simon Grätzer 0d5f8ae5b8 Fixed canceling of storage, changed the docs 2017-03-07 12:14:12 +01:00
Simon Grätzer 0b64bf3bc2 Fixed pregel test, async default off 2017-03-07 10:41:03 +01:00
Simon Grätzer 5b1cb0ec6d Various fixes 2017-03-06 15:41:27 +01:00
Simon Grätzer 77d02669c4 Added LabelPropagation 2017-03-02 19:53:34 +01:00
Simon Grätzer b2ceda6250 Some more async stuff 2017-03-02 15:03:35 +01:00
Simon Grätzer fefed8b1d6 Async stuff 2017-03-02 14:27:31 +01:00
Simon Grätzer 87e1acd5bf Fixed halting 2017-03-02 13:07:27 +01:00
Simon Grätzer c74fd5b2d8 Fix SSSP 2017-03-02 12:47:50 +01:00
Simon Grätzer 27098e9e4f Revert "Changing PageRank"
This reverts commit 93a03c923a.
2017-03-01 23:20:38 +01:00
Simon Grätzer 93a03c923a Changing PageRank 2017-03-01 23:03:45 +01:00
Simon Grätzer 3533364739 Added support for canceling during loading 2017-03-01 15:06:20 +01:00
Simon Grätzer 27c617fe10 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	3rdParty/V8/v8
#	arangod/Transaction/Methods.h
#	arangod/Utils/UserTransaction.h
#	arangod/V8Server/v8-collection.cpp
2017-03-01 14:52:35 +01:00
Simon Grätzer 9e9b1fd0c5 Stuff 2017-02-27 13:16:40 +01:00
Simon Grätzer 92d705ce76 Fix 2017-02-27 02:56:57 +01:00
Simon Grätzer 19d3dfc601 Small fix 2017-02-24 11:22:16 +01:00
Simon Grätzer 32200b24d2 angleichen von async SCC 2017-02-22 23:42:04 +01:00
Simon Grätzer 4722f4c6dd fix SCC 2017-02-22 23:39:49 +01:00
Simon Grätzer 3565469ebf Some stuff 2017-02-22 18:56:35 +01:00
Simon Grätzer 41bc0da58e Fixed DMID 2017-02-21 13:15:35 +01:00
Simon Grätzer 2e912a1743 Fixed HITS and MessageIterator 2017-02-20 15:44:30 +01:00
Simon Grätzer bba94e7ecd Added HITS algorithm 2017-02-20 12:19:01 +01:00
Simon Grätzer ea905816bd Some reshuffling 2017-02-19 13:50:43 +01:00
Simon Grätzer f9eb868f1a Fixed SCC 2017-02-18 18:14:29 +01:00
Simon Grätzer e2de2c4354 GRR 2017-02-17 20:24:04 +01:00
Simon Grätzer 8aa2465483 Fix compiler errors 2017-02-17 20:22:52 +01:00
Simon Grätzer ecf8a0559d Fixed HLL counter 2017-02-17 14:47:50 +01:00
Simon Grätzer 18fb10e2f7 Added Effective Closeness 2017-02-17 03:41:51 +01:00
Simon Grätzer ddee4c3619 Fixing async mode and LineRank 2017-02-16 16:52:58 +01:00
Simon Grätzer d263c51f59 Started with DMID 2017-02-16 14:38:04 +01:00
Simon Grätzer f58e7a4185 Merge branch 'devel' of https://github.com/graetzer/arangodb into devel 2017-02-15 17:54:35 +01:00
Simon Grätzer 63bca59945 stuff 2017-02-15 17:54:09 +01:00
Simon Grätzer 4ec41ed31d Stuff 2017-02-14 16:01:53 +01:00
Simon Grätzer 35cd39f859 Merge branch 'devel' of https://github.com/graetzer/arangodb into devel 2017-02-14 13:39:05 +01:00
Simon Grätzer 3f0b01023d Added comments to keys 2017-02-14 13:38:58 +01:00
Simon Grätzer 9fb0ade7ce Less locking 2017-02-13 03:06:36 +01:00
Simon Grätzer 62464be81f Stuff 2017-02-13 02:45:38 +01:00
Simon Grätzer 10c503ccf3 More profiling 2017-02-12 13:21:59 +01:00
Simon Grätzer bb0fa96251 Adding logging 2017-02-12 01:58:43 +01:00
Simon Grätzer 2c1e40f342 fix 2017-02-12 01:39:33 +01:00
Simon Grätzer 7198acc88e Added profiling 2017-02-12 00:53:52 +01:00
Simon Grätzer 3fd10aae34 Adding tryLock 2017-02-12 00:13:44 +01:00
Simon Grätzer aa4d117999 hmpf 2017-02-11 22:44:00 +01:00
Simon Grätzer 6853359e56 grr 2017-02-11 22:40:26 +01:00
Simon Grätzer cbe05181b8 added some lockers 2017-02-11 22:39:12 +01:00
Simon Grätzer becca2bdbb Testing randomized bucket access 2017-02-11 21:40:35 +01:00
Simon Grätzer 5f2f6727d3 Fixing log topics 2017-02-10 18:07:02 +01:00
Simon Grätzer f2bae38ed6 Merge branch 'devel' of https://github.com/graetzer/arangodb into devel
# Conflicts:
#	arangod/Pregel/Worker.cpp
2017-02-10 16:35:48 +01:00