1
0
Fork 0
Commit Graph

367 Commits

Author SHA1 Message Date
Jan 1ace247273 Bug fix/scheduling et al (#3161)
* added V8 context lifetime control options `--javascript.v8-contexts-max-invocations` and `--javascript.v8-contexts-max-age`

* make thread scheduling take into account most of the tasks dispatched via the io service
2017-08-30 10:40:02 +02:00
Jan 47e29e6e1f Bug fix/issues 1806 (#3069)
* fix buffer overruns in linenoise for long input lines

* don't make historian repeatedly print the same error messages that nothing can be done about

* make the implementations of the logging operator<<s not throw exceptions, so that logging does throw exceptions as an unintended side effect

* update CHANGELOG

* improve error message

* don't copy strings, but pass them by const reference
2017-08-18 22:58:09 +02:00
Simon Grätzer 3f58a44e3b Fix cases where the root user has access to excluded collections (#2856) 2017-08-03 21:16:08 +02:00
Simon Grätzer 9786b198c2 Allow pregel jobs to interrupt on shutdown (#2855) 2017-07-27 15:29:01 +02:00
Simon Grätzer 4f0ad75cef Fixing loading of some multi collection Graphs (#2840) 2017-07-19 20:34:47 +02:00
Simon Grätzer f50a36181d Various authentication related issues (#2824) 2017-07-18 22:22:09 +02:00
Frank Celler a5a25754ed Feature/reduce extraction to projection (#2792)
* reduce extractions to projections

* recycle string buffers in SocketTask

* micro optimizations for mmfiles indexes

* added special lookup function for _key

* moved function into the correct file

* speed up key buffer allocations a bit

* added noexcept specifier

* correctly name variable

* explicitly move bounds

* fix and speedup from/toPersistent functions

* reuse string from ManagedDocumentResult for multiple lookups

* use move-assign

* a bit less work for single server

* speedup AQL function HASH

* single fetch optimization

* performance optimization for the case when no documents need to be returned

* make reduce-extraction-to-projection a RocksDB-only optimizer rule

* cppcheck

* try to fix compile error on MacOS

* bug fix for MacOSX

* missing namespace (in Windows compile)
2017-07-14 08:40:29 +02:00
Max Neunhöffer 2f874249bb Bug fix/adjust agency comm timeouts (#2765)
* Take out 503 timeouts altogether.
* Overhaul of AgencyComm::sendWithFailover loop.
* Let performRequests optionally ignore 404 coll not found.
* Fix error message "database not found" when AgencyComm failed.
* Add log entries in Agency if locks are acquired too slowly.
* Reexecute the javascript cluster sync stuff even if there was no plan/current change...So failed sync jobs can retry later...
* Cover callbacks in Communicator by lock. This fixes https://github.com/arangodb/planning/issues/370
* Put in delay in waiting for leader in agency test.
* Schmutz logging to heartbeat topic.
* Add more lock time diagnostic in agent.
* Switch on agencycomm tracing in coordinator.
2017-07-13 00:44:28 +02:00
Frank Celler 40d73d5a8b Revert "[WIP] Feature/reduce extraction to projection (#2735)"
This reverts commit 5bfcff30cd.
2017-07-12 12:52:14 +02:00
Jan 5bfcff30cd [WIP] Feature/reduce extraction to projection (#2735)
* reduce extractions to projections

* recycle string buffers in SocketTask

* micro optimizations for mmfiles indexes

* added special lookup function for _key

* moved function into the correct file

* speed up key buffer allocations a bit

* added noexcept specifier

* correctly name variable

* explicitly move bounds

* fix and speedup from/toPersistent functions

* reuse string from ManagedDocumentResult for multiple lookups

* use move-assign

* a bit less work for single server

* speedup AQL function HASH

* single fetch optimization

* performance optimization for the case when no documents need to be returned

* make reduce-extraction-to-projection a RocksDB-only optimizer rule
2017-07-12 11:22:29 +02:00
Frank Celler bbe7484521 Feature/auth context (#2704)
* added read-only users
2017-07-02 23:15:57 +02:00
Simon Grätzer 2d3f1d8245 Added assert(false) to force coredump in jenkins 2017-06-07 17:44:52 +02:00
Simon Grätzer 571356a6ae added pregel vertex / edge count checks 2017-06-07 17:18:59 +02:00
Simon Grätzer 53ece582a8 optimized all index iterator 2017-05-31 11:34:32 +02:00
Simon Grätzer 6ecf733585 Merge branch 'devel' of https://github.com/arangodb/arangodb into feature/storage-format-refactoring
# Conflicts:
#	tests/RocksDBEngine/TypeConversionTest.cpp
2017-05-30 13:42:44 +02:00
jsteemann 53b150b206 added tests for intermediate commits 2017-05-30 12:03:58 +02:00
Simon Grätzer f8ab86e160 Begin storage format refactoring 2017-05-29 16:00:55 +02:00
Simon Grätzer 88977d204a Merge branch 'devel' of https://github.com/arangodb/arangodb into column-family
# Conflicts:
#	arangod/RocksDBEngine/RocksDBIndex.cpp
#	arangod/RocksDBEngine/RocksDBIndex.h
#	arangod/RocksDBEngine/RocksDBPrimaryIndex.cpp
#	arangod/RocksDBEngine/RocksDBPrimaryIndex.h
2017-05-23 11:17:30 +02:00
jsteemann a7b3839e6c renamed "getMore" to "next" 2017-05-23 08:53:13 +02:00
Simon Grätzer ad3da410b2 Pregel improvements 2017-05-22 11:10:28 +02:00
Simon Grätzer 45d7c5c715 Various debugging changes 2017-05-20 17:44:28 +02:00
Simon Grätzer 7cd0bc3c62 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/RocksDBEngine/RocksDBPrimaryIndex.cpp
2017-05-19 11:15:36 +02:00
Simon Grätzer 8ae7e00eb5 DMID improvements 2017-05-18 23:27:54 +02:00
Simon Grätzer 2bd2a15cb3 Column family support 2017-05-18 22:08:34 +02:00
Simon Grätzer 6dc5e2617a Fixes to DMID 2017-05-18 15:06:04 +02:00
Simon Grätzer d0f9ea5138 Fixing issue 2017-05-17 14:17:03 +02:00
Simon Grätzer 0c6de98365 Fixed SLPA 2017-05-17 11:50:24 +02:00
Simon Grätzer df3eed2289 Various changes 2017-05-16 10:58:15 +02:00
Simon Grätzer ead7ebcd7b Little changes for SLPA support 2017-05-15 10:42:25 +02:00
Simon Grätzer fe0e296737 RocksDB: fixing WAL tailing issues 2017-05-13 01:08:22 +02:00
Simon Grätzer 958c19de35 stuff 2017-05-12 14:07:30 +02:00
Simon Grätzer 5b79e77128 Begin work on transaction wrapper 2017-05-12 10:52:08 +02:00
Simon Grätzer f101e21328 Geo index update, renaming 2017-05-11 13:19:51 +02:00
Simon Grätzer 5d20b79c0f Incremental Sync 2017-04-25 12:01:58 +02:00
jsteemann 67cd947266 fixed typos 2017-04-18 14:54:48 +02:00
Simon Grätzer bab71f6339 Fixing jslint errors 2017-04-18 12:15:26 +02:00
jsteemann 08cd4ced33 moved class around 2017-04-07 13:13:48 +02:00
Simon Grätzer fce51594ac Fixing hash index semantics 2017-04-06 12:41:47 +02:00
Simon Grätzer a90e62bc02 Conversion errors 2017-04-06 10:50:40 +02:00
Simon Grätzer 1ef373dea7 Fixing some conversion issues 2017-04-05 12:16:53 +02:00
jsteemann 81dcfbbe3d pass trx into numberDocuments 2017-03-31 11:33:16 +02:00
Jan Christoph Uhde 95007fe28e Merge branch 'engine-api' of https://github.com/arangodb/arangodb into engine-api-arango-result
* 'engine-api' of https://github.com/arangodb/arangodb: (46 commits)
  Merged RocksDBPathBasedIndex into RocksDBVPackIndex.
  fix handling of externals
  fix toArray()
  fix returning documents
  Added hash-, skip list, persistent indexes
  harmonize filtering - filter on full filename.
  mini modifications
  standardize starting of servers for replication tests
  Edge index compliant with design doc
  another fix for #2404
  Moved „removeLargeRange“ method to commons
  Added length byte to IndexValue keys.
  fixed issue #2404
  Added drop to primary index
  Added drop() to indexes
  Fixes a coordinator crash in Clustered Traversal. In case of failover during query planning.
  Fixed edge index
  Expand on CORS documentation
  Let ArangoDB handle the allow-credentials header
  make the authentication tests run on directories
  ...
2017-03-30 19:46:17 +02:00
Jan Christoph Uhde b83ae2ab82 refactor some code to make use of arangodb::Result 2017-03-30 09:39:21 +02:00
Simon Grätzer 901abc6705 Fixing some windows conversion warnings 2017-03-29 11:35:37 +02:00
jsteemann e3ca787992 warn before we run out of file descriptors 2017-03-29 02:35:46 +02:00
Simon Grätzer 0b79c69884 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-27 08:56:20 +02:00
Simon Grätzer aadcad3a00 Fix various conversion warnings 2017-03-24 17:52:50 +01:00
Simon Grätzer 2091dae875 Pregel: Fix concurrent creation of aggregator 2017-03-24 15:14:12 +01:00
Simon Grätzer fbbc118160 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-24 11:04:38 +01:00
Simon Grätzer 39b2e349dd Pregel: Coverty Scan fixes 2017-03-24 11:04:15 +01:00
jsteemann 8e4e463239 don't call throwing functions in dtor 2017-03-23 19:40:13 +01:00
Simon Grätzer b69523d736 Pregel: Fixed memory leak warning 2017-03-23 16:14:06 +01:00
Simon Grätzer 6b5a6b4c2b Pregel: Fixed memory leak warning 2017-03-23 15:54:18 +01:00
Simon Grätzer bac7081983 Pregel: Reduced logspam 2017-03-22 17:55:43 +01:00
Simon Grätzer 7bc01b46e0 Pregel: Changed scheduler post call 2017-03-20 12:22:16 +01:00
Simon Grätzer 553421196a Pregel: Migrated to boost deadline_timer 2017-03-17 19:54:33 +01:00
Simon Grätzer 79c2e87bac Pregel: code reformatting 2017-03-17 16:21:25 +01:00
Simon Grätzer 31f30378cf Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-17 15:55:07 +01:00
Simon Grätzer 162a0476c3 Pregel: Removed ThreadPool, added test for memory mapping 2017-03-17 15:55:01 +01:00
jsteemann 650d1afad5 fix leaks during cleanup 2017-03-17 13:38:23 +01:00
Simon Grätzer 68f32177c6 Added test for mapped files in TypedBuffer.h 2017-03-16 17:17:05 +01:00
Simon Grätzer 5cc259e2a1 Pregel micro optimization 2017-03-16 14:12:43 +01:00
Simon Grätzer a823442811 Changed Pregel LogLevels to debug where appropriate 2017-03-16 12:25:24 +01:00
Simon Grätzer 215937a884 Fixing cppcheck and jslint warnings 2017-03-16 11:20:35 +01:00
Simon Grätzer e6ad88f2a3 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel 2017-03-16 10:52:08 +01:00
Simon Grätzer f2c133d5f6 Fix pregel test 2017-03-16 10:52:02 +01:00
jsteemann 22c86744b2 cppcheck 2017-03-16 10:34:09 +01:00
Simon Grätzer f22aec113f Fix typo in summary.md, fix segmentation fault, fix test 2017-03-15 17:47:33 +01:00
Simon Grätzer 3c8a6dbe9e Fixing windows build and warnings 2017-03-15 14:10:54 +01:00
Simon Grätzer 24eaf6a6ef Reverting integer hashing 2017-03-15 12:35:40 +01:00
Simon Grätzer 45fca509a8 Fixing linux build 2017-03-15 10:41:54 +01:00
Simon Grätzer 529cb4ae85 Integer ID for testing 2017-03-15 10:20:48 +01:00
Simon Grätzer ec6eb718f2 Working lazyloading with new memory backend 2017-03-13 23:25:53 +01:00
Simon Grätzer 7e0ed82f0f Memory Mapped files 2017-03-13 15:13:47 +01:00
Simon Grätzer 7b35f75b23 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/CMakeLists.txt
#	arangod/GeneralServer/GeneralServerFeature.cpp
2017-03-13 12:25:28 +01:00
Simon Grätzer f2d77435c6 Added memory mapped file 2017-03-12 00:46:54 +01:00
Simon Grätzer 5f4a8844f5 Fixed parallelism parameter 2017-03-10 13:56:10 +01:00
Simon Grätzer aa156ac28f Micro-Optimizations 2017-03-09 17:00:24 +01:00
Simon Grätzer 00d77cbb5e Fix compiler warnings 2017-03-09 14:38:39 +01:00
Simon Grätzer a1752da492 Added single server support 2017-03-08 18:20:36 +01:00
Simon Grätzer c049576c59 Added single server support 2017-03-07 15:07:51 +01:00
Simon Grätzer 0d5f8ae5b8 Fixed canceling of storage, changed the docs 2017-03-07 12:14:12 +01:00
Simon Grätzer 0b64bf3bc2 Fixed pregel test, async default off 2017-03-07 10:41:03 +01:00
Simon Grätzer 5b1cb0ec6d Various fixes 2017-03-06 15:41:27 +01:00
Simon Grätzer 77d02669c4 Added LabelPropagation 2017-03-02 19:53:34 +01:00
Simon Grätzer b2ceda6250 Some more async stuff 2017-03-02 15:03:35 +01:00
Simon Grätzer fefed8b1d6 Async stuff 2017-03-02 14:27:31 +01:00
Simon Grätzer 87e1acd5bf Fixed halting 2017-03-02 13:07:27 +01:00
Simon Grätzer c74fd5b2d8 Fix SSSP 2017-03-02 12:47:50 +01:00
Simon Grätzer 27098e9e4f Revert "Changing PageRank"
This reverts commit 93a03c923a.
2017-03-01 23:20:38 +01:00
Simon Grätzer 93a03c923a Changing PageRank 2017-03-01 23:03:45 +01:00
Simon Grätzer 3533364739 Added support for canceling during loading 2017-03-01 15:06:20 +01:00
Simon Grätzer 27c617fe10 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	3rdParty/V8/v8
#	arangod/Transaction/Methods.h
#	arangod/Utils/UserTransaction.h
#	arangod/V8Server/v8-collection.cpp
2017-03-01 14:52:35 +01:00
Simon Grätzer 9e9b1fd0c5 Stuff 2017-02-27 13:16:40 +01:00
Simon Grätzer 92d705ce76 Fix 2017-02-27 02:56:57 +01:00
Simon Grätzer 19d3dfc601 Small fix 2017-02-24 11:22:16 +01:00
Simon Grätzer 32200b24d2 angleichen von async SCC 2017-02-22 23:42:04 +01:00
Simon Grätzer 4722f4c6dd fix SCC 2017-02-22 23:39:49 +01:00
Simon Grätzer 3565469ebf Some stuff 2017-02-22 18:56:35 +01:00
Simon Grätzer 41bc0da58e Fixed DMID 2017-02-21 13:15:35 +01:00
Simon Grätzer 2e912a1743 Fixed HITS and MessageIterator 2017-02-20 15:44:30 +01:00
Simon Grätzer bba94e7ecd Added HITS algorithm 2017-02-20 12:19:01 +01:00
Simon Grätzer ea905816bd Some reshuffling 2017-02-19 13:50:43 +01:00
Simon Grätzer f9eb868f1a Fixed SCC 2017-02-18 18:14:29 +01:00
Simon Grätzer e2de2c4354 GRR 2017-02-17 20:24:04 +01:00
Simon Grätzer 8aa2465483 Fix compiler errors 2017-02-17 20:22:52 +01:00
Simon Grätzer ecf8a0559d Fixed HLL counter 2017-02-17 14:47:50 +01:00
Simon Grätzer 18fb10e2f7 Added Effective Closeness 2017-02-17 03:41:51 +01:00
Simon Grätzer ddee4c3619 Fixing async mode and LineRank 2017-02-16 16:52:58 +01:00
Simon Grätzer d263c51f59 Started with DMID 2017-02-16 14:38:04 +01:00
Simon Grätzer f58e7a4185 Merge branch 'devel' of https://github.com/graetzer/arangodb into devel 2017-02-15 17:54:35 +01:00
Simon Grätzer 63bca59945 stuff 2017-02-15 17:54:09 +01:00
Simon Grätzer 4ec41ed31d Stuff 2017-02-14 16:01:53 +01:00
Simon Grätzer 35cd39f859 Merge branch 'devel' of https://github.com/graetzer/arangodb into devel 2017-02-14 13:39:05 +01:00
Simon Grätzer 3f0b01023d Added comments to keys 2017-02-14 13:38:58 +01:00
Simon Grätzer 9fb0ade7ce Less locking 2017-02-13 03:06:36 +01:00
Simon Grätzer 62464be81f Stuff 2017-02-13 02:45:38 +01:00
Simon Grätzer 10c503ccf3 More profiling 2017-02-12 13:21:59 +01:00
Simon Grätzer bb0fa96251 Adding logging 2017-02-12 01:58:43 +01:00
Simon Grätzer 2c1e40f342 fix 2017-02-12 01:39:33 +01:00
Simon Grätzer 7198acc88e Added profiling 2017-02-12 00:53:52 +01:00
Simon Grätzer 3fd10aae34 Adding tryLock 2017-02-12 00:13:44 +01:00
Simon Grätzer aa4d117999 hmpf 2017-02-11 22:44:00 +01:00
Simon Grätzer 6853359e56 grr 2017-02-11 22:40:26 +01:00
Simon Grätzer cbe05181b8 added some lockers 2017-02-11 22:39:12 +01:00
Simon Grätzer becca2bdbb Testing randomized bucket access 2017-02-11 21:40:35 +01:00
Simon Grätzer 5f2f6727d3 Fixing log topics 2017-02-10 18:07:02 +01:00
Simon Grätzer f2bae38ed6 Merge branch 'devel' of https://github.com/graetzer/arangodb into devel
# Conflicts:
#	arangod/Pregel/Worker.cpp
2017-02-10 16:35:48 +01:00
Simon Grätzer 1a0d9ff9c7 Starting checkpointing 2017-02-10 16:33:55 +01:00
Simon Grätzer 4edba27b41 Fixed log topic 2017-02-10 16:31:38 +01:00
Simon Grätzer edab268572 Merge branch 'devel' of https://github.com/arangodb/arangodb into devel
# Conflicts:
#	arangod/Aql/FunctionDefinitions.cpp
#	arangod/Aql/Functions.h
#	arangod/Utils/ExplicitTransaction.h
2017-02-10 15:21:24 +01:00
Simon Grätzer 06604c5d47 Use more threads 2017-02-09 01:31:03 +01:00
Simon Grätzer 9b9f91a81c Pegel: Adding support for "PREGEL_RESULT" in aql 2017-02-07 18:37:23 +01:00
Simon Grätzer 9d669eadec Pregel: Multi-Threaded vertex updates 2017-02-07 13:27:03 +01:00
Simon Grätzer 00ebdbf61e Reformatting pregel code 2017-02-05 16:06:46 +01:00
Simon Grätzer 2800f33a2b Finer grained locking in the incoming cache 2017-02-05 04:07:55 +01:00
Simon Grätzer 730037f146 Added index buckets 2017-02-04 15:00:36 +01:00
Simon Grätzer 473b58c750 Fixed some stuff 2017-02-04 00:58:53 +01:00
Simon Grätzer 39278f22d8 Added debug logs 2017-02-03 14:40:45 +01:00
Simon Grätzer e53a1b62e4 Fixed pagerank 2017-02-03 12:33:50 +01:00
Simon Grätzer fd0696d1cf Fixing stuff 2017-02-03 11:57:06 +01:00
Simon Grätzer 40177040c9 Fixing pagerank 2017-02-02 17:51:46 +01:00
Simon Grätzer c0312071ed Fixing page rank 2017-02-02 17:34:48 +01:00
Simon Grätzer 877aa43599 Fixing a bug 2017-02-02 16:49:39 +01:00
Simon Grätzer bf25888450 Fixing compiler warnings 2017-02-02 14:58:02 +01:00
Simon Grätzer 5cce352c13 Fixed some stuff 2017-02-02 12:15:24 +01:00
Simon Grätzer 1f687ff4b1 Fixed linker error 2017-01-31 18:36:51 +01:00
Simon Grätzer 43ad534142 Started README, threshold for page rank 2017-01-31 18:22:50 +01:00
Simon Grätzer 97473e3223 Spelling fixes, reduce log spam 2017-01-31 16:42:17 +01:00
Simon Grätzer 6abfd6c3bd Fixed vertex loading, added back ThreadPool 2017-01-31 00:37:44 +01:00