1
0
Fork 0
Commit Graph

65 Commits

Author SHA1 Message Date
Tobias Gödderz e2c84acfaf Use explicit default destructors where possible (#10166) 2019-10-04 15:58:30 +02:00
Simon a5a72ef6d4 port Pregel segmented buffers (#9112) 2019-05-28 18:23:20 +02:00
Simon 93b2e64f37 Port pregel fixes (#9022) 2019-05-17 16:32:58 +02:00
Simon 0502a97abb forwardport changes from 3.4 (#8894) 2019-05-08 14:34:25 +02:00
Lars Maier 12eebb15fe Feature/new server infra (#7733)
* Decoupled IO handling from Scheduler.

* Fixed SSL start up bug.

* Replaced Scheduler with new worker farm implementation.

* Added minimal statistics and info string for Scheduler.

* Added support for timed submissions.

* Updated delayed submission api. Updated code that used timers.

* Extracted new Scheduler into a virtual parent class. The implementation can now depend on the usecase.

* Signal handler now working.

* Changed threads names, `_stop` is atomic, check for failure during thread start + exception handling like old scheduler did.

* Commented on source code and added TODOs.

* Played around with start-stop-conditions

* Play around with start stop condition.

* start stop cond

* Sart Stop Conditions

* Removed bad cv_status check.

* Bug fix: now compare the actual objects instead of pointer values. Setup t1 and t2 depending on the thread id.

* Moved most of the stuff now unrelated to the Scheduler to GeneralServer. Got rid of JobGuard.

* Instead of waiting for a thread to terminate, put it on a clean up list and check for its termination in each supervisor run.

* Allow detaching long running threads.

* Fixed test mock.

* Updated the WorkHandle logic. Removed post functions.

* Fixed crash when obtaining shared_ptr from this in destructor.

* Added lost mutex.

* Fixed memory leak.

* Fixed merge bug.

* Changed a lot of code to optimize the scheduler.

* Fixed bug of invalidated iterator. Dont remove task on shutdown at different places. Let scheduler threads run until queue is empty.

* Only by value calls to queue.

* Added options again.

* Clean up of code.

* UI Request Lane added.

* Bug fixes in Scheduler.

* Applied reformat.

* Use sigaction.
2019-01-08 10:12:02 +01:00
Frank Celler ac9f375fb5 big reformat 2018-12-26 00:54:03 +01:00
Simon 6628a4e55a Refactor stuff, add async batch extension task (#6875) (#6880) 2018-10-15 13:18:24 +02:00
Simon 4387fabacf Converting Pregel AQL function to c++ and fixing a bug (#5620) 2018-06-28 10:46:16 +02:00
Frank Celler c5ac519d1c Bug fix for Read/Write race [WIP] (#5534)
* added wrapper, added asio_ns
* Temporarily fix condition variable bug in job queue.
* preparation for 3.3 back-port
* clang-format
* removed unecessary check, this is now fixed by stand
* added missing RequestStatistics::SET_READ_END
* cosmetics
2018-06-08 10:51:54 +02:00
Simon fdee0544b7 Using asio::io_context::strands instead of locks (#5266)
* initial try adding strands

* working, stable amount of threads

* improve shell_client cluster

* Fixing some accounting for the scheduler

* Fix accounting

* Fixing wrong strand usage

* add missing return

* Fixing thread accounting

* More scheduler accounting issues

* Fixing various things

* Fixing some stuff

* Fixing some stuff

* Some more subtle bugfixes

* Some cleanup code

* fixing some stuff

* adding some more fixes

* Fixing possible issues

* Fixing missing _storeResult

* Fixing some stuff

* Reducing lambda stack, perhaps fixing hangups

* Fix writeunlocker

* Fixing possible issues

* adding some debugging stuff

* refactor sockets

* possible fixes

* Adding more job guards

* Fixin possible bug

* cleaning up some stuff

* working impl

* Remove debugging output

* Fixing build

* fixing import

* Fixing another bug

* removing debug log

* Removing examples

* Reverting scheduler working code

* Cleanup

* Addressing review comments
2018-05-07 15:58:19 +02:00
Jan 30b12e311b
Bug fix/remove most of aql js (#5223) 2018-04-30 11:17:11 +02:00
Vasiliy 0abd46ad73 backport: use vocbase reference instead of pointer in arangodb::pregel::GraphStore 2018-04-13 11:23:34 +03:00
Simon Grätzer c7ae7a7a2b Fixing nondeterministic behaviour (#4024) 2017-12-13 17:56:01 +01:00
Simon Grätzer 974fa47a87 Fixing Pregel module (#3557)
* Fixing wrong response logic

* fixing rest pregel handler
2017-10-31 20:15:51 +01:00
Simon Grätzer 39b2e349dd Pregel: Coverty Scan fixes 2017-03-24 11:04:15 +01:00
Simon Grätzer 553421196a Pregel: Migrated to boost deadline_timer 2017-03-17 19:54:33 +01:00
Simon Grätzer 79c2e87bac Pregel: code reformatting 2017-03-17 16:21:25 +01:00
Simon Grätzer 162a0476c3 Pregel: Removed ThreadPool, added test for memory mapping 2017-03-17 15:55:01 +01:00
Simon Grätzer a1752da492 Added single server support 2017-03-08 18:20:36 +01:00
Simon Grätzer 62464be81f Stuff 2017-02-13 02:45:38 +01:00
Simon Grätzer 9b9f91a81c Pegel: Adding support for "PREGEL_RESULT" in aql 2017-02-07 18:37:23 +01:00
Simon Grätzer 877aa43599 Fixing a bug 2017-02-02 16:49:39 +01:00
Simon Grätzer 5d9aa0cb6b Multi threaded GraphStore, ran clang-format 2017-01-30 01:39:39 +01:00
Simon Grätzer 8adf4a3039 Adaptive message buffers, Optimized message format 2017-01-22 15:53:11 +01:00
Simon Grätzer d8ba7ffc34 Aggregator refactoring 2017-01-20 14:42:01 +01:00
Simon Grätzer 44eb494434 Fixed aggregators 2017-01-18 18:37:53 +01:00
Simon Grätzer 06ef7792fb Fixing some more 2017-01-16 17:48:38 +01:00
Simon Grätzer a4444c3b8a Fixed lazy loading v2 2017-01-10 09:21:26 +01:00
Simon Grätzer 59b9167728 Fixed aync mode 2016-12-23 00:20:38 +01:00
Simon Grätzer 2b18f29de2 Reformatting 2016-12-22 11:47:31 +01:00
Simon Grätzer 96925c0e76 Working single phase async 2016-12-19 07:25:52 +01:00
Simon Grätzer f084bd7b12 All necessities supported 2016-12-17 14:09:41 +01:00
Simon Grätzer caa260defd More async work 2016-12-15 18:46:02 +01:00
Simon Grätzer f8dfca5e07 Reorganizing code 2016-12-14 10:39:37 +01:00
Simon Grätzer 63f87fbf52 reorganization 2016-12-13 13:54:14 +01:00
Simon Grätzer 6e07e81a1e starting async mode 2016-12-12 13:19:46 +01:00
Simon Grätzer 0f57b6633b Algorithms without combiners supported 2016-12-07 16:00:42 +01:00
Simon Grätzer d9d192e480 fixed some stuff 2016-12-05 13:53:49 +01:00
Simon Grätzer 0689ccaabb fixed some stuff, stopping still not working 2016-12-05 01:18:05 +01:00
Simon Grätzer 69322d769e shard indexes 2016-12-02 18:26:29 +01:00
Simon Grätzer 7d7474f6fd Structural changes, Algorithm registry, begin with optimistic recovery 2016-12-01 14:10:52 +01:00
Simon Grätzer c3d1118620 Multi-Threaded Pregel 2016-11-17 11:11:20 +01:00
Simon Grätzer 8e16011c67 Adding RangeIterator 2016-11-16 14:47:30 +01:00
Simon Grätzer 4b3a5a414e More js APIs 2016-11-15 21:19:36 +01:00
Simon Grätzer d2962a7de3 Statistics tracking 2016-11-15 13:37:52 +01:00
Simon Grätzer b0861672aa Working Aggregators, (seemingly) working PageRank 2016-11-13 03:10:45 +01:00
Simon Grätzer 7e435b2dfa Better GraphStore 2016-11-12 21:55:36 +01:00
Simon Grätzer 524878d242 Fixed aggregators 2016-11-11 12:01:15 +01:00
Simon Grätzer ecc8e29314 Working SSSP 2016-11-09 16:50:31 +01:00
Simon Grätzer cb98f3ab04 Added dedicated startup phase 2016-11-08 14:42:13 +01:00