mirror of https://gitee.com/bigwinds/arangodb
328f46e3d6
* Squashed commit of feature-3.5/hotbackup_devel. This puts hotbackup into 3.5. * Port atomic-database-creation-2 to 3.5. * Remove some wrongly ported code. * Fix compilation. * Fix a manual merge error. * Remove a feature from the mocks which does not exist in 3.5. * Add some code which was forgotten in manual merge. * Fix a problem introduced in a manual merge. * reuse function * Address some whitespace issues that came up in review * aardvark should not create the frontend collection * create _frontend collection from c++ * recheckAndUpdate Callback in CollectionWatcher * Wrong author ;) * rm outdated todo * Update lib/Basics/VelocyPackHelper.h Co-Authored-By: Michael Hackstein <michael@arangodb.com> * use logger unique id, use startup logger * not needed * optimized vector shardid method * do not create _modules collection lazy anymre * Formatting. * Assert instead of if/TRI_ASSERT(false) * Don't use exceptions as control structure * Re-add READ_LOCKER that got lost in translation * Fix audit log in case database creation fails early. * legacy sharding * Add CHANGELOG entry. * Retry database cancellation indefinitely * Do not use exceptions in UpgradeTask * DropCollection is a FAST_LANE action and should not need much time or else retry. * Remove superflous addition of LdapFeature Proudly brought to you by ASAN tests * Fixed check for distributShardsLike sharding on _system database * Fixed compile issue on tests * Removed assertion that seems to be not correct yet on devel. * Sort out google cloud storage as remote. (#9918) * Add successful method to ClusterCommResult. * Improve error forwarding for cluster internal communication. * Feature/hotbackup list retries (#9924) * retry hot backup listing for 2 minutes in cluster before giving up * Enable api by default. * fix broken list of non existing id (#9957) * Fix compilation after manual merge. * Fix another compilation problem. * Yet more fixes for compilation. * More compilation fixes. |
||
|---|---|---|
| .. | ||
| CMakeLists.txt | ||
| MMFilesAllocatorThread.cpp | ||
| MMFilesAllocatorThread.h | ||
| MMFilesCleanupThread.cpp | ||
| MMFilesCleanupThread.h | ||
| MMFilesCollection.cpp | ||
| MMFilesCollection.h | ||
| MMFilesCollectionExport.cpp | ||
| MMFilesCollectionExport.h | ||
| MMFilesCollectionKeys.cpp | ||
| MMFilesCollectionKeys.h | ||
| MMFilesCollectionWriteLocker.h | ||
| MMFilesCollectorCache.h | ||
| MMFilesCollectorThread.cpp | ||
| MMFilesCollectorThread.h | ||
| MMFilesCompactionFeature.cpp | ||
| MMFilesCompactionFeature.h | ||
| MMFilesCompactionLocker.h | ||
| MMFilesCompactorThread.cpp | ||
| MMFilesCompactorThread.h | ||
| MMFilesDatafile.cpp | ||
| MMFilesDatafile.h | ||
| MMFilesDatafileHelper.h | ||
| MMFilesDatafileStatistics.cpp | ||
| MMFilesDatafileStatistics.h | ||
| MMFilesDatafileStatisticsContainer.cpp | ||
| MMFilesDatafileStatisticsContainer.h | ||
| MMFilesDitch.cpp | ||
| MMFilesDitch.h | ||
| MMFilesDocumentOperation.cpp | ||
| MMFilesDocumentOperation.h | ||
| MMFilesDocumentPosition.h | ||
| MMFilesEdgeIndex.cpp | ||
| MMFilesEdgeIndex.h | ||
| MMFilesEngine.cpp | ||
| MMFilesEngine.h | ||
| MMFilesExportCursor.cpp | ||
| MMFilesExportCursor.h | ||
| MMFilesFulltextIndex.cpp | ||
| MMFilesFulltextIndex.h | ||
| MMFilesGeoIndex.cpp | ||
| MMFilesGeoIndex.h | ||
| MMFilesHashIndex.cpp | ||
| MMFilesHashIndex.h | ||
| MMFilesIncrementalSync.h | ||
| MMFilesIndex.cpp | ||
| MMFilesIndex.h | ||
| MMFilesIndexElement.cpp | ||
| MMFilesIndexElement.h | ||
| MMFilesIndexFactory.cpp | ||
| MMFilesIndexFactory.h | ||
| MMFilesIndexLookupContext.cpp | ||
| MMFilesIndexLookupContext.h | ||
| MMFilesLogfileManager.cpp | ||
| MMFilesLogfileManager.h | ||
| MMFilesOptimizerRules.cpp | ||
| MMFilesOptimizerRules.h | ||
| MMFilesPathBasedIndex.cpp | ||
| MMFilesPathBasedIndex.h | ||
| MMFilesPersistentIndex.cpp | ||
| MMFilesPersistentIndex.h | ||
| MMFilesPersistentIndexFeature.cpp | ||
| MMFilesPersistentIndexFeature.h | ||
| MMFilesPersistentIndexKeyComparator.cpp | ||
| MMFilesPersistentIndexKeyComparator.h | ||
| MMFilesPrimaryIndex.cpp | ||
| MMFilesPrimaryIndex.h | ||
| MMFilesRemoverThread.cpp | ||
| MMFilesRemoverThread.h | ||
| MMFilesRestCollectionHandler.cpp | ||
| MMFilesRestCollectionHandler.h | ||
| MMFilesRestExportHandler.cpp | ||
| MMFilesRestExportHandler.h | ||
| MMFilesRestHandlers.cpp | ||
| MMFilesRestHandlers.h | ||
| MMFilesRestReplicationHandler.cpp | ||
| MMFilesRestReplicationHandler.h | ||
| MMFilesRestWalHandler.cpp | ||
| MMFilesRestWalHandler.h | ||
| MMFilesRevisionsCache.cpp | ||
| MMFilesRevisionsCache.h | ||
| MMFilesSkiplist.h | ||
| MMFilesSkiplistIndex.cpp | ||
| MMFilesSkiplistIndex.h | ||
| MMFilesSynchronizerThread.cpp | ||
| MMFilesSynchronizerThread.h | ||
| MMFilesTransactionCollection.cpp | ||
| MMFilesTransactionCollection.h | ||
| MMFilesTransactionContextData.cpp | ||
| MMFilesTransactionContextData.h | ||
| MMFilesTransactionState.cpp | ||
| MMFilesTransactionState.h | ||
| MMFilesTtlIndex.cpp | ||
| MMFilesTtlIndex.h | ||
| MMFilesV8Functions.cpp | ||
| MMFilesV8Functions.h | ||
| MMFilesWalAccess.cpp | ||
| MMFilesWalAccess.h | ||
| MMFilesWalLogfile.cpp | ||
| MMFilesWalLogfile.h | ||
| MMFilesWalMarker.h | ||
| MMFilesWalRecoverState.cpp | ||
| MMFilesWalRecoverState.h | ||
| MMFilesWalRecoveryFeature.cpp | ||
| MMFilesWalRecoveryFeature.h | ||
| MMFilesWalSlot.cpp | ||
| MMFilesWalSlot.h | ||
| MMFilesWalSlots.cpp | ||
| MMFilesWalSlots.h | ||
| MMFilesWalSyncRegion.h | ||
| README.md | ||
| mmfiles-fulltext-common.h | ||
| mmfiles-fulltext-index.cpp | ||
| mmfiles-fulltext-index.h | ||
| mmfiles-fulltext-list.cpp | ||
| mmfiles-fulltext-list.h | ||
| mmfiles-fulltext-query.cpp | ||
| mmfiles-fulltext-query.h | ||
| mmfiles-replication-common.cpp | ||
| mmfiles-replication-common.h | ||
| mmfiles-replication-dump.cpp | ||
| mmfiles-replication-dump.h | ||
README.md
MMFilesEngine
How operations are stored - Overview
All operations like insert or remove are written as markers to a write ahead log (WAL). This WAL consists of files of a certain size and if such a file is full (or is manually flushed), all relevant markers are transferred (transferMarkers()) to the journals of the respective collections. During the transfer any obsolete markers will be thrown away: a sequence of insert, remove, insert on the same document will result in the last insert discarding the previous operations. When a journal file of size (journalSize()) is full, it will be sealed and renamed. By applying these operations it will become a datafile that is read-only. Datafiles will eventually be merged by a compactor thread that does about the same work as the transferMarkers function, reducing the size of the stored data.
Ditches
Ditches are used to pin objects in WAL or journal as long as they are used by other operations.