mirror of https://gitee.com/bigwinds/arangodb
592063c503
* Added full index iterator utilization in case of some documents was not found in collection * Added index operations reversal in case of insertion failure in rocksdb * Removed singleop optimization as rollback possible even for such operations (in case of index operation failure on insert) * Added tests for insert rollback in views * Added catch tests for view block * Added changelog entry * fixed jslint errors * fixed linux build * Added test for update * Fix CHANGELOG sequence * Add line * Added reverts for update and remove failures * Cleanup in test. Added throwing error in case of failed reversal * fixed typo Co-Authored-By: Simran <Simran-B@users.noreply.github.com> * fixed build * Applied review comments * Applied review comments |
||
|---|---|---|
| .. | ||
| CMakeLists.txt | ||
| MMFilesAllocatorThread.cpp | ||
| MMFilesAllocatorThread.h | ||
| MMFilesCleanupThread.cpp | ||
| MMFilesCleanupThread.h | ||
| MMFilesCollection.cpp | ||
| MMFilesCollection.h | ||
| MMFilesCollectionExport.cpp | ||
| MMFilesCollectionExport.h | ||
| MMFilesCollectionKeys.cpp | ||
| MMFilesCollectionKeys.h | ||
| MMFilesCollectionWriteLocker.h | ||
| MMFilesCollectorCache.h | ||
| MMFilesCollectorThread.cpp | ||
| MMFilesCollectorThread.h | ||
| MMFilesCompactionFeature.cpp | ||
| MMFilesCompactionFeature.h | ||
| MMFilesCompactionLocker.h | ||
| MMFilesCompactorThread.cpp | ||
| MMFilesCompactorThread.h | ||
| MMFilesDatafile.cpp | ||
| MMFilesDatafile.h | ||
| MMFilesDatafileHelper.h | ||
| MMFilesDatafileStatistics.cpp | ||
| MMFilesDatafileStatistics.h | ||
| MMFilesDatafileStatisticsContainer.cpp | ||
| MMFilesDatafileStatisticsContainer.h | ||
| MMFilesDitch.cpp | ||
| MMFilesDitch.h | ||
| MMFilesDocumentOperation.cpp | ||
| MMFilesDocumentOperation.h | ||
| MMFilesDocumentPosition.h | ||
| MMFilesEdgeIndex.cpp | ||
| MMFilesEdgeIndex.h | ||
| MMFilesEngine.cpp | ||
| MMFilesEngine.h | ||
| MMFilesExportCursor.cpp | ||
| MMFilesExportCursor.h | ||
| MMFilesFulltextIndex.cpp | ||
| MMFilesFulltextIndex.h | ||
| MMFilesGeoIndex.cpp | ||
| MMFilesGeoIndex.h | ||
| MMFilesHashIndex.cpp | ||
| MMFilesHashIndex.h | ||
| MMFilesIncrementalSync.h | ||
| MMFilesIndex.h | ||
| MMFilesIndexElement.cpp | ||
| MMFilesIndexElement.h | ||
| MMFilesIndexFactory.cpp | ||
| MMFilesIndexFactory.h | ||
| MMFilesIndexLookupContext.cpp | ||
| MMFilesIndexLookupContext.h | ||
| MMFilesLogfileManager.cpp | ||
| MMFilesLogfileManager.h | ||
| MMFilesOptimizerRules.cpp | ||
| MMFilesOptimizerRules.h | ||
| MMFilesPathBasedIndex.cpp | ||
| MMFilesPathBasedIndex.h | ||
| MMFilesPersistentIndex.cpp | ||
| MMFilesPersistentIndex.h | ||
| MMFilesPersistentIndexFeature.cpp | ||
| MMFilesPersistentIndexFeature.h | ||
| MMFilesPersistentIndexKeyComparator.cpp | ||
| MMFilesPersistentIndexKeyComparator.h | ||
| MMFilesPrimaryIndex.cpp | ||
| MMFilesPrimaryIndex.h | ||
| MMFilesRemoverThread.cpp | ||
| MMFilesRemoverThread.h | ||
| MMFilesRestCollectionHandler.cpp | ||
| MMFilesRestCollectionHandler.h | ||
| MMFilesRestExportHandler.cpp | ||
| MMFilesRestExportHandler.h | ||
| MMFilesRestHandlers.cpp | ||
| MMFilesRestHandlers.h | ||
| MMFilesRestReplicationHandler.cpp | ||
| MMFilesRestReplicationHandler.h | ||
| MMFilesRestWalHandler.cpp | ||
| MMFilesRestWalHandler.h | ||
| MMFilesRevisionsCache.cpp | ||
| MMFilesRevisionsCache.h | ||
| MMFilesSkiplist.h | ||
| MMFilesSkiplistIndex.cpp | ||
| MMFilesSkiplistIndex.h | ||
| MMFilesSynchronizerThread.cpp | ||
| MMFilesSynchronizerThread.h | ||
| MMFilesTransactionCollection.cpp | ||
| MMFilesTransactionCollection.h | ||
| MMFilesTransactionContextData.cpp | ||
| MMFilesTransactionContextData.h | ||
| MMFilesTransactionManager.cpp | ||
| MMFilesTransactionManager.h | ||
| MMFilesTransactionState.cpp | ||
| MMFilesTransactionState.h | ||
| MMFilesV8Functions.cpp | ||
| MMFilesV8Functions.h | ||
| MMFilesWalAccess.cpp | ||
| MMFilesWalAccess.h | ||
| MMFilesWalLogfile.cpp | ||
| MMFilesWalLogfile.h | ||
| MMFilesWalMarker.h | ||
| MMFilesWalRecoverState.cpp | ||
| MMFilesWalRecoverState.h | ||
| MMFilesWalRecoveryFeature.cpp | ||
| MMFilesWalRecoveryFeature.h | ||
| MMFilesWalSlot.cpp | ||
| MMFilesWalSlot.h | ||
| MMFilesWalSlots.cpp | ||
| MMFilesWalSlots.h | ||
| MMFilesWalSyncRegion.h | ||
| README.md | ||
| mmfiles-fulltext-common.h | ||
| mmfiles-fulltext-index.cpp | ||
| mmfiles-fulltext-index.h | ||
| mmfiles-fulltext-list.cpp | ||
| mmfiles-fulltext-list.h | ||
| mmfiles-fulltext-query.cpp | ||
| mmfiles-fulltext-query.h | ||
| mmfiles-replication-common.cpp | ||
| mmfiles-replication-common.h | ||
| mmfiles-replication-dump.cpp | ||
| mmfiles-replication-dump.h | ||
README.md
MMFilesEngine
How operations are stored - Overview
All operations like insert or remove are written as markers to a write ahead log (WAL). This WAL consists of files of a certain size and if such a file is full (or is manually flushed), all relevant markers are transferred (transferMarkers()) to the journals of the respective collections. During the transfer any obsolete markers will be thrown away: a sequence of insert, remove, insert on the same document will result in the last insert discarding the previous operations. When a journal file of size (journalSize()) is full, it will be sealed and renamed. By applying these operations it will become a datafile that is read-only. Datafiles will eventually be merged by a compactor thread that does about the same work as the transferMarkers function, reducing the size of the stored data.
Ditches
Ditches are used to pin objects in WAL or journal as long as they are used by other operations.