openethereum/util/src
Robert Habermeier 76a7246369 Snapshot creation and restoration (#1679)
* to_rlp takes self by-reference

* clean up some derefs

* out-of-order insertion for blockchain

* implement block rebuilder without verification

* group block chunk header into struct

* block rebuilder does verification

* integrate snapshot service with client service; flesh out implementation more

* initial implementation of snapshot service

* remove snapshottaker trait

* snapshot writer trait with packed and loose implementations

* write chunks using "snapshotwriter" in service

* have snapshot taking use snapshotwriter

* implement snapshot readers

* back up client dbs when replacing

* use snapshot reader in snapshot service

* describe offset format

* use new get_db_path in parity, allow some errors in service

* blockchain formatting

* implement parity snapshot

* implement snapshot restore

* force blocks to be submitted in order

* fix bug loading block hashes in packed reader

* fix seal field loading

* fix uncle hash computation

* fix a few bugs

* store genesis state in db. reverse block chunk order in packed writer

* allow out-of-order import for blocks

* bring restoration types together

* only snapshot the last 30000 blocks

* restore into overlaydb instead of journaldb

* commit version to database

* use memorydbs and commit directly

* fix trie test compilation

* fix failing tests

* sha3_null_rlp, not H256::zero

* move overlaydb to ref_overlaydb, add new overlaydb without on-disk rc

* port archivedb to new overlaydb

* add deletion mode tests for overlaydb

* use new overlaydb, check state root at end

* share chain info between state and block snapshotting

* create blocks snapshot using blockchain directly

* allow snapshot from arbitrary block, remove panickers from snapshot creation

* begin test framework

* blockchain chunking test

* implement stateproducer::tick

* state snapshot test

* create block and state chunks concurrently, better restoration informant

* fix tests

* add deletion mode tests for overlaydb

* address comments

* more tests

* Fix up tests.

* remove a few printlns

* add a little more documentation to `commit`

* fix tests

* fix ref_overlaydb test names

* snapshot command skeleton

* revert ref_overlaydb renaming

* reimplement snapshot commands

* fix many errors

* everything but inject

* get ethcore compiling

* get snapshot tests passing again

* instrument snapshot commands again

* fix fallout from other changes, mark snapshots as experimental

* optimize injection patterns

* do two injections

* fix up tests

* take snapshots from 1000 blocks efore

* address minor comments

* fix a few io crate related errors

* clarify names about total difficulty

[ci skip]
2016-08-05 17:00:46 +02:00
..
journaldb Snapshot creation and restoration (#1679) 2016-08-05 17:00:46 +02:00
migration Disable WAL (#1765) 2016-07-29 15:36:00 +02:00
rlp Bumping clippy & fixing warnings (#1823) 2016-08-03 19:01:48 +02:00
trie Remove (almost all) panickers from trie module (#1776) 2016-08-03 18:35:48 +02:00
bytes.rs removed unused code from util and unnecessary dependency of FixedHash (#1824) 2016-08-03 18:36:45 +02:00
common.rs Fixing clippy warnings (#1660) 2016-07-19 09:25:51 +02:00
crypto.rs Fixing some clippy warnings (#1728) 2016-07-26 20:31:25 +02:00
error.rs Split IO and network crates (#1828) 2016-08-05 10:32:04 +02:00
from_json.rs uint to separated crate 2016-03-01 00:21:15 +03:00
hash.rs protect unsafety in plainhasher; do more hashing (#1841) 2016-08-05 09:15:55 +02:00
hashdb.rs Remove (almost all) panickers from trie module (#1776) 2016-08-03 18:35:48 +02:00
heapsizeof.rs uint to separated crate 2016-03-01 00:21:15 +03:00
kvdb.rs use mutex in dbtransaction (#1843) 2016-08-04 23:54:26 +02:00
lib.rs Split IO and network crates (#1828) 2016-08-05 10:32:04 +02:00
log.rs Cleanup of colour code. Use is_a_tty. (#1621) 2016-07-15 10:11:14 +02:00
math.rs added license in every *.rs file 2016-02-05 13:40:41 +01:00
memorydb.rs Snapshot creation and restoration (#1679) 2016-08-05 17:00:46 +02:00
misc.rs replace synchronization primitives with those from parking_lot (#1593) 2016-07-13 19:59:59 +02:00
nibbleslice.rs Fixing clippy warnings. Implementing PartialEq for Uints 2016-02-23 11:40:23 +01:00
nibblevec.rs Fixing clippy warnings (#1568) 2016-07-10 13:18:33 +02:00
numbers.rs uint to separated crate 2016-03-01 00:21:15 +03:00
overlaydb.rs Snapshot creation and restoration (#1679) 2016-08-05 17:00:46 +02:00
path.rs Pro paths (#1650) 2016-07-17 23:00:47 +02:00
semantic_version.rs doc typo 2016-02-17 03:17:02 +03:00
sha3.rs serde is no longer util dependency (#1534) 2016-07-06 11:23:29 +02:00
snappy.rs use ZST error type for snappy, use new snappy compression methods 2016-06-16 15:35:49 +02:00
standard.rs Remove (almost all) panickers from trie module (#1776) 2016-08-03 18:35:48 +02:00
timer.rs Merge with master 2016-06-29 14:46:29 +02:00
triehash.rs Fixing some clippy warnings (#1728) 2016-07-26 20:31:25 +02:00
vector.rs expunge &Vec<T> pattern (#1579) 2016-07-12 10:28:35 +02:00