keorn
53b479fb7a
pass engine to snapshot service
2016-12-05 15:43:46 +00:00
keorn
c61a0e97b3
make engine determine block order
2016-12-05 15:20:32 +00:00
Tomasz Drwięga
2b3d100de2
Fixing some clippy warnings
2016-11-28 15:54:22 +01:00
Robert Habermeier
18153b8d9e
Merge branch 'master' into missing-code-by-prefix
2016-11-14 14:02:19 +01:00
Robert Habermeier
37f49aac1b
abort snapshot restoration faster ( #3356 )
...
* abort snapshot restoration faster
* flag-checking tests
2016-11-13 13:52:53 +01:00
Robert Habermeier
87c668ba9c
test previous code fetch
2016-11-11 18:24:12 +01:00
Gav Wood
a7ad75d851
whitespace
...
[ci:skip]
2016-11-11 17:32:54 +01:00
Robert Habermeier
ed135bb9dc
fetch known code from the database during restoration
...
previously it kept all seen code in memory, leading to
high memory usage by the end of state restoration
2016-11-11 17:18:31 +01:00
Arkadiy Paronyan
bccc56b6b0
mio version bump ( #2982 )
2016-10-30 09:56:34 +01:00
Tomasz Drwięga
f17cad9dff
Fixing clippy warnings 2 ( #2961 )
2016-10-29 13:08:49 +02:00
Robert Habermeier
2806f1d4c9
Even more snapshot validity checks ( #2935 )
...
* clarify "cancelled periodic snapshot" message
* more rigorous checks for snapshot validity
* verify ancient blocks on import
* limit number of fed blocks
* make it possible to feed snapshot service canonical hashes
* fix failing test build
* swap ethash DAG only when more recent
2016-10-28 16:10:30 +02:00
Tomasz Drwięga
88997801d0
Clippy bump ( #2877 )
...
* Bumping clippy
* Fixing warnings
* Fix the "fix"
2016-10-27 08:28:12 +02:00
Arkadiy Paronyan
f024acd329
More snapshot fixes and optimizations ( #2883 )
...
* More snapshot fixes and optimizations
* db drop
2016-10-26 16:14:13 +02:00
Arkadiy Paronyan
5b978be034
Get rid of MemoryDB denote ( #2881 )
2016-10-26 13:53:47 +02:00
Arkadiy Paronyan
135d5d0e4c
Snapshot fixes and optimizations ( #2863 )
2016-10-25 18:40:01 +02:00
Robert Habermeier
bc81ae0407
Snapshot and blockchain stability improvements ( #2843 )
...
* allow taking snapshot from just-restored database without error
* make creation informant less spammy
* Ancestry iterator failure-resilient
* make uncle hash searching resilient to incomplete chain
* deduce pre-chunk info from last written block's details
2016-10-24 18:27:23 +02:00
keorn
866ab9c7a3
Check queue to determine major importing ( #2763 )
...
* simplify major sync detection
* fix typos
* fix merge
* more realistic EthTester
* add new synced state
* remove Blocks synced state
* move is_major_importing to rpc crate and check queue
* add tests
2016-10-20 23:36:18 +02:00
Arkadiy Paronyan
ae853a7557
Don't add empty accounts to bloom ( #2753 )
2016-10-20 16:49:27 +02:00
keorn
aa52b04e31
Unify major syncing detection ( #2699 )
...
* simplify major sync detection
* fix typos
* fix merge
* more realistic EthTester
* add new synced state
2016-10-19 18:35:39 +02:00
Arkadiy Paronyan
487dfb0208
Snapshot sync part 2 ( #2098 )
...
* Split block downloader into a module
* Snapshot sync progress
* Warp sync CLI option
* Increased snapshot chunk and ping timeouts
* Fixed an issue with delayed writes
* Updated bootnodes
* Don't run pending IO tasks on shutdown
* Optional first_block; removed insert_snapshot_block
* Fixing expect calls
* Fixed stalled sync
* style and docs
* Update block_sync.rs
[ci:skip]
2016-10-18 18:16:00 +02:00
Robert Habermeier
8263bd4be2
snapshot: single byte for empty accounts ( #2625 )
2016-10-14 15:45:45 +03:00
Robert Habermeier
f28b8352c1
Configurable history size in master ( #2606 )
...
* split journaldb commit into two functions: journal_under and mark_canonical
* use new commit mechanism in client
* Configurable history size in master
* Reduce DB history
* Configurable history size
* Set min history size
* Test
* Fixed a test and reduced the limit
2016-10-14 15:44:56 +03:00
Nikolay Volf
7526b1d44b
Derive IPC interface only when ipc feature is on ( #2463 )
...
* derive -> ipc
* accident repair
* conditional ipc deriving
* fix test
2016-10-05 19:42:57 +02:00
Nikolay Volf
2b147616fd
derive -> ipc
2016-10-04 19:20:16 +03:00
Nikolay Volf
e1d3b3fff8
Accounts bloom in master ( #2426 )
...
* bloom crate link
* database layout and outdated tests
* state db alterations
* v10 migration run
* using arc
* bloom migration
* migration fixes and mess
* fix tests
2016-10-03 12:02:43 +02:00
Arkadiy Paronyan
ad63780b4d
Canonical state cache (master) ( #2311 )
...
* State cache
* Reduced copying data between caches
Whitespace and optional symbols
* Reduced copying data between caches
Whitespace and optional symbols
* Set a limit on storage cache
* Style and docs
2016-09-27 18:02:11 +02:00
Robert Habermeier
723d837d05
Snapshot format changes ( #2234 )
...
Closes #2213
Omit transaction and receipt roots from abridged block.
No longer use RLP compression.
Make ordered_trie_root generic over an iterator to save an allocation.
Breaks snapshot format backwards compatibility (with other 1.4 snapshots -- it's already been broken with 1.3).
Documentation will need updating
2016-09-22 19:47:03 +02:00
Robert Habermeier
a100b9d09e
Remove panickers from trie iterators ( #2209 )
...
* port trie iterators to use error handling
* use new trie iterators in snapshot
allows proper recovery from a premature periodic snapshot
2016-09-21 12:56:13 +02:00
Tomasz Drwięga
7f7e74869c
Bump clippy & Fix warnings ( #2109 )
...
* Bump clippy
* Fixing warnings
2016-09-16 23:03:26 +02:00
Robert Habermeier
83ddce011d
ensure the target folder doesn't exist before renaming ( #2074 )
2016-09-13 10:33:03 +02:00
Robert Habermeier
edcc4080d5
fix failing master build: update tests to new init_restore signature. ( #2069 )
2016-09-11 20:17:05 +02:00
Robert Habermeier
dcfd7eab6d
Local snapshot restore ( #2058 )
...
* restore from local snapshot
* update status with chunks done
* rework local restore trigger
2016-09-11 14:05:59 +02:00
Robert Habermeier
ff17174cf1
also test abort_restore
2016-09-08 12:44:10 +02:00
Robert Habermeier
756b7a3e67
test folder-deleting guards
2016-09-08 12:27:13 +02:00
Robert Habermeier
c65a5c8e9c
add restored_is_equivalent test
2016-09-08 12:14:53 +02:00
Robert Habermeier
b0f6bf2e78
remove client_db field from snapshot service
2016-09-07 19:38:59 +02:00
Robert Habermeier
57d5c35bb6
Use proper database configuration in snapshots. ( #2052 )
...
* use proper database config in snapshot service
* add snapshot path to parity directories struct
* fix RPC tests
2016-09-07 15:27:28 +02:00
Robert Habermeier
541b14a4ab
periodic snapshot tweaks ( #2054 )
...
* periodic snapshot tweaks
* set SNAPSHOT_HISTORY to 500
2016-09-07 15:27:14 +02:00
Robert Habermeier
f054a7b8d5
more info on current periodic snapshot
2016-09-06 17:44:11 +02:00
Robert Habermeier
46581e173d
check block queue size before taking periodic snapshot
2016-09-06 15:49:44 +02:00
Robert Habermeier
1e2cdedc9b
merge with master
2016-09-06 15:41:56 +02:00
Arkadiy Paronyan
5c5d9c8ccd
Snapshot sync ( #2047 )
...
* PV64 sync
* Tests
* Client DB restore
* Snapshot restoration over IPC
* Upating test
* Minor tweaks
* Upating test
2016-09-06 15:31:13 +02:00
Robert Habermeier
46b1224f7c
Merge branch 'master' into periodic_snapshot
2016-09-05 14:50:43 +02:00
Robert Habermeier
f0ef5e6943
keep snapshot watcher alive
2016-09-05 14:25:56 +02:00
Robert Habermeier
4e466f09db
Add a few small snapshot tests ( #2038 )
...
* add manifest data test
* begin tests for io
* add unit tests for snapshot io
* service smoke test
* remove empty service module
2016-09-05 12:24:03 +02:00
Robert Habermeier
2bf235e226
use more mocking in tests
2016-09-05 12:17:21 +02:00
Robert Habermeier
d9eb87cae7
add guard for temporary directories
2016-09-02 19:00:20 +02:00
Robert Habermeier
e3749b3bc4
implement snapshot watcher
2016-09-02 18:28:47 +02:00
Robert Habermeier
04dee54cb3
add take_snapshot to snapshot service
2016-09-02 16:15:25 +02:00
Robert Habermeier
5dd56aa070
port ethcore
2016-09-01 14:29:59 +02:00