openethereum/ethcore
cheme c1aed4af45 Fix light client deadlock (#9385)
This PR is fixing deadlock for #8918 

It avoids some recursive calls on light_sync by making state check optional for Informant.

The current behavior is to display the information when informant checks if block is major version.
This change a bit the informant behavior, but not on most cases.

To remember where and how this kind of deadlock are likely to happen (not seen with Parkinglot deadlock detection because it uses std condvar), I am adding a description of the deadlock.
Also, for the reviewers there may be better solution than modifying the informant.

### Thread1 

- ethcore/sync/light_sync/mod.rs

A call to the light handler through any Io (having a loop of rpc query running on like client makes the dead lock way more likely).
At the end of those calls we systematically call `maintain_sync` method.

Here maintain_sync locks `state` (it is the deadlock cause), with a write purpose

`maintain_sync` -> `begin_search` with the state locked open

`begin_search` -> lightcliennt `flush_queue` method

- ethcore/light/src/client/mod.rs

`flush_queue` -> `flush` on queue (HeaderQueue aka VerificationQueue of headers)

- ethcore/src/verification/queue/mod.rs

Condition there is some unverified or verifying content

`flush` wait on a condvar until the queue is empty. The only way to unlock condvar is that worker is empty and unlock it (so thread 2 is Verification worker).

### Thread2

A verification worker at the end of a verify loop (new block).

- ethcore/src/verification/queue/mod.rs

thread loops on `verify` method.

End of loop condition is_ready -> Import the block immediately 

calls `set_sync` on QueueSignal which send a BlockVerified ClientIoMessage in inner channel (IoChannel of ClientIoMessage) using `send_sync`

- util/io/src/service_mio.rs

IoChannel `send_sync` method calls all handlers with `message` method; one of the handlers is ImportBlocks IoHandler (with a single inner Client service field)

- ethcore/light/src/client/service.rs

`message` trigger inner method `import_verified`

- core/light/src/client/mod.rs

`import_verified` at the very end notify the listeners of a new_headers, one of the listeners is Informant `listener` method

- parity/informant.rs

`newHeaders` run up to call to `is_major_importing` on its target (again clinet)

-  ethcore/sync/src/light_sync/mod.rs

Here `is_major_importing` tries to get state lock (read purpose only) but cannot because of previous state lock, thus deadlock
2018-09-04 15:36:34 +01:00
..
benches ethcore: add builtin benchmarks based on geth (#9179) 2018-07-23 15:46:24 +02:00
evm Add EIP-1014 transition config flag (#9268) 2018-08-31 23:43:51 +08:00
light use kvdb-* and parity-snappy crates from crates.io (#9441) 2018-09-03 17:40:11 +01:00
node_filter use kvdb-* and parity-snappy crates from crates.io (#9441) 2018-09-03 17:40:11 +01:00
private-tx Private packets verification and queue refactoring (#8715) 2018-08-29 20:31:04 +08:00
res Add EIP-1014 transition config flag (#9268) 2018-08-31 23:43:51 +08:00
service use kvdb-* and parity-snappy crates from crates.io (#9441) 2018-09-03 17:40:11 +01:00
src Fix docs of address_hash (#9463) 2018-09-04 11:25:22 +02:00
stratum Update `log` -> 0.4, `env_logger` -> 0.5. (#9294) 2018-08-10 00:04:10 +01:00
sync Fix light client deadlock (#9385) 2018-09-04 15:36:34 +01:00
transaction deserialize block only once during verification (#9161) 2018-07-25 14:36:46 +02:00
types Remove unused BlockStatus::Pending (#9447) 2018-08-31 12:13:01 +01:00
vm Add EIP-1014 transition config flag (#9268) 2018-08-31 23:43:51 +08:00
wasm `gasleft` extern implemented for WASM runtime (kip-6) (#9357) 2018-08-24 18:03:46 +02:00
Cargo.toml use kvdb-* and parity-snappy crates from crates.io (#9441) 2018-09-03 17:40:11 +01:00