Commit Graph

12 Commits

Author SHA1 Message Date
4b2eb7b018
refactor: pass struct through pipeline fllters 2023-02-24 07:48:47 +00:00
85ef2ffaac
devnet: snapshot 2023-02-24 10:22:06 +03:00
2161e8936b
feat: jetstream event full tx object
* minor pass pointer down the pipleine
2023-01-19 13:36:21 +03:00
20fc30c34a
feat: RPC block fetcher (#15)
* feat: init base logic for rpc fetcher

* feat: rpc block fetcher, move filters to internal

* move filters to internal folder
* rpc block fetcher
* add benchmarks:

goos: linux
goarch: amd64
pkg: github.com/grassrootseconomics/cic-chain-events/pkg/fetch
cpu: AMD EPYC Processor
Benchmark_RPC
Benchmark_RPC/RPC_Block_Fetcher_Benchmark
Benchmark_RPC/RPC_Block_Fetcher_Benchmark-4                   25          46000646 ns/op          221697 B/op        844 allocs/op
Benchmark_GraphQL
Benchmark_GraphQL/GraphQL_Block_Fetcher_Benchmark
Benchmark_GraphQL/GraphQL_Block_Fetcher_Benchmark-4           56          21219962 ns/op           56686 B/op         94 allocs/op
PASS
ok      github.com/grassrootseconomics/cic-chain-events/pkg/fetch       2.920s

* inline-docs: Describe RPC fetcher
2023-01-19 11:42:59 +03:00
ef9f2b2b7f
hotfix: drain janitor queue, worker pool, js
* fully drain worker queue before reading gap from db
* dedicated go routine for head syncer
* emit blok, tx index and hash to jetstream
2023-01-18 22:40:14 +03:00
02e31146cc
refactor: move filter and fetch to pkg 2023-01-14 10:18:50 +00:00
f791b87172
update: add filters for transfer events and tests 2023-01-14 10:18:50 +00:00
42bc68024f
docs: add functionality, and usage
others:

* remove drop command from sql migration
2023-01-11 09:29:16 +00:00
f1e74961b0
fix: deepsource suggestions 2023-01-11 08:43:05 +00:00
df88d9df16
refactor: perf, update libraries ci, and add docs
* update config to better defaults
* add docs, inline and md
* add context support throughout
* replace json with goccy/go-json for better decoding of large JSON
* update graphql fetcher: replace ioutil with io
* test runner script (until CI is ready)
* update CI build config
2023-01-11 08:13:59 +00:00
0ccdaa0345
feat: add stats api, fix pipeline exe
* added cUSD sample filters
* decouple stats from metrics
2023-01-06 11:32:20 +00:00
df4f188807
release: v0.1.0-alpha 2023-01-05 11:45:09 +00:00