Commit Graph

27 Commits

Author SHA1 Message Date
9d1b77e907
refactor: filters, pipeline, minor fixes, remove RPC support (#27)
* devnet: snapshot

* refactor: pass struct through pipeline fllters

* refactor: replace timer with ticker

* refactor: filters, jetstream emitter

* add register filter
* update gas filter

* refactor: remove RPC fetcher support
2023-02-24 13:28:30 +03:00
6df00ddfce
docs: fix minor mistakes 2023-01-19 15:27:29 +03:00
7923384328
docs: improve instructions and description 2023-01-19 15:19:50 +03:00
2161e8936b
feat: jetstream event full tx object
* minor pass pointer down the pipleine
2023-01-19 13:36:21 +03:00
dependabot[bot]
7852d95335
build(deps): bump github.com/nats-io/nats.go from 1.22.1 to 1.23.0 (#16)
Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go) from 1.22.1 to 1.23.0.
- [Release notes](https://github.com/nats-io/nats.go/releases)
- [Commits](https://github.com/nats-io/nats.go/compare/v1.22.1...v1.23.0)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nats.go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-19 11:48:27 +03:00
20fc30c34a
feat: RPC block fetcher (#15)
* feat: init base logic for rpc fetcher

* feat: rpc block fetcher, move filters to internal

* move filters to internal folder
* rpc block fetcher
* add benchmarks:

goos: linux
goarch: amd64
pkg: github.com/grassrootseconomics/cic-chain-events/pkg/fetch
cpu: AMD EPYC Processor
Benchmark_RPC
Benchmark_RPC/RPC_Block_Fetcher_Benchmark
Benchmark_RPC/RPC_Block_Fetcher_Benchmark-4                   25          46000646 ns/op          221697 B/op        844 allocs/op
Benchmark_GraphQL
Benchmark_GraphQL/GraphQL_Block_Fetcher_Benchmark
Benchmark_GraphQL/GraphQL_Block_Fetcher_Benchmark-4           56          21219962 ns/op           56686 B/op         94 allocs/op
PASS
ok      github.com/grassrootseconomics/cic-chain-events/pkg/fetch       2.920s

* inline-docs: Describe RPC fetcher
2023-01-19 11:42:59 +03:00
ef9f2b2b7f
hotfix: drain janitor queue, worker pool, js
* fully drain worker queue before reading gap from db
* dedicated go routine for head syncer
* emit blok, tx index and hash to jetstream
2023-01-18 22:40:14 +03:00
dependabot[bot]
696263e35f
build(deps): bump github.com/VictoriaMetrics/metrics (#13)
Bumps [github.com/VictoriaMetrics/metrics](https://github.com/VictoriaMetrics/metrics) from 1.23.0 to 1.23.1.
- [Release notes](https://github.com/VictoriaMetrics/metrics/releases)
- [Commits](https://github.com/VictoriaMetrics/metrics/compare/v1.23.0...v1.23.1)

---
updated-dependencies:
- dependency-name: github.com/VictoriaMetrics/metrics
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-16 21:28:19 +03:00
c138c95583
docs: add jetstream desc and benthos example 2023-01-16 11:00:43 +00:00
e1c9faa7d0
dev: add profiler 2023-01-16 10:57:05 +00:00
f2d9154da0
refactor: decode JSON io.Reader stream 2023-01-16 08:31:46 +00:00
ad5ff05a32
feat: add jetstream integration
* closes #11
2023-01-14 10:18:50 +00:00
02e31146cc
refactor: move filter and fetch to pkg 2023-01-14 10:18:50 +00:00
f791b87172
update: add filters for transfer events and tests 2023-01-14 10:18:50 +00:00
a176b18ac0
del: jetstream docs, replace with issue 2023-01-14 10:18:50 +00:00
d0934bc4da
docs: add jetstream configs and instructions
* add Makefile to replace bash script
2023-01-14 10:18:50 +00:00
268f456522
Create codeql.yml 2023-01-11 12:49:32 +03:00
42bc68024f
docs: add functionality, and usage
others:

* remove drop command from sql migration
2023-01-11 09:29:16 +00:00
f1e74961b0
fix: deepsource suggestions 2023-01-11 08:43:05 +00:00
e2f7d1860d
docs (minor): fix typo 2023-01-11 11:25:35 +03:00
df88d9df16
refactor: perf, update libraries ci, and add docs
* update config to better defaults
* add docs, inline and md
* add context support throughout
* replace json with goccy/go-json for better decoding of large JSON
* update graphql fetcher: replace ioutil with io
* test runner script (until CI is ready)
* update CI build config
2023-01-11 08:13:59 +00:00
dependabot[bot]
29e7de6816
build(deps): bump github.com/labstack/echo/v4 from 4.2.1 to 4.9.0 (#8)
Bumps [github.com/labstack/echo/v4](https://github.com/labstack/echo) from 4.2.1 to 4.9.0.
- [Release notes](https://github.com/labstack/echo/releases)
- [Changelog](https://github.com/labstack/echo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/labstack/echo/compare/v4.2.1...v4.9.0)

---
updated-dependencies:
- dependency-name: github.com/labstack/echo/v4
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-06 14:50:07 +03:00
06d2677071
ci: fix Docker CGO build 2023-01-06 11:45:33 +00:00
d9866196f9
ci: enable CGO builds 2023-01-06 11:42:58 +00:00
0ccdaa0345
feat: add stats api, fix pipeline exe
* added cUSD sample filters
* decouple stats from metrics
2023-01-06 11:32:20 +00:00
ed0802d2be
add: ci integration 2023-01-06 08:07:19 +00:00
df4f188807
release: v0.1.0-alpha 2023-01-05 11:45:09 +00:00