4fcc088784
feat: add retryable head subscription wrapper
...
* closes #18
2023-04-14 08:27:08 +00:00
8085168ed3
major refactor: bootstrap from registry map and token index (see notes)
...
* the cache is now bootstrapped from the token index and registry map
* a token index filter auto updates the cache when a token is added (using add sig)
* minor fixes to filters
2023-03-29 16:17:30 +00:00
f592a6237d
devops: rename docker-compose file
2023-03-29 09:56:01 +00:00
521b3a35e0
fix (minor): lower case system address
2023-03-15 08:56:08 +00:00
3011d52fae
fix: switch back to ioutil + unmarshal JSON
...
- possible fix for #33
2023-03-14 07:19:07 +00:00
63205cc118
pkg: nump echopprof to include allocs handler
2023-03-13 15:05:53 +00:00
122b16451c
debug: add pprof handlers
2023-03-13 14:30:55 +00:00
8b14445c88
fix: loading systemAddress
2023-03-11 09:39:26 +00:00
94f1f3bc2c
fix: add checksum address to event, use stdlib json, load addresses from ko
2023-03-11 09:29:51 +00:00
c03932138d
fix: missing janitor count report
2023-03-09 08:33:09 +00:00
7b334e8691
fix: janitor incorrect missing block report
2023-03-08 14:52:29 +00:00
6d6b5d0d9f
docs: fix badge
2023-03-08 14:37:23 +00:00
dependabot[bot]
74c8c7cd6e
build(deps): bump github.com/jackc/tern/v2 from 2.0.0 to 2.0.1 ( #32 )
...
Bumps [github.com/jackc/tern/v2](https://github.com/jackc/tern ) from 2.0.0 to 2.0.1.
- [Release notes](https://github.com/jackc/tern/releases )
- [Changelog](https://github.com/jackc/tern/blob/master/.goreleaser.yaml )
- [Commits](https://github.com/jackc/tern/compare/v2.0.0...v2.0.1 )
---
updated-dependencies:
- dependency-name: github.com/jackc/tern/v2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:36:06 +03:00
dependabot[bot]
a95ac61388
build(deps): bump github.com/labstack/echo/v4 from 4.9.0 to 4.10.2 ( #29 )
...
Bumps [github.com/labstack/echo/v4](https://github.com/labstack/echo ) from 4.9.0 to 4.10.2.
- [Release notes](https://github.com/labstack/echo/releases )
- [Changelog](https://github.com/labstack/echo/blob/master/CHANGELOG.md )
- [Commits](https://github.com/labstack/echo/compare/v4.9.0...v4.10.2 )
---
updated-dependencies:
- dependency-name: github.com/labstack/echo/v4
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:35:45 +03:00
dependabot[bot]
9806def0df
build(deps): bump github.com/stretchr/testify from 1.8.1 to 1.8.2 ( #30 )
...
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify ) from 1.8.1 to 1.8.2.
- [Release notes](https://github.com/stretchr/testify/releases )
- [Commits](https://github.com/stretchr/testify/compare/v1.8.1...v1.8.2 )
---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:35:25 +03:00
dependabot[bot]
c319b41570
build(deps): bump github.com/jackc/pgx/v5 from 5.3.0 to 5.3.1 ( #31 )
...
Bumps [github.com/jackc/pgx/v5](https://github.com/jackc/pgx ) from 5.3.0 to 5.3.1.
- [Release notes](https://github.com/jackc/pgx/releases )
- [Changelog](https://github.com/jackc/pgx/blob/master/CHANGELOG.md )
- [Commits](https://github.com/jackc/pgx/compare/v5.3.0...v5.3.1 )
---
updated-dependencies:
- dependency-name: github.com/jackc/pgx/v5
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:34:51 +03:00
dependabot[bot]
edf9ebb029
build(deps): bump github.com/nats-io/nats.go from 1.23.0 to 1.24.0 ( #28 )
...
Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go ) from 1.23.0 to 1.24.0.
- [Release notes](https://github.com/nats-io/nats.go/releases )
- [Commits](https://github.com/nats-io/nats.go/compare/v1.23.0...v1.24.0 )
---
updated-dependencies:
- dependency-name: github.com/nats-io/nats.go
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:34:12 +03:00
05efa8af01
docs: update README
2023-03-08 14:32:44 +00:00
2bbc05bb45
major refactor: sig ch, remove conf settings, jetstream pub, ci
...
* This is a major refactor and includes general improvements around
- context cancellation
- build settings
- jetstream pub sub
- logging
- docker builds
- conf loading
2023-03-08 14:30:40 +00:00
661e6cf1f1
deps: update go version and ci fix
2023-02-24 10:39:12 +00:00
dependabot[bot]
cd67d2608c
build(deps): bump github.com/grassrootseconomics/w3-celo-patch ( #21 )
...
Bumps [github.com/grassrootseconomics/w3-celo-patch](https://github.com/grassrootseconomics/w3-celo-patch ) from 0.1.0 to 0.2.0.
- [Release notes](https://github.com/grassrootseconomics/w3-celo-patch/releases )
- [Commits](https://github.com/grassrootseconomics/w3-celo-patch/compare/v0.1.0...v0.2.0 )
---
updated-dependencies:
- dependency-name: github.com/grassrootseconomics/w3-celo-patch
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:33:30 +03:00
dependabot[bot]
bb5e9a43c7
build(deps): bump github.com/jackc/pgx/v5 from 5.2.0 to 5.3.0 ( #20 )
...
Bumps [github.com/jackc/pgx/v5](https://github.com/jackc/pgx ) from 5.2.0 to 5.3.0.
- [Release notes](https://github.com/jackc/pgx/releases )
- [Changelog](https://github.com/jackc/pgx/blob/master/CHANGELOG.md )
- [Commits](https://github.com/jackc/pgx/compare/v5.2.0...v5.3.0 )
---
updated-dependencies:
- dependency-name: github.com/jackc/pgx/v5
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:31:46 +03:00
dependabot[bot]
1a74662f61
build(deps): bump github.com/alitto/pond from 1.8.2 to 1.8.3 ( #19 )
...
Bumps [github.com/alitto/pond](https://github.com/alitto/pond ) from 1.8.2 to 1.8.3.
- [Release notes](https://github.com/alitto/pond/releases )
- [Commits](https://github.com/alitto/pond/compare/v1.8.2...v1.8.3 )
---
updated-dependencies:
- dependency-name: github.com/alitto/pond
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:31:13 +03:00
dependabot[bot]
3daaf98e73
build(deps): bump golang.org/x/net from 0.5.0 to 0.7.0 ( #25 )
...
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.5.0 to 0.7.0.
- [Release notes](https://github.com/golang/net/releases )
- [Commits](https://github.com/golang/net/compare/v0.5.0...v0.7.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:30:34 +03:00
dependabot[bot]
f97410de89
build(deps): bump github.com/knadh/koanf from 1.4.5 to 1.5.0 ( #17 )
...
Bumps [github.com/knadh/koanf](https://github.com/knadh/koanf ) from 1.4.5 to 1.5.0.
- [Release notes](https://github.com/knadh/koanf/releases )
- [Commits](https://github.com/knadh/koanf/compare/v1.4.5...v1.5.0 )
---
updated-dependencies:
- dependency-name: github.com/knadh/koanf
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:29:05 +03:00
9d1b77e907
refactor: filters, pipeline, minor fixes, remove RPC support ( #27 )
...
* devnet: snapshot
* refactor: pass struct through pipeline fllters
* refactor: replace timer with ticker
* refactor: filters, jetstream emitter
* add register filter
* update gas filter
* refactor: remove RPC fetcher support
2023-02-24 13:28:30 +03:00
6df00ddfce
docs: fix minor mistakes
2023-01-19 15:27:29 +03:00
7923384328
docs: improve instructions and description
2023-01-19 15:19:50 +03:00
2161e8936b
feat: jetstream event full tx object
...
* minor pass pointer down the pipleine
2023-01-19 13:36:21 +03:00
dependabot[bot]
7852d95335
build(deps): bump github.com/nats-io/nats.go from 1.22.1 to 1.23.0 ( #16 )
...
Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go ) from 1.22.1 to 1.23.0.
- [Release notes](https://github.com/nats-io/nats.go/releases )
- [Commits](https://github.com/nats-io/nats.go/compare/v1.22.1...v1.23.0 )
---
updated-dependencies:
- dependency-name: github.com/nats-io/nats.go
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-19 11:48:27 +03:00
20fc30c34a
feat: RPC block fetcher ( #15 )
...
* feat: init base logic for rpc fetcher
* feat: rpc block fetcher, move filters to internal
* move filters to internal folder
* rpc block fetcher
* add benchmarks:
goos: linux
goarch: amd64
pkg: github.com/grassrootseconomics/cic-chain-events/pkg/fetch
cpu: AMD EPYC Processor
Benchmark_RPC
Benchmark_RPC/RPC_Block_Fetcher_Benchmark
Benchmark_RPC/RPC_Block_Fetcher_Benchmark-4 25 46000646 ns/op 221697 B/op 844 allocs/op
Benchmark_GraphQL
Benchmark_GraphQL/GraphQL_Block_Fetcher_Benchmark
Benchmark_GraphQL/GraphQL_Block_Fetcher_Benchmark-4 56 21219962 ns/op 56686 B/op 94 allocs/op
PASS
ok github.com/grassrootseconomics/cic-chain-events/pkg/fetch 2.920s
* inline-docs: Describe RPC fetcher
2023-01-19 11:42:59 +03:00
ef9f2b2b7f
hotfix: drain janitor queue, worker pool, js
...
* fully drain worker queue before reading gap from db
* dedicated go routine for head syncer
* emit blok, tx index and hash to jetstream
2023-01-18 22:40:14 +03:00
dependabot[bot]
696263e35f
build(deps): bump github.com/VictoriaMetrics/metrics ( #13 )
...
Bumps [github.com/VictoriaMetrics/metrics](https://github.com/VictoriaMetrics/metrics ) from 1.23.0 to 1.23.1.
- [Release notes](https://github.com/VictoriaMetrics/metrics/releases )
- [Commits](https://github.com/VictoriaMetrics/metrics/compare/v1.23.0...v1.23.1 )
---
updated-dependencies:
- dependency-name: github.com/VictoriaMetrics/metrics
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-16 21:28:19 +03:00
c138c95583
docs: add jetstream desc and benthos example
2023-01-16 11:00:43 +00:00
e1c9faa7d0
dev: add profiler
2023-01-16 10:57:05 +00:00
f2d9154da0
refactor: decode JSON io.Reader stream
2023-01-16 08:31:46 +00:00
ad5ff05a32
feat: add jetstream integration
...
* closes #11
2023-01-14 10:18:50 +00:00
02e31146cc
refactor: move filter and fetch to pkg
2023-01-14 10:18:50 +00:00
f791b87172
update: add filters for transfer events and tests
2023-01-14 10:18:50 +00:00
a176b18ac0
del: jetstream docs, replace with issue
2023-01-14 10:18:50 +00:00
d0934bc4da
docs: add jetstream configs and instructions
...
* add Makefile to replace bash script
2023-01-14 10:18:50 +00:00
268f456522
Create codeql.yml
2023-01-11 12:49:32 +03:00
42bc68024f
docs: add functionality, and usage
...
others:
* remove drop command from sql migration
2023-01-11 09:29:16 +00:00
f1e74961b0
fix: deepsource suggestions
2023-01-11 08:43:05 +00:00
e2f7d1860d
docs (minor): fix typo
2023-01-11 11:25:35 +03:00
df88d9df16
refactor: perf, update libraries ci, and add docs
...
* update config to better defaults
* add docs, inline and md
* add context support throughout
* replace json with goccy/go-json for better decoding of large JSON
* update graphql fetcher: replace ioutil with io
* test runner script (until CI is ready)
* update CI build config
2023-01-11 08:13:59 +00:00
dependabot[bot]
29e7de6816
build(deps): bump github.com/labstack/echo/v4 from 4.2.1 to 4.9.0 ( #8 )
...
Bumps [github.com/labstack/echo/v4](https://github.com/labstack/echo ) from 4.2.1 to 4.9.0.
- [Release notes](https://github.com/labstack/echo/releases )
- [Changelog](https://github.com/labstack/echo/blob/master/CHANGELOG.md )
- [Commits](https://github.com/labstack/echo/compare/v4.2.1...v4.9.0 )
---
updated-dependencies:
- dependency-name: github.com/labstack/echo/v4
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-06 14:50:07 +03:00
06d2677071
ci: fix Docker CGO build
2023-01-06 11:45:33 +00:00
d9866196f9
ci: enable CGO builds
2023-01-06 11:42:58 +00:00
0ccdaa0345
feat: add stats api, fix pipeline exe
...
* added cUSD sample filters
* decouple stats from metrics
2023-01-06 11:32:20 +00:00
