Commit Graph

51 Commits

Author SHA1 Message Date
8085168ed3
major refactor: bootstrap from registry map and token index (see notes)
* the cache is now bootstrapped from the token index and registry map
* a token index filter auto updates the cache when a token is added (using add sig)
* minor fixes to filters
2023-03-29 16:17:30 +00:00
f592a6237d
devops: rename docker-compose file 2023-03-29 09:56:01 +00:00
521b3a35e0
fix (minor): lower case system address 2023-03-15 08:56:08 +00:00
3011d52fae
fix: switch back to ioutil + unmarshal JSON
- possible fix for #33
2023-03-14 07:19:07 +00:00
63205cc118
pkg: nump echopprof to include allocs handler 2023-03-13 15:05:53 +00:00
122b16451c
debug: add pprof handlers 2023-03-13 14:30:55 +00:00
8b14445c88
fix: loading systemAddress 2023-03-11 09:39:26 +00:00
94f1f3bc2c
fix: add checksum address to event, use stdlib json, load addresses from ko 2023-03-11 09:29:51 +00:00
c03932138d
fix: missing janitor count report 2023-03-09 08:33:09 +00:00
7b334e8691
fix: janitor incorrect missing block report 2023-03-08 14:52:29 +00:00
6d6b5d0d9f
docs: fix badge 2023-03-08 14:37:23 +00:00
dependabot[bot]
74c8c7cd6e
build(deps): bump github.com/jackc/tern/v2 from 2.0.0 to 2.0.1 (#32)
Bumps [github.com/jackc/tern/v2](https://github.com/jackc/tern) from 2.0.0 to 2.0.1.
- [Release notes](https://github.com/jackc/tern/releases)
- [Changelog](https://github.com/jackc/tern/blob/master/.goreleaser.yaml)
- [Commits](https://github.com/jackc/tern/compare/v2.0.0...v2.0.1)

---
updated-dependencies:
- dependency-name: github.com/jackc/tern/v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:36:06 +03:00
dependabot[bot]
a95ac61388
build(deps): bump github.com/labstack/echo/v4 from 4.9.0 to 4.10.2 (#29)
Bumps [github.com/labstack/echo/v4](https://github.com/labstack/echo) from 4.9.0 to 4.10.2.
- [Release notes](https://github.com/labstack/echo/releases)
- [Changelog](https://github.com/labstack/echo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/labstack/echo/compare/v4.9.0...v4.10.2)

---
updated-dependencies:
- dependency-name: github.com/labstack/echo/v4
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:35:45 +03:00
dependabot[bot]
9806def0df
build(deps): bump github.com/stretchr/testify from 1.8.1 to 1.8.2 (#30)
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.1 to 1.8.2.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.8.1...v1.8.2)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:35:25 +03:00
dependabot[bot]
c319b41570
build(deps): bump github.com/jackc/pgx/v5 from 5.3.0 to 5.3.1 (#31)
Bumps [github.com/jackc/pgx/v5](https://github.com/jackc/pgx) from 5.3.0 to 5.3.1.
- [Release notes](https://github.com/jackc/pgx/releases)
- [Changelog](https://github.com/jackc/pgx/blob/master/CHANGELOG.md)
- [Commits](https://github.com/jackc/pgx/compare/v5.3.0...v5.3.1)

---
updated-dependencies:
- dependency-name: github.com/jackc/pgx/v5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:34:51 +03:00
dependabot[bot]
edf9ebb029
build(deps): bump github.com/nats-io/nats.go from 1.23.0 to 1.24.0 (#28)
Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go) from 1.23.0 to 1.24.0.
- [Release notes](https://github.com/nats-io/nats.go/releases)
- [Commits](https://github.com/nats-io/nats.go/compare/v1.23.0...v1.24.0)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nats.go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-08 17:34:12 +03:00
05efa8af01
docs: update README 2023-03-08 14:32:44 +00:00
2bbc05bb45
major refactor: sig ch, remove conf settings, jetstream pub, ci
* This is a major refactor and includes general improvements around

- context cancellation
- build settings
- jetstream pub sub
- logging
- docker builds
- conf loading
2023-03-08 14:30:40 +00:00
661e6cf1f1
deps: update go version and ci fix 2023-02-24 10:39:12 +00:00
dependabot[bot]
cd67d2608c
build(deps): bump github.com/grassrootseconomics/w3-celo-patch (#21)
Bumps [github.com/grassrootseconomics/w3-celo-patch](https://github.com/grassrootseconomics/w3-celo-patch) from 0.1.0 to 0.2.0.
- [Release notes](https://github.com/grassrootseconomics/w3-celo-patch/releases)
- [Commits](https://github.com/grassrootseconomics/w3-celo-patch/compare/v0.1.0...v0.2.0)

---
updated-dependencies:
- dependency-name: github.com/grassrootseconomics/w3-celo-patch
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:33:30 +03:00
dependabot[bot]
bb5e9a43c7
build(deps): bump github.com/jackc/pgx/v5 from 5.2.0 to 5.3.0 (#20)
Bumps [github.com/jackc/pgx/v5](https://github.com/jackc/pgx) from 5.2.0 to 5.3.0.
- [Release notes](https://github.com/jackc/pgx/releases)
- [Changelog](https://github.com/jackc/pgx/blob/master/CHANGELOG.md)
- [Commits](https://github.com/jackc/pgx/compare/v5.2.0...v5.3.0)

---
updated-dependencies:
- dependency-name: github.com/jackc/pgx/v5
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:31:46 +03:00
dependabot[bot]
1a74662f61
build(deps): bump github.com/alitto/pond from 1.8.2 to 1.8.3 (#19)
Bumps [github.com/alitto/pond](https://github.com/alitto/pond) from 1.8.2 to 1.8.3.
- [Release notes](https://github.com/alitto/pond/releases)
- [Commits](https://github.com/alitto/pond/compare/v1.8.2...v1.8.3)

---
updated-dependencies:
- dependency-name: github.com/alitto/pond
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:31:13 +03:00
dependabot[bot]
3daaf98e73
build(deps): bump golang.org/x/net from 0.5.0 to 0.7.0 (#25)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.5.0 to 0.7.0.
- [Release notes](https://github.com/golang/net/releases)
- [Commits](https://github.com/golang/net/compare/v0.5.0...v0.7.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:30:34 +03:00
dependabot[bot]
f97410de89
build(deps): bump github.com/knadh/koanf from 1.4.5 to 1.5.0 (#17)
Bumps [github.com/knadh/koanf](https://github.com/knadh/koanf) from 1.4.5 to 1.5.0.
- [Release notes](https://github.com/knadh/koanf/releases)
- [Commits](https://github.com/knadh/koanf/compare/v1.4.5...v1.5.0)

---
updated-dependencies:
- dependency-name: github.com/knadh/koanf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-24 13:29:05 +03:00
9d1b77e907
refactor: filters, pipeline, minor fixes, remove RPC support (#27)
* devnet: snapshot

* refactor: pass struct through pipeline fllters

* refactor: replace timer with ticker

* refactor: filters, jetstream emitter

* add register filter
* update gas filter

* refactor: remove RPC fetcher support
2023-02-24 13:28:30 +03:00
6df00ddfce
docs: fix minor mistakes 2023-01-19 15:27:29 +03:00
7923384328
docs: improve instructions and description 2023-01-19 15:19:50 +03:00
2161e8936b
feat: jetstream event full tx object
* minor pass pointer down the pipleine
2023-01-19 13:36:21 +03:00
dependabot[bot]
7852d95335
build(deps): bump github.com/nats-io/nats.go from 1.22.1 to 1.23.0 (#16)
Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go) from 1.22.1 to 1.23.0.
- [Release notes](https://github.com/nats-io/nats.go/releases)
- [Commits](https://github.com/nats-io/nats.go/compare/v1.22.1...v1.23.0)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nats.go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-19 11:48:27 +03:00
20fc30c34a
feat: RPC block fetcher (#15)
* feat: init base logic for rpc fetcher

* feat: rpc block fetcher, move filters to internal

* move filters to internal folder
* rpc block fetcher
* add benchmarks:

goos: linux
goarch: amd64
pkg: github.com/grassrootseconomics/cic-chain-events/pkg/fetch
cpu: AMD EPYC Processor
Benchmark_RPC
Benchmark_RPC/RPC_Block_Fetcher_Benchmark
Benchmark_RPC/RPC_Block_Fetcher_Benchmark-4                   25          46000646 ns/op          221697 B/op        844 allocs/op
Benchmark_GraphQL
Benchmark_GraphQL/GraphQL_Block_Fetcher_Benchmark
Benchmark_GraphQL/GraphQL_Block_Fetcher_Benchmark-4           56          21219962 ns/op           56686 B/op         94 allocs/op
PASS
ok      github.com/grassrootseconomics/cic-chain-events/pkg/fetch       2.920s

* inline-docs: Describe RPC fetcher
2023-01-19 11:42:59 +03:00
ef9f2b2b7f
hotfix: drain janitor queue, worker pool, js
* fully drain worker queue before reading gap from db
* dedicated go routine for head syncer
* emit blok, tx index and hash to jetstream
2023-01-18 22:40:14 +03:00
dependabot[bot]
696263e35f
build(deps): bump github.com/VictoriaMetrics/metrics (#13)
Bumps [github.com/VictoriaMetrics/metrics](https://github.com/VictoriaMetrics/metrics) from 1.23.0 to 1.23.1.
- [Release notes](https://github.com/VictoriaMetrics/metrics/releases)
- [Commits](https://github.com/VictoriaMetrics/metrics/compare/v1.23.0...v1.23.1)

---
updated-dependencies:
- dependency-name: github.com/VictoriaMetrics/metrics
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-16 21:28:19 +03:00
c138c95583
docs: add jetstream desc and benthos example 2023-01-16 11:00:43 +00:00
e1c9faa7d0
dev: add profiler 2023-01-16 10:57:05 +00:00
f2d9154da0
refactor: decode JSON io.Reader stream 2023-01-16 08:31:46 +00:00
ad5ff05a32
feat: add jetstream integration
* closes #11
2023-01-14 10:18:50 +00:00
02e31146cc
refactor: move filter and fetch to pkg 2023-01-14 10:18:50 +00:00
f791b87172
update: add filters for transfer events and tests 2023-01-14 10:18:50 +00:00
a176b18ac0
del: jetstream docs, replace with issue 2023-01-14 10:18:50 +00:00
d0934bc4da
docs: add jetstream configs and instructions
* add Makefile to replace bash script
2023-01-14 10:18:50 +00:00
268f456522
Create codeql.yml 2023-01-11 12:49:32 +03:00
42bc68024f
docs: add functionality, and usage
others:

* remove drop command from sql migration
2023-01-11 09:29:16 +00:00
f1e74961b0
fix: deepsource suggestions 2023-01-11 08:43:05 +00:00
e2f7d1860d
docs (minor): fix typo 2023-01-11 11:25:35 +03:00
df88d9df16
refactor: perf, update libraries ci, and add docs
* update config to better defaults
* add docs, inline and md
* add context support throughout
* replace json with goccy/go-json for better decoding of large JSON
* update graphql fetcher: replace ioutil with io
* test runner script (until CI is ready)
* update CI build config
2023-01-11 08:13:59 +00:00
dependabot[bot]
29e7de6816
build(deps): bump github.com/labstack/echo/v4 from 4.2.1 to 4.9.0 (#8)
Bumps [github.com/labstack/echo/v4](https://github.com/labstack/echo) from 4.2.1 to 4.9.0.
- [Release notes](https://github.com/labstack/echo/releases)
- [Changelog](https://github.com/labstack/echo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/labstack/echo/compare/v4.2.1...v4.9.0)

---
updated-dependencies:
- dependency-name: github.com/labstack/echo/v4
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-06 14:50:07 +03:00
06d2677071
ci: fix Docker CGO build 2023-01-06 11:45:33 +00:00
d9866196f9
ci: enable CGO builds 2023-01-06 11:42:58 +00:00
0ccdaa0345
feat: add stats api, fix pipeline exe
* added cUSD sample filters
* decouple stats from metrics
2023-01-06 11:32:20 +00:00
ed0802d2be
add: ci integration 2023-01-06 08:07:19 +00:00