cic-chain-events/config.toml

[metrics]
# Exposes Prometheus metrics
go_process = true

# API server
[api]
# Host and port
address = ":8080"

# Geth API endpoints
[chain]
graphql_endpoint = "https://rpc.celo.grassecon.net/graphql"
ws_endpoint      = "wss://socket.celo.grassecon.net"

[syncer]
# Number of goroutines assigned to the worker pool
janitor_concurrency    = 5
# Max idle time after which goroutine is returned back to the pool
idle_worker_timeout    = 1
# Syncer start block
initial_lower_bound    = 17269000
# Max blocks in worker queue awaiting processing
janitor_queue_size     = 500
# Janitor sweep interval, should take into account concurrency and queue_size
janitor_sweep_interval = 5

[postgres]
dsn   = "postgres://postgres:postgres@localhost:5432/cic_chain_events"

# https://docs.nats.io/
[jetstream]
endpoint               = "nats://localhost:4222"
stream_name            = "CHAIN"
# Duration JetStream should keep the message before GC
persist_duration_hours = 48
# Duration to ignore duplicate transactions (e.g. due to restart)
dedup_duration_hours   = 6
# Stream subjects
stream_subjects        = [
    "CHAIN.transfer",
    "CHAIN.transferFrom",
    "CHAIN.mintTo"
]

# 77G - snapshot
# 111G - decompressed
# 112G - latest
release: v0.1.0-alpha 2023-01-05 12:45:09 +01:00			`[metrics]`
docs: add functionality, and usage others: * remove drop command from sql migration 2023-01-11 10:29:16 +01:00			`# Exposes Prometheus metrics`
feat: add stats api, fix pipeline exe * added cUSD sample filters * decouple stats from metrics 2023-01-06 12:32:20 +01:00			`go_process = true`

refactor: perf, update libraries ci, and add docs * update config to better defaults * add docs, inline and md * add context support throughout * replace json with goccy/go-json for better decoding of large JSON * update graphql fetcher: replace ioutil with io * test runner script (until CI is ready) * update CI build config 2023-01-11 09:13:59 +01:00			`# API server`
feat: add stats api, fix pipeline exe * added cUSD sample filters * decouple stats from metrics 2023-01-06 12:32:20 +01:00			`[api]`
docs: add functionality, and usage others: * remove drop command from sql migration 2023-01-11 10:29:16 +01:00			`# Host and port`
feat: add stats api, fix pipeline exe * added cUSD sample filters * decouple stats from metrics 2023-01-06 12:32:20 +01:00			`address = ":8080"`
release: v0.1.0-alpha 2023-01-05 12:45:09 +01:00
refactor: perf, update libraries ci, and add docs * update config to better defaults * add docs, inline and md * add context support throughout * replace json with goccy/go-json for better decoding of large JSON * update graphql fetcher: replace ioutil with io * test runner script (until CI is ready) * update CI build config 2023-01-11 09:13:59 +01:00			`# Geth API endpoints`
release: v0.1.0-alpha 2023-01-05 12:45:09 +01:00			`[chain]`
feat: add stats api, fix pipeline exe * added cUSD sample filters * decouple stats from metrics 2023-01-06 12:32:20 +01:00			`graphql_endpoint = "https://rpc.celo.grassecon.net/graphql"`
hotfix: drain janitor queue, worker pool, js * fully drain worker queue before reading gap from db * dedicated go routine for head syncer * emit blok, tx index and hash to jetstream 2023-01-18 20:40:14 +01:00			`ws_endpoint = "wss://socket.celo.grassecon.net"`
release: v0.1.0-alpha 2023-01-05 12:45:09 +01:00
refactor: perf, update libraries ci, and add docs * update config to better defaults * add docs, inline and md * add context support throughout * replace json with goccy/go-json for better decoding of large JSON * update graphql fetcher: replace ioutil with io * test runner script (until CI is ready) * update CI build config 2023-01-11 09:13:59 +01:00			`[syncer]`
			`# Number of goroutines assigned to the worker pool`
hotfix: drain janitor queue, worker pool, js * fully drain worker queue before reading gap from db * dedicated go routine for head syncer * emit blok, tx index and hash to jetstream 2023-01-18 20:40:14 +01:00			`janitor_concurrency = 5`
refactor: perf, update libraries ci, and add docs * update config to better defaults * add docs, inline and md * add context support throughout * replace json with goccy/go-json for better decoding of large JSON * update graphql fetcher: replace ioutil with io * test runner script (until CI is ready) * update CI build config 2023-01-11 09:13:59 +01:00			`# Max idle time after which goroutine is returned back to the pool`
hotfix: drain janitor queue, worker pool, js * fully drain worker queue before reading gap from db * dedicated go routine for head syncer * emit blok, tx index and hash to jetstream 2023-01-18 20:40:14 +01:00			`idle_worker_timeout = 1`
refactor: perf, update libraries ci, and add docs * update config to better defaults * add docs, inline and md * add context support throughout * replace json with goccy/go-json for better decoding of large JSON * update graphql fetcher: replace ioutil with io * test runner script (until CI is ready) * update CI build config 2023-01-11 09:13:59 +01:00			`# Syncer start block`
hotfix: drain janitor queue, worker pool, js * fully drain worker queue before reading gap from db * dedicated go routine for head syncer * emit blok, tx index and hash to jetstream 2023-01-18 20:40:14 +01:00			`initial_lower_bound = 17269000`
refactor: perf, update libraries ci, and add docs * update config to better defaults * add docs, inline and md * add context support throughout * replace json with goccy/go-json for better decoding of large JSON * update graphql fetcher: replace ioutil with io * test runner script (until CI is ready) * update CI build config 2023-01-11 09:13:59 +01:00			`# Max blocks in worker queue awaiting processing`
hotfix: drain janitor queue, worker pool, js * fully drain worker queue before reading gap from db * dedicated go routine for head syncer * emit blok, tx index and hash to jetstream 2023-01-18 20:40:14 +01:00			`janitor_queue_size = 500`
refactor: perf, update libraries ci, and add docs * update config to better defaults * add docs, inline and md * add context support throughout * replace json with goccy/go-json for better decoding of large JSON * update graphql fetcher: replace ioutil with io * test runner script (until CI is ready) * update CI build config 2023-01-11 09:13:59 +01:00			`# Janitor sweep interval, should take into account concurrency and queue_size`
hotfix: drain janitor queue, worker pool, js * fully drain worker queue before reading gap from db * dedicated go routine for head syncer * emit blok, tx index and hash to jetstream 2023-01-18 20:40:14 +01:00			`janitor_sweep_interval = 5`
release: v0.1.0-alpha 2023-01-05 12:45:09 +01:00
			`[postgres]`
feat: add jetstream integration * closes #11 2023-01-14 11:17:34 +01:00			`dsn = "postgres://postgres:postgres@localhost:5432/cic_chain_events"`

			`# https://docs.nats.io/`
			`[jetstream]`
			`endpoint = "nats://localhost:4222"`
			`stream_name = "CHAIN"`
			`# Duration JetStream should keep the message before GC`
			`persist_duration_hours = 48`
			`# Duration to ignore duplicate transactions (e.g. due to restart)`
			`dedup_duration_hours = 6`
			`# Stream subjects`
			`stream_subjects = [`
			`"CHAIN.transfer",`
			`"CHAIN.transferFrom",`
			`"CHAIN.mintTo"`
hotfix: drain janitor queue, worker pool, js * fully drain worker queue before reading gap from db * dedicated go routine for head syncer * emit blok, tx index and hash to jetstream 2023-01-18 20:40:14 +01:00			`]`

			`# 77G - snapshot`
			`# 111G - decompressed`
			`# 112G - latest`