feat(devnet): add substrate docker images to dockerfile #2263

EclesioMeloJunior · 2022-02-02T00:30:00Z

Changes

Create substrate docker images using parity/polkadot:v0.9.10 image
Update our current genesis.json and add a genesis-raw.json

Tests

Issues

Closes create Docker image for substrate node running gssmr chain #2148

Primary Reviewer

@timwu20

timwu20 · 2022-02-03T22:52:53Z

devnet/docker-compose-substrate.yml

+      - 30333
+      - 9933
+      - 9944
+      - 9615:9615


Suggested change

- 9615:9615

- 9615

can we make these exposed ports the same as gossamer? Or we should at least comment what the diff ports do.

Yes, it is possible!

devnet/docker-compose.yml

timwu20 · 2022-02-03T22:54:43Z

devnet/substrate_alice.Dockerfile

+COPY --from=polkadot /usr/bin/polkadot /usr/bin/polkadot
+COPY devnet/chain/gssmr/genesis-raw.json genesis-spec.json
+
+RUN go run cmd/update-dd-agent-confd/main.go -n=${METRICS_NAMESPACE} -t=key:alice > /etc/datadog-agent/conf.d/openmetrics.d/conf.yaml


what port is prometheus running on? update-dd-agent-config is currently expecting the prometheus endpoint to be http://127.0.0.1:9876/metrics.

Changed substrate nodes to expose Prometheus at port 9876

What port does substrate uses? Shouldn't we use the standard 9090 port for Gossamer as well 🤔

by default the port 9090 is the one Prometheus docker image prom/prometheus uses to bootstrap its own server to collect metrics. I just standardized the port which substrate and gossamer will expose metrics

Yes but by default what's the port substrate/polkadot uses for Prometheus? We force it to 9876 here it seems. I'm thinking we should change it in Gossamer (for end users experience).

As far as I know, applications usually have their Prom registry server listening on 9090, so maybe we want to use that instead? Although if polkadot uses 9876 for whatever weird reason, then sure we can match it as well I guess.

timwu20 · 2022-02-03T22:56:51Z

devnet/substrate_bob.Dockerfile

+RUN go run cmd/update-dd-agent-confd/main.go -n=${METRICS_NAMESPACE} -t=key:${key} > /etc/datadog-agent/conf.d/openmetrics.d/conf.yaml
+
+ENTRYPOINT service datadog-agent start && /usr/bin/polkadot \
+    --bootnodes=/dns/substrate-alice/tcp/30333/p2p/12D3KooWDpJ7As7BWAwRMfu1VU2WCqNjvq387JEYKDBj4kx6nXTN \


if I were to use this Dockerfile to connect to a gossamer alice how would this work? If I wanted to connect substrate non-lead nodes to a gossamer lead node how would that work?

The libp2p id would have to be the same for both substrate and gossamer alice nodes.

Now both substrate and gossamer alice nodes use the same node key so if you spin up a gossamer alice container and spin up bob and charlie substrate nodes they will connect without modifications to the image.

timwu20 · 2022-02-03T23:00:18Z

Are we absolutely sure that the alice, bob, and charlie keys are the same for both gossamer nodes and substrate nodes? Like if we run the gossamer only devnet with these changes using the raw genesis, are we sure those are the only 3 authorities?

EclesioMeloJunior · 2022-02-04T02:55:25Z

Are we absolutely sure that the alice, bob, and charlie keys are the same for both gossamer nodes and substrate nodes? Like if we run the gossamer only devnet with these changes using the raw genesis, are we sure those are the only 3 authorities?

Yes, those keys are the same for both gossamer and substrate nodes, you can check using subkey inspect //Alice, subkey inspect //Bob or subkey inspect //Charlie, and our raw genesis contains only those 3 authorities

noot

instead of modifying the existing gossamer-only devnet can you make a new folder for the cross-client devnet? it would be nice to have both

chore: keep both cross-client and gssmr chain genesis raw chore: mistakes

This is needed since ARG cannot be used inside ENTRYPOINT

…/gossamer into eclesio/substrate-docker-image

jimjbrettj

looks good!

devnet/substrate_alice.Dockerfile

devnet/alice.Dockerfile

timwu20 · 2022-02-11T17:50:58Z

devnet/docker-compose-substrate.yml

@@ -0,0 +1,57 @@
+services:
+  prometheus:


why are we running prometheus in this docker-compose?

I added Prometheus while testing the exported metric data from authority nodes, I decided to keep it in the same file to easily start a Prometheus server with authorities nodes, should I remove it?

timwu20 · 2022-02-11T17:51:34Z

devnet/substrate_alice.Dockerfile

+FROM parity/polkadot:v0.9.10 AS polkadot
+FROM golang:1.17
+
+ARG CHAIN=cross-client


what is the difference between the gssmr chain that's within our codebase and this one?

Both have 3 authority nodes, however, the cross-client genesis file is accepted by the substrate node since it has staking and session json keys while gssmr chain has Babe and Grandpa json keys. The cross-client genesis file has the runtime version 09.10 that don't trigger errors like:

CRIT target=runtime message=panicked at 'Timestamp slot must match `CurrentSlot`'

Ideally we should have one chain all cross client, and gossamer only setups. We may end up having multiple of these chains that differ based on number of authority nodes.

@kishansagathiya is working on secondary vrf slot mode for babe #2307. We need to ensure that the genesis file is using this mode and we should be updating to v0.9.16 of polkadot.

It would be nice to have some sort of readme or something in the devnet readme that describes how to generate these files. I know you were following the steps provided by Kishan, but where did the original genesis-spec.json come from? What pallets are in the runtime? These are questions we should have answers to. It may make sense to have another repo and associated github CI workflows to generate these genesis files that the devnets can pull down as part of the docker image build process. Rather than just putting arbitrary files in this repo.

where did the original genesis-spec.json come from?

./polkadot build-spec --disable-default-bootnode --dev > genesis-spec.json
And then you will have to modify it according to your requirements, like adding authorities.

And then you run something like this to get a genesis.json file
./polkadot build-spec --chain genesis-spec.json --raw --disable-default-bootnode > genesis.json

Will make a pr to add this to read me.

New versions have a different genesis-spec file than 0.9.10.
Also running cross-client dev net with newer version of polkadot gives runtime errors. So, yeah we need to update.

can we rename this to something more descriptive. 3-auth-node-0.9.10 or something.

Also we could have 0.9.10 as a build argument at the top global scope in the Dockerfile.

i.e.

ARG POLKADOT_VERSION=v0.9.10 FROM parity/polkadot:${POLKADOT_VERSION} AS polkadot FROM golang:1.17 ARG CHAIN=3-auth-node-${POLKADOT_VERSION}

@qdm12 I was having problems trying to use arguments declared before FROM, following this issue (link) I could resolve and apply the suggestion.

Basically, all the ARG's declared/initialized before FROM needs to be redeclared after FROM to use its values otherwise will not be possible to get the value from ARG. I your suggestion we need to add

ARG POLKADOT_VERSION=v0.9.10 FROM parity/polkadot:${POLKADOT_VERSION} AS polkadot FROM golang:1.17 + ARG POLKADOT_VERSION # Now its possible to use the value here ARG CHAIN=3-auth-node-${POLKADOT_VERSION}

devnet/substrate_alice.Dockerfile

devnet/alice.Dockerfile

devnet/substrate_alice.Dockerfile

qdm12 · 2022-02-15T20:50:56Z

devnet/substrate_alice.Dockerfile

+COPY --from=polkadot /usr/bin/polkadot /usr/bin/polkadot
+COPY devnet/chain/gssmr/genesis-raw.json genesis-spec.json
+
+RUN go run cmd/update-dd-agent-confd/main.go -n=${METRICS_NAMESPACE} -t=key:alice > /etc/datadog-agent/conf.d/openmetrics.d/conf.yaml


Yes but by default what's the port substrate/polkadot uses for Prometheus? We force it to 9876 here it seems. I'm thinking we should change it in Gossamer (for end users experience).

As far as I know, applications usually have their Prom registry server listening on 9090, so maybe we want to use that instead? Although if polkadot uses 9876 for whatever weird reason, then sure we can match it as well I guess.

devnet/substrate_bob.Dockerfile

timwu20 · 2022-02-23T16:51:22Z

Can we update this to polkadot v0.9.16

codecov · 2022-03-02T20:59:08Z

Codecov Report

Merging #2263 (03c89c6) into development (666795b) will decrease coverage by 0.01%.
The diff coverage is n/a.

@@               Coverage Diff               @@
##           development    #2263      +/-   ##
===============================================
- Coverage        58.07%   58.05%   -0.02%     
===============================================
  Files              213      213              
  Lines            27965    28010      +45     
===============================================
+ Hits             16240    16261      +21     
- Misses           10085    10109      +24     
  Partials          1640     1640

Flag	Coverage Δ
unit-tests	`58.05% <ø> (-0.02%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
lib/babe/crypto.go	`59.43% <0.00%> (-24.57%)`	⬇️
dot/sync/chain_processor.go	`48.04% <0.00%> (-1.67%)`	⬇️
dot/network/connmgr.go	`89.04% <0.00%> (-1.37%)`	⬇️
lib/runtime/wasmer/imports.go	`48.46% <0.00%> (-0.21%)`	⬇️
lib/babe/babe.go	`3.58% <0.00%> (-0.02%)`	⬇️
dot/types/babe.go	`34.72% <0.00%> (ø)`
dot/types/body.go	`62.02% <0.00%> (ø)`
lib/babe/build.go	`0.00% <0.00%> (ø)`
lib/babe/types.go	`0.00% <0.00%> (ø)`
dot/core/service.go	`33.50% <0.00%> (ø)`
... and 7 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 666795b...03c89c6. Read the comment docs.

devnet/substrate_alice.Dockerfile

devnet/substrate_bob.Dockerfile

EclesioMeloJunior · 2022-03-03T18:26:54Z

@timwu20 now there is only one genesis file!

timwu20 · 2022-03-04T15:50:25Z

devnet/substrate_alice.Dockerfile

+COPY ./devnet/go.mod ./devnet/go.sum ./
+RUN go mod download


do we need this? won't go run ... on line 13 just auto-download dependencies?

This is for Docker layer caching, so dependencies are cached and rebuilds will be faster.

timwu20 · 2022-03-04T15:51:52Z

devnet/substrate_alice.Dockerfile

+FROM parity/polkadot:v0.9.10 AS polkadot
+FROM golang:1.17
+
+ARG CHAIN=cross-client


can we rename this to something more descriptive. 3-auth-node-0.9.10 or something.

timwu20 · 2022-03-05T02:09:24Z

devnet/substrate_bob.Dockerfile

+RUN gpg --recv-keys --keyserver hkps://keys.mailvelope.com 9D4B2B6EB8F97156D19669A9FF0812D491B96798
+RUN gpg --export 9D4B2B6EB8F97156D19669A9FF0812D491B96798 > /usr/share/keyrings/parity.gpg


what are these for?

I was getting problem in the apt update because no pub keys were provided, so I follow the Polkadot README (link) installation guide that adds these gpg keys

# [0.7.0](v0.6.0...v0.7.0) (2022-11-23) ### Bug Fixes * **chain:** update ed25519 addresses in dev/gssmr genesis files ([#2225](#2225)) ([5f47d8b](5f47d8b)) * **ci:** caching of Go caches ([#2451](#2451)) ([ce3c10c](ce3c10c)) * **ci:** codecov.yml configuration ([#2698](#2698)) ([d4fc383](d4fc383)) * **ci:** comment skip code for required workflows ([#2312](#2312)) ([45dce9b](45dce9b)) * **ci:** copyright workflow to exit if different files ([#2487](#2487)) ([89c32ae](89c32ae)) * **ci:** deepsource toml configuration ([#2744](#2744)) ([86a70de](86a70de)) * **ci:** embed v0.9.20 runtime, update test suite, and ci workflows ([#2543](#2543)) ([0fff418](0fff418)), closes [#2419](#2419) [#2561](#2561) [#2572](#2572) [#2581](#2581) [#2671](#2671) * **ci:** fix staging Dockerfile ([#2474](#2474)) ([ae04b80](ae04b80)) * **ci:** mocks checking fixes ([#2274](#2274)) ([d1308e0](d1308e0)) * **ci:** run devnet module unit tests ([#2756](#2756)) ([f635c59](f635c59)) * **ci:** run golangci-lint on integration tests ([#2275](#2275)) ([3ae3401](3ae3401)) * **cmd:** allow --genesis flag to be passed to base command ([#2427](#2427)) ([7f5b5aa](7f5b5aa)) * **cmd:** avoid nil pointer dereference ([#2578](#2578)) ([f2cdfea](f2cdfea)) * **config:** temporary fix for pprof enabled setting precedence ([#2786](#2786)) ([d4d6262](d4d6262)) * **core:** fix txn pool for latest runtime ([#2809](#2809)) ([1551e66](1551e66)) * **deps:** upgrade chaindb to remove badger logs ([#2738](#2738)) ([e0c5706](e0c5706)) * **devnet:** Fix build workflow for devnet ([#2125](#2125)) ([0375fc2](0375fc2)) * **Dockerfile:** remove script entrypoint ([#2707](#2707)) ([abd161b](abd161b)) * **dot/core:** `RuntimeInstance` interface `Version` signature ([#2783](#2783)) ([7d66ec0](7d66ec0)) * **dot/core:** fix the race condition in TrieState ([#2499](#2499)) ([804069c](804069c)), closes [#2402](#2402) * **dot/digest:** BABE NextEpochData and NextConfigData should be set on finalization ([#2339](#2339)) ([e991cc8](e991cc8)) * **dot/digest:** verify if next epoch already contains some definition ([#2472](#2472)) ([a2ac6c2](a2ac6c2)) * **dot/netwok:** check for duplicate message earlier ([#2435](#2435)) ([d62503f](d62503f)) * **dot/network:** change BlockRequestMessage number from uint64 to uint32 ([8105cd4](8105cd4)) * **dot/network:** close notifications streams ([#2093](#2093)) ([de6e7c9](de6e7c9)), closes [#2046](#2046) * **dot/network:** fixing errMissingHandshakeMutex ([#2303](#2303)) ([eb07a53](eb07a53)) * **dot/network:** memory improvement for network buffers ([#2233](#2233)) ([fd9b70d](fd9b70d)) * **dot/network:** public IP address logging ([#2140](#2140)) ([9e21587](9e21587)) * **dot/network:** re-add nil mutex check for disconnected peer ([#2408](#2408)) ([9b39bd1](9b39bd1)) * **dot/network:** remove `defer cancel()` inside loop ([#2248](#2248)) ([9e360a5](9e360a5)) * **dot/network:** resize bytes slice buffer if needed ([#2291](#2291)) ([8db8b2a](8db8b2a)) * **dot/peerset:** fix sending on closed channel race condition when dropping peer ([#2573](#2573)) ([2fa5d8a](2fa5d8a)) * **dot/peerset:** remove race conditions from `peerset` package ([#2267](#2267)) ([df09d45](df09d45)) * **dot/rpc/modules:** grandpa.proveFinality update parameters, fix bug ([#2576](#2576)) ([e7749cf](e7749cf)) * **dot/rpc/modules:** rpc.state.queryStorage fixed ([#2565](#2565)) ([1ec0d47](1ec0d47)) * **dot/rpc:** include unsafe flags to be considered by RPC layer ([#2483](#2483)) ([3822257](3822257)) * **dot/state/epoch, lib/babe:** enable block production through epochs without rely on finalization ([#2593](#2593)) ([a0a1804](a0a1804)) * **dot/state:** actually prune finalized tries from memory ([#2196](#2196)) ([e4bc375](e4bc375)) * **dot/state:** change map of tries implementation to have working garbage collection ([#2206](#2206)) ([fada46b](fada46b)) * **dot/state:** inject mutex protected tries to states ([#2287](#2287)) ([67a9bbb](67a9bbb)) * **dot/subscription:** check websocket message from untrusted data ([#2527](#2527)) ([1f20d98](1f20d98)) * **dot/subscription:** unsafe type casting from untrusted input ([#2529](#2529)) ([1015733](1015733)) * **dot/sync, dot/rpc:** implement HighestBlock ([#2195](#2195)) ([f8d8657](f8d8657)) * **dot/sync:** cleanup logs; don't log case where we fail to get parent while processing ([#2188](#2188)) ([cb360ab](cb360ab)) * **dot/sync:** fix "block with unknown header is ready" error ([#2191](#2191)) ([483466f](483466f)) * **dot/sync:** fix `Test_lockQueue_threadSafety` ([#2605](#2605)) ([223cfbb](223cfbb)) * **dot/sync:** Fix flaky tests `Test_chainSync_logSyncSpeed` and `Test_chainSync_start` ([#2610](#2610)) ([7e1014b](7e1014b)) * **dot/sync:** Gossip `BlockAnnounceMessage` only after successfully imported ([#2885](#2885)) ([69031a6](69031a6)) * **dot/sync:** remove block announcement in `bootstrap` sync mode ([#2906](#2906)) ([2b4c257](2b4c257)) * **dot/sync:** remove max size limit from ascending block requests ([#2256](#2256)) ([e287d7e](e287d7e)) * **dot/sync:** sync benchmark ([#2234](#2234)) ([2f3aef8](2f3aef8)) * **dot/telemetry:** telemetry hashes to be in the hexadecimal format ([#2194](#2194)) ([9b48106](9b48106)) * **dot:** database close error checks ([#2948](#2948)) ([bdb0eea](bdb0eea)) * **dot:** no error logged for init check ([#2502](#2502)) ([2971325](2971325)) * ensure we convert the `uint` type ([#2626](#2626)) ([792e53f](792e53f)) * fix logger mutex locking in `.New` method ([#2114](#2114)) ([e7207ed](e7207ed)) * **internal/log:** log level `DoNotChange` ([#2672](#2672)) ([0008b59](0008b59)) * **levels-logged:** Fix log levels logging at start ([#2236](#2236)) ([a90a6e0](a90a6e0)) * **lib/babe:** check if authority index is in the `authorities` range ([#2601](#2601)) ([1072888](1072888)) * **lib/babe:** ensure the slot time is correct before build a block ([#2648](#2648)) ([78c03b6](78c03b6)) * **lib/babe:** epoch context error wrapping ([#2484](#2484)) ([c053dea](c053dea)) * **lib/babe:** Unrestricted Loop When Building Blocks (GSR-19) ([#2632](#2632)) ([139ad89](139ad89)) * **lib/blocktree:** reimplement `BestBlockHash` to take into account primary blocks in fork choice rule ([#2254](#2254)) ([1a368e2](1a368e2)) * **lib/grandpa:** avoid spamming round messages ([#2688](#2688)) ([b0042b8](b0042b8)) * **lib/grandpa:** capped number of tracked commit messages ([#2490](#2490)) ([47c23e6](47c23e6)) * **lib/grandpa:** capped number of tracked vote messages ([#2485](#2485)) ([d2ee47e](d2ee47e)), closes [#1531](#1531) * **lib/grandpa:** check equivocatory votes count ([#2497](#2497)) ([014629d](014629d)), closes [#2401](#2401) * **lib/grandpa:** Duplicate votes is GRANDPA are counted as equivocatory votes (GSR-11) ([#2624](#2624)) ([422e7b3](422e7b3)) * **lib/grandpa:** Storing Justification Allows Extra Bytes (GSR-13) ([#2618](#2618)) ([0fcde63](0fcde63)) * **lib/grandpa:** update grandpa protocol ID ([#2678](#2678)) ([3be75b2](3be75b2)) * **lib/grandpa:** various finality fixes, improves cross-client finality ([#2368](#2368)) ([c04d185](c04d185)) * **lib/grandpa:** verify equivocatory votes in grandpa justifications ([#2486](#2486)) ([368f8b6](368f8b6)) * **lib/runtime:** avoid caching version in runtime instance ([#2425](#2425)) ([7ab31f0](7ab31f0)) * **lib/runtime:** stub v0.9.17 host API functions ([#2420](#2420)) ([6a7b223](6a7b223)) * **lib/trie:** `handleDeletion` generation propagation ([24c303d](24c303d)) * **lib/trie:** `PopulateMerkleValues` functionality changes and fixes ([#2871](#2871)) ([7131290](7131290)) * **lib/trie:** Check for root in EncodeAndHash ([#2359](#2359)) ([087db89](087db89)) * **lib/trie:** Make sure writing and reading a trie to disk gives the same trie and cover more store/load child trie related test cases ([#2302](#2302)) ([7cd4118](7cd4118)) * **lib/trie:** prepare trie nodes for mutation only when needed ([#2834](#2834)) ([26868df](26868df)) * **lib/trie:** remove map deletion at `loadProof` ([#2259](#2259)) ([fbd13d2](fbd13d2)) * **lint:** fix issues found by golangcilint 1.47.3 ([#2715](#2715)) ([5765e67](5765e67)) * **mocks:** add missing `//go:generate` for mocks ([#2273](#2273)) ([f4f7465](f4f7465)) * **pprof:** pprofserver flag changed to boolean ([#2205](#2205)) ([be00a69](be00a69)) * **staging:** revise datadog-agent start process ([#2935](#2935)) ([36ce37d](36ce37d)) * **state/epoch:** assign epoch 1 when block number is 0 ([#2592](#2592)) ([e5c8cf5](e5c8cf5)) * **state/grandpa:** track changes across forks ([#2519](#2519)) ([3ab76bc](3ab76bc)) * **tests:** `TestAuthorModule_HasSessionKeys_Integration` ([#2932](#2932)) ([8d809aa](8d809aa)) * **tests:** fix block body regex in `TestChainRPC` ([#2805](#2805)) ([b0680f8](b0680f8)) * **tests:** Fix RFC3339 regex for log unit tests ([9caea2a](9caea2a)) * **tests:** Fix wasmer flaky sorts ([#2643](#2643)) ([7eede9a](7eede9a)) * **tests:** handle node crash during waiting ([#2691](#2691)) ([843bd50](843bd50)) * **tests:** update block body regex in `TestChainRPC` ([#2674](#2674)) ([055e5c3](055e5c3)) * **trie:** decode inline child nodes ([#2369](#2369)) ([9efde47](9efde47)) * **trie:** descendants count for clear prefix ([#2606](#2606)) ([1826896](1826896)) * **trie:** disallow empty byte slice node values ([#2927](#2927)) ([d769d1c](d769d1c)) * **trie:** equality differentiate nil and empty storage values ([#2969](#2969)) ([72a08ec](72a08ec)) * **trie:** no in-memory caching of node encoding ([#2919](#2919)) ([856780b](856780b)) * **trie:** Panic when deleting nonexistent keys from trie (GSR-10) ([#2609](#2609)) ([7886318](7886318)) * **trie:** remove encoding buffers pool ([#2929](#2929)) ([f4074cc](f4074cc)) * **trie:** use cached Merkle values for root hash ([#2943](#2943)) ([ec2549a](ec2549a)) * **trie:** use direct Merkle value for database keys ([#2725](#2725)) ([1a3c3ae](1a3c3ae)) * upgrade auto-generated mocks ([#2910](#2910)) ([a2975a5](a2975a5)) * **wasmer:** error logs for signature verification ([#2752](#2752)) ([363c080](363c080)) * **wasmer:** fix flaky sort in `Test_ext_crypto_sr25519_public_keys_version_1` ([#2607](#2607)) ([c061b35](c061b35)) ### Features * **build:** add `github.com/breml/rootcerts` ([#2695](#2695)) ([c74a5b0](c74a5b0)) * **build:** binary built-in timezone data ([#2697](#2697)) ([fdd5bda](fdd5bda)) * **chain:** use always the raw genesis file ([#2775](#2775)) ([dd2fbc9](dd2fbc9)) * **ci:** update mockery from `2.10` to `2.14` ([#2642](#2642)) ([d2c42b8](d2c42b8)) * **cross-client:** create docker-compose.yml for local devnet ([#2282](#2282)) ([8abbd87](8abbd87)) * detect chain directory dynamically ([#2292](#2292)) ([85c466c](85c466c)) * **devnet:** add substrate docker images to dockerfile ([#2263](#2263)) ([b7b2a66](b7b2a66)) * **devnet:** continuous integration `gssmr` devnet on AWS ECS ([#2096](#2096)) ([d096d44](d096d44)) * **docker:** docker-compose.yml to run Gossamer, Prometheus and Grafana ([#2706](#2706)) ([c5dda51](c5dda51)) * **dot/network:** add mismatched genesis peer reporting ([#2265](#2265)) ([a1d7269](a1d7269)) * **dot/state:** `gossamer_storage_tries_cached_total` gauge metric ([#2272](#2272)) ([625cbcf](625cbcf)) * **e2e:** build Gossamer on any test run ([#2608](#2608)) ([f97e0ef](f97e0ef)) * **go:** upgrade Go from 1.17 to 1.18 ([#2379](#2379)) ([d85a1db](d85a1db)) * include nested varying data type on neighbor messages ([#2722](#2722)) ([426569a](426569a)) * **lib/babe:** implement secondary slot block production ([#2260](#2260)) ([fcb81a3](fcb81a3)) * **lib/runtime:** support Substrate WASM compression ([#2213](#2213)) ([fd60061](fd60061)) * **lib/trie:** atomic tracked merkle values ([#2876](#2876)) ([1c4174c](1c4174c)) * **lib/trie:** clear fields when node is dirty ([#2297](#2297)) ([1162828](1162828)) * **lib/trie:** only copy nodes when mutation is certain ([#2352](#2352)) ([86624cf](86624cf)) * **lib/trie:** opportunistic parallel hashing ([#2081](#2081)) ([790dfb5](790dfb5)) * **metrics:** replace metrics port with address (breaking change) ([#2382](#2382)) ([d2ec68d](d2ec68d)) * **pkg/scale:** add `Encoder` with `Encode` method ([#2741](#2741)) ([af5c63f](af5c63f)) * **pkg/scale:** add use of pkg/error Wrap for error handling ([#2708](#2708)) ([08c4281](08c4281)) * **pkg/scale:** encoding and decoding of maps in scale ([#2894](#2894)) ([405db51](405db51)), closes [#2796](#2796) * **pkg/scale:** support for custom `VaryingDataType` types ([#2612](#2612)) ([914a747](914a747)) * remove uneeded runtime prefix logs ([#2110](#2110)) ([8bd05d1](8bd05d1)) * remove unused code ([#2677](#2677)) ([b3698d7](b3698d7)) * **scale:** add range checks to decodeUint function ([#2683](#2683)) ([ac700f8](ac700f8)) * **trie:** decode all inlined node variants ([#2611](#2611)) ([b09eb07](b09eb07)) * **trie:** export `LoadFromProof` ([#2455](#2455)) ([0b4f33d](0b4f33d)) * **trie:** faster header decoding ([#2649](#2649)) ([d9460e3](d9460e3)) * **trie:** finer deep copy of nodes ([#2384](#2384)) ([bd6d8e4](bd6d8e4)) * **trie:** tracking of number of descendant nodes for each node ([#2378](#2378)) ([dfcdd3c](dfcdd3c)) * **trie:** use scale encoder ([#2930](#2930)) ([e3dc108](e3dc108)) * **wasmer/crypto:** move sig verifier to crypto pkg ([#2057](#2057)) ([dc8bbef](dc8bbef)) * **wasmer:** Add `SetTestVersion` method to `Config` struct ([#2823](#2823)) ([e5c9336](e5c9336)) * **wasmer:** get and cache state version in instance context ([#2747](#2747)) ([3fd63db](3fd63db))

EclesioMeloJunior added 2 commits January 31, 2022 08:52

feat: include substrate docker image

6139712

chore: add substrate docker images

8c3fb1d

EclesioMeloJunior requested review from edwardmack, jimjbrettj, kishansagathiya, noot, qdm12 and timwu20 as code owners February 2, 2022 00:30

EclesioMeloJunior changed the title ~~Eclesio/substrate docker image~~ feat(devnet): add substrate docker files Feb 2, 2022

EclesioMeloJunior changed the title ~~feat(devnet): add substrate docker files~~ feat(devnet): add substrate docker images Feb 2, 2022

EclesioMeloJunior marked this pull request as draft February 2, 2022 00:39

EclesioMeloJunior added 2 commits February 1, 2022 22:20

chore: formatting and add depends on yaml key

c0be6dc

chore: add datadog stuff again

eda4e4a

EclesioMeloJunior force-pushed the eclesio/substrate-docker-image branch from b2598ea to eda4e4a Compare February 2, 2022 15:11

EclesioMeloJunior added 3 commits February 2, 2022 11:12

chore: use alice peer id

dae59e2

chore: split substrate docker compose services into another file

6ccf8fb

chore: enable prometheus external and add datadog

1407b3a

EclesioMeloJunior marked this pull request as ready for review February 2, 2022 23:44

EclesioMeloJunior changed the title ~~feat(devnet): add substrate docker images~~ feat(devnet): add substrate docker images to dockerfile Feb 3, 2022

timwu20 requested changes Feb 3, 2022

View reviewed changes

EclesioMeloJunior added 3 commits February 4, 2022 10:48

Merge branch 'development' into eclesio/substrate-docker-image

0d59fac

chore: keep substrate ports same as gossamer node ports

5108412

chore: expose rpc and ws calls in substrate docker file

9fa7ffb

noot reviewed Feb 4, 2022

View reviewed changes

EclesioMeloJunior added 3 commits February 4, 2022 15:17

chore: use same dns name and p2p id

71a8f5e

chore: use same key for both alice gossamer and substrate nodes

f1fea2d

chore: fix dd golang cmd

9b485f6

chore: keep both cross-client and gssmr chain genesis raw chore: mistakes

EclesioMeloJunior force-pushed the eclesio/substrate-docker-image branch from 70f2062 to 9b485f6 Compare February 4, 2022 22:57

EclesioMeloJunior added 5 commits February 8, 2022 18:34

chore: use env to chain

f03093a

This is needed since ARG cannot be used inside ENTRYPOINT

update substrate_bob.Dockerfile

25946ca

Merge branch 'development' into eclesio/substrate-docker-image

e8c1e9d

chore: add datadog-agent start to gssmr alice node

15f1377

Merge branch 'eclesio/substrate-docker-image' of github.com:ChainSafe…

94c6a87

…/gossamer into eclesio/substrate-docker-image

jimjbrettj approved these changes Feb 10, 2022

View reviewed changes

devnet/substrate_alice.Dockerfile Outdated Show resolved Hide resolved

timwu20 requested changes Feb 11, 2022

View reviewed changes

qdm12 suggested changes Feb 15, 2022

View reviewed changes

chore: add comment about different but same node keys

17fd1f2

EclesioMeloJunior added 2 commits March 2, 2022 16:36

chore: update substrate docker images to version 0.9.17

aacb438

chore: include license header

a382561

EclesioMeloJunior requested review from noot, qdm12 and timwu20 March 2, 2022 20:43

Merge branch 'development' into eclesio/substrate-docker-image

ca63faa

qdm12 approved these changes Mar 3, 2022

View reviewed changes

devnet/substrate_alice.Dockerfile Outdated Show resolved Hide resolved

devnet/substrate_alice.Dockerfile Outdated Show resolved Hide resolved

devnet/substrate_bob.Dockerfile Outdated Show resolved Hide resolved

chore: make image smaller, start dd agent at entrypoint

a4bd83c

EclesioMeloJunior force-pushed the eclesio/substrate-docker-image branch from c971bee to a4bd83c Compare March 3, 2022 16:52

chore: use only one genesis

e476e23

timwu20 requested changes Mar 4, 2022

View reviewed changes

EclesioMeloJunior added 2 commits March 4, 2022 13:35

chore: be more descriptive at genesis.json folder

e12686d

chore: update image to use arg polkadot version

03c89c6

timwu20 reviewed Mar 5, 2022

View reviewed changes

timwu20 approved these changes Mar 5, 2022

View reviewed changes

EclesioMeloJunior merged commit b7b2a66 into development Mar 8, 2022

EclesioMeloJunior deleted the eclesio/substrate-docker-image branch March 8, 2022 14:54

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(devnet): add substrate docker images to dockerfile #2263

feat(devnet): add substrate docker images to dockerfile #2263

EclesioMeloJunior commented Feb 2, 2022

timwu20 Feb 3, 2022

timwu20 Feb 3, 2022

EclesioMeloJunior Feb 4, 2022

timwu20 Feb 3, 2022

EclesioMeloJunior Feb 4, 2022

qdm12 Feb 8, 2022

EclesioMeloJunior Feb 8, 2022 •

edited

Loading

qdm12 Feb 15, 2022

timwu20 Feb 3, 2022

EclesioMeloJunior Feb 4, 2022 •

edited

Loading

timwu20 commented Feb 3, 2022

EclesioMeloJunior commented Feb 4, 2022 •

edited

Loading

noot left a comment

jimjbrettj left a comment

timwu20 Feb 11, 2022

EclesioMeloJunior Feb 16, 2022

timwu20 Feb 11, 2022

EclesioMeloJunior Feb 16, 2022

timwu20 Feb 23, 2022 •

edited

Loading

kishansagathiya Feb 24, 2022

timwu20 Mar 4, 2022

qdm12 Mar 4, 2022

EclesioMeloJunior Mar 4, 2022

qdm12 Feb 15, 2022

timwu20 commented Feb 23, 2022

codecov bot commented Mar 2, 2022 •

edited

Loading

EclesioMeloJunior commented Mar 3, 2022

timwu20 Mar 4, 2022

qdm12 Mar 4, 2022

timwu20 Mar 4, 2022

timwu20 Mar 5, 2022

EclesioMeloJunior Mar 5, 2022

		RUN gpg --recv-keys --keyserver hkps://keys.mailvelope.com 9D4B2B6EB8F97156D19669A9FF0812D491B96798
		RUN gpg --export 9D4B2B6EB8F97156D19669A9FF0812D491B96798 > /usr/share/keyrings/parity.gpg

feat(devnet): add substrate docker images to dockerfile #2263

feat(devnet): add substrate docker images to dockerfile #2263

Conversation

EclesioMeloJunior commented Feb 2, 2022

Changes

Tests

Issues

Primary Reviewer

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

EclesioMeloJunior Feb 8, 2022 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

EclesioMeloJunior Feb 4, 2022 • edited Loading

Choose a reason for hiding this comment

timwu20 commented Feb 3, 2022

EclesioMeloJunior commented Feb 4, 2022 • edited Loading

noot left a comment

Choose a reason for hiding this comment

jimjbrettj left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

timwu20 Feb 23, 2022 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

timwu20 commented Feb 23, 2022

codecov bot commented Mar 2, 2022 • edited Loading

Codecov Report

EclesioMeloJunior commented Mar 3, 2022

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

EclesioMeloJunior Feb 8, 2022 •

edited

Loading

EclesioMeloJunior Feb 4, 2022 •

edited

Loading

EclesioMeloJunior commented Feb 4, 2022 •

edited

Loading

timwu20 Feb 23, 2022 •

edited

Loading

codecov bot commented Mar 2, 2022 •

edited

Loading