(SOLVED) Vnode Issue - Image Status permanently stuck on 'restarting'.

Hi @Support,

I went to setup a new vnode this morning. I went through my usual routine (I’ve set these up before and others look to be fine). It seems like the usual command of

curl -LO https://node.incognito.org/run.sh && sed -i s/xxx/validator_key/ run.sh
sed -i s/YYYZZZ/infura_id/ run.sh
sudo bash run.sh

is resulting in only one of the containers being pulled through (no eth_mainnet) along with a ‘restart’ status. I’ve tried rebooting the server and rerunning the commands to no avail.

Any solutions?

Problem Node

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
b980d792377e incognitochain/incognito-mainnet:20210614_1 “/bin/bash run_incog…” 54 seconds ago Restarting (3) 20 seconds ago inc_mainnet

Functioning Node

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
63ceb0aea34d incognitochain/incognito-mainnet:20210614_1 “/bin/bash run_incog…” 35 hours ago Up 38 minutes 0.0.0.0:9334->9334/tcp, :::9334->9334/tcp, 0.0.0.0:9433->9433/tcp, :::9433->9433/tcp inc_mainnet
80afd06a4ce0 parity/parity:stable “/bin/parity --light…” 11 days ago Up 38 minutes 5001/tcp, 8080/tcp, 8082-8083/tcp, 8180/tcp, 0.0.0.0:8545->8545/tcp, :::8545->8545/tcp, 8546/tcp, 0.0.0.0:30303->30303/tcp, :::30303->30303/tcp, 0.0.0.0:30303->30303/udp, :::30303->30303/udp eth_mainnet

Thank you for your assistance!

For the easiest way to setup a vnode, please follow the latest instruction here!
It uses Infura instead of eth_mainnet docker image.

2 Likes

Thanks for your response Rocky - I’m a bit of a noob but managed to follow your steps.

I still have an issue which is when I check the status using sudo docker ps, I get a permanent ‘restarting status’ like the image never runs (refer to Screenshot #1).

Typically when I’ve run the image, it starts syncing the data and I’m able to add the node in the app no problem. See the status shows that it was run 32 hours ago compared with ‘restarting’.

Problem Node
image

Functioning Node
image

Does that make sense?

Can you run the following command and paste the output here, please!

docker container inspect <container name>

The container name should be inc_mainnet, but just to be sure you should check the name with:

docker container ps -a

Definitely inc_mainet:

image

image

Here’s the output!

[
{
“Id”: “f08221ec493a9d0d577f36e8c5b8005f3f5dcbceca23709f1dc85f86fb4d05b1”,
“Created”: “2021-06-17T08:53:03.345219203Z”,
“Path”: “/bin/bash”,
“Args”: [
“run_incognito.sh”
],
“State”: {
“Status”: “restarting”,
“Running”: true,
“Paused”: false,
“Restarting”: true,
“OOMKilled”: false,
“Dead”: false,
“Pid”: 0,
“ExitCode”: 3,
“Error”: “”,
“StartedAt”: “2021-06-17T21:58:35.35078954Z”,
“FinishedAt”: “2021-06-17T21:58:35.792019832Z”
},
“Image”: “sha256:5cfa8f6a9e92e94b344f5a376b4fead451f0d08d0b34502b90c161408b3b069e”,
“ResolvConfPath”: “/var/lib/docker/containers/f08221ec493a9d0d577f36e8c5b8005f3f5dcbceca23709f1dc85f86fb4d05b1/resolv.conf”,
“HostnamePath”: “/var/lib/docker/containers/f08221ec493a9d0d577f36e8c5b8005f3f5dcbceca23709f1dc85f86fb4d05b1/hostname”,
“HostsPath”: “/var/lib/docker/containers/f08221ec493a9d0d577f36e8c5b8005f3f5dcbceca23709f1dc85f86fb4d05b1/hosts”,
“LogPath”: “/var/lib/docker/containers/f08221ec493a9d0d577f36e8c5b8005f3f5dcbceca23709f1dc85f86fb4d05b1/f08221ec493a9d0d577f36e8c5b8005f3f5dcbceca23709f1dc85f86fb4d05b1-json.log”,
“Name”: “/inc_mainnet”,
“RestartCount”: 12,
“Driver”: “overlay2”,
“Platform”: “linux”,
“MountLabel”: “”,
“ProcessLabel”: “”,
“AppArmorProfile”: “docker-default”,
“ExecIDs”: null,
“HostConfig”: {
“Binds”: [
“/home/incognito/node_data:/data”
],
“ContainerIDFile”: “”,
“LogConfig”: {
“Type”: “json-file”,
“Config”: {}
},
“NetworkMode”: “inc_net”,
“PortBindings”: {
“8334/tcp”: [
{
“HostIp”: “”,
“HostPort”: “8334”
}
],
“9433/tcp”: [
{
“HostIp”: “”,
“HostPort”: “9433”
}
]
},
“RestartPolicy”: {
“Name”: “always”,
“MaximumRetryCount”: 0
},
“AutoRemove”: false,
“VolumeDriver”: “”,
“VolumesFrom”: null,
“CapAdd”: null,
“CapDrop”: null,
“CgroupnsMode”: “host”,
“Dns”: [],
“DnsOptions”: [],
“DnsSearch”: [],
“ExtraHosts”: null,
“GroupAdd”: null,
“IpcMode”: “private”,
“Cgroup”: “”,
“Links”: null,
“OomScoreAdj”: 0,
“PidMode”: “”,
“Privileged”: false,
“PublishAllPorts”: false,
“ReadonlyRootfs”: false,
“SecurityOpt”: null,
“UTSMode”: “”,
“UsernsMode”: “”,
“ShmSize”: 67108864,
“Runtime”: “runc”,
“ConsoleSize”: [
0,
0
],
“Isolation”: “”,
“CpuShares”: 0,
“Memory”: 0,
“NanoCpus”: 0,
“CgroupParent”: “”,
“BlkioWeight”: 0,
“BlkioWeightDevice”: [],
“BlkioDeviceReadBps”: null,
“BlkioDeviceWriteBps”: null,
“BlkioDeviceReadIOps”: null,
“BlkioDeviceWriteIOps”: null,
“CpuPeriod”: 0,
“CpuQuota”: 0,
“CpuRealtimePeriod”: 0,
“CpuRealtimeRuntime”: 0,
“CpusetCpus”: “”,
“CpusetMems”: “”,
“Devices”: [],
“DeviceCgroupRules”: null,
“DeviceRequests”: null,
“KernelMemory”: 0,
“KernelMemoryTCP”: 0,
“MemoryReservation”: 0,
“MemorySwap”: 0,
“MemorySwappiness”: null,
“OomKillDisable”: false,
“PidsLimit”: null,
“Ulimits”: null,
“CpuCount”: 0,
“CpuPercent”: 0,
“IOMaximumIOps”: 0,
“IOMaximumBandwidth”: 0,
“MaskedPaths”: [
“/proc/asound”,
“/proc/acpi”,
“/proc/kcore”,
“/proc/keys”,
“/proc/latency_stats”,
“/proc/timer_list”,
“/proc/timer_stats”,
“/proc/sched_debug”,
“/proc/scsi”,
“/sys/firmware”
],
“ReadonlyPaths”: [
“/proc/bus”,
“/proc/fs”,
“/proc/irq”,
“/proc/sys”,
“/proc/sysrq-trigger”
]
},
“GraphDriver”: {
“Data”: {
“LowerDir”: “/var/lib/docker/overlay2/4f5ada43e992eee51cea2964bc40a89b2d54eba5ff0bbd0f1bd5ac32c25a8a5c-init/diff:/var/lib/docker/overlay2/8977dd6dad6241f2061713c01557ed338eaf8c9223246e674a02e0802268c3b2/diff:/var/lib/docker/overlay2/fbea9bf468a6c4a4015f80805181a2f8b81ffd3d0a6405624624a78df39316e8/diff:/var/lib/docker/overlay2/73c916ba0b30f050af0e2272e80143a9c99730bcc438bd00a91ff52c391f5f62/diff:/var/lib/docker/overlay2/b97904ea1ffe6f8f03509ea0fd2d9cd67b67151abde8244ae1ac1b2dd0e81c05/diff:/var/lib/docker/overlay2/cf1d1efc3071794a511f6a695bd392a7a11275d5cb836a223ab10691a80e61d9/diff:/var/lib/docker/overlay2/cfc75fc53cfe56f1dd1680ab32dbe700a64f747bcecca3d37f24de68db7ebdcc/diff:/var/lib/docker/overlay2/3daf535400f5a1f6b80c5293a97202eebfa27848db28b9598f18b07cc4e97ad0/diff:/var/lib/docker/overlay2/cd1f62a4d03f1d0ae8a91dc542ce3c23babf448fc6b3ec4aa991f78a1c4d8421/diff:/var/lib/docker/overlay2/f7a0af4c5c672992e39a8394c67d2452ed1b3ec60daf0cf5fbf8a6ff85e9467a/diff:/var/lib/docker/overlay2/208bab388223bdab68bba9b78d876f34d2ea2becf47960abb86476ec1513a01f/diff:/var/lib/docker/overlay2/f975c18502ea127570632cd33894ac533c48b583b3db947ecc309cd4005d7a6b/diff:/var/lib/docker/overlay2/6769f7ceac172407f70ef661df1ad43f63bda61daff3a6de6912886320d7c060/diff:/var/lib/docker/overlay2/66093e658fd9e2687bafcad9150b3590ac81a8530c27ab60411cc27bee41fc6f/diff:/var/lib/docker/overlay2/f6db18a4ab3631aecb5c0dd503f78722165c1c6915a11ebb4c87a56a794a3b9a/diff:/var/lib/docker/overlay2/3a8f12e313689d69b56e3045afc4bcaf03e934babd58ef1d0dc352d6b1b7a4e7/diff:/var/lib/docker/overlay2/aa40ff0d0eff0d5783dc7f29e7210d6e8f71f1e8832e4048e43a559334d8fa02/diff:/var/lib/docker/overlay2/0d1672a546a7ea258ab72c0007f9b07bf5a4b645a0b2f47dd59b66bc3c726679/diff:/var/lib/docker/overlay2/bde609c9e12c973b8639868456addde7a28ac6c08377d2ad2988e32184780552/diff”,
“MergedDir”: “/var/lib/docker/overlay2/4f5ada43e992eee51cea2964bc40a89b2d54eba5ff0bbd0f1bd5ac32c25a8a5c/merged”,
“UpperDir”: “/var/lib/docker/overlay2/4f5ada43e992eee51cea2964bc40a89b2d54eba5ff0bbd0f1bd5ac32c25a8a5c/diff”,
“WorkDir”: “/var/lib/docker/overlay2/4f5ada43e992eee51cea2964bc40a89b2d54eba5ff0bbd0f1bd5ac32c25a8a5c/work”
},
“Name”: “overlay2”
},
“Mounts”: [
{
“Type”: “bind”,
“Source”: “/home/incognito/node_data”,
“Destination”: “/data”,
“Mode”: “”,
“RW”: true,
“Propagation”: “rprivate”
}
],
“Config”: {
“Hostname”: “f08221ec493a”,
“Domainname”: “”,
“User”: “”,
“AttachStdin”: false,
“AttachStdout”: false,
“AttachStderr”: false,
“ExposedPorts”: {
“8334/tcp”: {},
“9433/tcp”: {}
},
“Tty”: false,
“OpenStdin”: false,
“StdinOnce”: false,
“Env”: [
“MININGKEY=VALIDATOR KEY”,
“RPC_PORT=8334”,
“GETH_PORT=”,
“FULLNODE=0”,
“GETH_PROTOCOL=”,
“TESTNET=false”,
“LIMIT_FEE=1”,
“NODE_PORT=9433”,
“BOOTNODE_IP=mainnet-bootnode.incognito.org:9330”,
“GETH_NAME=https://mainnet.infura.io/v3/INFURA ACCOUNT”,
“PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin”
],
“Cmd”: [
“/bin/bash”,
“run_incognito.sh”
],
“Image”: “incognitochain/incognito-mainnet:20210617_1”,
“Volumes”: null,
“WorkingDir”: “”,
“Entrypoint”: null,
“OnBuild”: null,
“Labels”: {}
},
“NetworkSettings”: {
“Bridge”: “”,
“SandboxID”: “f942d1014f2ae01b6359b912db2d3681df5a450a65045e54aae1ca8319966e5f”,
“HairpinMode”: false,
“LinkLocalIPv6Address”: “”,
“LinkLocalIPv6PrefixLen”: 0,
“Ports”: {},
“SandboxKey”: “/var/run/docker/netns/f942d1014f2a”,
“SecondaryIPAddresses”: null,
“SecondaryIPv6Addresses”: null,
“EndpointID”: “”,
“Gateway”: “”,
“GlobalIPv6Address”: “”,
“GlobalIPv6PrefixLen”: 0,
“IPAddress”: “”,
“IPPrefixLen”: 0,
“IPv6Gateway”: “”,
“MacAddress”: “”,
“Networks”: {
“inc_net”: {
“IPAMConfig”: null,
“Links”: null,
“Aliases”: [
“f08221ec493a”
],
“NetworkID”: “b95d7314c3715822b32c055fafaef3eb5483d771c329cfe0b90491b06767f6d5”,
“EndpointID”: “”,
“Gateway”: “”,
“IPAddress”: “”,
“IPPrefixLen”: 0,
“IPv6Gateway”: “”,
“GlobalIPv6Address”: “”,
“GlobalIPv6PrefixLen”: 0,
“MacAddress”: “”,
“DriverOpts”: null
}
}
}
}
]

The docker container is fine.
Turns out there’s an issue with docker tag 20210617_1. We’re fixing it right now, there’s will be a new release soon. And since you followed my setup guide, your node will be updated automatically, you won’t have to do anything.
Please hang on!

Thank you Rocky for your help. Hope you have a cracking day!