Aleth failures

[holiman]

Getting this in output for the aleth runs:

DBUG[08-28|09:28:55] starting container 
INFO[08-28|09:28:56] docker daemon online                     version=18.04.0-ce
INFO[08-28|09:28:56] building clients for validation          pattern=aleth:develop
INFO[08-28|09:28:56] building validators for testing          pattern=none
INFO[08-28|09:28:56] creating ethash container 
INFO[08-28|09:28:56] building new docker image                nocache=true
DBUG[08-28|09:29:00] created ethash container 
INFO[08-28|09:29:00] generating genesis DAG 
DBUG[08-28|09:29:00] attaching to container 
DBUG[08-28|09:29:00] starting container 
DBUG[08-28|09:29:00] deleting ethash container 
INFO[08-28|09:29:00] building clients for simulation          pattern=aleth:develop
INFO[08-28|09:29:00] building simulators for testing          pattern=ethereum/consensus
INFO[08-28|09:29:00] building new docker image                simulator=ethereum/consensus nocache=true
adduser: uid '0' in use
DBUG[08-28|09:29:31] deleting shell container 

I've no idea why...
cc @chfast

[chfast]

So the error is adduser: uid '0' in use?

[holiman]

Yes and no. I've seen that before, not sure where it comes from. I'll try to repro locally again, I thought I had fixed it the other day

[holiman]

I think I fixed it now. My prev fix was flawed, since my docker image was not using a cached base image

[holiman]

Full error log from running it on hivetest.ethstats.net below.
@karalabe can this have something to do with the ethash thing?

INFO[08-29|11:22:08] docker daemon online                     version=17.05.0-ce
INFO[08-29|11:22:08] creating outer shell container 
INFO[08-29|11:22:08] building new docker image                nocache=true
Step 1/12 : FROM docker:dind
 ---> 6fc95ba0a776
Step 2/12 : RUN apk add --update musl-dev go && rm -rf /var/cache/apk/*
 ---> Running in b0fbb92152fb
fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/community/x86_64/APKINDEX.tar.gz
(1/16) Upgrading musl (1.1.18-r2 -> 1.1.18-r3)
(2/16) Installing binutils-libs (2.30-r1)
(3/16) Installing binutils (2.30-r1)
(4/16) Installing gmp (6.1.2-r1)
(5/16) Installing isl (0.18-r0)
(6/16) Installing libgomp (6.4.0-r5)
(7/16) Installing libatomic (6.4.0-r5)
(8/16) Installing pkgconf (1.3.10-r0)
(9/16) Installing libgcc (6.4.0-r5)
(10/16) Installing mpfr3 (3.1.5-r1)
(11/16) Installing mpc1 (1.0.3-r1)
(12/16) Installing libstdc++ (6.4.0-r5)
(13/16) Installing gcc (6.4.0-r5)
(14/16) Installing go (1.9.4-r0)
(15/16) Upgrading musl-utils (1.1.18-r2 -> 1.1.18-r3)
(16/16) Installing musl-dev (1.1.18-r3)
Executing busybox-1.27.2-r7.trigger
OK: 306 MiB in 50 packages
 ---> e8c44f46493b
Removing intermediate container b0fbb92152fb
Step 3/12 : ENV GOPATH /gopath
 ---> Running in 7c7c528ea5ba
 ---> 446fdc549137
Removing intermediate container 7c7c528ea5ba
Step 4/12 : ENV PATH $GOPATH/bin:$PATH
 ---> Running in 7dd578cace56
 ---> 4f1aec692881
Removing intermediate container 7dd578cace56
Step 5/12 : ADD vendor $GOPATH/src/github.com/karalabe/hive/vendor
 ---> 2b93cfb4ce0a
Removing intermediate container 03d7806a318e
Step 6/12 : RUN (cd $GOPATH/src/github.com/karalabe/hive && go install ./...)
 ---> Running in 1d60cb2328bb
warning: "./..." matched no packages
 ---> 800edf2ec2dc
Removing intermediate container 1d60cb2328bb
Step 7/12 : ADD *.go $GOPATH/src/github.com/karalabe/hive/
 ---> 67c1eb7e9f57
Removing intermediate container d963da6fbfca
Step 8/12 : WORKDIR $GOPATH/src/github.com/karalabe/hive
 ---> d619b6448e50
Removing intermediate container 21e22fd87ad5
Step 9/12 : RUN go install
 ---> Running in 93cce155c380
 ---> 0e0f4cff7d3b
Removing intermediate container 93cce155c380
Step 10/12 : RUN echo '#!/bin/sh'  > $GOPATH/bin/hive.sh && 	echo 'set -e'    >> $GOPATH/bin/hive.sh && 		echo 'dockerd-entrypoint.sh --storage-driver=aufs 2>/dev/null &' >> $GOPATH/bin/hive.sh && 	echo 'while [ ! -S /var/run/docker.sock ]; do sleep 1; done'           >> $GOPATH/bin/hive.sh && 		echo 'for id in `docker ps -a -q`; do docker rm -f $id; done'                                                     >> $GOPATH/bin/hive.sh && 	echo 'for id in `docker images -f "dangling=true" | tail -n +2 | awk "{print \\$3}"`; do docker rmi -f $id; done' >> $GOPATH/bin/hive.sh && 	echo 'hive --docker-noshell $@'                                                                                   >> $GOPATH/bin/hive.sh && 	echo 'for id in `docker ps -a -q`; do docker rm -f $id; done'                                                     >> $GOPATH/bin/hive.sh && 	echo 'for id in `docker images -f "dangling=true" | tail -n +2 | awk "{print \\$3}"`; do docker rmi -f $id; done' >> $GOPATH/bin/hive.sh && 		echo 'adduser -u $UID -D hive'       >> $GOPATH/bin/hive.sh && 	echo 'chown -R hive /var/lib/docker' >> $GOPATH/bin/hive.sh &&   echo 'chown -R hive workspace'       >> $GOPATH/bin/hive.sh && 		chmod +x $GOPATH/bin/hive.sh
 ---> Running in bc11452a8e4e
 ---> f36e08024131
Removing intermediate container bc11452a8e4e
Step 11/12 : ENTRYPOINT hive.sh
 ---> Running in 0b69cf46586e
 ---> 357be5bba13e
Removing intermediate container 0b69cf46586e
Step 12/12 : COPY . $GOPATH/src/github.com/karalabe/hive
 ---> 8f94c3ebd436
Removing intermediate container fd4be7060306
Successfully built 8f94c3ebd436
Successfully tagged hive/shell:latest
DBUG[08-29|11:22:21] created shell container 
INFO[08-29|11:22:21] starting outer shell container 
DBUG[08-29|11:22:21] attaching to container 
DBUG[08-29|11:22:21] starting container 
INFO[08-29|11:22:23] docker daemon online                     version=18.04.0-ce
INFO[08-29|11:22:23] building clients for validation          pattern=aleth:develop
INFO[08-29|11:22:23] building validators for testing          pattern=none
INFO[08-29|11:22:23] creating ethash container 
INFO[08-29|11:22:23] building new docker image                nocache=true
Step 1/3 : FROM ethereum/client-go
Pulling from ethereum/client-go
Pulling fs layer
Pulling fs layer
Pulling fs layer
Downloading [>                                                  ]  22.39kB/2.207MB
Downloading [==================================================>]  2.207MB/2.207MB
Verifying Checksum
Download complete
Extracting [>                                                  ]  32.77kB/2.207MB
Extracting [==================================================>]  2.207MB/2.207MB
Pull complete
Downloading [>                                                  ]  4.434kB/309.1kB
Downloading [==================================================>]  309.1kB/309.1kB
Verifying Checksum
Download complete
Extracting [=====>                                             ]  32.77kB/309.1kB
Extracting [==================================================>]  309.1kB/309.1kB
Extracting [==================================================>]  309.1kB/309.1kB
Downloading [>                                                  ]  116.9kB/11.52MB
Pull complete
Downloading [=>                                                 ]  374.7kB/11.52MB
Downloading [==>                                                ]  636.8kB/11.52MB
Downloading [====>                                              ]  1.014MB/11.52MB
Downloading [======>                                            ]   1.39MB/11.52MB
Downloading [=======>                                           ]  1.763MB/11.52MB
Downloading [=========>                                         ]  2.144MB/11.52MB
Verifying Checksum
Download complete
Extracting [>                                                  ]  131.1kB/11.52MB
Extracting [=====================>                             ]   4.85MB/11.52MB
Extracting [=========================================>         ]  9.568MB/11.52MB
Extracting [==================================================>]  11.52MB/11.52MB
Extracting [==================================================>]  11.52MB/11.52MB
Pull complete
Digest: sha256:4dfa0ada081e82a34327e9c216b438c0dc02b6f89bdd4e80cbe1ba6d9ceb7031
Status: Downloaded newer image for ethereum/client-go:latest
 ---> 79c11d1780e6
Step 2/3 : RUN   echo '#!/bin/sh'                          > /root/ethash.sh &&   echo 'set -e'                            >> /root/ethash.sh &&   echo 'geth makedag 1 /root/.ethash'      >> /root/ethash.sh &&   echo 'if [ "$UID" != "0" ]; then'        >> /root/ethash.sh &&   echo '  adduser -u $UID -D ethash'       >> /root/ethash.sh &&   echo '  chown -R ethash /root/.ethash/*' >> /root/ethash.sh &&   echo 'fi'                                >> /root/ethash.sh &&   chmod +x /root/ethash.sh
 ---> Running in 2b66d04dbc68
Removing intermediate container 2b66d04dbc68
 ---> 97ee45fc41b0
Step 3/3 : ENTRYPOINT ["/root/ethash.sh"]
 ---> Running in 3ac710bab9d7
Removing intermediate container 3ac710bab9d7
 ---> 52a1b8ea36ed
Successfully built 52a1b8ea36ed
Successfully tagged hive/internal/ethash:latest
DBUG[08-29|11:22:28] created ethash container 
INFO[08-29|11:22:28] generating genesis DAG 
DBUG[08-29|11:22:28] attaching to container 
DBUG[08-29|11:22:28] starting container 
DBUG[08-29|11:22:28] deleting ethash container 
INFO[08-29|11:22:28] building clients for simulation          pattern=aleth:develop
INFO[08-29|11:22:28] building simulators for testing          pattern=ethereum/consensus
INFO[08-29|11:22:28] building new docker image                simulator=ethereum/consensus nocache=true
Step 1/6 : FROM jfloff/alpine-python:2.7-onbuild
Pulling from jfloff/alpine-python
Pulling fs layer
Pulling fs layer
Pulling fs layer
Downloading [>                                                  ]  539.3kB/83.89MB
Downloading [=========>                                         ]     329B/1.779kB
Downloading [==================================================>]  1.779kB/1.779kB
Verifying Checksum
Download complete
Downloading [>                                                  ]  20.86kB/2.066MB
Verifying Checksum
Download complete
Extracting [>                                                  ]  32.77kB/2.066MB
Downloading [========>                                          ]  13.93MB/83.89MB
Extracting [==================================================>]  2.066MB/2.066MB
Pull complete
Downloading [===============>                                   ]  26.25MB/83.89MB
Downloading [=======================>                           ]  39.09MB/83.89MB
Downloading [===============================>                   ]  52.48MB/83.89MB
Downloading [======================================>            ]  64.29MB/83.89MB
Downloading [============================================>      ]  74.46MB/83.89MB
Verifying Checksum
Download complete
Extracting [>                                                  ]  557.1kB/83.89MB
Extracting [===>                                               ]  5.571MB/83.89MB
Extracting [=====>                                             ]   9.47MB/83.89MB
Extracting [=====>                                             ]  10.03MB/83.89MB
Extracting [======>                                            ]  10.58MB/83.89MB
Extracting [=======>                                           ]  12.26MB/83.89MB
Extracting [=========>                                         ]  16.15MB/83.89MB
Extracting [============>                                      ]  21.73MB/83.89MB
Extracting [================>                                  ]   27.3MB/83.89MB
Extracting [===================>                               ]  32.31MB/83.89MB
Extracting [======================>                            ]  38.44MB/83.89MB
Extracting [=========================>                         ]  43.45MB/83.89MB
Extracting [============================>                      ]  47.35MB/83.89MB
Extracting [===============================>                   ]  52.36MB/83.89MB
Extracting [==================================>                ]  58.49MB/83.89MB
Extracting [======================================>            ]  64.62MB/83.89MB
Extracting [==========================================>        ]   71.3MB/83.89MB
Extracting [==============================================>    ]  78.54MB/83.89MB
Extracting [==================================================>]  83.89MB/83.89MB
Pull complete
Extracting [==================================================>]  1.779kB/1.779kB
Extracting [==================================================>]  1.779kB/1.779kB
Pull complete
Digest: sha256:80af59e18316a946256ca0778115650f280577e381e3f7498fa43e8df29b80f0
Status: Downloaded newer image for jfloff/alpine-python:2.7-onbuild
# Executing 3 build triggers
 ---> Running in ddef477b4501
First run, checking for any requirements...
Installing all APK requirements...
fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/main/x86_64/APKINDEX.tar.gz
OK: 188 MiB in 43 packages
Pip requirements file detected!
Upgrading Pip...
Collecting pip
  Downloading https://files.pythonhosted.org/packages/5f/25/e52d3f31441505a5f3af41213346e5b6c221c9e086a166f3703d2ddaf940/pip-18.0-py2.py3-none-any.whl (1.3MB)
Installing collected packages: pip
  Found existing installation: pip 9.0.1
    Uninstalling pip-9.0.1:
      Successfully uninstalled pip-9.0.1
Successfully installed pip-18.0
Installing all Pip requirements...
Collecting requests (from -r /tmp/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/65/47/7e02164a2a3db50ed6d8a6ab1d6d60b69c4c3fdf57a284257925dfc12bda/requests-2.19.1-py2.py3-none-any.whl (91kB)
Collecting idna<2.8,>=2.5 (from requests->-r /tmp/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/4b/2a/0276479a4b3caeb8a8c1af2f8e4355746a97fab05a372e4a2c6a6b876165/idna-2.7-py2.py3-none-any.whl (58kB)
Collecting certifi>=2017.4.17 (from requests->-r /tmp/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/df/f7/04fee6ac349e915b82171f8e23cee63644d83663b34c539f7a09aed18f9e/certifi-2018.8.24-py2.py3-none-any.whl (147kB)
Collecting chardet<3.1.0,>=3.0.2 (from requests->-r /tmp/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
Collecting urllib3<1.24,>=1.21.1 (from requests->-r /tmp/requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/bd/c9/6fdd990019071a4a32a5e7cb78a1d92c53851ef4f56f62a3486e6a7d8ffb/urllib3-1.23-py2.py3-none-any.whl (133kB)
Installing collected packages: idna, certifi, chardet, urllib3, requests
Successfully installed certifi-2018.8.24 chardet-3.0.4 idna-2.7 requests-2.19.1 urllib3-1.23
fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/main/x86_64/APKINDEX.tar.gz
OK: 188 MiB in 43 packages
Removing intermediate container ddef477b4501
 ---> Running in 2b9dd57907c4
Removing intermediate container 2b9dd57907c4
 ---> f436629776cf
Step 2/6 : RUN apk add --update curl git &&   git clone --depth 1 https://github.com/ethereum/tests.git && echo "cacheoff6"
 ---> Running in 1d4043a723b6
fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/main/x86_64/APKINDEX.tar.gz
(1/1) Installing curl (7.61.0-r0)
Executing busybox-1.27.2-r7.trigger
OK: 188 MiB in 44 packages
Cloning into 'tests'...
cacheoff6
Removing intermediate container 1d4043a723b6
 ---> 9c37fa81ab6b
Step 3/6 : ADD simulator.sh /simulator.sh
 ---> b465b8072e41
Step 4/6 : RUN chmod +x /simulator.sh
 ---> Running in a73a12b956a2
Removing intermediate container a73a12b956a2
 ---> 3e4b24cd5966
Step 5/6 : COPY *.py /
 ---> a703cfb29a53
Step 6/6 : ENTRYPOINT ["python","/simulator.py"]
 ---> Running in e02f33be1eea
Removing intermediate container e02f33be1eea
 ---> 182922829d90
Successfully built 182922829d90
Successfully tagged hive/simulators/ethereum/consensus:latest
{}
adduser: uid '0' in use
DBUG[08-29|11:22:58] deleting shell container 

[holiman]

Ah, it's a duplicate of #103 . For whatever reason (perhaps we redeployed the machine at some point), the server has gone back to Xenial.

[holiman]

cc @nonsense -- we should update the (terraform? ansible? ) base images to use 18.04

[holiman]

Updated to 18.04, and fixed an error with the client name (was using aleth:develp, not aleth:nightly)