[Aboriginal] Dealing with distcc

[John Spencer]

On 10/08/2012 01:29 AM, Rob Landley wrote:
> On Sun, Oct 7, 2012 at 1:56 PM, John Spencer

>> distcc[204] (dcc_build_somewhere) Warning: failed to distribute, running
>> locally instead
>
> So the QEMU instance of the distcc c wrapper is trying to send it to
> host, but the host distccd isn't responding, so it retries locally.

there seems to be something horrible broken with the qemu-system-mips 
image i'm using (iirc aboriginal 1.1).
later (while building stuff) i got this here:

2012.10.07 19:33:11 building stage0_gcc3 
(/home/sabotage.bld/src/build/build_stage0_gcc3.sh) -> 
/home/sabotage.bld/src/logs/build_stage0_gcc3.log
------------[ cut here ]------------
WARNING: at net/sched/sch_generic.c:255 dev_watchdog+0x170/0x280()
NETDEV WATCHDOG: eth0 (pcnet32): transmit queue 0 timed out
Call Trace:
[<80106a68>] dump_stack+0x8/0x34
[<8011f324>] warn_slowpath_common+0x70/0x9c
[<8011f3d8>] warn_slowpath_fmt+0x2c/0x38
[<802dde54>] dev_watchdog+0x170/0x280
[<8012b068>] run_timer_softirq+0x148/0x1f0
[<80124fb8>] __do_softirq+0xa0/0x140
[<801251a0>] do_softirq+0x48/0x68
[<80125200>] irq_exit+0x40/0x90
[<8010178c>] ret_from_irq+0x0/0x4

---[ end trace 2cb711632f922f00 ]---
pcnet32: eth0: transmit timed out, status 07fb, resetting
pcnet32: eth0: transmit timed out, status 07fb, resetting
pcnet32: eth0: transmit timed out, status 07fb, resetting
[etc]

i had to disable distcc (no crosscompiler in path, CPUS=1) entirely to 
make it work robustly (no other network stuff used).

interestingly this is also the single system which died due to OOM while 
building gcc 4.5.3.
i had to add swap as HDC (making a swapfile inside qemu failed due to 
EINVAL delivered to swapon command).
i didn't experience any of these issues using the arm system images.

>
>> is it possible that all aboriginal instances use the same distcc port ?
>> i currently have armv4tl, armv6 and mips running...
>
> Simultaneously, as the first thing you're trying? Try to get one
> target to distribute distcc, and only add a second if that works.
>

yeah it seems to work for the arm system images. it looks like the mips 
systemimage has a borked network stack.
eventually i'll try your currently mips image later this week, maybe 
that fixes it.


P.S. have you seen the bug i reported about CPUS always getting set to 1 
unless you pass it manually ?

P.P.S. have you archived older versions of prebuilt system images and 
cross compilers somewhere ?

P.P.P.S. i'd be glad if you pushed an aboriginal release with the "new" 
binutils 2.17.xxx installed soon. the lack of -Bsymbolic-functions in 
the old version makes it impossible to use dynamic musl, and can lead to 
subtle bugs even in some statically linked apps.


--JS


 1349714889.0