Random Task Failure

[jeffpkamp]

I am trying to run a pipeline that fails anytime it encounters a wait step. I was trying to debug so I ran some of your simpler example script below.

PROGRAM:

#!/usr/bin/env bds

for( int i=0 ; i < 10 ; i++ ) task echo BEFORE $i
for( int i=0 ; i < 10 ; i++ ) task echo AFTER $i

---

When I use the task feature I get random errors (see below). Depending on the run it might give me errors on different loops. I am running this on windows subsystem for linux using the command: bds test.bds. When run with the sys command it works fine.

OUTPUT:

BEFORE 0
BEFORE 6
BEFORE 1
BEFORE 7
BEFORE 5
BEFORE 4
BEFORE 3
BEFORE 2
BEFORE 8
BEFORE 9
AFTER 0
AFTER 1
AFTER 2
AFTER 3
AFTER 4
AFTER 5
AFTER 6
AFTER 7
AFTER 8
AFTER 9
Task failed:
        Program & line     : 'test.bds', line 3
        Task Name          : ''
        Task ID            : 'test.bds.20170509_201731_701/task.test.line_3.id_6'
        Task PID           : '13418'
        Task hint          : 'echo BEFORE 5'
        Task resources     : 'cpus: 1   mem: -1.0 B     timeout: 86400  wall-timeout: 86400'
        State              : 'ERROR'
        Dependency state   : 'ERROR'
        Retries available  : '1'
        Input files        : '[]'
        Output files       : '[]'
        Script file        : '/home/jeff/test.bds.20170509_201731_701/task.test.line_3.id_6.sh'
        Exit status        : '1'
        Program            :
                echo BEFORE 5
        StdOut (100000000 lines)  :
                BEFORE 5

Task failed:
        Program & line     : 'test.bds', line 3
        Task Name          : ''
        Task ID            : 'test.bds.20170509_201731_701/task.test.line_3.id_7'
        Task PID           : '13415'
        Task hint          : 'echo BEFORE 6'
        Task resources     : 'cpus: 1   mem: -1.0 B     timeout: 86400  wall-timeout: 86400'
        State              : 'ERROR'
        Dependency state   : 'ERROR'
        Retries available  : '1'
        Input files        : '[]'
        Output files       : '[]'
        Script file        : '/home/jeff/test.bds.20170509_201731_701/task.test.line_3.id_7.sh'
        Exit status        : '1'
        Program            :
                echo BEFORE 6
        StdOut (100000000 lines)  :
                BEFORE 6

Task failed:
        Program & line     : 'test.bds', line 3
        Task Name          : ''
        Task ID            : 'test.bds.20170509_201731_701/task.test.line_3.id_3'
        Task PID           : '13419'
        Task hint          : 'echo BEFORE 2'
        Task resources     : 'cpus: 1   mem: -1.0 B     timeout: 86400  wall-timeout: 86400'
        State              : 'ERROR'
        Dependency state   : 'ERROR'
        Retries available  : '1'
        Input files        : '[]'
        Output files       : '[]'
        Script file        : '/home/jeff/test.bds.20170509_201731_701/task.test.line_3.id_3.sh'
        Exit status        : '1'
        Program            :
                echo BEFORE 2
        StdOut (100000000 lines)  :
                BEFORE 2

---

[Pablo Cingolani]

It works perfectly fine for me.

$ ./z.bds 
BEFORE 1
BEFORE 2
BEFORE 3
BEFORE 0
BEFORE 4
BEFORE 5
BEFORE 6
BEFORE 7
BEFORE 8
BEFORE 9
AFTER 0
AFTER 1
AFTER 3
AFTER 2
AFTER 4
AFTER 5
AFTER 6
AFTER 7
AFTER 8
AFTER 9

Can you run it in debug mode (i.e. bds -d script.bds) and send the whole output?

[jeffpkamp]

sorry for the late reply... the issue seems to have cleared up since the last major update from windows.