#gnuparallel goodness (2/2):

the "--results" option will place stdout and stderr output of each process into a file hierarchy, ordered by each parameter.

There is also the possibility of collect all the output just into a single .csv file.

parallel --results dir echo ::: 1 2 ::: 3 4