python Pool map multiple arguments - list and variable as input

Question

I would like to multiprocess a function (see below)

def func(c):
    time =  time
    list = [c, time]
    another_func(list)

I run this above function as follows:

p = multiprocess.Pool()
p.map(func, cust, chunksize=1)
p.close()
p.join()

cust is a list of strings like

cust = ['c1', 'c2', ...]

Now my question is it possible to get the time variable into the p.map like

p.map(func, cust, time, chunksize=1)

I have searched multiple topics here but I did not find a matching topic.

Thx for any help/hints!

kederrac · Accepted Answer · 2020-03-19 10:13:23Z

3

you can use starmap:

def func(c, time):
    my_list = [c, time]
    another_func(my_list)


p.starmap(func, [(c, time) for c in cust], chunksize=1)

even better:

p.map(another_func, [[c, time] for c in cust], chunksize=1)

answered Mar 19, 2020 at 9:57

kederrac

17.4k6 gold badges36 silver badges58 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1