Python

Search

process rows of dataframe in parallel

def parallelize_dataframe(df, func, n_cores=4):
    df_split = np.array_split(df, n_cores)
    pool = Pool(n_cores)
    df = pd.concat(pool.map(func, df_split))
    pool.close()
    pool.join()
    return df

Comment

PREVIOUS	NEXT

Code Example
Python :: kruskal python implementation
Python :: django prefetch_related vs select_related
Python :: Find and count unique values of a single column in Pandas DataFrame
Python :: is python oop
Python :: get_dummies
Python :: tkinter window size
Python :: matplotlib bar chart
Python :: test_size
Python :: how to install pyinstaller
Python :: check if element in list python
Python :: blender scripting set active ojbect
Python :: finding odd even python
Python :: replace nan with 0 pandas
Python :: matplotlib pyplot comment on plot
Python :: python print string name in pattern
Python :: tkinter entry focus
Python :: python cv2 imwrite
Python :: reverse element in a list in python 3
Python :: turn python script into exe
Python :: map and filter in python
Python :: how to for loop for amount in list python
Python :: jupyter notebook show full dataframe cell
Python :: python argparse optional required
Python :: Aligning rotated xticklabels with their respective xticks
Python :: ord python
Python :: dataframe python unique values rows
Python :: input in one line python
Python :: add cooldown to command discord.py
Python :: check if string contains python
Python :: how to make a discord bot in python

Search

PYTHON

process rows of dataframe in parallel

ADD CONTENT