Python

Search

read a large dataframe in pandas

filename='../input/*.csv'
chunksize=10**6
reader = pd.read_csv(filename,chunksize=chunksize, 
                    low_memory=False)    
train=pd.DataFrame()
for i, chunk in enumerate(reader):
    train=pd.concat([train,chunk],axis=0)

Comment

PREVIOUS	NEXT

Code Example
Python :: Python - Count the Number of Keys in a Python Dictionary
Python :: python file location path
Python :: Print the norm of a vector and a matrix using numpy.
Python :: from random import choice
Python :: mean of torch tensor
Python :: find the area of a circle in python
Python :: python3 hello world
Python :: how to count range in django template
Python :: python list of all characters
Python :: how to update the kali linux os from python2 to python3
Python :: python bz2 install
Python :: pandas to_csv no index
Python :: how to make a randomized pasword genirator in python
Python :: format string to 2 decimal places python
Python :: cast tensor type pytorch
Python :: how to use variables in string in python
Python :: bar plot matplotlib
Python :: fyit download
Python :: converting month number to month name python
Python :: list adding to the begining python
Python :: python read line into list
Python :: python turn true or false into 0 or 1
Python :: python game engine
Python :: how to run python file from cmd in dockerfile
Python :: discord py get channel id by name
Python :: how to print palindrome in 100 between 250 in python
Python :: python merge list into string
Python :: list to sentence python
Python :: rename key in python dictionary
Python :: python print utf-8

Search

PYTHON

read a large dataframe in pandas

ADD CONTENT