To apply pca for a large csv

Chris Angelico rosuav at gmail.com
Tue Apr 14 07:50:06 EDT 2020


On Tue, Apr 14, 2020 at 9:41 PM Rahul Gupta <rahulgupta100689 at gmail.com> wrote:
>
> Hello all, i have a csv of 1 gb which consists of 25000 columns and 20000 rows. I want to apply pca so i have seen sciki-learn had inbuilt fucntionality to use that. But i have seen to do eo you have to load data in data frame. But my machine is i5 with 8 gb of ram which fails to load all this data in data frame and shows memory error. Is there any alternative way that still i could aaply PCA on the same machine to the same rata set
>

Are you running a 32-bit or 64-bit version of Python?

ChrisA


More information about the Python-list mailing list