Correlation Matrix
I am trying to create a correlation Matrix In Pandas. For me other IDE and Software like SQL, Tableau, Power Bi doesn't work. When I am trying to import file and create a correlation matrix of CSV previousapplication.csv I get these error. Error 1: Low memory error This happened occured because data was too big and there were too many columns. [Fixed it] Fix low_memory=False Error 2: Tokenizing Error pandas.errors.ParserError: Error tokenizing data. C error: EOF inside string starting at row 57673 This is I don't know why happens but when I googled it, I got solution that it get's fixed by using engine='python' , but it has a restriction of 200,000 rows. [Tried fixing it got new error] Error 3: Value Error ValueError: The 'low_memory' option is not supported with the 'python' engine. PS: I did it for application_data.csv it gives results but i'm not quite sure about the result weather it is right or wrong. One cannot make a correlation matrix of string values so the result that I get after using code is this. import pandas as pd import seaborn as sn import matplotlib.pyplot as plt df = pd.readcsv("C:/Users/91734/Downloads/FDM Download/Trainity/P6/Cleanedapplicationdata.csv",lowmemory=False) corr_matrix = df.corr() sn.heatmap(corr_matrix, annot=True) plt.show()
