TrainityTrainity
All ideas

Loading previous_application file into mysql

I found that the maximum number of rows showing in excel is 1048576 for previousapplication while in mysql it is showing 1670214 rows, a significance difference of over 6 lakh rows. But however in doing so, mysql is not recognising the comma field used in nametype_suite column(spouse, partner) in excel and thus it is loaded in different columns in mysql rather in the same column (attaching the screenshot). Question: I thought of converting the ' , ' and replcae with ' / ' (found 42160 records in excel in NAMETYPESUITE column) but it would only affect till 1048576 rows. After replacing, I tried importing, but this time it showed only 1048576 rows im sql. So, how to proceed? How I can change the mysql importing style in which it detects ' , ' as not a delimiter but as entire field. Also, at first when I imported the file in mysql using datatype 'int' for integer columns, it was giving me 0 for all null values, how to correct it? as it would affect in analysis. However, I tried importing all columns as 'text', then it was showing 0 and null separately, but is it correct way of do it? Also, I have tried changing the delimiter to pipe '|' in excel csv but it imports only 1048576 rows in mysql Also, for a second thought, let me know if the analysis can be done with 1048576 rows, however, I want to proceed for the actual data. NOTE: I don't use python as I have not learned it yet. Please suggest MYSQL/excel solutions only