Altair scl reading a currupted csv recovering the most good data
Too long to post on a list. see github
https://github.com/rogerjdeangelis/utl-altair-scl-reading-a-currupted-csv-recovering-the-most-good-data
Altair community post
https://community.altair.com/discussion/52461/i-cannot-read-the-data-correctly-help?tab=all
The best way to read this messy csv is to put the data into max number of character columns(#commas+1)
where each column has length 255 and fill any of the missing trailing commas fields with missing values.
Post process to optimize lengths and deciding which columns are numeric.
CONTENTS
1 Count commas in each record
2 read all records chr255
3 optimize lengths
SOAPBOX ON
Not a fan of CSV files, see github
https://github.com/rogerjdeangelis/utl_flatfile
SOAPBOX OFF
Macros usded here
//github.com/rogerjdeangelis/utl-macros-used-in-many-of-rogerjdeangelis-repositories
