Monarch 2021.1 - Preview columns and statistics

Todd Klemp
Todd Klemp Altair Community Member
edited December 2022 in Community Q&A

Hello!

I was wondering if there was a way to export out the statistics for each column that is populating in the preview data before you load the selected table.

The reason is that we have used Monarch to clean up large data files and export out to csv files. We then upload those into another program and we have found a bug in that program that does not bring in all the data but we lack the reconciliation power to fully vet it out. We are thinking our only option would be to open the original file in data prep studio and just manually review the stats in the preview window and compare them to what gets loaded in the other program that is needed to perform the work we do. 

I have attached an example of one of the columns that we would like to export. In that example there are 297 unique instances that we want to ensure that the correct number of each were loaded into our other program.

Thanks in advance for any advice given! ~Todd

Best Answer

  • Baba_Majekodunmi_703
    Baba_Majekodunmi_703
    Altair Employee
    edited December 2022 Answer ✓

    Hi Todd,

     

    There isn't a way to generate the statistics output in the Preview view, but you're essentially getting the same data when you run the 'Create Statistics Snapshot' in the Prepare view. Have you tried this yet?

    What system did you load the data to? There must be some backend database or log file of what was successfully loaded, at least I assume so.

    image

     

    image

     

    image

Answers

  • Baba_Majekodunmi_703
    Baba_Majekodunmi_703
    Altair Employee
    edited December 2022 Answer ✓

    Hi Todd,

     

    There isn't a way to generate the statistics output in the Preview view, but you're essentially getting the same data when you run the 'Create Statistics Snapshot' in the Prepare view. Have you tried this yet?

    What system did you load the data to? There must be some backend database or log file of what was successfully loaded, at least I assume so.

    image

     

    image

     

    image

  • Todd Klemp
    Todd Klemp Altair Community Member
    edited December 2022

    @Baba Majekodunmi that is awesome! I just tried that option and provides me with the information that I was seeking. I did notice that when you change the Statistic Type in your second screenshot to Unique Values you can only run that on one column, which makes sense.

     

    Do you know if you can create multiple Unique Values tables and export them out in a single Excel file? Right now all that I can figure out is to export each table into one Excel file and then combine them later.

     

  • Baba_Majekodunmi_703
    Baba_Majekodunmi_703
    Altair Employee
    edited December 2022

    @Baba Majekodunmi that is awesome! I just tried that option and provides me with the information that I was seeking. I did notice that when you change the Statistic Type in your second screenshot to Unique Values you can only run that on one column, which makes sense.

     

    Do you know if you can create multiple Unique Values tables and export them out in a single Excel file? Right now all that I can figure out is to export each table into one Excel file and then combine them later.

     

    Hi Todd,

    At the moment it doesn't appear that you can run all of them at once, but I will check with the product team and see if this is an enhancement that can be made.

    That said, you're left with having to export (or copy) to combine them.

    By the way, have you seen some of our complimentary resources here in the community that might be of benefit to you?

    Hopefully these resources may help with your existing project or a new one.

  • Todd Klemp
    Todd Klemp Altair Community Member
    edited December 2022

    Hey Baba, 

    Thanks for the information. I have several resources that I have bookmarked for Monarch but I didn't have those three so I've added them to my arsenal!