I need help removing black diamond with white question mark symbol which shows as a dash in the original file but changes when imported into Data Prep Studio.

Aaron_21459
Aaron_21459 Altair Community Member
edited August 2022 in Community Q&A

Need to replace the question mark in black diamond with a " - ". 

image

In original the character is either a dash or a space

image

Tagged:

Answers

  • CPorthouse
    CPorthouse
    Altair Employee
    edited August 2022

    Try changing the encoding option when the report is loaded.

    Click the Gear Icon in the upper right image

    And under Import, select the Reports tab and choose a different encoding (Maybe UTF-8)

    image

  • Aaron_21459
    Aaron_21459 Altair Community Member
    edited August 2022
    Chris Porthouse said:

    Try changing the encoding option when the report is loaded.

    Click the Gear Icon in the upper right image

    And under Import, select the Reports tab and choose a different encoding (Maybe UTF-8)

    image

    Hello Chris

    Thank you for the suggestion. I have tried all those options but they have not helped.

  • CPorthouse
    CPorthouse
    Altair Employee
    edited August 2022
    Aaron_21459 said:

    Hello Chris

    Thank you for the suggestion. I have tried all those options but they have not helped.

    Another option then would be to try and copy the symbol (or entire cell) and use the menu drop down and select Replace->Using Find & Replace

    image

    Paste the symbol (or entire cell and delete everything but the symbol) in the find box and use "-" in the replace

  • Aaron_21459
    Aaron_21459 Altair Community Member
    edited August 2022
    Chris Porthouse said:

    Another option then would be to try and copy the symbol (or entire cell) and use the menu drop down and select Replace->Using Find & Replace

    image

    Paste the symbol (or entire cell and delete everything but the symbol) in the find box and use "-" in the replace

    Tried that too, but copy the symbol turns it into a blank space.

     

    I found this online and it seems to work. Its an extra step that I have to do outside Monarch every time though. 

     

    The black question mark is when a character is unrecognised.  You need to select the right encoding before import.  I usually do the following before importing CSV:

    1. Edit the file in Excel or whatever you are using
    2. Save as CSV (not Windows CSV, the standard CSV)
    3. Open in notepad
    4. Select "Save As..." and make sure you choose encoding of UTF-8 instead of ANSI
    5. Make sure UTF-8 is selected as the encoding when you import
  • CPorthouse
    CPorthouse
    Altair Employee
    edited August 2022
    Aaron_21459 said:

    Tried that too, but copy the symbol turns it into a blank space.

     

    I found this online and it seems to work. Its an extra step that I have to do outside Monarch every time though. 

     

    The black question mark is when a character is unrecognised.  You need to select the right encoding before import.  I usually do the following before importing CSV:

    1. Edit the file in Excel or whatever you are using
    2. Save as CSV (not Windows CSV, the standard CSV)
    3. Open in notepad
    4. Select "Save As..." and make sure you choose encoding of UTF-8 instead of ANSI
    5. Make sure UTF-8 is selected as the encoding when you import

    Agreed.  That is why I mentioned the encoding option first.  Just surprised it didn't work in DPS.

Categories