I need help removing black diamond with white question mark symbol which shows as a dash in the original file but changes when imported into Data Prep Studio.

Aaron_21459

Need to replace the question mark in black diamond with a " - ".

In original the character is either a dash or a space

Find more posts tagged with

English

Monarch

v2021.0

Accepted answers

All comments

CPorthouse

Try changing the encoding option when the report is loaded.

Click the Gear Icon in the upper right

And under Import, select the Reports tab and choose a different encoding (Maybe UTF-8)

Aaron_21459

Try changing the encoding option when the report is loaded.

Click the Gear Icon in the upper right

And under Import, select the Reports tab and choose a different encoding (Maybe UTF-8)

Hello Chris

Thank you for the suggestion. I have tried all those options but they have not helped.

CPorthouse

Hello Chris

Thank you for the suggestion. I have tried all those options but they have not helped.

Another option then would be to try and copy the symbol (or entire cell) and use the menu drop down and select Replace->Using Find & Replace

Paste the symbol (or entire cell and delete everything but the symbol) in the find box and use "-" in the replace

Aaron_21459

Another option then would be to try and copy the symbol (or entire cell) and use the menu drop down and select Replace->Using Find & Replace

Paste the symbol (or entire cell and delete everything but the symbol) in the find box and use "-" in the replace

Tried that too, but copy the symbol turns it into a blank space.

I found this online and it seems to work. Its an extra step that I have to do outside Monarch every time though.

Pete Singleton Feb 10, 2020

The black question mark is when a character is unrecognised. You need to select the right encoding before import. I usually do the following before importing CSV:

Edit the file in Excel or whatever you are using
Save as CSV (not Windows CSV, the standard CSV)
Open in notepad
Select "Save As..." and make sure you choose encoding of UTF-8 instead of ANSI
Make sure UTF-8 is selected as the encoding when you import

CPorthouse

Tried that too, but copy the symbol turns it into a blank space.

I found this online and it seems to work. Its an extra step that I have to do outside Monarch every time though.

Pete Singleton Feb 10, 2020

The black question mark is when a character is unrecognised. You need to select the right encoding before import. I usually do the following before importing CSV:

Edit the file in Excel or whatever you are using

Save as CSV (not Windows CSV, the standard CSV)

Open in notepad

Select "Save As..." and make sure you choose encoding of UTF-8 instead of ANSI

Make sure UTF-8 is selected as the encoding when you import

Agreed. That is why I mentioned the encoding option first. Just surprised it didn't work in DPS.