🎉Community Raffle - Win $25

An exclusive raffle opportunity for active members like you! Complete your profile, answer questions and get your first accepted badge to enter the raffle.
Join and Win

Text file has no line breaks - how do I parse this?

User: "Rebekah"
Altair Community Member
Updated by Rebekah
What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
There appear to be two ways the data is displayed:
Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
or 
Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
Rebekah


------------------------------
Rebekah
Operational Risk Analyst
Exchange Bank (CA)
------------------------------

Find more posts tagged with

Sort by:
1 - 5 of 51
    User: "Mo Abdolrahim"
    Altair Employee
    Updated by Mo Abdolrahim
    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program. 
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo 


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "
    User: "Rebekah"
    Altair Community Member
    OP
    Updated by Rebekah

    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program. 
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo 


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "

    Thank you, Mo - I will give your suggestions a try today. Much appreciated!
    Take care,
    Rebekah

    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-07-2020 08:04 AM
    From: Mahmoud Abdolrahim
    Subject: Text file has no line breaks - how do I parse this?

    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program.
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------

    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "
    User: "Rebekah"
    Altair Community Member
    OP
    Updated by Rebekah

    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program. 
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo 


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "

    Hi Mo,
    One additional question - is there a character set that would indicate a line break if I utilize the search and replace functionality in the utility? I have found that I can add a line break using Word if I replace a repeating character with ^l, but that means copying the text file into Word, running search and replace and then copying the results back into text format back for trapping with Monarch. It would be nice to use the utility for the search and replace part, if it can do that. So far, nothing that I have tried in the utility seems to get me the desired results in applying line breaks.
    I do like the fact that I can replace the pipe with another character set, since the pipe is a reserved character in trapping.
    Thanks again,
    Rebekah

    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-07-2020 08:04 AM
    From: Mahmoud Abdolrahim
    Subject: Text file has no line breaks - how do I parse this?

    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program.
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------

    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "
    User: "Mo Abdolrahim"
    Altair Employee
    Accepted Answer
    Updated by Mo Abdolrahim

    Hi Mo,
    One additional question - is there a character set that would indicate a line break if I utilize the search and replace functionality in the utility? I have found that I can add a line break using Word if I replace a repeating character with ^l, but that means copying the text file into Word, running search and replace and then copying the results back into text format back for trapping with Monarch. It would be nice to use the utility for the search and replace part, if it can do that. So far, nothing that I have tried in the utility seems to get me the desired results in applying line breaks.
    I do like the fact that I can replace the pipe with another character set, since the pipe is a reserved character in trapping.
    Thanks again,
    Rebekah

    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-07-2020 08:04 AM
    From: Mahmoud Abdolrahim
    Subject: Text file has no line breaks - how do I parse this?

    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program.
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------

    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "

    Hi Rebekah,
    You can use the Monarch Utility program and replace a pipe character (|) with another character (Replace all instances of a string with another string or an empty string.), however, you can not use the utility program and replace another character with carriage control & line feed.
    The find & replace in the utility program is in text mode, not hex mode.
    If you don't have Notepad++, you can download it (its free) and add the HEX-Editor plugin.  you can open your file in the Notepad++ switch to Hex editor and replace a character with CC+LF (0doa), per screenshots below:
    image
    image

    image
    Regards
    Mo

    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-07-2020 01:51 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    Hi Mo,
    One additional question - is there a character set that would indicate a line break if I utilize the search and replace functionality in the utility? I have found that I can add a line break using Word if I replace a repeating character with ^l, but that means copying the text file into Word, running search and replace and then copying the results back into text format back for trapping with Monarch. It would be nice to use the utility for the search and replace part, if it can do that. So far, nothing that I have tried in the utility seems to get me the desired results in applying line breaks.
    I do like the fact that I can replace the pipe with another character set, since the pipe is a reserved character in trapping.
    Thanks again,
    Rebekah

    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------

    Original Message:
    Sent: 01-07-2020 08:04 AM
    From: Mahmoud Abdolrahim
    Subject: Text file has no line breaks - how do I parse this?

    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program.
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840

    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "
    User: "Rebekah"
    Altair Community Member
    OP
    Updated by Rebekah

    Hi Rebekah,
    You can use the Monarch Utility program and replace a pipe character (|) with another character (Replace all instances of a string with another string or an empty string.), however, you can not use the utility program and replace another character with carriage control & line feed.
    The find & replace in the utility program is in text mode, not hex mode.
    If you don't have Notepad++, you can download it (its free) and add the HEX-Editor plugin.  you can open your file in the Notepad++ switch to Hex editor and replace a character with CC+LF (0doa), per screenshots below:

    image
    image

    image
    Regards
    Mo

    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-07-2020 01:51 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    Hi Mo,
    One additional question - is there a character set that would indicate a line break if I utilize the search and replace functionality in the utility? I have found that I can add a line break using Word if I replace a repeating character with ^l, but that means copying the text file into Word, running search and replace and then copying the results back into text format back for trapping with Monarch. It would be nice to use the utility for the search and replace part, if it can do that. So far, nothing that I have tried in the utility seems to get me the desired results in applying line breaks.
    I do like the fact that I can replace the pipe with another character set, since the pipe is a reserved character in trapping.
    Thanks again,
    Rebekah

    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------

    Original Message:
    Sent: 01-07-2020 08:04 AM
    From: Mahmoud Abdolrahim
    Subject: Text file has no line breaks - how do I parse this?

    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program.
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840

    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "
    Excellent - I will try Notepad ++ to address the line break issue and I will go from there. Thank you again, Mo!
    Rebekah

    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-07-2020 02:53 PM
    From: Mahmoud Abdolrahim
    Subject: Text file has no line breaks - how do I parse this?

    Hi Rebekah,
    You can use the Monarch Utility program and replace a pipe character (|) with another character (Replace all instances of a string with another string or an empty string.), however, you can not use the utility program and replace another character with carriage control & line feed.
    The find & replace in the utility program is in text mode, not hex mode.
    If you don't have Notepad++, you can download it (its free) and add the HEX-Editor plugin.  you can open your file in the Notepad++ switch to Hex editor and replace a character with CC+LF (0doa), per screenshots below:
    image
    image

    image
    Regards
    Mo

    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840
    ------------------------------

    Original Message:
    Sent: 01-07-2020 01:51 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    Hi Mo,
    One additional question - is there a character set that would indicate a line break if I utilize the search and replace functionality in the utility? I have found that I can add a line break using Word if I replace a repeating character with ^l, but that means copying the text file into Word, running search and replace and then copying the results back into text format back for trapping with Monarch. It would be nice to use the utility for the search and replace part, if it can do that. So far, nothing that I have tried in the utility seems to get me the desired results in applying line breaks.
    I do like the fact that I can replace the pipe with another character set, since the pipe is a reserved character in trapping.
    Thanks again,
    Rebekah

    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)

    Original Message:
    Sent: 01-07-2020 08:04 AM
    From: Mahmoud Abdolrahim
    Subject: Text file has no line breaks - how do I parse this?

    Hi Rebekah,
    If the file is created by Unix OS, then each line should have a line feed (ASCII code 10).  Try opening the file in DPS using text delimited option.
    If the file does not have any line feed, then you may try the Monarch utility program.
    This program is installed on your PC as part of Monarch installation.
    After you start the Monarch utility, select prepare file for Monarch (Replace, Inset line breaks, EDI) option.
    select a folder where the file is saved, and also select an output folder.
    on the next panel there are 4 options.  You may try one of the first three options.
    You may send me a sample report and let me look into it.
    Regards
    Mo


    ------------------------------
    Mahmoud Abdolrahim
    Senior Implementation & Integration Engineer
    Datawatch Corporation
    MA
    (978) 935-3840

    Original Message:
    Sent: 01-06-2020 02:25 PM
    From: Rebekah Tyrrell
    Subject: Text file has no line breaks - how do I parse this?

    What is the best way to deal with content that is a big block of text without line breaks? Is there a way to add line breaks prior to creating a trap?

    Also, the report uses the the pipe as a deliminator and is poorly formatted for data mining.
    There appear to be two ways the data is displayed:
    Alpha-numeric Record Name | Unknown | Account # | Account Type | Name | email address | Unknown | Reason for return
    or
    Numeric | Account # | Account Type | Name | email address | unknown | Reason for return

    But in order to work with the fuzzy data, I really need some line breaks first - any ideas on an approach would be greatly appreciated!
    Rebekah


    ------------------------------
    Rebekah
    Operational Risk Analyst
    Exchange Bank (CA)
    ------------------------------
    "