"Split Text Case - RegEx dropping letters"

mob

I have some text that comes in different cases sometimes tokens are TextendNewtext others textendNewtext I found this regex online for python
([A-Z])([A-Z])([a-z])|([a-z])([A-Z])

but when I apply it to my dataset using the replace tokens operator and ([A-Z])([A-Z])([a-z])|([a-z])([A-Z]) replaced by $1 $2 I get
Texten ewtext

I'm far from an expert in regex in any flavour but can anyone help me resolve this

mob

For reference this is the StackOverflow post where I got the regex http://stackoverflow.com/questions/15369566/putting-space-in-camel-case-string-using-regular-expression

is there a way in rapidminer to handle CamelCaseTextOfVariousLengths and split it into tokens?

MartinLiebig

Hi mob,

why not simply use replace and replace capital letters with white space followed by the latter? Seems to work

~Martin

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<process version="7.0.000">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="7.0.000" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="generate_data_user_specification" compatibility="7.0.000" expanded="true" height="68" name="Generate Data by User Specification" width="90" x="45" y="34">
        <list key="attribute_values">
          <parameter key="text" value="&quot;CamelCaseTextOfVariousLengths&quot;"/>
        </list>
        <list key="set_additional_roles"/>
      </operator>
      <operator activated="true" class="nominal_to_text" compatibility="7.0.000" expanded="true" height="82" name="Nominal to Text" width="90" x="179" y="34"/>
      <operator activated="true" class="replace" compatibility="7.0.000" expanded="true" height="82" name="Replace" width="90" x="313" y="34">
        <parameter key="replace_what" value="([A-Z])"/>
        <parameter key="replace_by" value=" $1"/>
      </operator>
      <operator activated="true" class="text:process_document_from_data" compatibility="6.5.000" expanded="true" height="82" name="Process Documents from Data" width="90" x="447" y="34">
        <list key="specify_weights"/>
        <process expanded="true">
          <operator activated="true" class="text:tokenize" compatibility="6.5.000" expanded="true" height="68" name="Tokenize" width="90" x="246" y="34"/>
          <connect from_port="document" to_op="Tokenize" to_port="document"/>
          <connect from_op="Tokenize" from_port="document" to_port="document 1"/>
          <portSpacing port="source_document" spacing="0"/>
          <portSpacing port="sink_document 1" spacing="0"/>
          <portSpacing port="sink_document 2" spacing="0"/>
        </process>
      </operator>
      <connect from_op="Generate Data by User Specification" from_port="output" to_op="Nominal to Text" to_port="example set input"/>
      <connect from_op="Nominal to Text" from_port="example set output" to_op="Replace" to_port="example set input"/>
      <connect from_op="Replace" from_port="example set output" to_op="Process Documents from Data" to_port="example set"/>
      <connect from_op="Process Documents from Data" from_port="example set" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="0"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>

BalazsBaranyRM

The problem with your replacement is the following:

In the regular expression
([A-Z])([A-Z])([a-z])|([a-z])([A-Z])
all the parentheses are numbered. You're trying to replace by the value coming from the first and second parentheses, which would be two capital letters if your text matched that. It doesn't, so it goes to the second (alternate) match after the pipe symbol. But the contents of those parentheses are not in the replacement string. They would be $4 and $5.

Martin's approach seems to be what you want.

mob

Thanks Martin and Balázs Martins simple solution did exactly what I needed and also handled the situation with tokens like notcamelCase

AndreasS

Hi Martin, hi everybody

I am facing the same problem as mob. Unfortunately I couldn't solve it using your comment from 02-01-2016.

 

Problem:

I want to separate the following text: "PleaseSeparateMeByCapitalLetters" into "Please Separate Me By Capital Letters"

I tried to use the Replace Tokens operator

- replace what:[A-Z]

- replace by: $1

 

However the result is " lease eparate e y apital etters".

 

Thanks in advance for your help

 

Andreas

BalazsBaranyRM

The $1 refers to a "capture expression". You define capture expressions with (). If that's not in the replace what part, then $1 will be empty.

kayman

Try this : ([A-Z])(.) ,replace by  $1$2 and ensure there is a space before $1. It also adds a space before the first word but you can remove that one again by doing a second regex or trim the string.

 

so like this :

 

<parameter key="replace_what" value="([A-Z])(.)"/>
<parameter key="replace_by" value=" $1$2"/>

 

Probably not the most sexy solution but plain simple sometimes does the trick also.

AndreasS

Thank you !!!