"Getting CTA DB error message with web crawler - help!"

hello @michael_crowdes - welcome to the RapidMiner Community.  Could you post your XML in this thread so we can see your process?  Please use the </> tool.

Thanks.

Scott

<?xml version="1.0" encoding="UTF-8"?><process version="7.6.001">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="7.6.001" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="web:crawl_web_modern" compatibility="7.3.000" expanded="true" height="68" name="Crawl Web" width="90" x="246" y="187">
        <parameter key="url" value="http://parker.com"/>
        <list key="crawling_rules">
          <parameter key="store_with_matching_url" value="*parker.com*"/>
        </list>
        <parameter key="max_crawl_depth" value="3"/>
        <parameter key="retrieve_as_html" value="true"/>
        <parameter key="write_pages_to_disk" value="true"/>
        <parameter key="include_binary_content" value="true"/>
        <parameter key="output_dir" value="C:\Users\533537\Desktop\webPages"/>
        <parameter key="ignore_robot_exclusion" value="true"/>
      </operator>
      <connect from_op="Crawl Web" from_port="example set" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="0"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>

Hi Michael,

it seems that you have an error in the regex field of the crawling rules. "*parker.com*" is not a valid expression. What exactly have been your intentions with that expression? Capture everything that contains "parker.com", no matter what elements are before or after that? If so, try this expression (without quotation marks): ".*parker.com.*"