"csv import ends with no import"

ariknoi
ariknoi New Altair Community Member
edited November 5 in Community Q&A
hi
i am trying to import my data which is in csv file
when using the csv import wizard it starting importing but than it vanishing and nothing is created in the library i chose.
pls advice
thanks
Tagged:

Answers

  • Marco_Boeck
    Marco_Boeck New Altair Community Member
    Hi,

    does the preview in the import wizard show the correct data structured in a table? You need to set some parameters during import to match your actual .csv file structure.
    You can check the rapidminer-studio.log / rm.log file in the .RapidMiner / .RapidMiner5 folder in your user home to see if any errors appear after importing.

    Regards,
    Marco
  • ariknoi
    ariknoi New Altair Community Member
    yes, the csv looks ok on the table
    also i have only rpidminer studio library and couldn't find the log files u indicated
  • Marco_Boeck
    Marco_Boeck New Altair Community Member
    Hi,

    RapidMiner Studio stores settings in a custom folder in the user folder of your operating system. So for example on Windows "C:\users\username" is the user folder, and in there is a subfolder called ".RapidMiner" or ".RapidMiner5" (depends on the version you are running). In there either rapidminer-studio.log or rm.log can be found, which might give me a clue what went wrong.

    Regards,
    Marco
  • ariknoi
    ariknoi New Altair Community Member
    here it is (rapidminer-studio.log) ... i found nothing related

    Jan 23, 2014 9:07:50 PM com.rapidminer.tools.I18N <clinit>
    INFO: Set locale to en.
    Jan 23, 2014 9:07:50 PM com.rapidminer.license.ProductConstraintManager initialize
    INFO: Initializing license manager.
    Jan 23, 2014 9:07:50 PM com.rapidminer.license.ProductConstraintManager initialize
    INFO: Using default license location.
    Jan 23, 2014 9:07:50 PM com.rapidminer.license.ProductConstraintManager initialize
    INFO: Registering default product.
    Jan 23, 2014 9:07:50 PM com.rapidminer.tools.plugin.Plugin registerPlugins
    INFO: Register plugin: Data Editor
    Jan 23, 2014 9:07:52 PM com.rapidminer.tools.expression.parser.ExpressionParserFactory <clinit>
    INFO: Default version of expression parser registered successfully
    Jan 23, 2014 9:08:19 PM com.rapidminer.tools.jdbc.JDBCProperties <init>
    WARNING: Missing database driver class name for ODBC Bridge (e.g. Access)
    Jan 23, 2014 9:08:19 PM com.rapidminer.tools.jdbc.JDBCProperties registerDrivers
    INFO: JDBC driver ca.ingres.jdbc.IngresDriver not found. Probably the driver is not installed.
    Jan 23, 2014 9:08:41 PM com.rapidminer.gui.ApplicationPerspectives loadAll
    CONFIG: Loading perspectives.
    Jan 23, 2014 9:08:58 PM com.rapid_i.deployment.update.client.UpdateManager checkForUpdates
    CONFIG: Ignoring update check. Last update check was on 1/23/14 7:20 PM.
    Jan 23, 2014 9:10:32 PM com.rapidminer.operator.nio.model.WizardState readNow
    INFO: Reading example set...
    Jan 23, 2014 9:12:06 PM com.rapidminer.operator.nio.model.WizardState readNow
    INFO: Reading example set...
    Jan 23, 2014 9:33:20 PM com.rapidminer.gui.RapidMinerGUI$ShutdownHook run
    INFO: Running shutdown sequence.
    Jan 23, 2014 9:33:20 PM com.rapidminer.gui.ApplicationPerspectives saveAll
    CONFIG: Saving perspectives.
    Jan 23, 2014 9:33:20 PM com.rapidminer.tools.usagestats.UsageStatistics save
    CONFIG: Saving operator usage.
  • Marco_Boeck
    Marco_Boeck New Altair Community Member
    Hi,

    is it possible to post the first couple of rows from your .csv file here? I could then create my own .csv file with your data and see if something is broken.

    Regards,
    Marco
  • ariknoi
    ariknoi New Altair Community Member
    4_0.3_0.7_2000_2_-6_-19_1.1,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_-2_-19_0.8,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_3_-6_-38_1.4,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_2_-19_1.1,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_4_-2_-38_1.1,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_4_2_-38_0.5,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_-2_-19_0.5,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_4_-6_-38_0.5,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_6_-19_0.8,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_4_-6_-38_1.4,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_2_-38_1.1,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_-6_-19_1.4,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_4_-2_-38_0.8,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_4_-6_-19_0.5,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_-2_-38_0.5,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_-6_-38_1.1,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_4_-6_-38_1.1,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_6_-38_1.1,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_-6_-38_0.5,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_3_2_-19_0.5,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_4_2_-38_1.4,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_-2_-19_1.4,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_3_2_-38_0.5,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
    4_0.3_0.7_2000_2_6_-38_0.8,02/01/2013 09:35,BUY,1,1450.25,,,2013-01-02,09:35
  • ariknoi
    ariknoi New Altair Community Member
    ?????????
  • Marco_Boeck
    Marco_Boeck New Altair Community Member
    Hi,

    sorry for the delay, your answer slipped by!
    This works for me just fine when selecting "," as the separator. See the process below (you just need to adapt the location of the .csv file):

    <?xml version="1.0" encoding="UTF-8" standalone="no"?>
    <process version="6.0.002">
      <context>
        <input/>
        <output/>
        <macros/>
      </context>
      <operator activated="true" class="process" compatibility="6.0.002" expanded="true" name="Process">
        <process expanded="true">
          <operator activated="true" class="read_csv" compatibility="6.0.002" expanded="true" height="60" name="Read CSV" width="90" x="45" y="30">
            <parameter key="csv_file" value="C:\Users\username\Desktop\test.csv"/>
            <parameter key="column_separators" value=","/>
            <parameter key="date_format" value="yyyy-MM-dd:HH:mm"/>
            <parameter key="first_row_as_names" value="false"/>
            <list key="annotations"/>
            <parameter key="encoding" value="UTF-8"/>
            <list key="data_set_meta_data_information">
              <parameter key="0" value="att1.true.polynominal.attribute"/>
              <parameter key="1" value="att2.true.binominal.attribute"/>
              <parameter key="2" value="att3.true.binominal.attribute"/>
              <parameter key="3" value="att4.true.integer.attribute"/>
              <parameter key="4" value="att5.true.real.attribute"/>
              <parameter key="5" value="att6.true.attribute_value.attribute"/>
              <parameter key="6" value="att7.true.attribute_value.attribute"/>
              <parameter key="7" value="att8.true.binominal.attribute"/>
              <parameter key="8" value="att9.true.binominal.attribute"/>
            </list>
          </operator>
          <operator activated="true" class="nominal_to_date" compatibility="6.0.002" expanded="true" height="76" name="Nominal to Date" width="90" x="179" y="30">
            <parameter key="attribute_name" value="att8"/>
            <parameter key="date_format" value="yyyy-MM-dd"/>
          </operator>
          <operator activated="true" class="nominal_to_date" compatibility="6.0.002" expanded="true" height="76" name="Nominal to Date (2)" width="90" x="313" y="30">
            <parameter key="attribute_name" value="att9"/>
            <parameter key="date_type" value="time"/>
            <parameter key="date_format" value="HH:mm"/>
          </operator>
          <connect from_op="Read CSV" from_port="output" to_op="Nominal to Date" to_port="example set input"/>
          <connect from_op="Nominal to Date" from_port="example set output" to_op="Nominal to Date (2)" to_port="example set input"/>
          <connect from_op="Nominal to Date (2)" from_port="example set output" to_port="result 1"/>
          <portSpacing port="source_input 1" spacing="0"/>
          <portSpacing port="sink_result 1" spacing="0"/>
          <portSpacing port="sink_result 2" spacing="0"/>
        </process>
      </operator>
    </process>
    Regards,
    Marco