nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Siemens Community Catalyst Program

The Siemens Community Catalyst program was co-created with our community to acknowledge technology leaders who consistently contribute to the Siemens Community. Nominations are accepted on a rolling basis.

Nominate Now

New guy - learning how to clean up and parse a CSV file

WesCo2019

I am new to data analysis and preparing a data set. I have a CSV file with the time stamp in the following format: "2018/05/14:12:00:00 PM."

What is a recommended way to "parse" the time stamp into Year, date, and time components to make it easier to sort and filter?

Thanks!

Find more posts tagged with

AI Studio

CSV

ETL + Data Prep

Accepted answers

sgenzer

hi @WesCo2019 - you're going to want to first put it into a date-time data type:

As for parsing, I would use "Generate Attributes" to create separate attributes for each piece you want:

<?xml version="1.0" encoding="UTF-8"?><process version="9.0.003">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="9.0.003" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="retrieve" compatibility="9.0.003" expanded="true" height="68" name="Retrieve Lake Huron" width="90" x="45" y="34">
        <parameter key="repository_entry" value="//Samples/Time Series/data sets/Lake Huron"/>
      </operator>
      <operator activated="true" class="generate_attributes" compatibility="9.0.003" expanded="true" height="82" name="Generate Attributes" width="90" x="179" y="34">
        <list key="function_descriptions">
          <parameter key="Year" value="date_get(Date,DATE_UNIT_YEAR)"/>
          <parameter key="Month" value="date_get(Date,DATE_UNIT_MONTH)"/>
          <parameter key="Week" value="date_get(Date,DATE_UNIT_WEEK)"/>
          <parameter key="Day" value="date_get(Date,DATE_UNIT_DAY)"/>
          <parameter key="Hour" value="date_get(Date,DATE_UNIT_HOUR)"/>
        </list>
      </operator>
      <connect from_op="Retrieve Lake Huron" from_port="output" to_op="Generate Attributes" to_port="example set input"/>
      <connect from_op="Generate Attributes" from_port="example set output" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="0"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>

Hope that helps.

Scott

All comments

sgenzer

hi @WesCo2019 - you're going to want to first put it into a date-time data type:

As for parsing, I would use "Generate Attributes" to create separate attributes for each piece you want:

<?xml version="1.0" encoding="UTF-8"?><process version="9.0.003">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="9.0.003" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="retrieve" compatibility="9.0.003" expanded="true" height="68" name="Retrieve Lake Huron" width="90" x="45" y="34">
        <parameter key="repository_entry" value="//Samples/Time Series/data sets/Lake Huron"/>
      </operator>
      <operator activated="true" class="generate_attributes" compatibility="9.0.003" expanded="true" height="82" name="Generate Attributes" width="90" x="179" y="34">
        <list key="function_descriptions">
          <parameter key="Year" value="date_get(Date,DATE_UNIT_YEAR)"/>
          <parameter key="Month" value="date_get(Date,DATE_UNIT_MONTH)"/>
          <parameter key="Week" value="date_get(Date,DATE_UNIT_WEEK)"/>
          <parameter key="Day" value="date_get(Date,DATE_UNIT_DAY)"/>
          <parameter key="Hour" value="date_get(Date,DATE_UNIT_HOUR)"/>
        </list>
      </operator>
      <connect from_op="Retrieve Lake Huron" from_port="output" to_op="Generate Attributes" to_port="example set input"/>
      <connect from_op="Generate Attributes" from_port="example set output" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="0"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>

Hope that helps.

Scott

hughesfleming68

You can also define the date-time format in the csv import wizard and save one step. Which I see Scott has already pointed out. I didn't see the first image.

Telcontar120

Or you can use "Date to Numerical" and then specify the date component you want to extract.

WesCo2019

Thanks to all for the helpful insght

Quick Links

Upcoming Events

Advancing power electronics design with Simcenter PSIM and High-Performance Computing
Join us for a community conversation on how High-Performance Computing (HPC) and Simcenter PSIM work together to meet the increasing demands of modern power electronics simulation. During this one-hour technical session, you'll discover how leveraging HPC can speed up simulations, improve scalability, and empower engineers…
Getting Started with Faster Motor Building in Simcenter Simlab
Join us for a community conversation on accelerating your motor simulation workflow with Simcenter Simlab. In this beginner-friendly session, we'll introduce the platform's automated model-building capabilities and show how easy it is to set up your first electric motor analysis. You'll see the basic steps of geometry…
Practical hybrid solver workflows in Simcenter Feko
Join us for a Community Conversation where we'll discuss practical approaches to analyzing complex electromagnetic models using hybrid solver techniques. This session will provide a general overview of how different computational methods can be combined within a single simulation to address models containing varied…

View all community events