nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Siemens Community Catalyst Program

The Siemens Community Catalyst program was co-created with our community to acknowledge technology leaders who consistently contribute to the Siemens Community. Nominations are accepted on a rolling basis.

Nominate Now

Can RapidMiner de-identify or make data anonymous?

CraigBostonUSA

Is it possible to anonymize or de-identify data with RapidMiner?

Thanks!

Find more posts tagged with

AI Studio

Accepted answers

sgenzer

yup. Try "Obfuscate".

Scott

All comments

sgenzer

yup. Try "Obfuscate".

Scott

earmijo

I think "obfuscate" will mask some variables, but that's all it does. Look into other specialized software to do anonymization (k-anonymization, l-diversity, etc). I have one in mind:

I've used it and it is very powerful:

http://arx.deidentifier.org/

sgenzer

Obfuscate will anonymize nominal attribute names and nominal data values:

<?xml version="1.0" encoding="UTF-8"?><process version="7.6.001">
  <context>
    <input/>
    <output/>
    <macros/>
  </context>
  <operator activated="true" class="process" compatibility="7.6.001" expanded="true" name="Process">
    <process expanded="true">
      <operator activated="true" class="retrieve" compatibility="7.6.001" expanded="true" height="68" name="Retrieve Iris" width="90" x="179" y="136">
        <parameter key="repository_entry" value="//Samples/data/Iris"/>
      </operator>
      <operator activated="true" class="productivity:obfuscate" compatibility="7.6.001" expanded="true" height="82" name="Obfuscate" width="90" x="380" y="136">
        <parameter key="use_local_random_seed" value="true"/>
      </operator>
      <connect from_op="Retrieve Iris" from_port="output" to_op="Obfuscate" to_port="example set input"/>
      <connect from_op="Obfuscate" from_port="example set output" to_port="result 1"/>
      <portSpacing port="source_input 1" spacing="0"/>
      <portSpacing port="sink_result 1" spacing="0"/>
      <portSpacing port="sink_result 2" spacing="0"/>
    </process>
  </operator>
</process>

I agree that this is not extremely robust and would recommend a proper hashing algorithm of some kind if you truly want to protect your data and/or you have numerical values. Often I will create a hash myself using a form of public key crypto rather than use obfuscate.

Thanks for the suggestion for that software, @earmijo - I will need to check that out.

Scott

earmijo

Hi Scott. I am currently learning about the subject. The handling of PII (personal identifiers) by completely masking them is standard. The key problem with anonymization is what to do with quasi-identifiers. If you completely mask them, the dataset is rendered useless. Finding the right balance between usefulness and anonymity seems to be goal (there are some researchers that believe this compromise is not possible. See for instance: The False Promise of Anonymization : "Data can be either useful or perfectly anonymous but never both.") A nice intro to the main issues is discussed in this video

https://www.youtube.com/watch?v=O3hxp117EHs

sgenzer

that is very interesting @earmijo. Thank you for sharing. I worked a lot with PII-sensitive data when I was freelancing (mostly FERPA compliance here in the USA - protecting PII of student data from schools) and I like the way you phrase this tough quandary. Food for thought.

Scott

MartinLiebig

Hey @earmijo,

looks like a lot of brain food for me . Since your linked library is java - have you considered to embed this into RM as operators?

Cheers,

Martin

earmijo

Hi @mschmitz

That would be awesome (an extension linking both applications). Unfortunately, it is beyond my skills. I know how to drive the car, but I have no idea what's under the hood :-)

MartinLiebig

Hi,

an important question first - how good is your Java?

Best,

Martin

Telcontar120

Maybe @sgenzer another simpler option would be add this one to the API dev list since it looks like some of the basics would be interoperable that way: http://arx.deidentifier.org/api/

But clearly the best option would be to develop a full extension using their API toolkit (they have a lot of options)!

sgenzer

excellent idea, @Telcontar120. Noted. @mschmitz and I are making some (very slow) progress on this project. Delay is purely my fault - I am an abysmal Java programmer and the rest of the dev team is completely booked with RM8.0. We will get there!

Scott

Quick Links

Upcoming Events

Advancing power electronics design with Simcenter PSIM and High-Performance Computing
Join us for a community conversation on how High-Performance Computing (HPC) and Simcenter PSIM work together to meet the increasing demands of modern power electronics simulation. During this one-hour technical session, you'll discover how leveraging HPC can speed up simulations, improve scalability, and empower engineers…
Getting Started with Faster Motor Building in Simcenter Simlab
Join us for a community conversation on accelerating your motor simulation workflow with Simcenter Simlab. In this beginner-friendly session, we'll introduce the platform's automated model-building capabilities and show how easy it is to set up your first electric motor analysis. You'll see the basic steps of geometry…
Practical hybrid solver workflows in Simcenter Feko
Join us for a Community Conversation where we'll discuss practical approaches to analyzing complex electromagnetic models using hybrid solver techniques. This session will provide a general overview of how different computational methods can be combined within a single simulation to address models containing varied…

View all community events