"Attribute weight operator"
Hi,
is there an operator that assigns weights to attributes via the attribute name (maybe with regular expressions)? I looked at the docs but I didn't find anything. There's the InteractiveAttributeWeighting operator but I have too many features (text classification). If there's not such an operator I will write one myself. This should actually be pretty easy.
Thanks
is there an operator that assigns weights to attributes via the attribute name (maybe with regular expressions)? I looked at the docs but I didn't find anything. There's the InteractiveAttributeWeighting operator but I have too many features (text classification). If there's not such an operator I will write one myself. This should actually be pretty easy.
Thanks
Find more posts tagged with
Sort by:
1 - 7 of
71
For anybody who's interested:
import java.util.List;
import java.util.regex.Pattern;
import java.util.regex.PatternSyntaxException;
import com.rapidminer.example.Attribute;
import com.rapidminer.example.AttributeWeights;
import com.rapidminer.example.ExampleSet;
import com.rapidminer.operator.OperatorDescription;
import com.rapidminer.operator.OperatorException;
import com.rapidminer.operator.features.weighting.AbstractWeighting;
import com.rapidminer.parameter.ParameterType;
import com.rapidminer.parameter.ParameterTypeDouble;
import com.rapidminer.parameter.ParameterTypeList;
public class AttributeWeighting extends AbstractWeighting {
private static final String WEIGHTING_PARAMETER = "regex";
public AttributeWeighting(OperatorDescription description) {
super(description);
}
@Override
public AttributeWeights calculateWeights(ExampleSet exampleSet) throws OperatorException {
AttributeWeights attributeWeights = new AttributeWeights();
for (Attribute attribute : exampleSet.getAttributes()) {
attributeWeights.setWeight(attribute.getName(), 1);
}
@SuppressWarnings("unchecked")
List<Object[]> list = getParameterList(WEIGHTING_PARAMETER);
for (Object[] entry : list) {
String regex = (String) entry[0];
Double weighting = (Double) entry[1];
if (regex != null && weighting != null) {
try {
Pattern pattern = Pattern.compile(regex);
for (Attribute attribute : exampleSet.getAttributes()) {
String attributeName = attribute.getName();
if (pattern.matcher(attributeName).matches()) {
attributeWeights.setWeight(attributeName, weighting);
}
}
} catch (PatternSyntaxException e) {
logWarning(regex + " is not a valid regular expression!");
}
}
}
return attributeWeights;
}
@Override
public List<ParameterType> getParameterTypes() {
List<ParameterType> parameters = super.getParameterTypes();
ParameterType weighting = new ParameterTypeList(WEIGHTING_PARAMETER, "Regex -> Weighting", new ParameterTypeDouble("weighting", "weighting", 0, Double.MAX_VALUE, false));
weighting.setExpert(false);
parameters.add(weighting);
return parameters;
}
}
Wow, that's fast 8)
I would really like to add your contribution to the official release if you do not object. If this is ok to you, I would like to ask if you could sign the joint copyright assignment (known from Open Office, basically it only states that both parties, i.e. you and Rapid-I, have the copyright for the contribution) and send it to us. Then we are able to add the new operator to the official release. If you like to contribute, just download and sign the JCA under
http://rapid-i.com/component/option,com_docman/task,doc_download/gid,26/Itemid,62/
Since we have to adapt the code a bit anyway to stick to our coding standards, this is of course not too much of an issue but I would like to get things right first.
Cheers,
Ingo
I would really like to add your contribution to the official release if you do not object. If this is ok to you, I would like to ask if you could sign the joint copyright assignment (known from Open Office, basically it only states that both parties, i.e. you and Rapid-I, have the copyright for the contribution) and send it to us. Then we are able to add the new operator to the official release. If you like to contribute, just download and sign the JCA under
http://rapid-i.com/component/option,com_docman/task,doc_download/gid,26/Itemid,62/
Since we have to adapt the code a bit anyway to stick to our coding standards, this is of course not too much of an issue but I would like to get things right first.
Cheers,
Ingo
Ok, I will sign the JCA and send it via old fashioned mail in the next days.
mierswa wrote:
Wow, that's fast 8)
I would really like to add your contribution to the official release if you do not object. If this is ok to you, I would like to ask if you could sign the joint copyright assignment (known from Open Office, basically it only states that both parties, i.e. you and Rapid-I, have the copyright for the contribution) and send it to us. Then we are able to add the new operator to the official release. If you like to contribute, just download and sign the JCA under
http://rapid-i.com/component/option,com_docman/task,doc_download/gid,26/Itemid,62/
Since we have to adapt the code a bit anyway to stick to our coding standards, this is of course not too much of an issue but I would like to get things right first.
Cheers,
Ingo
nice idea but there is currently no operator for this, sorry.
Cheers,
Ingo