nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Siemens Community Catalyst Program

The Siemens Community Catalyst program was co-created with our community to acknowledge technology leaders who consistently contribute to the Siemens Community. Nominations are accepted on a rolling basis.

Nominate Now

Significance testing

lsevel

Hi all,

I'm interested in comparing the performance of an algorithm to chance with a significance test. I understand there's a t-test operator that may allow me to do this but I'm not sure how exactly. Could anyone offer some advice?

Thanks!

Find more posts tagged with

AI Studio

Accepted answers

All comments

earmijo

There is an operator T-test. There is an example process that illustrates its use. Click on the operator (Evaluation/Significante) and in the help Tab you'll get a description of the operator and a link to the illustrative process.

lsevel

I'm aware of this operator but it assumes a paired t-test and requires two input vectors. Is it necessary to build a 'chance' classifier or is there another way to compare one model to chance?

rachel_lomasky

I also have this question. I'd like to do a proportion test on rows of a data grid, not model performance vectors. Is this possible?

Thanks,

Rachel

sgenzer

Hello - not sure what you mean by a “proportion test”. Maybe you’re looking for a correlation matrix?

Scott

rachel_lomasky

What is prop.test in R. Which I just ended up using as a RapidMiner operator.

sgenzer

Ah I see. Never heard of prop.test but it looks like basically chi-squared independence / goodness of fit to me. @land does your stats extension do this? Anything in the toolbox, @mschmitz?

Scott

land

Hi,

we have Chi-Square test but not no direct prop.test equivalent. But seems it is solved by integrating R?

Greetings,

Sebastian

rachel_lomasky

Yeah, I'm happy with just using the R function.

Quick Links

Upcoming Events

Advancing power electronics design with Simcenter PSIM and High-Performance Computing
Join us for a community conversation on how High-Performance Computing (HPC) and Simcenter PSIM work together to meet the increasing demands of modern power electronics simulation. During this one-hour technical session, you'll discover how leveraging HPC can speed up simulations, improve scalability, and empower engineers…
Getting Started with Faster Motor Building in Simcenter Simlab
Join us for a community conversation on accelerating your motor simulation workflow with Simcenter Simlab. In this beginner-friendly session, we'll introduce the platform's automated model-building capabilities and show how easy it is to set up your first electric motor analysis. You'll see the basic steps of geometry…
Practical hybrid solver workflows in Simcenter Feko
Join us for a Community Conversation where we'll discuss practical approaches to analyzing complex electromagnetic models using hybrid solver techniques. This session will provide a general overview of how different computational methods can be combined within a single simulation to address models containing varied…

View all community events