Linear Regression using p-value

Suppose you are building optimization process for feature selection that shave off the variables of less importance. You can use the “Forward Selection”, “Backward Elimination”, or other feature engineering operators. But we are using the performance (RMSE, AUC, accuracy, precision, recall, f-score, etc.) measurement of the predictive models not the p-value to select the significant variables. 

In RapidMiner, only Generalized Linear Model or Logistic Regression could return a table of p-values. So we can build iterative loops to select important variables according to the p-values from GLM/LR. My attached process shows a simplified version (no iteration) of feature selection by p-values from GLM. Other non-linear models or ensembled regression models may not have p-values. Attached process is an example to drop variables with nonsignificant p-values. You will need the converters extension from Marketplace to run the process. The converter is used to extract the p-value from linear regression model to shave off the non-significant attributes...

Cheers,

YY