Z-Trasformation

cristiano
cristiano New Altair Community Member
edited November 5 in Community Q&A
Dear listers,
I've build a model with some Z-transformed variables,

I should pre-transform the variables than apply the model, but the transformation is affected by the mean and the standard deviation of the new dataset values.

So If I apply the model and his rules on the new dataset, the prediction is not always the same, is related to the 'shape' of the new data.

Where I'm wrong?



Thanks for your attention.

Cristiano.
Tagged:

Answers

  • land
    land New Altair Community Member
    Hi Cristiano,
    the Normalization operator will return a preprocessing model. This contains the 'shape' (mean and std. deviation) of the original data and can be applied on new data.

    Simply apply the preprocessing model first, the the prediction model...

    Greetings,
      Sebastian
  • cristiano
    cristiano New Altair Community Member
    WOW

    Thanks for your support!

    So I should use 2 'Apply Model' , the first is for preprocessing and the second for the model,

    In the first node:
    the model input is the proprocessing output of the normalized original data
    data: normalized new data

    In the second node:
    the model input is the original model
    data: labeled data of the first node(normalized new data)


    Is it correct?

    Thanks again for your attention.

    Cristiano.
  • land
    land New Altair Community Member
    Yes, correct :)
  • cristiano
    cristiano New Altair Community Member
    Sebastian Land wrote:

    Yes, correct :)
    Thanks Sebastian,
    when I read the content of preprocessing model I see:

    Normalize 33 attributes to mean 0 and variance 1.
    Using var1 --> mean 0.1

    ... 28 more attributes ..
    .

    How I see other normalize parameter's attributes?

    Thanks for your support.

    Cristiano.
  • cristiano
    cristiano New Altair Community Member
    cristiano wrote:

    Thanks Sebastian,
    when I read the content of preprocessing model I see:

    Normalize 33 attributes to mean 0 and variance 1.
    Using var1 --> mean 0.1

    ... 28 more attributes ..
    .

    How I see other normalize parameter's attributes?

    Thanks for your support.


    You can write the parameters with 'WriteModel' Operator, easy isn't it? ,)



    Cristiano.

  • land
    land New Altair Community Member
    Hi,
    which other parameters?

    Greetings,
      Sebastian
  • cristiano
    cristiano New Altair Community Member
    Sebastian Land wrote:

    Hi,
    which other parameters?

    Greetings,
      Sebastian
    Hi,
    Just mean and variance.

    C.
  • land
    land New Altair Community Member
    Ups,
    they aren't shown? Hm. Please make a feature request for that. Normally this should be displayable, since I saw that it is saved in the models.

    Greetings,
      Sebastian