Operator nominal to numerical error

Bifruan
Bifruan New Altair Community Member
edited November 5 in Community Q&A
My data is 700,000 records with 8 Attributes.
When I start to operate "nominal to numerical" the error is occur that "need more memory"
but my computer is 8 GB with 512 SSD and Core I5 Gen 11
Is that my spec of my computer is not enough for this operation?
what I can do to fix this problem?
Tagged:

Answers

  • MartinLiebig
    MartinLiebig
    Altair Employee
    Hi,
    how many different classes are in your column? If you have a 700.000 different values in one column, than this operator simply creates 700.000 new columns. This means you roughly increase your data set by the factor 700.000.

    Best,
    Martin
  • Bifruan
    Bifruan New Altair Community Member
    There are 5000 different classes in one column so is it possible that rapidminer can create 5000 new column.
    And Is that student license affect to limit of the operation rows?

    Best Regards
  • MartinLiebig
    MartinLiebig
    Altair Employee
    edited February 2021
    no it does come from your edu license.You increased your data set size from
    700.000x8 = 5.6 Million data entries
    to
    700.000x5000 = 3.5 Billion data entries.
    Thats just killing your laptop. I would either choose something like target encoding or try to reduce the number of different classes i.e. with Replace Rare Values or manual mapping

    Best,
    Martin


  • Marco_Barradas
    Marco_Barradas
    Altair Employee
    @Bifruan hi what type of model are you trying to build, from the picture you uploaded i see that you are taking a basket ID in the operator. I'm guessing you are using some kind of transactions dataset, may basket analysis, why do you need to convert your ID to individual columns?


Categories