Market basket analysis data preprocess
Hi all! I am extremely new to Rapidminer (only got introduced recently). I am trying to conduct a market basket analysis with the given CSV file. The example is something like this:
ID,Item
C1,yogurt,cheese roll,cat pork
C2,chicken,yogurt,pork,soda,whipped/sour cream
C3,beef
C4,onions,liquor
C5,soda,whipped/sour cream
...
C2000,soda,cheese roll,yogurt
I understand I will need to apply FP-Growth followed by Association rule in Rapidminer. I have read through a few previous post but can't understand how to process this set of data.
I am trying to get it into a binary matrix where it will be like then apply the association rule.
Is there an easy way in Rapidminer 9.8 that can quickly transform this set of data into binary matrix or any other ways to preprocessed this kind of data for market basket analysis? If yes, how should I do it?
End result should be something like:
yogurt cheese roll....
C1 1 1
C2 1 0
C3 0 0
....
where x axis will be all the unique products in the basket
y axis is the customer ID
Thanks!
ID,Item
C1,yogurt,cheese roll,cat pork
C2,chicken,yogurt,pork,soda,whipped/sour cream
C3,beef
C4,onions,liquor
C5,soda,whipped/sour cream
...
C2000,soda,cheese roll,yogurt
I understand I will need to apply FP-Growth followed by Association rule in Rapidminer. I have read through a few previous post but can't understand how to process this set of data.
I am trying to get it into a binary matrix where it will be like then apply the association rule.
Is there an easy way in Rapidminer 9.8 that can quickly transform this set of data into binary matrix or any other ways to preprocessed this kind of data for market basket analysis? If yes, how should I do it?
End result should be something like:
yogurt cheese roll....
C1 1 1
C2 1 0
C3 0 0
....
where x axis will be all the unique products in the basket
y axis is the customer ID
Thanks!
Find more posts tagged with
Sort by:
1 - 5 of
51
Altair EmployeeHi @newjop228 ,
for awhile you do not need to change the format anymore, since we changed the FP-Grwoth operator to also work with list data like yours. The format you have is called 'item list in column'. It is the first parameter of Fp-Growth.
Cheers,
Martin
Hey @mschmitz , thanks for the reply!
Cool that is great! I have tested it out but my results show nothing.
Operators:
Retrieve -> FP-Growth -> Create association rules -> output
Results:
FrequentItemSet(FP-growth) - no itemset found
AssociationRules(Create association rules) - No rules found
Any idea?
Cool that is great! I have tested it out but my results show nothing.
Operators:
Retrieve -> FP-Growth -> Create association rules -> output
Results:
FrequentItemSet(FP-growth) - no itemset found
AssociationRules(Create association rules) - No rules found
Any idea?
Altair EmployeeHi,
did you try to lower the min_support setting of FP-Growth? This basically controls how strong the rule needs to be to find it. The lower the more results you get.
Cheers,
Martin
Thanks @mschmitz. May I ask one last thing - for association rule, do I have to arrange the products to have an effective analysis? That is, column 1 will be "yogurt" and all customerID, column 2 will be "chicken". Or the association rule do not require me to arrange these products?
Altair EmployeeHi,
order should not make a difference.
Best,
Martin
Sort by:
1 - 1 of
11
Altair EmployeeHi @newjop228 ,
for awhile you do not need to change the format anymore, since we changed the FP-Grwoth operator to also work with list data like yours. The format you have is called 'item list in column'. It is the first parameter of Fp-Growth.
Cheers,
Martin