Loading...
2017
Efficient Association Rule Mining based SON Algorithm for a Bigdata Platform
빅데이터 플랫폼을 위한 SON알고리즘 기반의 효과적인 연관 룰 마이닝
한국디지털콘텐츠학회
김경백
논문정보
- Publisher
- 디지털컨텐츠학회논문지
- Issue Date
- 2017-12-31
- Keywords
- -
- Citation
- -
- Source
- -
- Journal Title
- -
- Volume
- 18
- Number
- 8
- Start Page
- 1593
- End Page
- 1601
- DOI
- ISSN
- 15982009
Abstract
In a big data platform, association rule mining applications could bring some benefits. For instance, in a agricultural big data platform, the association rule mining application could recommend specific products for farmers to grow, which could increase income. The key process of the association rule mining is the frequent itemsets mining, which finds sets of products accompanying together frequently. Former researches about this issue, e.g. Apriori, are not satisfying enough because huge possible sets can cause memory to be overloaded. In order to deal with it, SON algorithm has been proposed, which divides the considered set into many smaller ones and handles them sequently. But in a single machine, SON algorithm cause heavy time consuming. In this paper, we present a method to find association rules in our Hadoop based big data platform, by parallelling SON algorithm. The entire process of association rule mining including pre-processing, SON algorithm based frequent itemset mining, and association rule finding is implemented on Hadoop based big data platform. Through the experiment with real dataset, it is conformed that the proposed method outperforms a brute force method.
- 전남대학교
- KCI
- 디지털컨텐츠학회논문지
저자 정보
| 이름 | 소속 |
|---|---|
| 김경백 | 인공지능융합학과 |