Research Hub

대학 자원

대학 인프라와 자원을 공유해 공동 연구와 기술 활용을 지원합니다.

Loading...

논문 리스트

2017
Efficient Association Rule Mining based SON Algorithm for a Bigdata Platform 빅데이터 플랫폼을 위한 SON알고리즘 기반의 효과적인 연관 룰 마이닝
한국디지털콘텐츠학회
김경백
논문정보
Publisher
디지털컨텐츠학회논문지
Issue Date
2017-12-31
Keywords
-
Citation
-
Source
-
Journal Title
-
Volume
18
Number
8
Start Page
1593
End Page
1601
DOI
ISSN
15982009
Abstract
In a big data platform, association rule mining applications could bring some benefits. For instance, in a agricultural big data platform, the association rule mining application could recommend specific products for farmers to grow, which could increase income. The key process of the association rule mining is the frequent itemsets mining, which finds sets of products accompanying together frequently. Former researches about this issue, e.g. Apriori, are not satisfying enough because huge possible sets can cause memory to be overloaded. In order to deal with it, SON algorithm has been proposed, which divides the considered set into many smaller ones and handles them sequently. But in a single machine, SON algorithm cause heavy time consuming. In this paper, we present a method to find association rules in our Hadoop based big data platform, by parallelling SON algorithm. The entire process of association rule mining including pre-processing, SON algorithm based frequent itemset mining, and association rule finding is implemented on Hadoop based big data platform. Through the experiment with real dataset, it is conformed that the proposed method outperforms a brute force method.

저자 정보

이름 소속
김경백 인공지능융합학과