Loading...
2017
Design of a Platform for Collecting and Analyzing Agricultural Big Data
농업 빅데이터 수집 및 분석을 위한 플랫폼 설계
한국디지털콘텐츠학회
김경백
논문정보
- Publisher
- 디지털컨텐츠학회논문지
- Issue Date
- 2017-02-28
- Keywords
- -
- Citation
- -
- Source
- -
- Journal Title
- -
- Volume
- 18
- Number
- 1
- Start Page
- 149
- End Page
- 158
- DOI
- ISSN
- 15982009
Abstract
Big data have been presenting us with exciting opportunities and challenges in economic development. For instance, in the agriculture sector, mixing up of various agricultural data (e.g., weather data, soil data, etc.), and subsequently analyzing these data deliver valuable and helpful information to farmers and agribusinesses. However, massive data in agriculture are generated in every minute through multiple kinds of devices and services such as sensors and agricultural web markets. It leads to the challenges of big data problem including data collection, data storage, and data analysis. Although some systems have been proposed to address this problem, they are still restricted either in the type of data, the type of storage, or the size of data they can handle. In this paper, we propose a novel design of a platform for collecting and analyzing agricultural big data. The proposed platform supports (1) multiple methods of collecting data from various data sources using Flume and MapReduce; (2) multiple choices of data storage including HDFS, HBase, and Hive; and (3) big data analysis modules with Spark and Hadoop.
- 전남대학교
- KCI
- 디지털컨텐츠학회논문지
저자 정보
| 이름 | 소속 |
|---|---|
| 김경백 | 인공지능융합학과 |