Research Hub

대학 자원

대학 인프라와 자원을 공유해 공동 연구와 기술 활용을 지원합니다.

Loading...

논문 리스트

2021
Distribution Analysis of Feature Map and Gradients in Mobilenet and Resnet Model Layers using Glorot and He`s initialization Glorot과 He의 초기화를 이용한 Mobilenet 및 Resnet 모델 레이어의 형상도 및 경사도 분포 분석
한국디지털콘텐츠학회
김진영 외 3명
논문정보
Publisher
디지털콘텐츠학회논문지
Issue Date
2021-10-31
Keywords
-
Citation
-
Source
-
Journal Title
-
Volume
22
Number
10
Start Page
1721
End Page
1731
DOI
ISSN
15982009
Abstract
Initializing the weights plays an essential role in a convolutional neural network model. This paper investigates how Glorot and He''s initialization methods behave in Mobilenet and Resnet models on the weeds classification problem. Experiments show that pointwise and depthwise convolution in Mobilenet reduces the variance of feature maps from earlier layers. Using the He’s method, shortcut connection in Resnet saturate values in logistic classify layer. The accuracy of Mobilenet and Resnet, using Glorot''s method, are 0.9568 and 0.9711, respectively. While using He''s method, we obtain 0.9471 using Mobilenet and 0.9645 using Resnet. Also, both models converge faster and better generalization using Glorot''s method than using He''s method.

저자 정보

이름 소속
김진영 지능전자컴퓨터공학과