Due to the negative impact on the environment, the demand for solar energy, which can effectively replace fossil fuels, is increasing. In order to operate solar energy efficiently, deep learning has been used recently to predict future power generation, but it is still achallenge to provide accurate predictions because the power generation greatly depends on external factors such as weather and timeof day. In this paper, we propose a hybrid model that combines LSTM and Linear models using Multi-Head Attention to provide moreaccurate predictions. The proposed model can improve prediction accuracy and learn richer time series features because each Linearmodel can capture trends and irregularities in time series features. We conducted extensive experiments, and the results showed thatthe proposed model outperformed other prediction models by about 10%, and the ablation study confirmed that combining three modelsbased on Multi-Head Attention is the most effective way to consider trends and irregularities.