Long Short-Term Memory Approach for Predicting Air Temperature In Indonesia

Authors

  • Putu Harry Gunawan School of Computing, Telkom University, Indonesia http://orcid.org/0000-0002-3635-894X
  • Devi Munandar The Indonesian Institute of Sciences, Bandung, Indonesia
  • Anis Zainia Farabiba School of Computing, Telkom University, Indonesia

DOI:

https://doi.org/10.15575/join.v5i2.551

Keywords:

Air temperature, Deep learning, Long short-term memory, Prediction

Abstract

Air temperature is one of the main factors for describing the weather behaviour in the earth. Since Indonesia is located on and near equator, then monitoring the air temperature is needed to determine either global climate change occurs or not. Climate change can have an impact on biological growth in various fields. For instance, climate change can affect the quality of production and growth of animal and plants. Therefore, air temperature prediction is important to meteorologists and Indonesian government to provide information in many sectors. Various prediction algorithms have been used to predict temperature and produce different accuracy. In this study, the deep learning method with Long Short-Term Memory (LSTM) model is used to predict air temperature. Here, the results show that LSTM model with one layer and Adaptive Moment Estimation (ADAM) optimizer produce accuracy which is 32% of , 0.068 of MAE and 0.99 of RMSE. Moreover, here, ADAM optimizer is found better than Stochastic Gradient Descent (SGD) optimizer.

References

S. E. Page, R. Wust, D. Weiss, J. O. Rieley, W. Shotyk, and S. H. Limin, “A record of late pleistocene and holocene carbon accumulation and climate change from an equatorial peat bog (kalimantan, indonesia): implications for past, present and future carbon dynamics,†Journal of Quaternary Science, vol. 19, no. 7, pp. 625–635, 2004.

F. Nhita et al., “A rainfall forecasting using fuzzy system based on genetic algorithm,†in Information and Communication Technology (ICoICT), 2013 International Conference. IEEE, 2013, pp. 111–115.

A. Klein Tank, J. Wijngaard, G. Konnen, R. Bohm, G. Demaree, A. Gocheva, M. Mileta, S. Pashiardis, L. Hejkrlik, C. Kern-Hansen et al., “Daily dataset of 20th-century surface air temperature and precipitation series for the european climate assessment,†International Journal of Climatology: A Journal of the Royal Meteorological Society, vol. 22, no. 12, pp. 1441–1453, 2002.

J. Priyana and A. M. Abadi, “Peramalan suhu udara di yogyakarta dengan menggunakan model fuzzy,†in Prosiding Seminar Nasional Penelitian, Pendidikan dan Penerapan MIPA: Fakultas MIPA Universitas Negeri Yogyakarta, 2011.

C. O. Alm, D. Roth, and R. Sproat, “Emotions from text: machine learning for text-based emotion prediction,†in Proceedings of the conference on human language technology and empirical methods in natural language processing. Association for Computational Linguistics, 2005, pp. 579–586.

H. Nielsen, S. Brunak, and G. von Heijne, “Machine learning approaches for the prediction of signal peptides and other protein sorting signals,†Protein engineering, vol. 12, no. 1, pp. 3–9, 1999.

P. M. Ferreira, E. Faria, and A. Ruano, “Neural network models in greenhouse air temperature prediction,†Neurocomputing, vol. 43, no. 1-4, pp. 51–75, 2002.

B. A. Smith, R. W. McClendon, and G. Hoogenboom, “Improving air temperature prediction with artificial neural networks,†International Journal of Computational Intelligence, vol. 3, no. 3, pp. 179–186, 2006.

C. Inard, H. Bouia, and P. Dalicieux, “Prediction of air temperature distribution in buildings with a zonal model,†Energy and buildings, vol. 24, no. 2, pp. 125–132, 1996.

H. Swaid and M. E. Hoffman, “Prediction of urban air temperature variations using the analytical cttc model,†Energy and Buildings, vol. 14, no. 4, pp. 313–324, 1990.

R. F. Chevalier, G. Hoogenboom, R. W. McClendon, and J. A. Paz, “Support vector regression with reduced training sets for air temperature prediction: a comparison with artificial neural networks,†Neural Computing and Applications, vol. 20, no. 1, pp. 151–159, 2011.

S. Hochreiter and J. Schmidhuber, “Long short-term memory,†Neural computation, vol. 9, no. 8, pp. 1735–1780, 1997.

A. Graves, N. Jaitly, and A.-r. Mohamed, “Hybrid speech recognition with deep bidirectional lstm,†in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on. IEEE, 2013, pp. 273–278.

A. Graves and J. Schmidhuber, “Offline handwriting recognition with multidimensional recurrent neural networks,†in Advances in neural information processing systems, 2009, pp. 545–552.

I. Sutskever, J. Martens, and G. E. Hinton, “Generating text with recurrent neural networks,†in Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 1017–1024.

O. Vinyals, A. Toshev, S. Bengio, and D. Erhan, “Show and tell: A neural image caption generator,†in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3156–3164.

I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to sequence learning with neural networks,†in Advances in neural information processing systems, 2014, pp. 3104–3112.

Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,†nature, vol. 521, no. 7553, p. 436, 2015.

A. Graves and J. Schmidhuber, “Framewise phoneme classification with bidirectional lstm and other neural network architectures,†Neural Networks, vol. 18, no. 5-6, pp. 602–610, 2005.

H. Sak, A. Senior, and F. Beaufays, “Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition,†arXiv preprint arXiv:1402.1128, 2014.

W. Zaremba, I. Sutskever, and O. Vinyals, “Recurrent neural network regularization,†arXiv preprint arXiv:1409.2329, 2014.

A. Geron, ´ Hands-on machine learning with Scikit-Learn and TensorFlow: concepts, tools, and techniques to build intelligent systems.†O’Reilly Media, Inc.â€, 2017.

S. Hochreiter, Y. Bengio, P. Frasconi, J. Schmidhuber et al., “Gradient flow in recurrent nets: the difficulty of learning long-term dependencies,†Sepp Hochreiter Fakult at f ur Informatik, 2001.

J. Han, J. Pei, and M. Kamber, Data mining: concepts and techniques. Elsevier, 2011.

M. Berry and G. Linoff, Mastering data mining: The art and science of customer relationship management. John Wiley & Sons, Inc., 1999.

Z. Liu and C. J. Sullivan, “Prediction of weather induced background radiation fluctuation with recurrent neural networks,†Radiation Physics and Chemistry, 2018.

A. Graves, “Generating sequences with recurrent neural networks,†arXiv preprint arXiv:1308.0850, 2013.

Downloads

Published

2020-12-03

Issue

Vol. 5 No 2 (2020)

Section

Article

Citation Check

License

You are free to:

 

Under the following terms:

  • Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

  • NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.

  • No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

 

Notices:

  • You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
  • No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.

Creative Commons License
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License