AR Make-up Filter for Social Media using the HSV Color Extraction


  • Maisevli Harika Department of Computer and Informatics, Politeknik Negeri Bandung, Bandung 40559, Indonesia
  • Setiadi Rachmat Department of Computer and Informatics, Politeknik Negeri Bandung, Bandung 40559, Indonesia
  • Nurul Dewi Aulia Department of Informatics, UIN Sunan Gunung Djati Bandung, Bandung 40614, Indonesia, Indonesia
  • Zulfa Audina Dwi Department of Informatics, UIN Sunan Gunung Djati Bandung, Bandung 40614, Indonesia, Indonesia
  • Vandha Pradwiyasma Widartha Department of IT Convergence and Application Engineering, Pukyong National University, Busan 48513, South Korea, Korea, Republic of



Augmented reality, HSV, Cosmetics, Social media, Filter


Choosing the appropriate cosmetics is an arduous task. Because cosmetics are tested directly on the skin to ensure each person’s preferences are met. The consumer repeatedly tries a sample and then discards it until he discovers one that meets his tastes. The cosmetics business and consumers are affected by this move. Companies can utilize Augmented Reality (AR) technology as an alternative to mass-producing cosmetic samples. The difficulty of deploying augmented reality is the difficulty of putting cosmetics into camera video streams. Each individual bears the burden of skin color and its effect on light. HSV Color Extraction was the method employed for this study. The application of augmented reality intends to enable consumers to test cosmetics with their chosen color and assist businesses in competing in the industry by promoting items and engaging customers. This work makes it easier to choose cosmetics using augmented reality and social media. AR simulates the usage of the desired color cosmetics, whereas social media allows users to obtain feedback on their color preferences. The outcomes of this study indicate that augmented reality (AR) apps can display filters in bright, dim, and even wholly dark lighting conditions. This research contributes originality that cosmetic firms can utilize to market their products on social media.

Author Biography

Maisevli Harika, Department of Computer and Informatics, Politeknik Negeri Bandung, Bandung 40559

Scopus Profile


V. R. Mileva, A. L. Jones, R. Russell, and A. C. Little, “Sex Differences in the Perceived Dominance and Prestige of Women With and Without Cosmetics,†Perception, vol. 45, no. 10, pp. 1166–1183, 2016, doi: 10.1177/0301006616652053.

V. A. Nandasari and A. Suyanto, “Pengaruh Brand Image, Harga Dan Kualitas Produk Terhadap Keputusan Pembelian Produk Skincare Korea Melalui Beauty Vlogger (The Influence of Brand Image, Price and Product Quality on Purchase Decisions for Korean Skincare Products Through Beauty Vloggers),†eProceedings Manag., vol. 8, no. 6, 2021.

V. T. Aliska, “Pengaruh Merek, Negara Asal (Country Of Origin) Dan Reputasi Merek Terhadap Sikap Konsumen Dalam Memilih Produk Kosmetik Korea Innisfree (The Influence of Brand, Country of Origin and Brand Reputation on Consumer Attitudes in Choosing Innisfree Korean Cosmetic).†Universitas Muhammadiyah Jember, 2020.

A. KARTIKASARI, “Pengaruh Country Of Origin Dan Exposure To Korean Culture Terhadap Niat Beli Dengan Sikap Konsumen Pada Skin Care Korea (The Influence of Country Of Origin And Exposure To Korean Culture On Purchase Intentions With Consumer Attitudes To Korean Skin Care).†Universitas Airlangga, 2019.

E. APRILIANI, “Analisis Peran Media Dalam Mempengaruhi Remaja Wanita Usia 20-An Dalam Menggunakan Make Up Korean Style Di Dki Jakarta (Analysis of the Role of the Media in Influencing Young Women in their 20s in Using Korean Style Make Up in DKI Jakarta),†Organization, p. 18, 2000.

A. Nisa, B. Prihatminingtyas, and W. Agustim, “Pengaruh Bauran Pemasaran (Marketing Mix) 9P Terhadap Trend Hallyu (Korean Wave) Dalam Mempengaruhi Keputusan Pembelian Skin care (The Effect of 9P Marketing Mix on the Hallyu Trend (Korean Wave) In Influencing Skin Care Purchasing Decisions).†Fakultas Ekonomi dan Universitas Tribhuwana Tungga Dewi Malang, 2022.

M. A. Firnas, “Pengaruh Korean Wave Terhadap Maraknya Produk Dan Tren Kosmetik Korea Selatan (K-BEAUTY) Di Indonesia Periode 2017-2020 (The Influence of the Korean Wave on the Rise of South Korean Cosmetic Products and Trends (K-BEAUTY) in Indonesia in the 2017-2020 Per.†Program Studi Ilmu Hubungan Internasional Fakultas Ilmu Sosial Dan Ilmu ….

A. Nafli, “Hubungan Antara Citra Diri Dengan Perilaku Konsumtif Membeli Produk Make Up Pada Wanita Karir (Relationship Between Self-Image and Consumptive Behavior of Buying Make Up Products in Career Women).†UIN Raden Intan Lampung, 2019.

N. Febriani and W. W. A. Dewi, Perilaku Konsumen di Era Digital: Beserta Studi Kasus (Consumer Behavior in the Digital Age: Along with Case Studies). Universitas Brawijaya Press, 2019.

Y.-C. Tan, S. R. Chandukala, and S. K. Reddy, “Augmented reality in retail and its impact on sales,†J. Mark., vol. 86, no. 1, pp. 48–66, 2022.

A. R. Smink, S. Frowijn, E. A. van Reijmersdal, G. van Noort, and P. C. Neijens, “Try online before you buy: How does shopping with augmented reality affect brand responses and personal data disclosure,†Electron. Commer. Res. Appl., vol. 35, p. 100854, 2019.

E. S. Post and S. B. Petersen, “Augmented Reality: A Beneficial Tool for Marketing Cosmetics?â€.

S. Almomani, “Assessment of Virtual Reality technology as a tool to enhance beauty and skincare e-commerce targeting Gen X, Millennials and Gen Z in Dubai, United Arab Emirates.†The British University in Dubai (BUiD), 2020.

V. Rodner, A. Goode, and Z. Burns, “‘Is it all just lip service?’: on Instagram and the normalisation of the cosmetic servicescape,†J. Serv. Mark., 2021.

S. Erbaş, “Augmented Reality Applications in Advertisements: A Qualitative Research on the Cosmetics Industry,†A New Perspect. Soc. Sci., p. 263.

G. Jha and S. Gupta, “Future of augmented reality in healthcare department,†in Proceedings of Second International Conference on Computing, Communications, and Cyber-Security, 2021, pp. 667–678.

H.-T. Feng, “The Effect of Augmented Reality on Purchase Intention: Examples of Beauty Cosmetic Products,†2021.

R. Jaswal, “Augmented Reality’s Effect on Online Cosmetics Consumer Purchasing Patterns: A Study on Virtual Artists at Sephora,†Turkish J. Comput. Math. Educ., vol. 12, no. 12, pp. 730–737, 2021.

A. Elder, C. Ring, K. Heitmiller, Z. Gabriel, and N. Saedi, “The role of artificial intelligence in cosmetic dermatology—current, upcoming, and future trends,†J. Cosmet. Dermatol., vol. 20, no. 1, pp. 48–52, 2021.

T. Chandran and F. Othman, “AR Makeup Tester: Design and Development of Augmented Reality based on Makeup Tester to support Product Testing,†Appl. Inf. Technol. Comput. Sci., vol. 3, no. 1, pp. 19–32, 2022.

E. Borromeo, A. S. Delos Santos, and S. M. C. Tomas, “AR virtual try-on application of MAC Cosmetics and purchase intention mediated by AR experience among Gen Y beauty consumers,†2021.

N. Mangtani, N. Bajpai, S. Sahasrabudhe, and D. Wasule, “Importance Of Artificial Intelligence And Augmented Reality In Cosmetic And Beauty Industry Post Covid 19,†2020.

I. S. Jang, J. W. Kim, J. Y. You, and J. S. Kim, “Spectrum-Based color reproduction algorithm for makeup simulation of 3d facial avatar,†ETRI J., vol. 35, no. 6, pp. 969–979, 2013, doi: 10.4218/etrij.13.2013.0079.

A. D. F. S. Borges and C. H. Morimoto, “A virtual makeup augmented reality system,†in Proceedings - 2019 21st Symposium on Virtual and Augmented Reality, SVR 2019, 2019, pp. 34–42. doi: 10.1109/SVR.2019.00022.

P. Hedman, V. Skepetzis, K. Hernandez-Diaz, J. Bigun, and F. Alonso-Fernandez, “On the effect of selfie beautification filters on face detection and recognition,†Pattern Recognit. Lett., vol. 163, pp. 104–111, 2022, doi: 10.1016/j.patrec.2022.09.018.

M. Harika and D. R. Ramdania, “Rancang Bangun Pengontrol Presentasi Berbasis Slide dengan Teknik Analisis Gerakan Jari dan Tangan,†J. Online Inform., vol. 1, no. 2, 2016, doi: 10.15575/join.v1i2.45.

J. Pardede, M. G. Husada, A. N. Hermana, and S. A. Rumapea, “Fruit Ripeness Based on RGB, HSV, HSL, L ab Color Feature Using SVM,†in 2019 International Conference of Computer Science and Information Technology (ICoSNIKOM), 2019, pp. 1–5.

F. G. Waldamichael, T. G. Debelee, and Y. M. Ayano, “Coffee disease detection using a robust HSV colorâ€based segmentation and transfer learning for use on smartphones,†Int. J. Intell. Syst., vol. 37, no. 8, pp. 4967–4993, 2022.

Y. A. Gerhana, W. B. Zulfikar, A. H. Ramdani, and M. A. Ramdhani, “Implementation of nearest neighbor using HSV to identify skin disease,†in IOP Conference Series: Materials Science and Engineering, 2018, vol. 288, no. 1, p. 12153.

A. Zarkasi, S. Nurmaini, D. Stiawan, and C. D. Amanda, “Implementation of fire image processing for land fire detection using color filtering method,†in Journal of Physics: Conference Series, 2019, vol. 1196, no. 1, p. 12003.

F. Islami, “Implementation of HSV-based Thresholding Method for Iris Detection,†J. Comput. Networks, Archit. High Perform. Comput., vol. 3, no. 1, pp. 97–104, 2021.

A. H. Pratomo, W. Kaswidjanti, A. S. Nugroho, and S. Saifullah, “Parking detection system using background subtraction and HSV color segmentation,†Bull. Electr. Eng. Informatics, vol. 10, no. 6, pp. 3211–3219, 2021.

L. Li, X. Mu, S. Li, and H. Peng, “A Review of Face Recognition Technology,†IEEE Access, vol. 8, pp. 139110–139120, 2020, doi: 10.1109/ACCESS.2020.3011028.

A. Davison, “Face detection and tracking,†in Killer Game Programming in Java, 2011, vol. 2, no. May, pp. 1–17. [Online]. Available:

G. Rafael C and W. Richard E, “Digital image processing.†Prentice Hall, 2002.

E. Kemal and Y. Nihat, “Shifting Colors to Overcome not Realizing Objects Problem due to Color Vision Deficiency,†in Conf. on Advances in Computing, Electronics and Electrical Technology, 2014, no. December, pp. 11–14. [Online]. Available:

M. A. Sayeed, “Detecting Crows on Sowed Crop Fields using Simplistic Image processing Techniques by Open CV in comparison with TensorFlow Image Detection API,†in International Journal for Research in Applied Science and Engineering Technology, 2020, vol. 8, no. 3, pp. 61–73. doi: 10.22214/ijraset.2020.3014.

C. Donner and H. W. Jensen, “A Spectral BSSRDF for Shading Human Skin,†Eurographics, vol. 2006, no. 5, p. 147, 2006, [Online]. Available:







Citation Check