Receipt Image Extraction in Budgeting Mobile Application

Authors

  • Rou Yi Wong
  • Ping Ping Tan Universiti Malaysia Sarawak

DOI:

https://doi.org/10.33736/tur.6110.2024

Keywords:

budgeting mobile application, Computer Vision, Optical Character Recognition (OCR), Form Recognizer, receipt extraction

Abstract

Money is spent and received almost daily. In most cases, receipts are issued after making a transaction.  Budgeting mobile applications let users record these transactions for the purpose of tracking and managing their budget and money flow.  The normal budgeting application let users input their transactions manually.  In this paper, we proposed an improved feature: computer vision to capture the receipts and extract the data from the receipts.The technology used to extract the data of receipt is Microsoft Azure Form Recognizer which is a specialized Optical Character Recognizer (OCR) service that helps to extract form-like data. The user is required to take a picture of a receipt then the data of the receipt would be extracted. This would help to save the time for the user to repeat the steps to record the transaction by entering the details such as name, amount, date and so on one by one. The tools used for development are Android Studio and Visual Studio Code. Azure Services including Azure Web App Service, Azure Database for MySQL flexible server and Azure Form Recognizer are utilized in this project to develop a web-hosting budgeting mobile application. After the development of the application is done, the real application was tested by 30 respondents and received positive feedback from the respondents where 86.7% of the respondents agreed that the receipt scanning feature and its ability to automatically fill in the transaction details were satisfactory.This budgeting mobile app has the potential to reduce the mistake through manual keying in.

References

Caldwell, M. (2022). Why You Need to Track Expenses to Become Aware of Your Spending. The Balance. Retrieved from https://www.thebalancemoney.com/is-it-important-to-track-my-expenses-2385679#toc-reasons-to-keep-track-of-expenditures

Candra, S., Sisodia, S., & Gupta, P. (2020). Optical Character Recognition – A Review. International Research Journal of Engineering and Technology, 07(04), 3037-3041.

Chien, C. (2020). What is Rapid Application Development (RAD)? Retrieved from https://codebots.com/app-development/what-is-rapid-application-development-rad

Easy Expense. (n.d.). Easy Expense. Retrieved from https://easy-expense.com/

Garcia, M. B., & Claour, J. P. (2021, November). Mobile bookkeeper: personal financial management application with receipt scanner using optical character recognition. In 2021 1st Conference on Online Teaching for Mobile Education (OT4ME) (pp. 15-20). IEEE.

Horton, C. (2022, April). What is a Budget App? The Balance. Retrieved from https://www.thebalancemoney.com/what-is-a-budget-app-5216548

Kumar, V., Kaware, P., Singh, P., Sonkusare, R., & Kumar, S. (2020, September). Extraction of information from bill receipts using optical character recognition. In 2020 international conference on smart electronics and communication (ICOSEC) (pp. 72-77). IEEE.

Microsoft Azure. (2020). How to call the Read API. Microsoft Learn. Retrieved from https://learn.microsoft.com/en-us/azure/cognitive-services/computer-vision/how-to/call-read-api

Monefy. (n.d.). Monefy. Retrieved from https://monefy.me/

Naz, R. & Khan, M. N. A. (2015). Rapid Applications Development Techniques: A Critical Review, 9(11), 163-176.

Polak, P., Nelischer, C., Guo, H., & Robertson, D. C. (2020). “Intelligent” finance and treasury management: what we can expect. Ai & Society, 35(3), 715-726.

RinggitPlus. (2023). Malaysian Financial Literacy Survey 2023. Retrieved from https://ringgitplus.com/en/blog/wp-content/uploads/2023/10/RMFLS-2023-Survey-Report-FINAL.pdf

Robert,V. & Talbot, H. (2020). Does Super-Resolution Improve OCR Performance In The Real World? A Case Study On Images Of Receipts. 2020 IEEE International Conference on Image Processing (ICIP), 548-552.

Downloads

Published

2024-06-28

How to Cite

Wong, R. Y., & Tan, P. P. (2024). Receipt Image Extraction in Budgeting Mobile Application. Trends in Undergraduate Research, 7(1), c16–25. https://doi.org/10.33736/tur.6110.2024

Issue

Section

Computer Science and Information Technology