Open Access Open Access  Restricted Access Subscription or Fee Access

A Novel Framework to Monitor and Test the Performance of Mobile Applications


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/irecap.v12i1.21497

Abstract


Mobile applications (apps) are being widely used around the world. The long-term success and diffusion of a mobile app depends on it being well-tested, with respect to its performance and its reliability. Mobile app testing is typically carried out in multiple stages. An app is first tested for performance and reliability in a controlled lab-like environment during its development. However, the heterogeneity of in-the-field environments (including many device profiles, network speeds, etc.) is far greater than in a lab setting, with a small group of users. For this reason, a so-called Beta version of the app is typically rolled-out to a limited number of users, to get deeper insights into its performance and reliability in the field. After the Beta test results are analyzed, and refinements are incorporated, the application is released to all of its intended users. However, this work is based on a belief that field testing should be an automatic and ongoing process. Field test data, representing the actual performance and reliability of the app in the field, should be continuously fed back to the developer. To accomplish this, this paper proposes a framework for ongoing monitoring and field testing of mobile apps. This framework includes a library that mobile app developers can use to collect performance and reliability data during ongoing extensive field testing. These data are collected and presented using a web form to inform developers about the performance and reliability of their apps as they are being used by end-users in the field.
Copyright © 2022 Praise Worthy Prize - All rights reserved.

Keywords


Mobile Applications; Monitoring; Performance; Testing; App Developers

Full Text:

PDF


References


A. S. Ami, M. M. Hasan, M. R. Rahman and K. Sakib, MobiCoMonkey - Context Testing of Android Apps, 2018 IEEE/ACM 5th International Conference on Mobile Software Engineering and Systems (MOBILESoft), 2018, pp. 76-79.
https://doi.org/10.1145/3197231.3197234

H. Khalid, E. Shihab, M. Nagappan, and A. E. Hassan, What do mobile app users complain about?, IEEE software, Vol. 32, no. 3, pp. 70-77, 2014.
https://doi.org/10.1109/MS.2014.50

J. Gao, L. Li, T. F. Bissyandé and J. Klein, On the Evolution of Mobile App Complexity, 2019 24th International Conference on Engineering of Complex Computer Systems (ICECCS), 2019, pp. 200-209.
https://doi.org/10.1109/ICECCS.2019.00029

K. S. Arif and U. Ali, Mobile Application testing tools and their challenges: A comparative study, 2019 2nd International Conference on Computing, Mathematics and Engineering Technologies (iCoMET), 2019, pp. 1-6.
https://doi.org/10.1109/ICOMET.2019.8673505

Gao, R., Wang, Y., Feng, Y. et al. Successes, challenges, and rethinking - an industrial investigation on crowdsourced mobile application testing. Empir Software Eng 24, 537-561 (2019).
https://doi.org/10.1007/s10664-018-9618-5

B. Zaid, R. Jamaludin, and B. Wafaa, A comparative study of usability methods for mobile applications, International Journal of Scientific & Engineering Research, Vol. 3, no. 8, pp. 1-4, 2012.

J. Kjeldskov and C. Graham. A review of mobile HCI research methods, International Conference on Mobile Human-Computer Interaction, Springer, Berlin, Heidelberg, 2003.
https://doi.org/10.1007/978-3-540-45233-1_23

Sauer, Juergen; Sonderegger, Andreas; Heyden, Klaus; Biller, Jasmin; Klotz, Julia; Uebelbacher, Andreas (2019). Extra-laboratorial usability tests: An empirical comparison of remote and classical field testing with lab testing. Applied Ergonomics, 74(), 85-96.
https://doi.org/10.1016/j.apergo.2018.08.011

C. M. Nielsen, M. Overgaard, M. B. Pedersen, J. Stage, and S. Stenild, It's worth the hassle! the added value of evaluating the usability of mobile systems in the field, In Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, pp. 272-280, 2006.
https://doi.org/10.1145/1182475.1182504

C. M. Liang, N. D. Lane, N. Brouwers, L. Zhang, B. Karlsson, H. Liu, Y. Liu, J. Tang, X. Shan, R. Chandra, and F. Zhao, Context virtualizer: A cloud service for automated large-scale mobile app testing under real-world conditions, Technical report, Microsoft, 2013.

B. Kirubakaran and V. Karthikeyani. Mobile application testing-Challenges and solution approach through automation, 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering (PRIME), IEEE, 2013.
https://doi.org/10.1109/ICPRIME.2013.6496451

M. E. Joorabchi, A. Mesbah, and P. Kruchten. Real challenges in mobile app development, International Symposium on Empirical Software Engineering and Measurement, 2013 ACM/IEEE. IEEE, 2013.
https://doi.org/10.1109/ESEM.2013.9

G. Bano et al., Comparative analysis of Mobile Application Testing and Crowd Source Software Testing, 2019 8th International Conference on Information and Communication Technologies (ICICT), 2019, pp. 129-134.
https://doi.org/10.1109/ICICT47744.2019.9001991

Gamido, Heidilyn Veloso, and Marlon Viray Gamido. Comparative review of the features of automated software testing tools. International Journal of Electrical and Computer Engineering 9.5 (2019): 4473.
https://doi.org/10.11591/ijece.v9i5.pp4473-4478

S. She, S. Sivapalan, and I. Warren, Hermes: A tool for testing mobile device applications, Software Engineering Conference, 2009. ASWEC'09, Australian, IEEE, 2009.
https://doi.org/10.1109/ASWEC.2009.17

Luo, Chu, Jorge Goncalves, Eduardo Velloso, and Vassilis Kostakos. A survey of context simulation for testing mobile context-aware applications. ACM Computing Surveys (CSUR) 53, no. 1 (2020): 1-39.
https://doi.org/10.1145/3372788

L. Nagowah and G. Sowamber, A novel approach of automation testing on mobile devices, Computer & Information Science (ICCIS), 2012 International Conference on, Vol. 2, IEEE, 2012.
https://doi.org/10.1109/ICCISci.2012.6297158

Pareek, Peeyush, and Swati V. Chande. Grey Box Approach for Mobile Application Testing. Rising Threats in Expert Applications and Solutions. Springer, Singapore, 2021. 411-419.
https://doi.org/10.1007/978-981-15-6014-9_47

R. Huang, W. Sun, Y. Xu, H. Chen, D. Towey and X. Xia, A Survey on Adaptive Random Testing, in IEEE Transactions on Software Engineering, vol. 47, no. 10, pp. 2052-2083, 1 Oct. 2021.
https://doi.org/10.1109/TSE.2019.2942921

N. Mirzaei, S. Malek, C. S. Păsăreanu, N. Esfahani, and R. Mahmood, Testing android apps through symbolic execution, ACM SIGSOFT Software Engineering Notes, Vol. 37, no. 6, pp. 1-5, 2012.
https://doi.org/10.1145/2382756.2382798

S. Hao, B. Liu, S. Nath, W. G. Halfond, and R. Govindan, Puma: Programmable ui-automation for large-scale dynamic analysis of mobile apps, In Proceedings of the 12th annual international conference on Mobile systems, applications, and services, pp. 204-217, 2014.
https://doi.org/10.1145/2594368.2594390

L. Ravindranath, S. Nath, J. Padhye, and H. Balakrishnan, Automatic and scalable fault detection for mobile applications, In Proceedings of the 12th annual international conference on Mobile systems, applications, and services, pp. 190-203, 2014.
https://doi.org/10.1145/2594368.2594377

R. Chandra, B. F. Karlsson, N. Lane, C. M. Liang, S. Nath, J. Padhye, L. Ravindranath, and F. Zhao. Towards scalable automated mobile app testing, Technical report, Technical Report MSR-TR-2014-44, 2014.

C. M. Liang, N. D. Lane, N. Brouwers, L. Zhang, B. F. Karlsson, H. Liu, Y. Liu, J. Tang, X. Shan, R. Chandra, and F. Zhao, Caiipa: Automated large-scale mobile app testing through contextual fuzzing, In Proceedings of the 20th annual international conference on Mobile computing and networking, pp. 519-530, 2014.
https://doi.org/10.1145/2639108.2639131

Girardon, Gustavo, et al. Testing as a service (TaaS) a systematic literature map. Proceedings of the 35th Annual ACM Symposium on Applied Computing. 2020.
https://doi.org/10.1145/3341105.3374004

P. Graubner, L. Baumgärtner, P. Heckmann, M. Müller, and B. Freisleben, Dynalize: Dynamic analysis of mobile apps in a platform-as-a-service cloud, In 2015 IEEE 8th International Conference on Cloud Computing, pp. 925-932, IEEE, 2015.
https://doi.org/10.1109/CLOUD.2015.126

L. Ravindranath, J. Padhye, S. Agarwal, R. Mahajan, I. Obermiller, and S. Shayandeh, Appinsight: Mobile app performance monitoring in the wild, In 10th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 12), pp. 107-120, 2012.

Mun, Hyunsu, and Youngseok Lee. Appspeedxray: A mobile application performance measurement tool. Proceedings of the 35th Annual ACM Symposium on Applied Computing. 2020.
https://doi.org/10.1145/3341105.3375773

M. Ceccato, L. Gazzola, F. M. Kifetew, L. Mariani, M. Orrù and P. Tonella, Toward In-Vivo Testing of Mobile Applications, 2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW), 2019, pp. 137-143.
https://doi.org/10.1109/ISSREW.2019.00063

Aji, S. H., A. T. Saputra, and R. N. Tuada. Development of physics mobile learning media in optical instruments for senior high school student using android studio. Journal of Physics: Conference Series. Vol. 1440. No. 1. IOP Publishing, 2020.
https://doi.org/10.1088/1742-6596/1440/1/012032

Software Asset Management - Microsoft SAM.
www.microsoft.com/en-jo

Professional ASP.NET Hosting with Unlimited Space and Bandwidth and Email. SmarterASP.net - Unlimited ASP.NET Web Hosting. www.smarterasp.net/

Fiddler - Free Web Debugging Proxy - Telerik. Telerik Blogs, Telerik. www.telerik.com/fiddler

Panggabean, G., Girsang, A., Integration of Completion Management System Using Service-Oriented Architecture, (2019) International Journal on Engineering Applications (IREA), 7 (4), pp. 117-123.
https://doi.org/10.15866/irea.v7i4.17581


Refbacks

  • There are currently no refbacks.



Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize