Fault Injection via Code Mutation for Dependability Assessment in Cloud Environments

Guilherme Silva; Erica Sousa

doi:10.22456/2175-2745.149183

Authors

Guilherme Silva Universidade Federal Rural de Pernambuco https://orcid.org/0009-0007-8286-3801
Erica Sousa Universidade Federal Rural de Pernambuco

DOI:

https://doi.org/10.22456/2175-2745.149183

Keywords:

cloud environment, dependability, software fault injection, OpenStack

Abstract

Software fault injection assesses the resilience of complex systems, especially in cloud environments with multiple interdependent components. Since many software releases contain bugs not detected by traditional testing, this technique simulates realistic failures (e.g., by code mutation) to observe system behavior under defects, identify vulnerabilities before production, and understand how failures propagate. This paper presents CIMut, a fault injection tool through source code mutation in cloud environments, publicly available as a web application. The proposed approach was evaluated through an experimental study on the OpenStack cloud platform. A total of 62 experiments were performed on OpenStack, each injecting faults into different system components. The study showed that 96.7% of the injected faults resulted in bugs, classified as explicit errors (crashes, exceptions) or bugs with functional impact (incorrect behavior, data loss). These results demonstrate that the CIMut tool can generate representative faults that can be used to assess the resilience of complex software systems such as OpenStack.

Downloads

Download data is not yet available.

Author Biographies

Guilherme Silva, Universidade Federal Rural de Pernambuco

Universidade Federal Rural de Pernambuco, Recife, Pernambuco.

Erica Sousa, Universidade Federal Rural de Pernambuco

Universidade Federal Rural de Pernambuco, Recife, Pernambuco.

References

[1] BRADLEY, A. Cloud computing transformation: leveraging AI for predictive resource management. 2023. ResearchGate. Disponível em: ⟨https://www.researchgate.net/publication/385781616⟩. Acesso em: 24 maio 2025.

[2] SAYEGH, E. How cloud computing revolutionized business operations and what lies ahead. 2023. Forbes. Disponível em: ⟨https://www.forbes.com/sites/emilsayegh/2023/11/28/how-cloud-computing-revolutionized-business-operations-and-what-lies-ahead/⟩. Acesso em: 24 maio 2025.

[3] CLOUD computing and firm performance: Evidence from IT investment. 2023. International Review of Financial Analysis. Disponível em: ⟨https://l1nq.com/mtREk⟩. Acesso em: 24 maio 2025.

[4] RED HAT. Red Hat Recognized as a Leader in 2024 Gartner® Magic Quadrant™ for Cloud Application Platforms. 2024. Press release.

[5] LI, Y. et al. Predicting node failures in an ultra-large-scale cloud computing platform: An AIOps solution. ACM Transactions on Software Engineering and Methodology, v. 29, n. 2, 2020.

[6] ABED, A. H. The techniques of authentication in the context of cloud computing. International Journal of Advanced Networking and Applications, v. 16, n. 04, p. 6515–6522, 2025.

[7] AHMAD, A. A.-S.; ANDRAS, P. Scalability resilience framework using application-level fault injection for cloud-based software services. Journal of Cloud Computing: Advances, Systems and Applications, v. 11, n. 1, p. 1–17, 2022. Disponível em: ⟨https://encr.pw/Yp3Sy⟩. Acesso em: 24 maio 2025.

[8] COTRONEO, D. et al. Fault Injection Analytics: A Novel Approach to Discover Failure Modes in Cloud-Computing Systems. 2020. ArXiv preprint arXiv:2010.00331. Disponível em: ⟨https://arxiv.org/abs/2010.00331⟩. Acesso em: 24 maio 2025.

[9] NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY (NIST). The NIST Definition of Cloud Computing. [S.l.], 2011. Special Publication 800-145. Disponível em: ⟨https://csrc.nist.gov/publications/detail/sp/800-145/final⟩. Acesso em: 24 maio 2025.

[10] INTERNATIONAL ORGANIZATION FOR STANDARDIZATION (ISO). Information technology – Cloud computing – Part 1: Vocabulary. [S.l.], 2023. ISO/IEC 22123-1:2023(E).

[11] KHOMCHAK, M. Enterprise private cloud platforms: A systematic review of key vendors. International Journal of Wireless and Microwave Technologies, v. 14, n. 4, p. 1–14, 2024.

[12] TOZZI, C. Why Private Clouds May See a Resurgence in 2024. 2024. ITPro Today. Acesso em: 24 maio 2025.

[13] RED HAT. OpenShift. 2025. ⟨https://www.openshift.com/learn/what-is-openshift⟩. Acesso em: 19 fev. 2025.

[14] APACHE CloudStack: Open-Source Cloud Computing. 2025. Apache CloudStack website. Acesso em: 24 maio 2025.

[15] OpenNebula 2023: Year in Review. 2024. Blog OpenNebula Systems. Acesso em: 24 maio 2025.

[16] Cloudify: Open-Source Multi-Cloud Orchestration Platform. 2024. ⟨https://docs.cloudify.co/latest/about/what-is-cloudify/⟩. Cloudify Documentation Center. Acesso em: 23 maio 2026.

[17] NURMI, D. et al. The Eucalyptus open-source cloud-computing system. In: 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID). Shanghai, China: IEEE, 2009. p. 124–131. DOI: 10.1109/CCGRID.2009.93.

[18] CHOWDHURY, D. D. Cloud networking. In: Future of Networks: Modern Communication Infrastructure. Cham: Springer Nature Switzerland, 2025. p. 79–123.

[19] VANKAYALAPATI, R. K. The future of hybrid cloud: Trends, technologies, and predictions. In: The Synergy Between Public and Private Clouds in Hybrid Infrastructure Models: Real-World Case Studies and Best Practices. [S.l.: s.n.], 2025. p. 148.

[20] OPEN Source Cloud Computing Platform Software – OpenStack. 2024. Website. Disponível em: ⟨https://www.openstack.org/software/project-navigator/openstack-components⟩. Acesso em: 12 fev. 2024.

[21] MACIEL, P. Performance, Reliability, and Availability Evaluation of Computational Systems. Volume I: Performance and Background. Boca Raton: CRC Press, 2022. DOI: 10.1201/9781003306016.

[22] NATELLA, R.; COTRONEO, D.; MADEIRA, H. S. Assessing dependability with software fault injection: A survey. ACM Computing Surveys, v. 48, n. 3, p. 44:1–44:55, fev. 2016. DOI: 10.1145/2841425.

[23] SHUVO, A. M. et al. A Comprehensive Survey on Non-Invasive Fault Injection Attacks. 2023. Cryptology ePrint Archive, Paper 2023/1769. Disponível em: ⟨https://eprint.iacr.org/2023/1769⟩. Acesso em: 24 maio 2025.

[24] DURAES, J. A.; MADEIRA, H. S. Emulation of software faults: A field data study and a practical approach. IEEE Transactions on Software Engineering, v. 32, n. 11, p. 849–867, nov. 2006. DOI: 10.1109/TSE.2006.113.

[25] NATELLA, R. et al. On fault representativeness of software fault injection. IEEE Transactions on Software Engineering, v. 39, n. 1, p. 80–96, jan. 2013. DOI: 10.1109/TSE.2011.124.

[26] KUMAR, S.; MUTTOO, S. K.; SINGH, V. B. Classification of software defects using orthogonal defect classification. International Journal of Open Source Software and Processes, v. 13, n. 1, p. 1–16, 2022. DOI: 10.4018/IJOSSP.300749.

[27] BANABIC, R.; CANDEA, G. Fast black-box testing of system recovery code. In: Proceedings of the 7th ACM European Conference on Computer Systems – EuroSys ’12. [S.l.: s.n.], 2012.

[28] MEIKLEJOHN, C. Resilient Microservice Applications, by Design, and without the Chaos. Tese (Doutorado) — Carnegie Mellon University, 2024.

[29] KAO, W.; IYER, R. K. DEFINE: A distributed fault injection and monitoring environment. In: Proceedings of IEEE Workshop on Fault-Tolerant Parallel and Distributed Systems. College Station, TX, USA: [s.n.], 1994. p. 252–259. DOI: 10.1109/FTPDS.1994.494497.

[30] DAI, Y.; LIU, S.; LIU, H. Mutation-based approach to supporting human-machine pair inspection. Electronics, v. 14, n. 2, p. 382, 2025.

[31] SOUZA, D. et al. EucaBomber: Experimental evaluation of availability in Eucalyptus private clouds. In: 2013 IEEE International Conference on Systems, Man, and Cybernetics. Manchester, UK: IEEE, 2013. p. 4080–4085. DOI: 10.1109/SMC.2013.696.

[32] ARAÚJO, J. et al. Availability and reliability modeling of mobile cloud architectures. IEEE Transactions on Industrial Informatics, 2023.

[33] SEGALL, Z. et al. FIAT – fault injection based automated testing environment. In: Twenty-Fifth International Symposium on Fault-Tolerant Computing, 1995, 'Highlights from Twenty-Five Years'. Pasadena, CA, USA: IEEE, 1995. p. 394. DOI: 10.1109/FTCSH.1995.532663.

[34] AMYAN, A. et al. Automating fault test cases generation and execution for automotive safety validation via NLP and HIL simulation. Sensors, v. 24, n. 10, p. 3145, 2024.

[35] LATTNER, C. et al. MLIR: Scaling compiler infrastructure for domain specific computation. In: Proceedings of the IEEE/ACM International Symposium on Code Generation and Optimization (CGO). [S.l.]: IEEE, 2021. p. 2–14.

[36] JOSHI, P.; GUNAWI, H. S.; SEN, K. PREFAIL: A programmable tool for multiple-failure injection. SIGPLAN Notices, v. 46, n. 10, p. 171–188, out. 2011.

[37] KHAN, H. U.; ALI, F.; NAZIR, S. Systematic analysis of software development in cloud computing perceptions. Journal of Software: Evolution and Process, v. 36, n. 2, p. e2485, 2024.

[38] COTRONEO, D. et al. ProFIPy: Programmable software fault injection as-a-service. In: 2020 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN). Valencia, Spain: IEEE, 2020. p. 364–372. DOI: 10.1109/DSN48063.2020.00052.

[39] SALIH, N. K.; GOPAL, R. Optimization software fault injection by using two-dimensional bin packing algorithms. Journal of Electrical Systems, v. 20, n. 10s, p. 6638–6645, 2024.

[40] YALÇIN, G. et al. FIMSIM: A fault injection infrastructure for microarchitectural simulators. In: 2011 IEEE 29th International Conference on Computer Design (ICCD). Amherst, MA, USA: IEEE, 2011. p. 431–432. DOI: 10.1109/ICCD.2011.6081435.

[41] ASADOVA, F.; KERTÉSZ, G.; LOVAS, R. Simulation-based network fault injection in the CloudSim Plus cloud simulation environment. Azerbaijan Journal of High Performance Computing, v. 6, n. 1, 2023.

[42] CHOI, G. S.; IYER, R. K. FOCUS: An experimental environment for fault sensitivity analysis. IEEE Transactions on Computers, v. 41, n. 12, p. 1515–1526, dez. 1992. DOI: 10.1109/12.214660.

[43] KANAWATI, G. A.; KANAWATI, N. A.; ABRAHAM, J. A. FERRARI: A tool for validating system dependability properties. In: Digest of Papers. FTCS-22: The Twenty-Second International Symposium on Fault-Tolerant Computing. Boston, MA, USA: IEEE, 1992. p. 336–344. DOI: 10.1109/FTCS.1992.243567.

[44] TSAI, T.; IYER, R. K. Measuring fault tolerance with the FTAPE fault injection tool. In: Dependable Computing – EDCC-3. [S.l.]: Springer Berlin Heidelberg, 1999, (Lecture Notes in Computer Science, v. 1667). p. 26–43. DOI: 10.1007/BFb0024305.

[45] ARLAT, J. et al. Fault injection for dependability validation: A methodology and some applications. IEEE Transactions on Software Engineering, v. 16, n. 2, p. 166–182, fev. 1990.

[46] MADEIRA, H. et al. RIFLE: A general purpose pin-level fault injector. In: ECHTLE, K.; HAMMER, D.; POWELL, D. (Ed.). Dependable Computing – EDCC-1. Berlin, Heidelberg: Springer Berlin Heidelberg, 1994, (Lecture Notes in Computer Science, v. 852). p. 197–216. DOI: 10.1007/3-540-58426-9_132.

[47] SALIH, N. K. et al. A survey on software/hardware fault injection tools and techniques. In: 2022 IEEE Symposium on Industrial Electronics & Applications (ISIEA). [S.l.]: IEEE, 2022. p. 1–7.

[48] CARREIRA, J.; MADEIRA, H.; SILVA, J. Xception: Software fault injection and monitoring in processor functional units. In: Proceedings of the 5th IFIP Working Conference on Dependable Computing for Critical Applications. [S.l.: s.n.], 2001.

[49] COTRONEO, D.; SIMONE, L. D.; NATELLA, R. ThorFI: A novel approach for network fault injection as a service. arXiv preprint arXiv:2201.07521, 2022.

[50] RED Hat Bugzilla. 2024. ⟨https://bugzilla.redhat.com/⟩. Acesso em: 12 fev. 2024.

[51] CHEN, E. et al. Application of orthogonal defect classification for software reliability analysis. In: 16th International Conference on Probabilistic Safety Assessment and Management (PSAM 2022). Honolulu, United States: [s.n.], 2022.