Adoptability of Test Process Models: ISO/IEC 29119, TMMI y TPI from the small organization perspective - Adoptabilidad de Modelos de Proceso de Pruebas: ISO/IEC 29119, TMMI, TPI, desde la perspectiva de una pequeña organización
DOI:
https://doi.org/10.32870/recibe.v7i1.96Keywords:
TMMi, TAMAR, ISO/IEC 29119-2, ISO/IEC 33063, TPI, MPS, software test process model, comparative analysisAbstract
Testing is considered to be an important stage in the software development process. Therefore, there are different proposals regarding how to perform testing activities at a project level and at organizational level. However, in the context of very small organizations where there are ad-hoc proposals in software and system engineering, the ease of the adoption of influential models such as ISO/IEC 29119, TMMI and TPI is not yet clear. The objective of this work is to compare these models with the characteristics of the resources and finances of small organizations established in the standardization guidelines of ISO. This study conducted a comparative analysis of test process models with respect to the characteristics of very small organizations. A comparative chart was obtained with the answers of the analysis of each model with respect to the criteria considered. It can be inferred from the analysis, that the assessed test process models are not easily adoptable by very small organizations. Resumen: La prueba de software es una etapa importante en el proceso de desarrollo de software. Por lo tanto, hay diferentes propuestas sobre cómo realizar actividades de prueba a nivel de proyecto y a nivel organizacional. Sin embargo, en el contexto de organizaciones muy pequeñas donde existen propuestas ad hoc en software e ingeniería de sistemas, la facilidad de adopción de modelos influyentes como ISO/IEC 29119, TMMI y TPI aún no está clara. El objetivo de este trabajo es comparar estos modelos desde las características de los recursos y las finanzas de las pequeñas organizaciones establecidas en las pautas de estandarización de ISO. Este estudio realizó un análisis comparativo de modelos de procesos de prueba con respecto a las características de organizaciones muy pequeñas. Se obtuvo un cuadro comparativo con las respuestas del análisis de cada modelo con respecto a los criterios considerados. Del análisis se puede inferir que los modelos evaluados de procesos de prueba no son fácilmente adoptables por organizaciones muy pequeñas. Palabras clave: TMMi, TAMAR, ISO/IEC 29119-2, ISO/IEC 33063, TPI, MPS, modelo de proceso de prueba de software, análisis comparativo.References
Alone, S., & Glocksien, K. (s.f.). Evaluation of Test Process Improvement approaches: An industrial case study. Recuperado el 14 de abril de 2016, de University of Gothenburg: https://gupea.ub.gu.se/bitstream/2077/38986/1/gupea_2077_38986_1.pdf
Carvalho Cavalcanti Furtado, A., Wanderley Gomes, M., Carneiro Andrade, E., & Honório de Farias Junior, I. (27-29 Aug. 2012). MPT.BR: A Brazilian Maturity Model for Testing. 2012 12th International Conference on Quality Software. Xi'an, Shaanxi: IEEE.
Cernant, L., Norman-Lopez, A., & Duch T-Figueras, A. (September de 2014). SMEs are more Important than you think! Challenges and Opportunities for EU Exporting SMEs. DG TRADE Chief Economist.
Dávila, A. (2012). Nueva aproximación de procesos en pequeñas organizaciones de Tecnología de Información. Magazine IEEEPeru. La revista tecnológica de la Sección Perú de IEEE, Vol 1(Nro 2), pp 30-31.
Dyba, T. (December de 2000). An Instrument for Measuring the Key Factors of Success in Software Process Improvement. Empirical Software Engineering, págs. 357-390.
Dyba, T. (December de 2002). Enabling Software Process Improvement: An Investigation of the Importance of Organizational Issues. Empirical Software Engineering, 7, págs. 387-390.
Dyba, T. (2003). Factors of software process improvement success in small and large organizations: an empirical study in the scandinavian context. Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering (ESEC/FSE-11) (págs. 148-157). New York, USA: ACM.
Dyba, T. (Mayo de 2005). An empirical investigation of the key factors for success in software process improvement. IEEE Transactions on Software Engineering, 31, 410-424.
ECS. (2010). Guidance for writing standards taking into account micro, small and medium-sized enterprises (SMEs) needs. European Committee for Standardization (CEN) and European Committee for Electrotechnical Standardization (CENELEC). Brussels: European Committee for Standardization.
European Union. (20 de May de 2003). Commission Recommendation of 6 May 2003 concerning the definition of micro, small and medium-sized enterprises. Official Journal of the European Union, 46, págs. p. 36–41.
Foundation, T. (s.f.). Find an accredited Assessor. Recuperado el 14 de Abril de 2015, de http://www.tmmi.org/?q=assesor
García, C., & Dávila, A. (2012). Mejora del proceso de pruebas usando el modelo TPI® en proyectos internos de desarrollo con Scrum. Caso Alfa-Lim.
García, C., Dávila, A., & Pessoa, M. (2014). Test process models: Systematic literature review. Software Process Improvement and Capability Determination (págs. 84-93). Springer.
Garcia, S. (2005). Thoughts on Applying CMMI in Small Settings. Pittsburgh: Carnegie-Mellon University. Software Engineering Institute.
Gelperin, D. H., & Hetzel, B. (June de 1988). The growth of software testing. Communications of the ACM., 31(6), 687-695.
Genero Bocco, M., Cruz-Lemus, J. A., & Piattini Velthuis, M. (2014). Métodos de investigación en Ingeniería de Software. Ra-Ma Editorial.
ISO/IEC. (2004). ISO/IEC 15504-2:2003/Cor 1:2004 Information technology -- Process assessment -- Part 2: Performing an assessment. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2008). ISO/IEC 12207:2008 Systems and software engineering -- Software life cycle processes. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2010). ISO/IEC TR 24774:2010 Systems and software engineering -- Life cycle management -- Guidelines for process description. Geneva, Switzerland: International Organization for Standarization.
ISO/IEC. (2011). ISO/IEC 29110-1: Software engineering — Lifecycle profiles for Very Small Entities (VSEs) — Part 1: Overview. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2011). ISO/IEC 29110-4-1:2011 Software engineering -- Lifecycle profiles for Very Small Entities (VSEs) Part 4-1: Profile specifications: Generic profile group. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2011). ISO/IEC TR 29110-5-1-2:2011 Software engineering -- Lifecycle profiles for Very Small Entities (VSEs) -- Part 5-1-2: Management and engineering guide: Generic profile group: Basic profile. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2013). ISO/IEC/IEEE 29119-1:2013 Software and systems engineering — Software testing — Part 1: Concepts and definitions. Geneva, Switzerland: International Organization for Standarization.
ISO/IEC. (2013). ISO/IEC/IEEE 29119-2: Software and systems engineering — Software testing — Part 2: Test process. Geneva, Switzerland: International Organization for Standarization.
ISO/IEC. (2013). ISO/IEC/IEEE 29119-3:2013 Software and systems engineering — Software testing — Part 3: Test Documentation. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2014). ISO/IEC TR 29110-5-6-2:2014 Systems and software engineering -- Lifecycle profiles for Very Small Entities (VSEs) -- Part 5-6-2: Systems engineering -- Management and engineering guide: Generic profile group: Basic profile. Geneva, Switzerland: International Organization for Standarization.
ISO/IEC. (2015). ISO/IEC 33001 Information technology — Process assessment — Concepts and terminology. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2015). ISO/IEC 33002:2015 Information technology -- Process assessment -- Requirements for performing process assessment. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2015). ISO/IEC FDIS 33063 Information technology -- Process assessment -- Process assessment model for software testing. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2015). ISO/IEC TR 15504-7:2008 Information technology -- Process assessment -- Part 7: Assessment of organizational maturity. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2015). ISO/IEC/IEEE 29119-4:2015 Software and systems engineering -- Software testing -- Part 4: Test techniques. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2016). ISO/IEC Guide 17:2016 Guide for writing standards taking into account the needs of micro, small and medium-sized enterprises. Geneva, Switzerland: International Organization for Standardization.
ISO/IEC. (2016). ISO/IEC Guide 17:2016 Guide for writing standards taking into account the needs of micro, small and medium-sized enterprises. Geneva, Switzerland: International Organization for Standardization.
ISTQB. International Software Testing Qualifications Board. (s.f.). Recuperado el 14 de abril de 2015, de http://www.istqb.org
Kulkarni, S. (2006). Test process maturity models–yesterday, today and tomorrow. Proceedings of the 6th Annual International Software Testing Conference, Delhi, India. Citeseer.
Laporte, C., Houde, R., & Marvin, J. (2014). 6.4.2 Systems Engineering International Standards and Support Tools for Very Small Enterprises. INCOSE International Symposium, (págs. 551–569). Las Vegas, NV.
Luo, L. (2001). Software testing techniques. PA: Institute for software research international Carnegie mellon university Pittsburgh.
Meerts, J. (04 de 14 de 2016). http://www.testingreferences.com/testinghistory.php. Obtenido de http://www.testingreferences.com/testinghistory.php.
Mexico, N. (s.f.). Tecnología de la información - Software - Modelos de procesos y evaluación para desarrollo y mantenimiento de software - Parte 2: Requisitos y procesos (MoProSoft). Recuperado el 14 de April de 2015, de http://www.tecnyce.com.mx/index.php/proceso-verif/moprosoft.html
Myers, G. J. (1979). Art of Software Testing. New York, USA: John Wiley & Sons, Inc.
NIST. (2002). The Economic Impacts of Inadequate Infrastructure for Software Testing. Washington: National Institute of Standards & Technology.
Rasking, M. (2011). Experiences Developing TMMi® as a Public Model. 11th International Conference, SPICE 2011 (págs. pp 190-193). Dublin, Ireland: Springer Berlin Heidelberg.
Reid, S. (s.f.). ISO/IEC/IEEE 29119:The New International Software Testing Standards. London UK: Testing Solution Group Ltd.
Sanz, A., Saldaña, J., Garcia, J., & Gaitero, D. (Diciembre de 2008). TestPAI Un área de proceso de pruebas integrada con CMMI. Revista Española de Innovación, Calidad e Ingeniería del Software REICIS, Volumen 4(No 4).
Softex. (s.f.). Melhoria de Proceso do Software Brasileiro. Recuperado el 14 de April de 2015, de http://www.softex.br/mpsbr/
Sogeti Web Site. (14 de April de 2015). Obtenido de SOGETI: http://www.sogeti.com/
Sogueti. (s.f.). TPI NEXT® Process Certification. Recuperado el 14 de April de 2015, de http://www.sogeti.es/globalassets/spain/soluciones/testing/certificacion-tpi-next-sogeti.pdf
Swinkels, R. (2000). A comparison of TMM and other test process improvement models.
Tim , K., & Martin, P. (1999). Test Process Improvement: A practical step-by-step guide to structured testing. Addison Wesley Longman INC.
TMMI Foundation. (04 de 06 de 2016). Recuperado el 14 de Abril de 2015, de http://www.tmmi.org/
Tmmi Foundation. (2012). Test Maturity Model TMMi Release 1.0. Ireland: Erik van Veenendaal .
Tmmi Foundation. (s.f.). TMMi Assessment Method Application Requirements (TAMAR) version 2.0. Andrew Goslin .
United Nations. (2012). Information Economy Report 2012 - The Software Industry and Developing Countries. En L. Cernat (Ed.), United Nations Conference on Tradea and Development UNCTAD, (pág. 14). New York and Geneva.
USITC. (2010). Small and MediumSized Enterprises: Characteristics and Performance. Washington, DC 20436: United States International Trade Commission. Publication 4189.
Visser, B., de Vries, G., Linker, B., Wilhelmus, L., van Ewijk, A., & van Oosterwijk, M. (2013). TPI® NEXT - Business Driven Test Process Improvement (1 edition (November 17, 2009) ed.). UTN Publishers.
