Abstract:
The automated generation of test cases for heap allocated, complex, structures is particularly difficult. Various state of the art tools tackle this problem by bounded exhaustive exploration of potential test cases, using constraint solving mechanisms based on techniques such as search, model checking, symbolic execution and combinations of these. In this article we present a technique for improving the bounded exhaustive constraint based test case generation of structurally complex inputs, for "filtering" approaches. The technique works by guiding the search considering a given black box test criterion. Such a test criterion is incorporated in the constraint based mechanism so that the exploration of potential test cases can be pruned without missing coverable classes of inputs, corresponding to the test criterion. We present the technique, together with some case studies illustrating its performance for some black box testing criteria. The experimental results associated with these case studies are shown in the context of Korat, a state of the art tool for constraint based test case generation, but the approach is applicable in other contexts using a filtering approach to test generation. © 2011 Springer-Verlag Berlin Heidelberg.
Registro:
Documento: |
Artículo
|
Título: | Incorporating coverage criteria in bounded exhaustive black box test generation of structural inputs |
Autor: | Aguirre, N.M.; Bengolea, V.S.; Frias, M.F.; Galeotti, J.P. |
Ciudad: | Zurich |
Filiación: | Departamento de Computacíon, FCEFQyN, Universidad Nacional de Ŕio Cuarto and CONICET, Ŕio Cuarto, Cordoba, Argentina Departamento de Ingenieŕia Inforḿatica, Instituto Tecnoĺogico Buenos Aires and CONICET, Buenos Aires, Argentina Departamento de Computacíon, FCEyN, Universidad de Buenos Aires and CONICET, Buenos Aires, Argentina
|
Palabras clave: | Automated generation; Black box test; Black-box testing; Complex inputs; Constraint Solving; Constraint-based; Coverable; Coverage criteria; State of the art; Symbolic execution; Test case; Test case generation; Test criteria; Test generations; Model checking; Software testing; Testing |
Año: | 2011
|
Volumen: | 6706 LNCS
|
Página de inicio: | 15
|
Página de fin: | 32
|
DOI: |
http://dx.doi.org/10.1007/978-3-642-21768-5_3 |
Título revista: | 5th International Conference on Tests and Proofs, TAP 2011
|
Título revista abreviado: | Lect. Notes Comput. Sci.
|
ISSN: | 03029743
|
Registro: | https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_03029743_v6706LNCS_n_p15_Aguirre |
Referencias:
- Barnett, M., Grieskamp, W., Nachmanson, L., Schulte, W., Tillmann, N., Veanes, M., Model-based testing with asmL.NET (2003) Proceedings of the 1st European Conference on Model-Driven Software Engineering
- Boyapati, C., Khurshid, S., Marinov, D., Korat: Automated testing based on java predicates (2002) Proceedings of International Symposium on Software Testing and Analysis ISSTA 2002, , ACM Press New York
- Galeotti, J.P., Rosner, N., Lopez Pombo, C., Frias, M., Analysis of invariants for efficient bounded verification (2010) Proceedings of the 19th International Symposium on Software Testing and Analysis ISSTA 2010, , ACM Press, Trento
- Gligoric, M., Gvero, T., Jagannath, V., Khurshid, S., Kuncak, V., Marinov, D., Test generation through programming in UDITA (2010) Proceedings of the 32nd ACM/ IEEE International Conference on Software Engineering ICSE 2010, , ACM Press Cape Town
- Jackson, D., (2006) Software Abstractions: Logic Language and Analysis, , The MIT Press, Cambridge
- Kaner, C., Bach, J., Pettichord, B., (2001) Lessons Learned in Software Testing, , Wiley Chichester
- Khurshid, S., Marinov, D., TestEra: Specification-based testing of java programs using SAT (2004) Automated Software Engineering, 11 (4)
- Liskov, B., Guttag, J., (2000) Program Development in Java: Abstraction Specification and Object-Oriented Design, , Addison-Wesley, Reading
- Ma, Y.-S., Offutt, J., Kwon, Y.-R., MuJava: An automated class mutation system (2005) Journal of Software Testing, Verification and Reliability, 15 (2)
- Milicevic, A., Misailovic, S., Marinov, D., Khurshid, S., Korat: A tool for generating structurally complex test inputs (2007) Proceedings of International Conference on Software Engineering ICSE 2007, , IEEE Press, Los Alamitos
- MuJava Home Page, , http://www.cs.gmu.edu/offutt/mujava/
- Sen, K., Marinov, D., Agha, G., CUTE: A concolic unit testing engine for C (2005) Proceedings of the 5th Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering ESEC/FSE 2005, , ACM Press New York
- Siddiqui, J., Khurshid, S., An empirical study of structural constraint solving techniques (2009) LNCS, 5885, pp. 88-106. , Breitman, K., Cavalcanti, A. (eds.) ICFEM 2009 Springer, Heidelberg
- Siddiqui, J., Khurshid, S., PKorat: Parallel generation of structurally complex test inputs (2009) Proceedings of the 2nd International Conference on Software Testing Verification and Validation ICST 2009, , IEEE Computer Society, Los Alamitos
- Visser, W., Pasareanu, C., Khurshid, S., Test input generation with java pathfinder (2004) Proceedings of International Symposium on Software Testing and Analysis ISSTA 2004, , ACM Press New York
- Xie, T., Marinov, D., Notkin, D., Rostra: A framework for detecting redundant object-oriented unit tests (2004) Proceedings of the 19th IEEE International Conference on Automated Software Engineering ASE 2004, , IEEE Computer Society, Linz
- Zhu, H., Hall, P., May, J., Software unit test coverage and adequacy (1997) ACM Computing Surveys, 29 (4)
Citas:
---------- APA ----------
Aguirre, N.M., Bengolea, V.S., Frias, M.F. & Galeotti, J.P.
(2011)
. Incorporating coverage criteria in bounded exhaustive black box test generation of structural inputs. 5th International Conference on Tests and Proofs, TAP 2011, 6706 LNCS, 15-32.
http://dx.doi.org/10.1007/978-3-642-21768-5_3---------- CHICAGO ----------
Aguirre, N.M., Bengolea, V.S., Frias, M.F., Galeotti, J.P.
"Incorporating coverage criteria in bounded exhaustive black box test generation of structural inputs"
. 5th International Conference on Tests and Proofs, TAP 2011 6706 LNCS
(2011) : 15-32.
http://dx.doi.org/10.1007/978-3-642-21768-5_3---------- MLA ----------
Aguirre, N.M., Bengolea, V.S., Frias, M.F., Galeotti, J.P.
"Incorporating coverage criteria in bounded exhaustive black box test generation of structural inputs"
. 5th International Conference on Tests and Proofs, TAP 2011, vol. 6706 LNCS, 2011, pp. 15-32.
http://dx.doi.org/10.1007/978-3-642-21768-5_3---------- VANCOUVER ----------
Aguirre, N.M., Bengolea, V.S., Frias, M.F., Galeotti, J.P. Incorporating coverage criteria in bounded exhaustive black box test generation of structural inputs. Lect. Notes Comput. Sci. 2011;6706 LNCS:15-32.
http://dx.doi.org/10.1007/978-3-642-21768-5_3