Conferencia

Czemerinski, H.; Braberman, V.; Uchitel, S. "Behaviour abstraction coverage as black-box adequacy criteria" (2013) IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013:222-231
La versión final de este artículo es de uso interno de la institución.
Consulte el artículo en la página del editor

Abstract:

Code artefacts that have non-trivial requirements with respect to the ordering in which their methods or procedures ought to be called are common and appear, for instance, in the form of API implementations and objects. Testing such code artefacts to gain confidence in that they conform to their intended protocols is an important and challenging problem. In this paper we propose and study experimentally conformance testing adequacy criteria based on covering an abstraction of the intended behavior's semantics. Thus, the criteria are independent of the specification language and structure used to describe the intended protocol and the language used to implement it. As a consequence the results may be of use to black box conformance testing approaches in general. Experimental results show that the criterion is a good predictor for conformance failure detection and for classical structural coverage criteria such as code and branch coverage. © 2013 IEEE.

Registro:

Documento: Conferencia
Título:Behaviour abstraction coverage as black-box adequacy criteria
Autor:Czemerinski, H.; Braberman, V.; Uchitel, S.
Ciudad:Luxembourg
Filiación:Departamento de Computación, FCEyN, Universidad de Buenos Aires, Argentina
Department of Computing, Imperial College London, United Kingdom
Palabras clave:conformance testing; coverage criteria; object protocols; Black boxes; Branch coverage; Conformance testing; Coverage criteria; Failure detection; Non-trivial; Abstracting; Semantics; Specification languages; Software testing
Año:2013
Página de inicio:222
Página de fin:231
DOI: http://dx.doi.org/10.1109/ICST.2013.22
Título revista:IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013
Título revista abreviado:Proc. - IEEE Int. Conf. Softw. Test., Verif. Validation, ICST
Registro:https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_NIS11282_v_n_p222_Czemerinski

Referencias:

  • Andrews, J., Groce, A., Weston, M., Xu, R.-G., Random test run length and effectiveness (2008) ASE, 8, pp. 19-28
  • Arcuri, A., Briand, L.C., A practical guide for using statistical tests to assess randomized algorithms in software engineering (2011) ICSE, 11, pp. 1-10
  • Beckman, N., Kim, D., Aldrich, J., An empirical study of object protocols in the wild (2011) ECOOP, 11, pp. 2-26
  • Bierhoff, K., Beckman, N.E., Aldrich, J., Practical API protocol checking with access permissions (2009) ECOOP, 9, pp. 195-219
  • Bochmann, G., Petrenko, A., Bellal, O., Maguiraga, S., Automating the process of test derivation from SDL specifications (1997) SDL Forum, 97
  • Dallmeier, V., Knopp, N., Mallon, C., Hack, S., Zeller, A., Generating test cases for specification mining (2010) ISSTA, 10, pp. 85-96
  • De Caso, G., Braberman, V., Garbervetsky, D., Uchitel, S., Validation of contracts using enabledness preserving finite state abstractions (2009) ICSE, 9, pp. 452-462
  • De Caso, G., Braberman, V., Garbervetsky, D., Uchitel, S., Program abstractions for behaviour validation (2011) ICSE, 11, pp. 381-390
  • Deline, R., Fndrich, M., Typestates for objects (2004) ECOOP, 9, pp. 465-490
  • Fraser, G., Walkinshaw, N., Behaviourally adequate software testing (2012) ICST, 12, pp. 300-309
  • Grieskamp, W., Gurevich, Y., Schulte, W., Veanes, M., Generating finite state machines from abstract state machines (2002) ISSTA, 2, pp. 112-122
  • Grieskamp, W., Kicillof, N., Stobie, K., Braberman, V., Model-based quality assurance of protocol documentation: Tools and methodology (2011) STVR, 21 (1), pp. 55-71
  • Groce, A., Zhang, C., Eide, E., Chen, Y., Regehr, J., Swarm testing (2012) ISSTA, 12, pp. 78-88
  • Heimdahl, M.P., George, D., Weber, R., Specification test coverage adequacy criteria = specification test generation inadequacy criteria? (2004) HASE, 4, pp. 178-186
  • Hierons, R.M., Bogdanov, K., Bowen, J.P., Cleaveland, R., Derrick, J., Dick, J., Gheorghe, M., Zedan, H., Using formal specifications to support testing (2009) ACM Computing Surveys, 41 (9), pp. 1-9. , 76
  • Conformance testing with labelled transition systems: Implementation relations and test generation (1996) Computer Networks and ISDN Systems, 29 (1), pp. 49-79. , Jan and Tretmans
  • Korel, B., Koutsogiannakis, G., Tahat, L.H., Model-based test prioritization heuristic methods and their evaluation (2007) A-MOST, 7, pp. 34-43
  • Lee, D., Yannakakis, M., Principles and methods of testing finite state machines-a survey (1996) Proceedings of the IEEE, 84 (8), pp. 1090-1123
  • Liu, L., Meyer, B., Schoeller, B., Using contracts and boolean queries to improve the quality of automatic test generation (2007) TAP, 7, pp. 114-130
  • Ma, Y.-S., Offutt, J., Kwon, Y.R., Mujava: An automated class mutation system (2005) STVR, 15 (2), pp. 97-133
  • Mariani, L., Pezz, M., Riganelli, O., Santoro, M., Autoblacktest: A tool for automatic black-box testing (2011) ICSE, 11, pp. 1013-1015
  • Mouchawrab, S., Briand, L.C., Labiche, Y., Di Penta, M., Assessing, comparing, and combining state machine-based testing and structural testing: A series of experiments (2011) TSE, 37 (2), pp. 161-187
  • Namin, A.S., Andrews, J.H., The influence of size and coverage on test suite effectiveness (2009) ISSTA, 9, pp. 57-68
  • Offutt, J., Liu, S., Abdurazik, A., Ammann, P., Generating test data from state-based specifications (2003) STVR, 13 (1), pp. 25-53
  • Pacheco, C., Lahiri, S.K., Ernst, M.D., Ball, T., Feedbackdirected (2007) ICSE, 7, pp. 75-84. , random test generation
  • Pretschner, A., Prenninger, W., Wagner, S., Knel, C., Baumgartner, M., Sostawa, B., Zch, R., Stauner, T., One evaluation of model-based testing and its automation (2005) ICSE, 5, pp. 392-401
  • Rutherford, M.J., Carzaniga, A., Wolf, A.L., Evaluating test suites and adequacy criteria using simulation-based models of distributed systems (2008) TSE, 34, pp. 452-470
  • Selic, B., The pragmatics of model-driven development (2003) IEEE Software, 20 (5), pp. 19-25
  • Sharma, R., Gligoric, M., Arcuri, A., Fraser, G., Marinov, D., Testing container classes Random or systematic? (2011) FASE, 11, pp. 262-277
  • Thummalapenta, S., Xie, T., Tillmann, N., De Halleux, J., Su, Z., Synthesizing method sequences for high-coverage testing (2011) OOPSLA, 11
  • Utting, M., Legeard, B., Practical model-based testing: A tools approach (2007) Morgan Kaufmann
  • Visser, W., Pasareanu, C., Pelek, R., Test input generation for java containers using state matching (2006) ISSTA, 6, pp. 37-48
  • Weissleder, S., Simulated satisfaction of coverage criteria on uml state machines (2010) ICST, 10, pp. 117-126
  • Xiao, X., Xie, T., Tillmann, N., De Halleux, J., Precise identification of problems for structural test generation (2011) ICSE, 11, pp. 611-620
  • Xie, T., Notkin, D., Automatic extraction of object-oriented observer abstractions from unit-test executions (2004) LNCS, 3308, pp. 290-305. , Formal Methods and Software Engineering

Citas:

---------- APA ----------
Czemerinski, H., Braberman, V. & Uchitel, S. (2013) . Behaviour abstraction coverage as black-box adequacy criteria. IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013, 222-231.
http://dx.doi.org/10.1109/ICST.2013.22
---------- CHICAGO ----------
Czemerinski, H., Braberman, V., Uchitel, S. "Behaviour abstraction coverage as black-box adequacy criteria" . IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013 (2013) : 222-231.
http://dx.doi.org/10.1109/ICST.2013.22
---------- MLA ----------
Czemerinski, H., Braberman, V., Uchitel, S. "Behaviour abstraction coverage as black-box adequacy criteria" . IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013, 2013, pp. 222-231.
http://dx.doi.org/10.1109/ICST.2013.22
---------- VANCOUVER ----------
Czemerinski, H., Braberman, V., Uchitel, S. Behaviour abstraction coverage as black-box adequacy criteria. Proc. - IEEE Int. Conf. Softw. Test., Verif. Validation, ICST. 2013:222-231.
http://dx.doi.org/10.1109/ICST.2013.22