Publikationen

2022

P. Feldmeier and G. Fraser, Neuroevolution-Based Generation of Tests and Oracles for Games, In Proceedings of the 37th ACM/IEEE International Conference on Automated Software Engineering (ASE 2022), ACM, 2022.
W. Wang, G. Fraser, M. Bobbadi, B.T. Tabarsi, T. Barnes, C. Martens, S. Jiao, and T. Price. Pinpoint: A Record, Replay, and Extract System to Support Code Comprehension and Reuse. In Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) (pp. 1-10). IEEE Computer Society, 2022.
M. Auer, F. Adler, G. Fraser, Improving Search-based Android Test Generation using Surrogate Models, In Proceedings of the 14th Symposium on Search-based Software Engineering (SSBSE). Springer, 2022.
V. Tymofyeyev and G. Fraser, Search-based Test Suite Generation for Rust, In Proceedings of the 14th Symposium on Search-based Software Engineering (SSBSE). Springer, 2022.
A. Gambi, V. Nguyen, J. Ahmed G. Fraser, Generating Critical Driving Scenarios from Accident Sketches, In Proceedings of the 4th IEEE International Conference on Artificial Intelligence Testing (AITest), IEEE, 2022.
B. Fein, I. Graßl, F. Beck, and G. Fraser. An Evaluation of code2vec Embeddings for Scratch, In Proceedings of the 15th International Conference on Educational Data Mining (EDM'22). 2022.
K. Götz, P. Feldmeier, G. Fraser. Model-based Testing of Scratch Programs. In Proceedings of the IEEE Conference on Software Testing, Verification and Validation (ICST) (pp. 411-421). IEEE, 2022.
M. Gruber and G. Fraser. A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It. In Proceedings of the IEEE Conference on Software Testing, Verification and Validation (ICST), (pp. 82-92). IEEE, 2022.
A. Panichella, S. Panichella, G. Fraser, A. Sawant, V. Hellendoorn, Test Smells 20 Years Later: Detectability, Validity, and Reliability. Empirical Software Engineering, 2022.
B. Fein, F. Obermüller, G. Fraser. CATNIP: An Automated Hint Generation Tool for Scratch. In Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education (ITiCSE), (pp. 124-130), ACM, 2022.
F. Obermüller, R. Pernerstorfer, L. Bailey, U. Heuer, G. Fraser, Common Patterns in Block-Based Robot Programs, In Proceedings of the Proceedings of the 17th Workshop in Primary and Secondary Computing Education (WiPSCE ’22). ACM, 2022.
I. Graßl and G. Fraser, Gender-dependent Contribution, Code and Creativity in a Virtual Programming Course, In Proceedings of the Proceedings of the 17th Workshop in Primary and Secondary Computing Education (WiPSCE ’22). ACM, 2022.
L. Greifenstein, I. Graßl, U. Heuer, G. Fraser, Common Problems and Effects of Feedback on Fun When Programming Ozobots in Primary School, In Proceedings of the Proceedings of the 17th Workshop in Primary and Secondary Computing Education (WiPSCE ’22). ACM, 2022.
I. Graßl and G. Fraser, Scratch as Social Network: Topic Modeling and Sentiment Analysis in Scratch Projects, In Proceedings of the IEEE/ACM 44th International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS), (pp. 143-148), ACM, 2022.
S. Lukasczyk and G. Fraser, Pynguin: Automated Unit Test Generation for Python, in Proceedings of the IEEE/ACM 44th International Conference on Software Engineering (ICSE '22), pp. 168–172, ACM, 2022
P. Straubinger and G. Fraser, Gamekins: Gamifying Software Testing in Jenkins, in Proceedings of the IEEE/ACM 44th International Conference on Software Engineering (ICSE '22), pp. 85-89, ACM, 2022.
V. Nguyen, A. Gambi, J. Ahmed, G. Fraser. CRISCE: Towards Generating Test Cases from Accident Sketches. In Proceedings of the IEEE/ACM 44th International Conference on Software Engineering (ICSE) (pp. 339-340). IEEE, 2022.
S. Schweikl, G. Fraser, A. Arcuri. EvoSuite at the SBST 2022 Tool Competition. In Proceedings of the IEEE/ACM 15th International Workshop on Search-Based Software Testing (SBST), (pp. 33-34). IEEE, 2022.
B. Clegg, G. Fraser, and P. McMinn. Diagnosability, Adequacy & Size: How Test Suites Impact Autograding, In Proceedings of the International Conference on Software Engineering Education and Training (CSEET): Collaborative Special Track at the Hawaii International Conference on System Sciences (HICSS), 2022.

2021

G. Petrovic, M. Ivankovic, G. Fraser, and R. Just. Practical Mutation Testing at Scale: A view from Google. IEEE Transactions on Software Engineering (to appear), IEEE, 2021.
L. Greifenstein, I. Graßl, and G. Fraser. Challenging but Full of Opportunities: Teachers’ Perspectives on Programming in Primary Schools, in Proceedings of the 21st Koli Calling International Conference on Computing Education Research (Koli Calling '21), (pp. 1-10), ACM, 2021.
S. Vogl, S. Schweikl, and G. Fraser, Encoding the certainty of boolean variables to improve the guidance for search-based test generation, in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2021), (pp. 1088-1096), ACM, 2021.
D. Diner, G. Fraser, S. Schweikl, and A. Stahlbauer, Generating Timed UI Tests from Counterexamples, in Proceedings of the International Conference on Tests and Proofs (TAP 2021) (pp. 53-71), Springer, 2021.
S. Vogl, S. Schweikl, G. Fraser, A. Arcuri, J. Campos, and A. Panichella, EvoSuite at the SBST 2021 Tool Competition, in Proceedings of the 2021 IEEE/ACM 14th International Workshop on Search-Based Software Testing (SBST) (pp. 28-29). IEEE, 2021.
F. Obermüller, U. Heuer, and G. Fraser, Guiding Next-Step Hint Generation Using Automated Tests, in Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE'21), (pp. 220–226), ACM, 2021.
W. Wang, C. Zhang, A. Stahlbauer, G. Fraser, and T. Price, SnapCheck: Automated Testing for Snap Programs, in Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE'21), (pp. 227–233), ACM, 2021.
Y. Lin, Y. S. Ong, J. Sun, G. Fraser, and J. S. Dong, Graph-Based Seed Object Synthesis for Search-Based Unit Testing, in Proceedings of the 2021 ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ACM, 2021.
F. Obermüller, L. Bloch, L. Greifenstein, U. Heuer, and G. Fraser, Code Perfumes: Reporting Good Code to Encourage Learners, in Proceedings of the 16th Workshop in Primary and Secondary Computing Education (WiPSCE ’21). ACM, 2021. (to appear)
I. Graßl, K. Geldreich and G. Fraser, Data-driven Analysis of Gender Differences and Similarities in Scratch Programs, in Proceedings of the 16th Workshop in Primary and Secondary Computing Education (WiPSCE ’21). ACM, 2021.
N. Körber, L. Bailey, L. Greifenstein, G. Fraser, B. Sabitzer and M. Rottenhofer, An Experience of Introducing Primary School Children to Programming using Ozobots (Practical Report), in Proceedings of the 16th Workshop in Primary and Secondary Computing Education (WiPSCE ’21). ACM, 2021. (to appear)
L. Greifenstein, F. Obermueller, E. Wasmeier, U. Heuer and G. Fraser, Effects of Hints on Debugging Scratch Programs: An Empirical Study with Primary School Teachers in Training, in Proceedings of the 16th Workshop in Primary and Secondary Computing Education (WiPSCE ’21). ACM, 2021. (to appear)
F. Adler, G. Fraser, E. Gründinger, N. Körber, S. Labrenz, J. Lerchenberger, S. Lukasczyk, S. Schweikl, Improving Readability of Scratch Programs with Search-based Refactoring, in Proceedings of the 21st IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM'21), IEEE, 2021. (to appear)
G. Petrović, M. Ivanković, G. Fraser, R. Just. Does mutation testing improve testing practices? In Proceedings of the 43rd International Conference on Software Engineering (pp. 910–921). IEEE, 2021.
B. S. Clegg, P. McMinn, G. Fraser. An Empirical Study to Determine if Mutants Can Effectively Simulate Students' Programming Mistakes to Increase Tutors' Confidence in Autograding. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (pp. 1055–1061). ACM, 2021.
B. Clegg, M-C. Villa-Uriol, P. McMinn, G. Fraser. Gradeer: An Open-Source Modular Hybrid Grader. In Proceedings of the 43rd International Conference on Software Engineering: Joint Track on Software Engineering Education and Training (ICSE-JSEET) (pp. 60-65). IEEE, 2021.
N. Körber, K. Geldreich, A. Stahlbauer, G. Fraser. Finding Anomalies in Scratch Assignments. In Proceedings of the 43rd International Conference on Software Engineering: Joint Track on Software Engineering Education and Training (ICSE-JSEET) (pp. 171-182). IEEE, 2021.
G. Fraser, U. Heuer, N. Körber, F. Obermüller, E. Wasmeier. LitterBox: A Linter for Scratch Programs. In Proceedings of the 43rd International Conference on Software Engineering: Joint Track on Software Engineering Education and Training (ICSE-JSEET) (pp. 183-188). IEEE, 2021.
M. Gruber, S. Lukasczyk, F. Kroiß, G. Fraser. An Empirical Study of Flaky Tests in Python. In Proceedings of the IEEE International Conference on Software Testing, Verification and Validation (pp. 148–158). IEEE, 2021.

2020

A. Stahlbauer, C. Frädrich, G. Fraser. Verified from Scratch: Program Analysis for Learners' Programs. In Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering (pp. 150–162). ACM, 2020.
Y. Chen, R. Gopinath, A. Tadakamalla, Mike D. Ernst, R. Holmes, G. Fraser, P. Ammann, R. Just. Revisiting the relationship between fault detection, test adequacy criteria, and test set size. In Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering (pp. 237–249). ACM, 2020.
A. Panichella, S. Panichella, G. Fraser, A. A. Sawant, V. Hellendoorn. Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities. In Proceedings of the 36th IEEE International Conference on Software Maintenance and Evolution (pp. 523–533). IEEE, 2020.
A. Deiner, C. Frädrich, G. Fraser, S. Geserer, N. Zantner. Search-based Testing for Scratch Programs. In Proceedings of the 12th Symposium on Search-based Software Engineering (pp. 58–72). Springer, 2020.
S. Lukasczyk, F. Kroiß, G. Fraser. Automated Unit Test Generation for Python. In Proceedings of the 12th Symposium on Search-based Software Engineering (pp. 9–24). Springer, 2020.
N. Albunian, G. Fraser, D. Sudholt. Measuring and Maintaining Population Diversity in Search-based Unit Test Generation. In Proceedings of the 12th Symposium on Search-based Software Engineering (pp. 153–168). Springer, 2020.
B. S. Clegg, P. McMinn, G. Fraser. The Influence of Test Suite Properties on Automated Grading of Programming Exercises. In Proceedings of the 32nd IEEE International Conference on Software Engineering Education & Training (pp. 1–10). IEEE, 2020.
G. Fraser, A. Gambi, J. M. Rojas. Teaching Software Testing with the Code Defenders Testing Game: Experiences and Improvements. In Proceedings of the 1st International Software Testing Education Workshop @ ICST (pp.461–464), IEEE, 2020.
A. Panichella, J. Campos, G. Fraser. EvoSuite at the SBST 2020 Tool Competition. In Proceedings of the 13th International Workshop on Search-Based Software Testing @ ICSE (pp. 549–552). IEEE, 2020.
M. Krafft, G. Fraser, N. Walkinshaw. Motivating Adult Learners by Introducing Programming Concepts with Scratch. In Proceedings of the 4th European Conference on Software Engineering Education (pp. 22–26). ACM. 2020.
N. Albunian, G. Fraser, D. Sudholt. Causes and Effects of Fitness Landscapes in Unit Test Generation. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference (pp. 1204–1212). ACM. 2020.
Y. Lin, J. Sun, G. Fraser, Z. Xiu, T. Liu, J. S. Dong. Recovering Fitness Gradients for Interprocedural Boolean Flags in Search-Based Testing. In Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis (pp. 440–451). ACM. 2020.
C. Frädrich, F. Obermüller, N. Körber, U. Heuer, G. Fraser. Common Bugs in Scratch Programs. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education (pp. 89–95). ACM. 2020.
A. Stahlbauer, M. Kreis, G. Fraser. Testing Scratch Programs Automatically. In Software Engineering 2020 (pp. 139–140). Gesellschaft für Informatik e.V. 2020.

2019

S. Lukasczyk. Generating Tests to Analyse Dynamically-Typed Programs. In Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering (pp. 1226-1229). IEEE. 2019.
A. Stahlbauer, M. Kreis, G. Fraser. Testing scratch programs automatically. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (pp. 165-175). ACM. 2019.
S. Keller, M. Krafft, G. Fraser, N. Walkinshaw, K. Otto, B. Sabitzer. Improving Scratch Programming with CRC-Card Design. In Proceedings of the 14th Workshop in Primary and Secondary Computing Education (pp. 1-4). 2019.
L. Sell, M. Auer, C. Frädrich, M. Gruber, P. Werli, G. Fraser. An Empirical Evaluation of Search Algorithms for App Testing. In IFIP International Conference on Testing Software and Systems (pp. 123-139). Springer, 2019.
A. Gambi, T. Huynh, G. Fraser. Generating effective test cases for self-driving cars from police reports. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (pp. 257-267). ACM. 2019.
M. Ivanković, G. Petrović, R. Just, G. Fraser. Code coverage at Google. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (pp. 955-963). ACM. 2019.
A. Gambi, M. Mueller, G. Fraser. Automatically testing self-driving cars with search-based procedural content generation. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (pp. 318-328). ACM. 2019.
T. D. White, G. Fraser, G. J. Brown. Improving random GUI testing with image-based widget detection. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (pp. 307-317). ACM. 2019
B. Clegg, S. North, P. McMinn, G. Fraser. Simulating student mistakes to evaluate the fairness of automated grading. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering Education and Training (pp. 121-125). IEEE Press. 2019.
A. Gambi, T. Huynh, G. Fraser. Automatically reconstructing car crashes from police reports for testing self-driving cars. In Proceedings of the 41st International Conference on Software Engineering: Companion Proceedings (pp. 290-291). IEEE Press. 2019.
A. Gambi, M. Müller, G. Fraser. AsFault: testing self-driving car software using search-based procedural content generation. In Proceedings of the 41st International Conference on Software Engineering: Companion Proceedings (pp. 27-30). IEEE Press. 2019.
T. Huynh, A. Gambi, G. Fraser. AC3R: automatically reconstructing car crashes from police reports. In Proceedings of the 41st International Conference on Software Engineering: Companion Proceedings (pp. 31-34). IEEE Press. 2019.
V. Bader, J. Campos, G. Fraser. Parallel Many-Objective Search for Unit Tests. In 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST) (pp. 37-47). IEEE. 2019.
D. Paterson, J. Campos, R. Abreu, G. Kapfhammer, G. Fraser, P. McMinn. An Empirical Study on the Use of Defect Prediction for Test Case Prioritization. In 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST) (pp. 346-357). IEEE. 2019.
G. Fraser, A. Gambi, M. Kreis, J. M. Rojas. Gamifying a Software Testing Course with Code Defenders. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (pp. 571-577). ACM. 2019.
G. Fraser, J. M. Rojas. Software Testing. In Handbook of Software Engineering (pp. 123-192). Springer, Cham. 2019.

2018

J. Campos, Y. Ge, N. Albunian, G. Fraser, M. Eler, A. Arcuri. An empirical evaluation of evolutionary algorithms for unit test suite generation. Information and Software Technology, 104, 207-235. 2018.
C. Budnik, G. Fraser, F. Lonetti, H. Zhu. Special issue on automation of software testing: improving practical applicability. Software Quality Journal, 26(4), 1415-1419. 2018.
G. Fraser. A Tutorial on Using and Extending the EvoSuite Search-Based Test Generator. In International Symposium on Search Based Software Engineering (pp. 106-130). Springer, Cham. 2018.
M. Huchard, C. Kästner, G. Fraser. Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE 2018). ASE: Automated Software Engineering. ACM, 2018.
M. Almasi, H. Hemmati, G. Fraser, P. McMinn, J. Benefelds. Search-based detection of deviation failures in the migration of legacy spreadsheet applications. In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis (pp. 266-275). ACM. 2018.
C. Silva, M. Eler, G. Fraser. A survey on the tool support for the automatic evaluation of mobile accessibility. In Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion (pp. 286-293). ACM. 2018.
G. Fraser, A. Gambi, J. M. Rojas. A preliminary report on gamifying a software testing course with the Code Defenders testing game. In Proceedings of the 3rd European Conference of Software Engineering Education (pp. 50-54). ACM. 2018.
S. Shamshiri, J. M. Rojas, L. Gazzola, G. Fraser, P. McMinn, L. Mariani, A. Arcuri. Random or evolutionary search for object‐oriented test suite generation?. Software Testing, Verification and Reliability, 28(4), e1660. 2018.
D. Paterson, G. M. Kapfhammer, G. Fraser, P. McMinn. Using controlled numbers of real faults and mutants to empirically evaluate coverage-based test case prioritization. In Proceedings of the 13th International Workshop on Automation of Software Test (pp. 57-63). ACM. 2018.
M. M. Eler, J. M. Rojas, Y. Ge, G. Fraser. Automated accessibility testing of mobile apps. In 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST) (pp. 116-126). IEEE. 2018.
S. Shamshiri, J.M. Rojas, J.P. Galeotti, N. Walkinshaw, G. Fraser. How do automatically generated unit tests influence software maintenance?. In 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST) (pp. 250-261). IEEE. 2018.
T.D. White, G. Fraser, G. Brown. Modelling hand gestures to test Leap Motion Controlled applications. In 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) (pp. 204-213). IEEE. 2018.

2017

J. Campos, Y. Ge, G. Fraser, M. Eler, A. Arcuri. An empirical evaluation of evolutionary algorithms for test suite generation. In International Symposium on Search Based Software Engineering (pp. 33-48). Springer, Cham. 2017.
E. Daka, J.M. Rojas, G. Fraser. Generating unit tests with descriptive names or: Would you name your children thing1 and thing2?. In Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis (pp. 57-67). ACM. 2017.
G. Fraser. Gamification of software testing. In 2017 IEEE/ACM 12th International Workshop on Automation of Software Testing (AST) (pp. 2-7). IEEE. 2017.
J. M. Rojas, G. Fraser. Is search-based unit test generation research stuck in a local optimum?. In 2017 IEEE/ACM 10th International Workshop on Search-Based Software Testing (SBST) (pp. 51-52). IEEE. 2017.
B. S. Clegg, J. M. Rojas, G. Fraser. Teaching software testing concepts using a mutation testing game. In 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET) (pp. 33-36). IEEE. 2017.
S. Shamshiri, J. Campos, G. Fraser, P. McMinn. Disposable testing: avoiding maintenance of generated unit tests by throwing them away. In Proceedings of the 39th International Conference on Software Engineering Companion (pp. 207-209). IEEE Press. 2017.
M. M. Almasi, H. Hemmati, G. Fraser, A. Arcuri, J. Benefelds. An industrial evaluation of unit test generation: Finding real faults in a financial application. In Proceedings of the 39th International Conference on Software Engineering: Software Engineering in Practice Track (pp. 263-272). IEEE Press. 2017.
J. M. Rojas, T. D. White, B. S. Clegg, G. Fraser. Code defenders: crowdsourcing effective tests and subtle mutants with a mutation testing game. In Proceedings of the 39th International Conference on Software Engineering (pp. 677-688). IEEE Press. 2017.
S. Pearson, J. Campos, R. Just, G. Fraser, R. Abreu, M. D. Ernst, B. Keller. Evaluating and improving fault localization. In Proceedings of the 39th International Conference on Software Engineering (pp. 609-620). IEEE Press. 2017.
J. M. Rojas, M. Vivanti, A. Arcuri, G. Fraser. A detailed investigation of the effectiveness of whole test suite generation. Empirical Software Engineering, 22(2), 852-893. 2017.
A. Arcuri, G. Fraser, R. Just. Private api access and functional mocking in automated unit test generation. In 2017 IEEE international conference on software testing, verification and validation (ICST) (pp. 126-137). IEEE. 2017.
N. Walkinshaw, G. Fraser. Uncertainty-driven black-box test data generation. In 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) (pp. 253-263). IEEE. 2017.