Publications

2025

  • Benchmarking Generative AI Models for Deep Learning Test Input Generation
    Maryam, Matteo Biagiola, Andrea Stocco, and Vincenzo Riccio
    In Proceedings of the 18th IEEE International Conference on Software Testing, Verification and Validation (ICST 2025)
    [PDF]

2024

  • Focused Test Generation for Autonomous Driving Systems
    Tahereh Zohdinasab, Vincenzo Riccio, and Paolo Tonella
    ACM Transactions on Software Engineering and Methodology (TOSEM 2024)
    [PDF]

  • Two is Better Than One: Digital Siblings to Improve Autonomous Driving Testing
    Matteo Biagiola, Andrea Stocco, Vincenzo Riccio, and Paolo Tonella
    Empirical Software Engineering (EMSE)
    [PDF]

2023

  • An Empirical Study on Low- and High-Level Explanations of Deep Learning Misbehaviours
    Tahereh Zohdinasab, Vincenzo Riccio, and Paolo Tonella
    In Proceedings of the 17th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM 2023) [PDF] [slides]

  • DeepAtash: Focused Test Generation for Deep Learning Systems
    Tahereh Zohdinasab, Vincenzo Riccio, and Paolo Tonella
    In Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2023)
    [PDF] [slides]

  • SBFT Tool Competition 2023 - Cyber-Physical Systems Track
    Matteo Biagiola, Stefan Klikovits, Jarkko Peltomaki, and Vincenzo Riccio
    In Proceedings of the IEEE/ACM 45th International Conference on Software Engineering Workshops (SBST@ICSE 2023)
    [PDF]

  • When and Why Test Generators for Deep Learning Produce Invalid Inputs: an Empirical Study
    Vincenzo Riccio, Paolo Tonella
    In Proceedings of the 45th ACM/IEEE International Conference on Software Engineering (ICSE)
    [PDF] [slides]

  • Efficient and Effective Feature Space Exploration for Testing Deep Learning Systems
    Tahereh Zohdinasab, Vincenzo Riccio, Alessio Gambi, and Paolo Tonella
    ACM Transactions on Software Engineering and Methodology (TOSEM)
    [PDF]

2022

  • Does Road Diversity Really Matter in Testing Automated Driving Systems? – A Registered Report
    Stefan Klikovits, Vincenzo Riccio, Ezequiel Castellano, Ahmet Cetinkaya, Alessio Gambi, Paolo Arcaini
    Presented at the 16th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)
    [PDF] [slides]

  • SBST Tool Competition 2022
    Alessio Gambi, Gunel Jahangirova, Vincenzo Riccio, and Fiorella Zampetti
    In Proceedings of the IEEE/ACM 44th International Conference on Software Engineering Workshops (SBST@ICSE 2022)
    [PDF]

2021

  • DeepMetis: Augmenting a Deep Learning Test Set to Increase its Mutation Score
    Vincenzo Riccio, Nargiz Humbatova, Gunel Jahangirova, and Paolo Tonella
    In Proceedings of the 36th IEEE/ACM International Conference on Automated Software Engineering (ASE 2021)
    [PDF] [slides]

  • DeepHyperion: Exploring the Feature Space of DeepLearning-Based Systems through Illumination Search
    Tahereh Zohdinasab, Vincenzo Riccio, Alessio Gambi, and Paolo Tonella
    In Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2021)
    [PDF][slides]

  • SBST Tool Competition 2021
    Sebastiano Panichella, Alessio Gambi, Fiorella Zampetti, and Vincenzo Riccio
    In Proceedings of the IEEE/ACM 43rd International Conference on Software Engineering Workshops (SBST@ICSE 2021)
    [PDF] [slides]

2020

  • Model-based exploration of the frontier of behaviours for deep learning system testing
    Vincenzo Riccio and Paolo Tonella
    In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2020)
    [PDF] [slides]

  • Testing Machine Learning based Systems: A Systematic Mapping
    Vincenzo Riccio, Gunel Jahangirova, Andrea Stocco, Nargiz Humbatova, Michael Weiss, and Paolo Tonella
    Empirical Software Engineering (EMSE)
    [PDF]

  • Taxonomy of Real Faults in Deep Learning Systems
    Nargiz Humbatova, Gunel Jahangirova, Gabriele Bavota, Vincenzo Riccio, Andrea Stocco, and Paolo Tonella
    In Proceedings of 42nd International Conference on Software Engineering (ICSE 2020)
    [PDF]

  • Do Memories Haunt You? An Automated Black Box Testing Approach for Detecting Memory Leaks in Android Apps
    Domenico Amalfitano, Vincenzo Riccio, Porfirio Tramontana, and Anna Rita Fasolino
    IEEE Access
    [PDF]

2019

  • Combining automated gui exploration of android apps with capture and replay through machine learning
    Domenico Amalfitano, Vincenzo Riccio, Nicola Amatucci, Vincenzo De Simone, and Anna Rita Fasolino
    Information and Software Technology (IST)
    [PDF]

2018

  • Is this the lifecycle we really want? an automated black-box testing approach for Android activities
    Vincenzo Riccio, Domenico Amalfitano, and Anna Rita Fasolino
    In Companion Proceedings for the ISSTA/ECOOP 2018 Workshops (INTUITESTBEDS@ISSTA/ECOOP 2018)
    [PDF] [slides]

  • Why does the orientation change mess up my Android application? From GUI failures to code faults
    Domenico Amalfitano, Vincenzo Riccio, Ana CR Paiva, and Anna Rita Fasolino
    Software Testing, Verification and Reliability (STVR 2018)
    [PDF]

2017

  • Towards a thing-in-the-loop approach for the verification and validation of IoT systems
    Domenico Amalfitano, Nicola Amatucci, Vincenzo De Simone, Vincenzo Riccio, and Anna Rita Fasolino
    In Proceedings of the 1st ACM Workshop on the Internet of Safe Things (SafeThings@SenSys 2017)
    [PDF]

2015

  • Comparing model coverage and code coverage in model driven testing: an exploratory study
    Domenico Amalfitano, Vincenzo De Simone, Anna Rita Fasolino, and Vincenzo Riccio
    In Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (TESTBEDS@ASE 2015)
    [PDF]