Systematic Testing for Complex Systems in the Absence of Oracles
Abstract: Many modern software systems operate in domains where precise specifications are unavailable and reliable test oracles are difficult or impossible to obtain. This is particularly true for systems such as program analyzers, cryptographic proof systems, and machine-learning models, whose correctness depends on complex semantics or learned behavior. This keynote explores how metamorphic testing enables systematic testing in the absence of traditional oracles by checking necessary relations across multiple executions rather than individual outputs. Drawing on experience from testing program analyzers, zero-knowledge proof systems, and machine-learning models, the talk highlights the effectiveness of metamorphic testing across diverse settings. Beyond individual techniques and tools, the keynote distills general lessons on how to reason about correctness when specifications are incomplete, relational, or implicit, and how rigorous testing remains possible even when classical notions of correctness are difficult to apply.
Achieving Digital Sovereignty in Europe: Key Considerations for Success
Abstract: European Digital Sovereignty is on everyone’s lips. European governments are making their intentions clear, with EU Member States signing the Declaration for European Digital Sovereignty, setting out landmark commitments to reduce Europe’s dependence on a small number of global platforms and to invest in trusted European infrastructures. Industry events have been popping up everywhere and governments are working hard to share knowledge and try to crack the problem. Open Source and Digital Commons are cornerstones of the solution, and the launch of the Digital Commons EDIC in December 2025 is a good example of the work being done.
But what is Digital Sovereignty, why is it important and why are Open Source and Digital Commons so central to it? And more importantly: What are the traps to avoid and best practices if we want to implement Digital Sovereignty successfully? Let’s pause and have a think.
Abstract: The keynote shares a line of studies that carry out human-like testing using large language model(LLM)-driven testing agents, especially in GUI testing. First, we present LLM-powered automated mobile GUI testing that frames interaction between LLM and mobile apps as a functionality-aware exploration process, demonstrating strong activity coverage and real-world bug discovery at scale. Second, to emulate how human testers accumulate experience, we introduce dynamic memory for GUI testing agents, including interaction-level episodic memory, function-level reflective memory, and app-level strategic memory, with on-demand invocation. This “experience layer” can be integrated as a plugin to improve both coverage and bug yield across different GUI testing tools and settings. Then, we extend human-like testing beyond single-user interactions by addressing multi-user interactive features, which are common in real apps and difficult to test with record-and-replay scripts due to device independence and action coordination requirements.