HN
Today

Show HN: Finalrun – Spec-driven testing using English and vision for mobile apps

Finalrun introduces an open-source, AI-driven CLI tool designed to revolutionize mobile app testing by addressing the inherent brittleness of traditional selectors and the challenge of test maintenance. It leverages vision-based execution across Android and iOS, coupled with codebase-integrated test generation. This solution promises more robust and synchronized test automation by allowing tests to live alongside the code they validate.

5
Score
2
Comments
#17
Highest Rank
3h
on Front Page
First Seen
Apr 7, 4:00 PM
Last Seen
Apr 7, 6:00 PM
Rank Over Time
171728

The Lowdown

Finalrun is an innovative, open-source command-line interface (CLI) tool aimed at streamlining mobile app testing using AI and vision capabilities. The creator developed Finalrun to overcome common frustrations in mobile test automation, specifically the reliance on fragile selectors like XPath and the difficulty of keeping tests aligned with rapidly changing application code. Instead of manual test definition or PRD-generated tests that quickly go out of sync, Finalrun integrates test generation directly into the development workflow.

  • Vision-Based Execution: Finalrun employs a vision-based agent that can 'see' the mobile screen, understand user intent, and perform actions on both Android and iOS platforms without needing brittle selectors.
  • Codebase-Contextual Test Generation: Tests are generated from the codebase context and reside locally within the repository, ensuring they stay synchronized with the application's evolution.
  • YAML-Based Test Flows: Test specifications are written in simple YAML files, making them human-readable and maintainable.
  • Secure Environment Handling: The tool provides a robust mechanism for managing environment variables and secrets, utilizing .env files and .gitignore to prevent sensitive data from being committed to the repository.
  • Comprehensive CLI Commands: It offers commands for workspace validation (check), test execution (test, suite), platform readiness diagnosis (doctor), report inspection (runs), and local report server management.
  • AI Provider Integration: Finalrun supports leading AI models from OpenAI, Google, and Anthropic for test generation, with secure API key management.

By combining visual intelligence with tight integration into the development lifecycle, Finalrun aims to deliver a more reliable and efficient approach to mobile app quality assurance, reducing the overhead typically associated with maintaining comprehensive test suites.