On the recordRead 30 Sep 202618 facts
Flake
On the record
- Availability
- The README describes Flake as a cross-platform Go CLI and provides a `go install` command and released binaries for OS and architecture combinations.github.com · read 30 Sep 2026
- Controlled variations
- Runs can vary test order, seeds, sequential or parallel execution, worker count, timezone, locale, temporary-directory handling, and allowed environment variables.github.com · read 30 Sep 2026
- Dependencies
- Flake uses test runners and plugins already installed in the project and does not install dependencies or plugins.github.com · read 30 Sep 2026
- Detection
- It computes failure rates and normalizes output into stable signatures to group failures into incidents.github.com · read 30 Sep 2026
- Detection and replay
- Flake computes failure rates, minimizes reproduction conditions, reports suspected causes from observed evidence, and saves replay commands.github.com · read 30 Sep 2026
- Diagnosis
- For ordering failures, Flake uses delta debugging to reduce the preceding test sequence and verify a minimized reproduction.github.com · read 30 Sep 2026
- Hosting model
- The README states that Flake has no web dashboard, server, or cloud service.github.com · read 30 Sep 2026
- Integrations
- Flake is available as a GitHub Action that can write a Markdown job summary, annotate flaky test files, and upload JSON, Markdown, or SARIF reports as an artifact.github.com · read 30 Sep 2026
- License
- The repository lists the MIT license.github.com · read 30 Sep 2026
- Limitations
- With Jest, Flake cannot force an exact cross-file test order because Jest's own sequencer chooses it.github.com · read 30 Sep 2026
- Local execution
- Flake is a cross-platform Go command-line tool, with released binaries available for operating systems and architectures on its releases page.github.com · read 30 Sep 2026
- Privacy
- The README says Flake does not upload source or test output, and stores its state in a local SQLite database in the OS application-data directory.github.com · read 30 Sep 2026
- Purpose
- Flake detects, diagnoses, and replays flaky tests by repeatedly running test suites under controlled variations.github.com · read 30 Sep 2026
- Replay
- Each incident stores a run specification, and `flake replay <id>` rebuilds the recorded invocation.github.com · read 30 Sep 2026
- Secret handling
- Flake redacts likely-secret values before storing them and rejects secret-looking variable names in the environment allowlist.github.com · read 30 Sep 2026
- Security controls
- Flake rejects secret-looking variable names from its environment allowlist and does not vary or store likely-secret variables by default.github.com · read 30 Sep 2026
- Supported runners
- It supports pytest, Jest, and Vitest test suites.github.com · read 30 Sep 2026
- Supported test runners
- Flake supports pytest, Jest, and Vitest.github.com · read 30 Sep 2026
