ArcMutate vs Cosmic Ray

ArcMutate

6.4 #1 in Mutation Testing Tools

About ArcMutate

Cosmic Ray

5.8 #6 in Mutation Testing Tools

About Cosmic Ray
ArcMutateCosmic Ray
Free planYesNo
Free trialYesNo
Paid from$8/mo—
Open sourceNoNo
PlatformsLinux, macOS, self-hosted, WindowsLinux, self-hosted
Free planYesYes
Supported languagesJava, Kotlin, GroovyPython 3
Test frameworksJUnit 4, JUnit 5, Spring Test, Mockito, MockK, Robolectricunittest, pytest, nose
Incremental analysisYesYes
Parallel executionYesYes
Surviving mutant reportsYesYes
Mutation quality gateYes—
Mutation operatorsExtended, extreme, chained calls, varargs, one-less-parameter, remove distinct/filter/limit/skip/sorted, predicate operators, field writes, parameter swaps, stream match swaps, reactive return and mapping operators, Groovy boundary and conditional operators, Spring annotation operatorsbinary operator replacement; boolean replacement; break/continue replacement; comparison operator replacement; exception replacement; keyword replacement; number replacement; decorator removal; unary operator replacement; zero-iteration for loops

Both are listed in Best Mutation Testing Tools. On Samsung Mobile US Press, ArcMutate scores higher on our published basis.