Cosmic Ray vs Mutatest

Cosmic Ray

5.8 #6 in Mutation Testing Tools

About Cosmic Ray

Mutatest

6.3 #3 in Mutation Testing Tools

About Mutatest
Cosmic RayMutatest
Free planNoYes
Free trialNoNo
Paid from—Free
Open sourceNoNo
PlatformsLinux, self-hostedLinux, macOS, Windows
Free planYesYes
Supported languagesPython 3Python
Test frameworksunittest, pytest, nosepytest
Incremental analysisYes—
Parallel executionYesYes
Surviving mutant reportsYesYes
Mutation operatorsbinary operator replacement; boolean replacement; break/continue replacement; comparison operator replacement; exception replacement; keyword replacement; number replacement; decorator removal; unary operator replacement; zero-iteration for loopsAugAssign; BinOp; bitwise comparison; bitwise shift; BoolOp; Compare; Compare In; Compare Is; If; Index; NameConstant; Slice
Mutation quality gate—Yes

Both are listed in Best Mutation Testing Tools. On Samsung Mobile US Press, Mutatest scores higher on our published basis.