A chi-square test of independence confirmed that this difference was highly statistically significant, X²(1, N = 333) = 19.09, p < .001, with a small-to-medium effect size (φ = .24). Matches made through MentorPRO had roughly one-quarter the odds of closing early relative to those made manually by staff (OR = 0.25), and their closure rate was approximately one-third that of the comparison group (RR = 0.33). These  differences reflect a meaningful and replicable pattern. Zing also evaluated relationship quality, including goal and relationship strength and progress, follow-up, and commitment. MentorPRO-matched pairs scored higher on match quality than manually assigned pairs.

Outcome

MentorPRO Matches (n = 133)

Manually Matched (n = 200)

Early Match Closure Rate

10.87%

29.41%

Difference in Closure Rates

18+ percentage points lower

Reference group

Odds of Early Closure

One-quarter the odds (OR = 0.25)

Reference group

Relative Closure Rate

One-third that of manual matching (RR = 0.33)

Reference group

Statistical Significance

X²(1, N = 333) = 19.09, p < .001

 

Effect Size

φ = .24 (small-to-medium)

 

Match Quality Ratings

Higher across goal progress, relationship strength, follow-up, and commitment

Lower on all match quality indicators

Algorithmic Matching vs. Manual Assignment