A chi-square test of independence confirmed that this difference was highly statistically significant, X²(1, N = 333) = 19.09, p < .001, with a small-to-medium effect size (φ = .24). Matches made through MentorPRO had roughly one-quarter the odds of closing early relative to those made manually by staff (OR = 0.25), and their closure rate was approximately one-third that of the comparison group (RR = 0.33). These differences reflect a meaningful and replicable pattern. Zing also evaluated relationship quality, including goal and relationship strength and progress, follow-up, and commitment. MentorPRO-matched pairs scored higher on match quality than manually assigned pairs.
|
Outcome |
MentorPRO Matches (n = 133) |
Manually Matched (n = 200) |
|
Early Match Closure Rate |
10.87% |
29.41% |
|
Difference in Closure Rates |
18+ percentage points lower |
Reference group |
|
Odds of Early Closure |
One-quarter the odds (OR = 0.25) |
Reference group |
|
Relative Closure Rate |
One-third that of manual matching (RR = 0.33) |
Reference group |
|
Statistical Significance |
X²(1, N = 333) = 19.09, p < .001 |
|
|
Effect Size |
φ = .24 (small-to-medium) |
|
|
Match Quality Ratings |
Higher across goal progress, relationship strength, follow-up, and commitment |
Lower on all match quality indicators |
Algorithmic Matching vs. Manual Assignment