Raise_2022 Evaluation & Annual Report_Web

The power of showing up | raise.org.au

35

The Raise impact over time

Outcome

Measure

2022 2021

2020 2019

Enjoyed the program Things are different

Proportion Proportion

99% 97% 98% 99% 77% 78% 79% 85%

Asking for help

Statistically significant impact

Yes

Yes ~

N/A N/A

N/A N/A

Effect size

0.36

0.3~

Resilience

Statistically significant impact

Yes

Yes

Yes ~

Yes

Effect size

0.24

0.1

0.32 ~

0.1

Hope for the future

Statistically significant impact

Yes

Yes ~

Yes

Yes

Effect size

0.38

0.8~

0.18 N/A N/A

0.3

School belonging

Statistically significant impact

Yes ~

Yes ~

N/A N/A

Effect size

0.81 ~

0.2 ~

Note 1: ~ For mentees who started with a low score at the start of the program

A note about the statistical methodology we use We use a repeated-sample t-test (or paired t-test) methodology to determine whether any changes in outcomes between the pre-program measure and the post-program measure are statistically significant. We test at a 5 per cent level of significance.

To determine the threshold for the ‘low starting score’ cohorts for each outcome we use, where possible, accepted or recommended cutoff points. Where there are no recommended cutoff points (for example for Raise-designed measures) we have set cutoff points based on data characteristics and tested these using sensitivity analysis.

“I am thankful for the program and the time the mentor took to spend each week getting to know our daughter. It gave our daughter something to look forward to each week. She was very unsure at the start as talking to people she doesn’t know was hard especially with her social anxiety. We could see as each week passed, she was coming out of her shell and happy to talk with her mentor. It was a positive experience and made a big difference for our daughter.” - Sue, Parent

Made with FlippingBook Converter PDF to HTML5