Raise Foundation 2023 Annual & Evaluation Report

The power of showing up | raise.org.au

35

The Raise impact over time

Outcome

Measure

2023 2022 2021

2020 2019

Enjoyed the program Things are different

Proportion Proportion

97% 99% 97% 98% 99% 77% 77% 78% 79% 85%

Asking for help

Statistically significant impact

Yes

Yes

Yes ~

N/A N/A

N/A N/A

Effect size

0.47

0.36

0.3~

Resilience

Statistically significant impact

Yes

Yes

Yes

Yes ~

Yes

Effect size

0.16

0.24

0.1

0.32 ~

0.1

Hope for the future

Statistically significant impact

Yes

Yes

Yes ~

Yes

Yes

Effect size

0.39

0.38

0.8~

0.18 N/A N/A

0.3

School belonging

Statistically significant impact

Yes

Yes ~

Yes ~

N/A N/A

Effect size

0.27

0.81 ~

0.2 ~

Note 1: ~ For mentees who started with a low score at the start of the program

A note about the statistical methodology we use We use a repeated-sample t-test (or paired t-test) methodology to determine whether any changes in outcomes between the pre-program measure and the post-program measure are statistically significant. We test at a 5 per cent level of significance.

To determine the threshold for the ‘low starting score’ cohorts for each outcome we use, where possible, accepted or recommended cutoff points. Where there are no recommended cutoff points (for example for Raise-designed measures) we have set cutoff points based on data characteristics and tested these using sensitivity analysis.

“My child now looks forward to going to school where beforehand it was a constant battle to get them there. He has gained heaps of confidence, not only with his school work but also with expressing when he needs help.” - Sue, Parent

Made with FlippingBook Converter PDF to HTML5