Consultation Paper - Review of Excellence in Research for A…

Issues to be explored

Q4.11

Are the two-digit Field of Research codes the most appropriate method to define units of assessment for Engagement and Impact? Yes/No. Please explain your answer. Are there other ways to classify units of assessment in EI, for example, SEO codes? Yes/No. Please explain your answer.

Q4.12

4.3.2 EI methodology at a glance EI is a selective assessment which has three components: research engagement, impact, and approach to impact. An EI round opens with submission of data by universities for assessment in EI. Assessments are conducted by assessment panels, comprised of expert researchers and end-users, through a series of individual and panel assessment processes. These are outlined in the EI 2018 Assessment Handbook. 4.3.3 Selectiveness of EI Unlike ERA, which is a comprehensive evaluation, in EI only a single engagement narrative and a single impact study (which includes the approach to impact) is required per broad discipline in a university. A small suite of income-based engagement indicators, and indicator explanatory statement, are also included for engagement. Universities are able to select the information they include in an engagement narrative and/or impact narrative for each discipline. Universities are only required to provide a submission for disciplines in which they met the EI low-volume threshold. In EI 2018, the maximum number of units that could be submitted by any university was 25. 19 The decision to make EI a selective assessment was intended to minimise the burden placed on universities participating in EI. In feedback the ARC has received from universities since EI 2018, views were mixed on the scale of EI. Some respondents proposed a more comprehensive assessment or greater flexibility around the numbers of units of assessment that can be submitted, while others have suggested using other mechanisms to determine submission eligibility apart from the number of research publications submitted in the unit of assessment during ERA 2018.

Issues to be explored

Q4.13

Should there be more or fewer units of assessment per university? More units of assessment; The same number as in EI 2018; Fewer units of assessment.

a. How many and why? Please explain your answer.

4.3.4 EI low-volume threshold In general, EI assessed broad disciplines at universities where there were meaningful levels of data for assessment. For this reason, a low-volume threshold was applied. The low-volume threshold for a unit was based on the number of research publications submitted in the broad discipline by a university for ERA 2018.

19 One per two-digit Field of Research, plus one Interdisciplinary impact study, plus one Aboriginal and Torres Strait Islander research impact study.

25

Made with FlippingBook Proposal Creator