04:05 Issue 29

04:05 GLOBAL

Survey creation and interpretation is a craft, an art form. It’s a discipline that, like payroll, has its own set of high standards. It takes a bit of experience and skill to first ask the question that captures the result in a way that can be measured empirically and then categorize and report it properly. For payroll-related surveys, those creating the questions need to understand the payroll function or risk asking the irrelevant. And for reporting the results, we all need to understand how the data can be interpreted in different directions, and that a spin of sorts can be applied. Some surveys are so much creatures of their agendas that they are crafted to achieve anticipated answers, despite their unbiased appearance to those responding to the questions. Those fielding these surveys often generally know the results; they just now need the respondent data

to verify their assumptions and then can broadcast the numbers and percentages. Know that all surveys and their reported results are not created equal. Some are fully transparent in their goals, and the results are meticulously analyzed. Others are developed particularly for clickbait, to highlight a particular aspect that fits with the marketing agenda of whoever sponsored the survey. Some also take shortcuts in the analysis, not applying the rigor necessary, and this can skew the results reported to the public. They may then contain erroneous conclusions, either through honest mistakes or, for the nefarious, even on purpose, to reach a desired conclusion. Properly trained AI agents can now sift through the responses and produce decent-looking results, but if they are not trained properly, reported results can be hallucinations. Cutting Through the Noise A rule of thumb for surveys is that they need at least 50 or more responses to get enough data to analyze, and even at that level, the results can be compromised.

For payroll-related surveys, those creating the questions need to understand the payroll function or risk asking the irrelevant.

74 I 04:05

GLOBAL PAYROLL MAGAZINE ISSUE 29

Made with FlippingBook - Share PDF online