What are the main criteria we assess AI assistants on?
FACTOR
CRITERIA
ASSESSMENT OF GPT-4
RATIONALE
They have high responsiveness to all prompts & questions.
Relevance
Medium
They have contextual presence and relevance in interactions; they can pick up where the exchange has been left-off. They do have the ability to recognize limits but do not know when the information is inadequate.
Quality
Accuracy
Medium
Precision/ Correctness
Medium
Higih Low High Low High
Agility Reliability Expanse Consistency Retention
Turnaround speed and time is a few seconds.
The coverage of topics is high.
Scalability
Slight variation in prompts can significantly alter the response.
Provocation
Low
AI assistants have the capability to provide prompts, examples, and quick turnaround for generated text, images, and video.
Speed
High
Creativity
They do not yet provide ‘new’ ideas, pushback, or inspiration.
Medium
Variety
Low
Trust
As they are perceived to be accurate/objective, the believability remains higher than it should. AI assistants come with an existential threat, unawareness about data security, ownership/copyright concerns, and lack of content moderation across platforms.
High
Believability
Low/Medium
Psychological Safety
Safety
Medium
Physical Safety
Low
Data Safety
Closing the Gap: Unraveling the AI User Experience and Expectation Although many people are increasingly eager to adopt AI solutions at the foundational level, a lingering distrust still needs to be addressed regarding its capabilities, trustworthiness, and potential in enterprise business. This is primarily due to the recognition that the AI model can exhibit biases that result in challenging predictions and maintain racist or sexist systems.
Notwithstanding these concerns, most individuals bear an optimistic outlook on AI's future in enterprise systems, extending from routine and autonomous work to complex decision-making processes. [1]
Source: OpenAI Examples:
Figure 5: Process flow of OpenAI
12
© 2023 Fractal Analytics Inc. All rights reserved
Made with FlippingBook - PDF hosting