mlte/qa_category/functionality/task_efficacy.py
TaskEfficacy QACategory definition.
TaskEfficacy
Bases: QACategory
The TaskEfficacy QACategory assesses the ability of
a model to perform the task for which it is designed.
Source code in mlte/qa_category/functionality/task_efficacy.py
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28 | class TaskEfficacy(QACategory):
"""
The TaskEfficacy QACategory assesses the ability of
a model to perform the task for which it is designed.
"""
def __init__(self, rationale: str):
"""Initialize a TaskEfficacy instance."""
super().__init__(
instance=self,
description="""
The TaskEfficacy QACategory assesses a model's ability
to correctly perform instances of its task. The means
of measurement for this QACategory will vary by both
domain and task. Examples include accuracy, error rate,
and average precision, but many others are possible.
""",
rationale=rationale,
)
|
__init__(rationale)
Initialize a TaskEfficacy instance.
Source code in mlte/qa_category/functionality/task_efficacy.py
16
17
18
19
20
21
22
23
24
25
26
27
28 | def __init__(self, rationale: str):
"""Initialize a TaskEfficacy instance."""
super().__init__(
instance=self,
description="""
The TaskEfficacy QACategory assesses a model's ability
to correctly perform instances of its task. The means
of measurement for this QACategory will vary by both
domain and task. Examples include accuracy, error rate,
and average precision, but many others are possible.
""",
rationale=rationale,
)
|