Skip to content

Commit 7297560

Browse files
micpap25dorian451bmcutler
authored
[Refactor:Developer] Add hidden test case details (#619)
Co-authored-by: dorian451 <[email protected]> Co-authored-by: Barb Cutler <[email protected]>
1 parent a241a96 commit 7297560

File tree

3 files changed

+63
-0
lines changed

3 files changed

+63
-0
lines changed
Lines changed: 52 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,52 @@
1+
---
2+
title: Hidden Testcase Examples
3+
category: Instructor > Autograding
4+
redirect_from:
5+
- /instructor/assignment_configuration/hidden_testcase_examples
6+
---
7+
8+
### Hide Testcase Details and Score, Never Release
9+
10+
In your `config.json`, add this line to the testcase:
11+
```
12+
"hidden": true
13+
```
14+
15+
This is what it will look like for students:
16+
17+
#### Image goes here
18+
19+
#### Discussion of use
20+
21+
### Hide Testcase Details and Score, Release With Grades
22+
23+
In your `config.json`, add these lines to the testcase:
24+
```
25+
"hidden": true,
26+
"release_hidden_details": true
27+
```
28+
29+
This is what it will look like for students:
30+
31+
#### Image goes here
32+
33+
#### Discussion of use
34+
35+
### Hide Testcase Details, Show Score
36+
37+
In your `config.json`, **do not** change the `hidden` field.
38+
Instead, add these lines to the validation of the testcase:
39+
```
40+
"show_actual": never,
41+
"show_expected": never
42+
```
43+
Additionally, if working with image differences, add this line:
44+
```
45+
"show_difference_image": never
46+
```
47+
48+
This is what it will look like for students:
49+
50+
#### Image goes here
51+
52+
#### Discussion of use

_docs/instructor/autograding/specification.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -183,6 +183,16 @@ executables.
183183
**type:** _boolean_
184184
**default value:** ``false``
185185

186+
_Students will not know how many points hidden test cases are worth or
187+
how many points they recieve for that test case. For similar functionality
188+
while still allowing students to see how many points they receive, adjust
189+
``show_message``, ``show_actual``, and ``show_expected`` in validation instead._
190+
191+
192+
* **field:** ``"release_hidden_details"``
193+
**type:** _boolean_
194+
**default value:** ``false``
195+
186196

187197
* **field:** ``"extra_credit"``
188198
**type:** _boolean_

navtreedata.js

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -132,6 +132,7 @@ var NAVTREE =
132132
[ "Validation", "/instructor/autograding/validation", null ],
133133
[ "Batch Regrade Submissions", "/instructor/autograding/batch_regrade", null ],
134134
[ "Sample Assignments", "/instructor/autograding/sample_assignments", null ],
135+
[ "Hidden Testcase Examples", "/instructor/autograding/hidden_testcase_examples", null ],
135136
[ "Docker Images", "/instructor/autograding/docker_images", null ],
136137
[ "Docker UI", "/instructor/autograding/docker_ui", null ],
137138
[ "Static Analysis", "/instructor/autograding/static_analysis/index", [

0 commit comments

Comments
 (0)