Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Relax criteria #115

Closed
michelole opened this issue Jul 19, 2017 · 2 comments
Closed

Relax criteria #115

michelole opened this issue Jul 19, 2017 · 2 comments
Labels
bug experiment P0

Comments

@michelole
Copy link
Member

We don't have 1000 results per topic, which could affect recall.

cat results/topics2017-pmid.trec_results | cut -c1-2 | sort | uniq -c | sort -n

Relax must criteria so that more docs are retrieved. Possibly related to #89.
@michelole
Copy link
Member Author

Actual counts:

   7 13
  16 15
  19 29
  49 14
  51 24
 121 28
 134 11
 248 16
 288 3	
 292 1	
 336 20
 598 12
 767 6	
 822 18
1000 10
1000 17
1000 19
1000 2	
1000 21
1000 22
1000 23
1000 25
1000 26
1000 27
1000 30
1000 4	
1000 5	
1000 7	
1000 8	
1000 9

michelole pushed a commit to michelole/trec2017 that referenced this issue Jul 27, 2017
Try to get more results by changing must queries into should
eadae63 
This tests different boost values and refs bst-mug#115.
@michelole
Copy link
Member Author

Changing must queries to should with boost 2 worsened results from 0.7693 to 0,5672.

A synonym API (#85) could be used instead.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug experiment P0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@michelole