Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
09 API Interactions III.
Search
LiLa'16
March 20, 2016
Research
0
50
09 API Interactions III.
LiLa'16
March 20, 2016
Tweet
Share
More Decks by LiLa'16
See All by LiLa'16
01 Introduction
lila16ecir
0
77
02 Online Evaluation
lila16ecir
0
85
03 LL4IR Architecture
lila16ecir
0
66
04 Use-Cases
lila16ecir
0
69
05 API Interactions I.
lila16ecir
0
63
06 Models for Use-Cases
lila16ecir
0
55
07 API Interactions II.
lila16ecir
0
54
08 Interpreting Feedback
lila16ecir
0
96
10 Simulations
lila16ecir
0
74
Other Decks in Research
See All in Research
[CV勉強会@関東 CVPR2025] VLM自動運転model S4-Driver
shinkyoto
2
520
カスタマーサクセスの視点からAWS Summitの展示を考える~製品開発で活用できる勘所~
masakiokuda
2
210
Time to Cash: The Full Stack Breakdown of Modern ATM Attacks
ratatata
0
160
AWSで実現した大規模日本語VLM学習用データセット "MOMIJI" 構築パイプライン/buiding-momiji
studio_graph
2
690
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
tomoyanonymous
0
200
一人称視点映像解析の最先端(MIRU2025 チュートリアル)
takumayagi
6
3.8k
Language Models Are Implicitly Continuous
eumesy
PRO
0
290
RHO-1: Not All Tokens Are What You Need
sansan_randd
1
190
最適決定木を用いた処方的価格最適化
mickey_kubo
4
1.9k
AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label data
satai
3
330
Submeter-level land cover mapping of Japan
satai
3
410
Adaptive Experimental Design for Efficient Average Treatment Effect Estimation and Treatment Choice
masakat0
0
120
Featured
See All Featured
Reflections from 52 weeks, 52 projects
jeffersonlam
352
21k
Building Applications with DynamoDB
mza
96
6.7k
Into the Great Unknown - MozCon
thekraken
40
2.1k
Practical Orchestrator
shlominoach
190
11k
Unsuck your backbone
ammeep
671
58k
Raft: Consensus for Rubyists
vanstee
139
7.1k
GitHub's CSS Performance
jonrohan
1032
470k
Large-scale JavaScript Application Architecture
addyosmani
514
110k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
A Modern Web Designer's Workflow
chriscoyier
697
190k
The Cost Of JavaScript in 2023
addyosmani
53
9k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Transcript
Anne Schuth (Blendle / University of Amsterdam, The Netherlands) Krisztian
Balog (University of Stavanger, Norway) Tutorial at ECIR 2016 in Padua, Italy API Interactions III.
Outline for API interactions • Obtaining an API key and
signing up for a site • Getting queries and candidate items • Generating and uploading rankings • Obtaining feedback and outcome
Feedback endpoint • GET /api/participant/feedback/(key)/ (qid)[/(runid)] • Returns feedback for
this user on this query • runid is optional • qid can be “all”
Feedback endpoint { "feedback": [ {"qid": "S-q1", "runid": "baseline", "modified_time":
"Sun, 27 Apr 2014 13:46:00 -0000", "doclist": [ { "clicked": false, "docid": "R-d89", "team": "participant" }, { "clicked": false, "docid": "R-d87", "team": "site" }, { "clicked": true, "docid": "R-d88", "team": "site" }, ...
Outcome endpoint • GET /api/participant/outcome/(key)/ (qid) • Returns outcome for
this user on this query • Outcomes are aggregated per test period • qid can be “all”
Outcome endpoint { "outcomes": [ { "impressions": 661, "losses": 103,
"outcome": 0.4690721649484536, "qid": "all", "site_id": "R", "test_period": { "end": "Sat, 16 May 2015 00:00:00 -0000", "name": "CLEF LL4IR Round #1", "start": "Fri, 01 May 2015 00:00:00 -0000" }, "ties": 467, "type": "test", "wins": 91 }, ... ] }
Exercise • Complete 03_feedback.py to obtain feedback and outcome for
the queries from the run(s) you submitted in exercise #2
What to do with this feedback? • You figure it
out… • (That might be your next paper)