07 API Interactions II.

Transcript

1. Anne Schuth (Blendle / University of Amsterdam, The Netherlands) Krisztian Balog (University of Stavanger, Norway) Tutorial at ECIR 2016 in Padua, Italy API Interactions II.
2. Outline for API interactions • Obtaining an API key and signing up for a site • Getting queries and candidate items • Generating and uploading rankings • Obtaining feedback and outcome
3. Uploading ranking Living Labs API Researcher ranking click Queries Documents
4. Run endpoint • PUT /api/participant/run/(key)/(qid) • Submit a ranking for a specific query • A run is just a ranking of docids as shown to users • A run can be updated • Note: runs for test queries can only be updated before the test period starts
5. Example { 'doclist': [ {'docid': u'R-d70'}, {'docid': u'R-d72'}, {'docid': u'R-d74'}, {'docid': u'R-d75'}, {'docid': u'R-d1270'}, {'docid': u'R-d73'}, {'docid': u'R-d1271'}, {'docid': u'R-d71'}], 'qid': u'R-q2', 'runid': "LiLa’16" } R-q2 Q0 R-d70 1 0.9 LiLa16 R-q2 Q0 R-d72 2 0.8 LiLa16 R-q2 Q0 R-d74 3 0.7 LiLa16 R-q2 Q0 R-d75 4 0.6 LiLa16 R-q2 Q0 R-d1270 5 0.5 LiLa16 R-q2 Q0 R-d73 6 0.4 LiLa16 R-q2 Q0 R-d1271 7 0.3 LiLa16 R-q2 Q0 R-d71 8 0.2 LiLa16
6. Example { 'doclist': [ {'docid': u'R-d70'}, {'docid': u'R-d72'}, {'docid': u'R-d74'}, {'docid': u'R-d75'}, {'docid': u'R-d1270'}, {'docid': u'R-d73'}, {'docid': u'R-d1271'}, {'docid': u'R-d71'}], 'qid': u'R-q2', 'runid': "LiLa’16" } PUT http://api.living-labs.net/api/
 participant/doclist/(key)/R-q2
7. Historical feedback • Go figure • http://doc.living-labs.net/en/latest/api- participant.html#historical-feedback
8. Exercise • Code for baseline (single field) retrieval and uploading the ranking to the API is given in 02_ranker.py 1. Implement multi-field retrieval 2. Incorporate historical feedback into the ranking