Upgrade to Pro — share decks privately, control downloads, hide ads and more …

07 API Interactions II.

Avatar for LiLa'16 LiLa'16
March 20, 2016

07 API Interactions II.

Avatar for LiLa'16

LiLa'16

March 20, 2016
Tweet

More Decks by LiLa'16

Other Decks in Research

Transcript

  1. Anne Schuth (Blendle / University of Amsterdam, The Netherlands) Krisztian

    Balog (University of Stavanger, Norway) Tutorial at ECIR 2016 in Padua, Italy API Interactions II.
  2. Outline for API interactions • Obtaining an API key and

    signing up for a site • Getting queries and candidate items • Generating and uploading rankings • Obtaining feedback and outcome
  3. Run endpoint • PUT /api/participant/run/(key)/(qid) • Submit a ranking for

    a specific query • A run is just a ranking of docids as shown to users • A run can be updated • Note: runs for test queries can only be updated before the test period starts
  4. Example { 'doclist': [ {'docid': u'R-d70'}, {'docid': u'R-d72'}, {'docid': u'R-d74'},

    {'docid': u'R-d75'}, {'docid': u'R-d1270'}, {'docid': u'R-d73'}, {'docid': u'R-d1271'}, {'docid': u'R-d71'}], 'qid': u'R-q2', 'runid': "LiLa’16" } R-q2 Q0 R-d70 1 0.9 LiLa16 R-q2 Q0 R-d72 2 0.8 LiLa16 R-q2 Q0 R-d74 3 0.7 LiLa16 R-q2 Q0 R-d75 4 0.6 LiLa16 R-q2 Q0 R-d1270 5 0.5 LiLa16 R-q2 Q0 R-d73 6 0.4 LiLa16 R-q2 Q0 R-d1271 7 0.3 LiLa16 R-q2 Q0 R-d71 8 0.2 LiLa16
  5. Example { 'doclist': [ {'docid': u'R-d70'}, {'docid': u'R-d72'}, {'docid': u'R-d74'},

    {'docid': u'R-d75'}, {'docid': u'R-d1270'}, {'docid': u'R-d73'}, {'docid': u'R-d1271'}, {'docid': u'R-d71'}], 'qid': u'R-q2', 'runid': "LiLa’16" } PUT http://api.living-labs.net/api/
 participant/doclist/(key)/R-q2
  6. Exercise • Code for baseline (single field) retrieval and uploading

    the ranking to the API is given in 02_ranker.py 1. Implement multi-field retrieval 2. Incorporate historical feedback into the ranking