UKARA 1.0 Challenge Track 1

Dfda3ce33093a2ce23246410c5087a92?s=47 Ali Akbar S.
October 14, 2019

UKARA 1.0 Challenge Track 1

Our results from UKARA 1.0 Challenge Track 1, an NLP challenge to build an automatic short-answer scoring.

Dfda3ce33093a2ce23246410c5087a92?s=128

Ali Akbar S.

October 14, 2019
Tweet

Transcript

  1. 2.
  2. 3.
  3. 5.

    Task A Task B # Positive Train 191 (71%) 168

    (55%) # Negative Train 77 (29%) 137 (45%) Avg. # Char 87.23 97.33 # Dev 215 244 # Test 855 974
  4. 6.
  5. 8.
  6. 9.
  7. 12.

    • Tokenizer + lemmatizer • Unigram / TF-IDF ◦ •

    Latent Semantic Analysis (LSA) ◦ ◦ • ML algorithms ◦ ◦ ◦ • Evaluation metric ◦
  8. 15.
  9. 17.

    Train A Train B Dev Test Best 0.879 0.764 0.810

    0.812 Ensemble+Original 0.885 0.764 0.799 0.801 Ensemble+Updated 0.898 0.831 0.810 0.803
  10. 18.
  11. 19.
  12. 20.
  13. 21.
  14. 22.