Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OpenTalks.AI - Александр Артеменков, Towards Sc...

Avatar for OpenTalks.AI OpenTalks.AI
February 21, 2020
Science
0
2.1k

OpenTalks.AI - Александр Артеменков, Towards Scalable Dimensionality Reduction via Noise Contrastive Estimation

Avatar for OpenTalks.AI

OpenTalks.AI

February 21, 2020
Tweet

More Decks by OpenTalks.AI

See All by OpenTalks.AI
OpenTalks.AI - Виктор Лемпицкий, Моделирование 3Д сцен: новые подходы в 2020 году
Avatar for OpenTalks.AI opentalks
0
480
OpenTalks.AI - Алексей Чернявский, Нейросетевые алгоритмы для повышения качества медицинских изображений
Avatar for OpenTalks.AI opentalks
0
430
OpenTalks.AI - Александр Громов, Устойчивость нейросетевых моделей при анализе КТ/НДКТ-исследований
Avatar for OpenTalks.AI opentalks
0
370
OpenTalks.AI - Денис Тимонин, Megatron-LM: Обучение мультимиллиардных LMs при помощи техники Model Parallelism
Avatar for OpenTalks.AI opentalks
0
500
OpenTalks.AI - Егор Филимонов, Возможности платформы Huawei Atlas и эффективный гетерогенный инференс.
Avatar for OpenTalks.AI opentalks
0
140
OpenTalks.AI - Александр Прозоров, Референсная архитектура робота сервисного центра в отраслях с изменчивыми бизнес-процессами
Avatar for OpenTalks.AI opentalks
0
370
OpenTalks.AI - Наталья Лукашевич, Анализ тональности по отношению к компании — с чем не справился BERT
Avatar for OpenTalks.AI opentalks
0
330
OpenTalks.AI - Константин Воронцов, Фейковые новости и другие типы потенциально опасного дискурса: типология, подходы, датасеты, соревнования
Avatar for OpenTalks.AI opentalks
0
430
OpenTalks.AI - Дмитрий Ветров, Фрактальность функции потерь, эффект двойного спуска и степенные законы в глубинном обучении - фрагменты одной мозаики
Avatar for OpenTalks.AI opentalks
0
460

Other Decks in Science

See All in Science
KH Coderチュートリアル（スライド版）
Avatar for HIGUCHI Koichi koichih
1
46k
安心・効率的な医療現場の実現へ　～オンプレAI & ノーコードワークフローで進める業務改革～
Avatar for W&B Si siyoo
0
320
データベース01: データベースを使わない世界
Avatar for Y. Yamamoto trycycle
PRO
1
770
AIによる科学の加速： 各領域での革新と共創の未来
Avatar for Masaya Mori (森正弥) / CAIO (Chief AI Officer) masayamoriofficial
0
110
機械学習 - pandas入門
Avatar for Y. Yamamoto trycycle
PRO
0
310
データマイニング - ウェブとグラフ
Avatar for Y. Yamamoto trycycle
PRO
0
170
テンソル分解による糖尿病の組織特異的遺伝子発現の統合解析を用いた関連疾患の予測
Avatar for Y-h. Taguchi tagtag
2
240
Lean4による汎化誤差評価の形式化
Avatar for Kei Tsukamoto milano0017
1
300
データから見る勝敗の法則 / The principle of victory discovered by science (open lecture in NSSU)
Avatar for konakalab konakalab
1
140
データベース03: 関係データモデル
Avatar for Y. Yamamoto trycycle
PRO
1
260
白金鉱業Meetup Vol.16_数理最適化案件のはじめかた・すすめかた
Avatar for BrainPad brainpadpr
4
2k
凸最適化からDC最適化まで
Avatar for ざきまつ santana_hammer
1
290

Featured

See All Featured
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
8
520
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
54
11k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.4k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
48
9.7k
Designing for humans not robots
Avatar for Tammie Lister tammielis
253
25k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
271
21k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
184
22k
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
29
2.9k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
248
1.3M
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
187
55k
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
16k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
252
21k

Transcript

  1. Towards Scalable Dimensionality Reduction Aleksandr Artemenkov joint work with Maxim

    Panov via Noise Contrastive Estimation

  2. News Headlines Of India 3 million topics you are unfamiliar

    with Kaggle Dataset
  3. None

  4. Just repeat 3 million times! (not a good idea)

  5. Is there a better approach? (visualization)

  6. None

  7. Noise Contrastive Estimation (without a single formula) (check out the

    poster for them)

  8. Building Representation “cold” “frosty” “cold” “warm” “cold” “first” similar different

    unrelated (noisy) ? ? ?

  9. Simple Insight • similar points = closer than predefined noisy

    distance • different points = further than predefined noisy distance Any benefits from such approach?

  10. Parallelized Batch Optimization • noisy distance is predefined • repel

    different points • attract similar points • adjustments are independent of each other to distinguish them from noise Meet NCVis! (Noise Contrastive Visualization) GitHub Repository

  11. Why use NCVis? (there are reasons) Paper

  12. None
  13. None

  14. Thank you for your attention! (find me near the poster)