Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

OpenTalks.AI - Александр Артеменков, Towards Sc...

Avatar for OpenTalks.AI OpenTalks.AI
February 21, 2020
Science
2.2k
0

OpenTalks.AI - Александр Артеменков, Towards Scalable Dimensionality Reduction via Noise Contrastive Estimation

Avatar for OpenTalks.AI

OpenTalks.AI

February 21, 2020

More Decks by OpenTalks.AI

See All by OpenTalks.AI
OpenTalks.AI - Виктор Лемпицкий, Моделирование 3Д сцен: новые подходы в 2020 году
Avatar for OpenTalks.AI opentalks
0
500
OpenTalks.AI - Алексей Чернявский, Нейросетевые алгоритмы для повышения качества медицинских изображений
Avatar for OpenTalks.AI opentalks
0
460
OpenTalks.AI - Александр Громов, Устойчивость нейросетевых моделей при анализе КТ/НДКТ-исследований
Avatar for OpenTalks.AI opentalks
0
390
OpenTalks.AI - Денис Тимонин, Megatron-LM: Обучение мультимиллиардных LMs при помощи техники Model Parallelism
Avatar for OpenTalks.AI opentalks
0
550
OpenTalks.AI - Егор Филимонов, Возможности платформы Huawei Atlas и эффективный гетерогенный инференс.
Avatar for OpenTalks.AI opentalks
0
190
OpenTalks.AI - Александр Прозоров, Референсная архитектура робота сервисного центра в отраслях с изменчивыми бизнес-процессами
Avatar for OpenTalks.AI opentalks
0
410
OpenTalks.AI - Наталья Лукашевич, Анализ тональности по отношению к компании — с чем не справился BERT
Avatar for OpenTalks.AI opentalks
0
350
OpenTalks.AI - Константин Воронцов, Фейковые новости и другие типы потенциально опасного дискурса: типология, подходы, датасеты, соревнования
Avatar for OpenTalks.AI opentalks
0
470
OpenTalks.AI - Дмитрий Ветров, Фрактальность функции потерь, эффект двойного спуска и степенные законы в глубинном обучении - фрагменты одной мозаики
Avatar for OpenTalks.AI opentalks
0
500

Other Decks in Science

See All in Science
暗号解読における量子計算の展望
Avatar for Nkowne63 neutron63zf
0
450
コーヒー豆様核 (Coffee-bean nuclei) における形態学的サブタイピングと精選・焙煎特性の同定
Avatar for Teramoto Yuki jagupath
PRO
0
190
言葉をはかる：テキストマイニング入門①講義編
Avatar for Kosuke Sato satocos135
0
270
明治薬科大学講義_ビッグデータ解析を支えるデータベース技術とクラウドコンピューティング
Avatar for Tatsuya Koreeda ktatsuya
1
200
[TMLR 2026, Featured Certification] Double Bounded α-Divergence Optimization for Density Estimation
Avatar for Kazu Ghalamkari gkazunii
1
130
機械学習 - 授業概要
Avatar for Y. Yamamoto trycycle
PRO
0
670
機械学習 - DBSCAN
Avatar for Y. Yamamoto trycycle
PRO
0
2.2k
大黒市で発生した大規模インシデント の ポストモーテムから読み解く、 記憶媒体消去の大切さ
Avatar for しゅういちろ shucho0103
0
300
チュートリアル：世界モデル
Avatar for Hironobu Fujiyoshi hf149
0
2.4k
From Prediction to Understanding: Causal Discovery for Data Science and AI Applications
Avatar for Shohei SHIMIZU sshimizu2006
0
320
[Webinaire InnOvin] Coup de Chaud : Comment préserver la santé des animaux
Avatar for Idele institutdelelevage
PRO
0
220
Where does the rigor go? Research software and the future of trustworthy science.
Avatar for Arfon Smith arfon
0
350

Featured

See All Featured
Unsuck your backbone
Avatar for Amy Palamountain ammeep
672
58k
Side Projects
Avatar for Sacha Greif sachag
456
43k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
Building a A Zero-Code AI SEO Workflow
Avatar for Ian Lurie portentint
PRO
0
770
Fireside Chat
Avatar for paigeccino paigeccino
43
4.1k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
304
22k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
KATA
Avatar for Megan Lloyd mclloyd
PRO
35
16k
The Impact of AI in SEO - AI Overviews June 2024 Edition
Avatar for Aleyda Solis aleyda
6
1.2k
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
400
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
2
620
Done Done
Avatar for chrislema chrislema
187
17k

Transcript

  1. Towards Scalable Dimensionality Reduction Aleksandr Artemenkov joint work with Maxim

    Panov via Noise Contrastive Estimation

  2. News Headlines Of India 3 million topics you are unfamiliar

    with Kaggle Dataset
  3. None

  4. Just repeat 3 million times! (not a good idea)

  5. Is there a better approach? (visualization)

  6. None

  7. Noise Contrastive Estimation (without a single formula) (check out the

    poster for them)

  8. Building Representation “cold” “frosty” “cold” “warm” “cold” “first” similar different

    unrelated (noisy) ? ? ?

  9. Simple Insight • similar points = closer than predefined noisy

    distance • different points = further than predefined noisy distance Any benefits from such approach?

  10. Parallelized Batch Optimization • noisy distance is predefined • repel

    different points • attract similar points • adjustments are independent of each other to distinguish them from noise Meet NCVis! (Noise Contrastive Visualization) GitHub Repository

  11. Why use NCVis? (there are reasons) Paper

  12. None
  13. None

  14. Thank you for your attention! (find me near the poster)