Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OpenTalks.AI - Александр Артеменков, Towards Sc...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for OpenTalks.AI OpenTalks.AI
February 21, 2020
Science
0
2.2k

OpenTalks.AI - Александр Артеменков, Towards Scalable Dimensionality Reduction via Noise Contrastive Estimation

Avatar for OpenTalks.AI

OpenTalks.AI

February 21, 2020
Tweet

More Decks by OpenTalks.AI

See All by OpenTalks.AI
OpenTalks.AI - Виктор Лемпицкий, Моделирование 3Д сцен: новые подходы в 2020 году
Avatar for OpenTalks.AI opentalks
0
490
OpenTalks.AI - Алексей Чернявский, Нейросетевые алгоритмы для повышения качества медицинских изображений
Avatar for OpenTalks.AI opentalks
0
440
OpenTalks.AI - Александр Громов, Устойчивость нейросетевых моделей при анализе КТ/НДКТ-исследований
Avatar for OpenTalks.AI opentalks
0
380
OpenTalks.AI - Денис Тимонин, Megatron-LM: Обучение мультимиллиардных LMs при помощи техники Model Parallelism
Avatar for OpenTalks.AI opentalks
0
520
OpenTalks.AI - Егор Филимонов, Возможности платформы Huawei Atlas и эффективный гетерогенный инференс.
Avatar for OpenTalks.AI opentalks
0
160
OpenTalks.AI - Александр Прозоров, Референсная архитектура робота сервисного центра в отраслях с изменчивыми бизнес-процессами
Avatar for OpenTalks.AI opentalks
0
390
OpenTalks.AI - Наталья Лукашевич, Анализ тональности по отношению к компании — с чем не справился BERT
Avatar for OpenTalks.AI opentalks
0
340
OpenTalks.AI - Константин Воронцов, Фейковые новости и другие типы потенциально опасного дискурса: типология, подходы, датасеты, соревнования
Avatar for OpenTalks.AI opentalks
0
450
OpenTalks.AI - Дмитрий Ветров, Фрактальность функции потерь, эффект двойного спуска и степенные законы в глубинном обучении - фрагменты одной мозаики
Avatar for OpenTalks.AI opentalks
0
480

Other Decks in Science

See All in Science
Distributional Regression
Avatar for takyas tackyas
0
420
シャボン玉の虹から原子も地震も重力も見える！ 〜 物理の目「干渉縞」のすごい力 〜
Avatar for Syota-Sasaki syotasasaki593876
1
110
MATSUO Makiko
Avatar for Genomethica genomethica
0
120
AI(人工知能)の過去・現在・未来 —AIは人間を超えるのか—
Avatar for Y-h. Taguchi tagtag
PRO
1
250
論文紹介 音源分離:SCNET SPARSE COMPRESSION NETWORK FOR MUSIC SOURCE SEPARATION
Avatar for kenmatsu4 kenmatsu4
0
580
データベース09: 実体関連モデル上の一貫性制約
Avatar for Y. Yamamoto trycycle
PRO
0
1.1k
AI(人工知能)の過去・現在・未来 —AIは人間を超えるのか—
Avatar for Y-h. Taguchi tagtag
PRO
0
160
HajimetenoLT vol.17
Avatar for hashimoto-kei hashimoto_kei
1
200
コンピュータビジョンによるロボットの視覚と判断：宇宙空間での適応と課題
Avatar for Hironobu Fujiyoshi hf149
1
580
データマイニング - ウェブとグラフ
Avatar for Y. Yamamoto trycycle
PRO
0
260
白金鉱業Vol.21【初学者向け発表枠】身近な例から学ぶ数理最適化の基礎 / Learning the Basics of Mathematical Optimization Through Everyday Examples
Avatar for BrainPad brainpadpr
1
670
AIに仕事を奪われる
最初の医師たちへ
Avatar for iKora128 ikora128
0
1k

Featured

See All Featured
Fireside Chat
Avatar for paigeccino paigeccino
42
3.9k
The Curious Case for Waylosing
Avatar for Cassini Nazir cassininazir
0
280
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
21
1.4k
Groundhog Day: Seeking Process in Gaming for Health
Avatar for Sebastian Deterding codingconduct
0
130
技術選定の審美眼（2025年版） / Understanding the Spiral of Technologies 2025 edition
Avatar for Takuto Wada twada
PRO
118
110k
Music & Morning Musume
Avatar for Bryan Veloso bryan
47
7.1k
Docker and Python
Avatar for Tania Allard trallard
47
3.8k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
22k
Claude Code のすすめ
Avatar for schroneko schroneko
67
220k
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
160
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
29
4.2k

Transcript

  1. Towards Scalable Dimensionality Reduction Aleksandr Artemenkov joint work with Maxim

    Panov via Noise Contrastive Estimation

  2. News Headlines Of India 3 million topics you are unfamiliar

    with Kaggle Dataset
  3. None

  4. Just repeat 3 million times! (not a good idea)

  5. Is there a better approach? (visualization)

  6. None

  7. Noise Contrastive Estimation (without a single formula) (check out the

    poster for them)

  8. Building Representation “cold” “frosty” “cold” “warm” “cold” “first” similar different

    unrelated (noisy) ? ? ?

  9. Simple Insight • similar points = closer than predefined noisy

    distance • different points = further than predefined noisy distance Any benefits from such approach?

  10. Parallelized Batch Optimization • noisy distance is predefined • repel

    different points • attract similar points • adjustments are independent of each other to distinguish them from noise Meet NCVis! (Noise Contrastive Visualization) GitHub Repository

  11. Why use NCVis? (there are reasons) Paper

  12. None
  13. None

  14. Thank you for your attention! (find me near the poster)