Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OpenTalks.AI - Александр Артеменков, Towards Sc...

Avatar for OpenTalks.AI OpenTalks.AI
February 21, 2020
Science
0
2.1k

OpenTalks.AI - Александр Артеменков, Towards Scalable Dimensionality Reduction via Noise Contrastive Estimation

Avatar for OpenTalks.AI

OpenTalks.AI

February 21, 2020
Tweet

More Decks by OpenTalks.AI

See All by OpenTalks.AI
OpenTalks.AI - Виктор Лемпицкий, Моделирование 3Д сцен: новые подходы в 2020 году
Avatar for OpenTalks.AI opentalks
0
480
OpenTalks.AI - Алексей Чернявский, Нейросетевые алгоритмы для повышения качества медицинских изображений
Avatar for OpenTalks.AI opentalks
0
420
OpenTalks.AI - Александр Громов, Устойчивость нейросетевых моделей при анализе КТ/НДКТ-исследований
Avatar for OpenTalks.AI opentalks
0
370
OpenTalks.AI - Денис Тимонин, Megatron-LM: Обучение мультимиллиардных LMs при помощи техники Model Parallelism
Avatar for OpenTalks.AI opentalks
0
500
OpenTalks.AI - Егор Филимонов, Возможности платформы Huawei Atlas и эффективный гетерогенный инференс.
Avatar for OpenTalks.AI opentalks
0
140
OpenTalks.AI - Александр Прозоров, Референсная архитектура робота сервисного центра в отраслях с изменчивыми бизнес-процессами
Avatar for OpenTalks.AI opentalks
0
370
OpenTalks.AI - Наталья Лукашевич, Анализ тональности по отношению к компании — с чем не справился BERT
Avatar for OpenTalks.AI opentalks
0
330
OpenTalks.AI - Константин Воронцов, Фейковые новости и другие типы потенциально опасного дискурса: типология, подходы, датасеты, соревнования
Avatar for OpenTalks.AI opentalks
0
430
OpenTalks.AI - Дмитрий Ветров, Фрактальность функции потерь, эффект двойного спуска и степенные законы в глубинном обучении - фрагменты одной мозаики
Avatar for OpenTalks.AI opentalks
0
460

Other Decks in Science

See All in Science
Accelerated Computing for Climate forecast
Avatar for Jeongkyu Shin inureyes
PRO
0
110
Trend Classification of InSAR Displacement Time Series Using SAE–CNN
Avatar for SatAI.challenge satai
3
530
Valuable Lessons Learned on Kaggle’s ARC AGI LLM Challenge (PyDataGlobal 2024)
Avatar for ianozsvald ianozsvald
0
400
サイゼミ用因果推論
Avatar for LW lw
1
7.4k
点群ライブラリPDALをGoogleColabにて実行する方法の紹介
Avatar for Kenta Itakura kentaitakura
1
350
機械学習 - SVM
Avatar for Y. Yamamoto trycycle
PRO
1
870
オンプレミス環境にKubernetesを構築する
Avatar for kouki.miura koukimiura
0
310
白金鉱業Meetup Vol.16_【初学者向け発表】 数理最適化のはじめの一歩 〜身近な問題で学ぶ最適化の面白さ〜
Avatar for BrainPad brainpadpr
11
2.3k
「美は世界を救う」を心理学で実証したい～クラファンを通じた新しい研究方法
Avatar for Jimpei jimpe_hitsuwari
1
140
深層学習を用いた根菜類の個数カウントによる収量推定法の開発
Avatar for Kenta Itakura kentaitakura
0
170
mathematics of indirect reciprocity
Avatar for Yohsuke Murase yohm
1
160
コンピュータビジョンによるロボットの視覚と判断：宇宙空間での適応と課題
Avatar for Hironobu Fujiyoshi hf149
0
270

Featured

See All Featured
How GitHub (no longer) Works
Avatar for Zach Holman holman
314
140k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
32
1.1k
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
16k
Done Done
Avatar for chrislema chrislema
185
16k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
1.3k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
512
110k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
507
140k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
43
7.4k
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
5.7k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
140
7.1k
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
8
450

Transcript

  1. Towards Scalable Dimensionality Reduction Aleksandr Artemenkov joint work with Maxim

    Panov via Noise Contrastive Estimation

  2. News Headlines Of India 3 million topics you are unfamiliar

    with Kaggle Dataset
  3. None

  4. Just repeat 3 million times! (not a good idea)

  5. Is there a better approach? (visualization)

  6. None

  7. Noise Contrastive Estimation (without a single formula) (check out the

    poster for them)

  8. Building Representation “cold” “frosty” “cold” “warm” “cold” “first” similar different

    unrelated (noisy) ? ? ?

  9. Simple Insight • similar points = closer than predefined noisy

    distance • different points = further than predefined noisy distance Any benefits from such approach?

  10. Parallelized Batch Optimization • noisy distance is predefined • repel

    different points • attract similar points • adjustments are independent of each other to distinguish them from noise Meet NCVis! (Noise Contrastive Visualization) GitHub Repository

  11. Why use NCVis? (there are reasons) Paper

  12. None
  13. None

  14. Thank you for your attention! (find me near the poster)