Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OpenTalks.AI - Александр Артеменков, Towards Sc...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for OpenTalks.AI OpenTalks.AI
February 21, 2020
Science
2.2k
0

OpenTalks.AI - Александр Артеменков, Towards Scalable Dimensionality Reduction via Noise Contrastive Estimation

Avatar for OpenTalks.AI

OpenTalks.AI

February 21, 2020

More Decks by OpenTalks.AI

See All by OpenTalks.AI
OpenTalks.AI - Виктор Лемпицкий, Моделирование 3Д сцен: новые подходы в 2020 году
Avatar for OpenTalks.AI opentalks
0
500
OpenTalks.AI - Алексей Чернявский, Нейросетевые алгоритмы для повышения качества медицинских изображений
Avatar for OpenTalks.AI opentalks
0
440
OpenTalks.AI - Александр Громов, Устойчивость нейросетевых моделей при анализе КТ/НДКТ-исследований
Avatar for OpenTalks.AI opentalks
0
380
OpenTalks.AI - Денис Тимонин, Megatron-LM: Обучение мультимиллиардных LMs при помощи техники Model Parallelism
Avatar for OpenTalks.AI opentalks
0
530
OpenTalks.AI - Егор Филимонов, Возможности платформы Huawei Atlas и эффективный гетерогенный инференс.
Avatar for OpenTalks.AI opentalks
0
170
OpenTalks.AI - Александр Прозоров, Референсная архитектура робота сервисного центра в отраслях с изменчивыми бизнес-процессами
Avatar for OpenTalks.AI opentalks
0
390
OpenTalks.AI - Наталья Лукашевич, Анализ тональности по отношению к компании — с чем не справился BERT
Avatar for OpenTalks.AI opentalks
0
340
OpenTalks.AI - Константин Воронцов, Фейковые новости и другие типы потенциально опасного дискурса: типология, подходы, датасеты, соревнования
Avatar for OpenTalks.AI opentalks
0
450
OpenTalks.AI - Дмитрий Ветров, Фрактальность функции потерь, эффект двойного спуска и степенные законы в глубинном обучении - фрагменты одной мозаики
Avatar for OpenTalks.AI opentalks
0
490

Other Decks in Science

See All in Science
共生概念の整理と AIアライメントの構想
Avatar for HiroHamada hiroakihamada
0
190
YouTubeにおける撤回論文の参照実態 / metascience-meetup2026
Avatar for Jiro Kikkawa corgies
3
260
水耕栽培：古代の知恵から宇宙農業まで
Avatar for 栽培設計室 grow_design_lab
0
110
プロジェクト「Azayaka」のSARの数式とジオメトリ
Avatar for じゃらしまる syuchimu
0
270
Cross-Media Technologies, Information Science and Human-Information Interaction
Avatar for Beat Signer signer
PRO
3
32k
防災デジタル分野での官民共創の取り組み (1)防災DX官民共創をどう進めるか
Avatar for Masakatsu Sugii ditccsugii
0
610
Bリーグのショットデータを活用した得点期待値モデルの構築 / Construction of expected points model using shot data of B.LEAGUE
Avatar for konakalab konakalab
0
120
Question Driven Development using Python
Avatar for Carol Willing willingc
PRO
1
110
主成分分析に基づく教師なし特徴抽出法を用いたコラーゲン-グリコサミノグリカンメッシュの遺伝子発現への影響
Avatar for Y-h. Taguchi tagtag
PRO
0
250
Fairfax County’s Tree Canopy: Examining the Effects of Land Development Regulations on Tree Canopy Conservation
Avatar for Eric Wiseman pwiseman
1
110
（メタ）科学コミュニケーターからみたAI for Scienceの同床異夢
Avatar for Ryuichi Maruyama rmaruy
0
220
なぜエネルギーは保存する？ 〜自由落下でわかる“対称性”とネーターの定理〜
Avatar for Syota-Sasaki syotasasaki593876
0
130

Featured

See All Featured
Efficient Content Optimization with Google Search Console & Apps Script
Avatar for Katarina Dahlin katarinadahlin
PRO
1
540
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
17k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
820
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
6
1.1k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
25
1.9k
Avoiding the “Bad Training, Faster” Trap in the Age of AI
Avatar for Mike Taylor tmiket
0
140
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
120
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
128
17k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
Impact Scores and Hybrid Strategies: The future of link building
Avatar for Tamara Novitovic tamaranovitovic
0
270
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
200

Transcript

  1. Towards Scalable Dimensionality Reduction Aleksandr Artemenkov joint work with Maxim

    Panov via Noise Contrastive Estimation

  2. News Headlines Of India 3 million topics you are unfamiliar

    with Kaggle Dataset
  3. None

  4. Just repeat 3 million times! (not a good idea)

  5. Is there a better approach? (visualization)

  6. None

  7. Noise Contrastive Estimation (without a single formula) (check out the

    poster for them)

  8. Building Representation “cold” “frosty” “cold” “warm” “cold” “first” similar different

    unrelated (noisy) ? ? ?

  9. Simple Insight • similar points = closer than predefined noisy

    distance • different points = further than predefined noisy distance Any benefits from such approach?

  10. Parallelized Batch Optimization • noisy distance is predefined • repel

    different points • attract similar points • adjustments are independent of each other to distinguish them from noise Meet NCVis! (Noise Contrastive Visualization) GitHub Repository

  11. Why use NCVis? (there are reasons) Paper

  12. None
  13. None

  14. Thank you for your attention! (find me near the poster)