Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Wakuwaku!!!!!! 原來自然語言可以這樣玩

Avatar for LINE Developers Taiwan LINE Developers Taiwan
PRO
July 04, 2023
Technology
0
6.2k

Wakuwaku!!!!!! 原來自然語言可以這樣玩

活動：LINE Developers Meetup 開發者小聚 #18 - TECH FRESH 畢業展
活動頁面：https://linegroup.kktix.cc/events/20230627-tech-fresh-gratudation
講者：Danny Lo
Avatar for LINE Developers Taiwan

LINE Developers Taiwan
PRO

July 04, 2023
Tweet

More Decks by LINE Developers Taiwan

See All by LINE Developers Taiwan
菸酒生在 LINE Taiwan 的後端雙刀流
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
1.1k
讓測試不再 BB！ 從 BDD 到 CI/CD， 不靠人力也能 MVP
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
1.1k
DB 醬，嗨！哪泥嘎斯基？
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
1.1k
比起獨自升級 我更喜歡 DevOps 文化 <3
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
1.1k
工具人的一生: 開發很多 AI 工具讓我 慵懶過一生
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
1.1k
從四件事帶你見識見識 事件驅動架構設計 (EDA)
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
980
TODAY 看世界(?) 是我們在看扣啦！
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
1.1k
你想成為什麼樣的開發者？
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
24
研究生的 LINER生活
Avatar for LINE Developers Taiwan line_developers_tw
PRO
0
26

Other Decks in Technology

See All in Technology
Prox Industries株式会社 会社紹介資料
Avatar for Prox proxindustries
0
210
“社内”だけで完結していた私が、AWS Community Builder になるまで
Avatar for nagisa_53 nagisa53
1
240
Claude Code Actionを使ったコード品質改善の取り組み
Avatar for Katsunori Kanda potix2
PRO
4
1.7k
キャディでのApache Iceberg, Trino採用事例　-Apache Iceberg and Trino Usecase in CADDi--
Avatar for recruiting@caddi.jp caddi_eng
0
180
より良いプロダクトの開発を目指して - 情報を中心としたプロダクト開発 #phpcon #phpcon2025
Avatar for 弁護士ドットコム bengo4com
1
410
成立するElixirの再束縛（再代入）可という選択
Avatar for kubell kubell_hr
0
960
プロダクトエンジニアリング組織への歩み、その現在地 / Our journey to becoming a product engineering organization
Avatar for hiro-torii hiro_torii
0
110
Definition of Done
Avatar for Yasunobu Kawaguchi kawaguti
PRO
6
470
Amazon ECS & AWS Fargate 運用アーキテクチャ2025 / Amazon ECS and AWS Fargate Ops Architecture 2025
Avatar for iselegant iselegant
16
4.8k
AIエージェント最前線！ Amazon Bedrock、Amazon Q、そしてMCPを使いこなそう
Avatar for みのるん minorun365
PRO
11
4.2k
[TechNight #90-1] 本当に使える？ ZDMの 新機能を実践検証してみた
Avatar for oracle4engineer oracle4engineer
PRO
3
140
CI/CDとタスク共有で加速するVibe Coding
Avatar for tnbe21 tnbe21
0
230

Featured

See All Featured
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
31
1.2k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
53
2.8k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
337
57k
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
223
9.7k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
69
11k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
657
60k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
206
24k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
233
17k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
281
13k
Faster Mobile Websites
Avatar for Dean Hume deanohume
307
31k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
30
2.1k

Transcript

  1. Wakuwaku!!!!!! 原來⾃然語⾔可以這樣玩 Danny Lo 2023/06/09

  2. Danny Lo Data Dev, TECH FRESH • NTU CSIE •

    Research Assistant @MSLAB • LINE TECH FRESH @LINE Data Dev

  3. Large Language Model …? ※ Source: generated by Midjourney 給語言模型大量資料，期待他能展現超越小型語言

    模型的文本理解和生成能力

  4. 準備⼯作 Model Data Device

  5. 建立 NLP pipeline Data preparation Model training Model Evaluation Model

    Validation Model Analysis

  6. 事情似乎沒有那麼容易 • 資料量不足，特別是中文的文本和訓練集 • Error: CUDA out of memory. 👊

    👊 👊 • 訓練時間過長 • 模型表現不如預期 ※ Source: generated by Midjourney

  7. 解決⽅法

  8. AS-IS 專案切換 效率低落 ※ Source: generated by Midjourney

  9. TO-BE Context Switch ※ Source: generated by Midjourney

  10. THANK YOU