$30 off During Our Annual Pro Sale. View Details »

Wakuwaku!!!!!! 原來自然語言可以這樣玩

LINE Developers Taiwan
PRO
July 04, 2023
Technology
0
2.6k

Wakuwaku!!!!!! 原來自然語言可以這樣玩

活動：LINE Developers Meetup 開發者小聚 #18 - TECH FRESH 畢業展
活動頁面：https://linegroup.kktix.cc/events/20230627-tech-fresh-gratudation
講者：Danny Lo

LINE Developers Taiwan
PRO

July 04, 2023
Tweet

More Decks by LINE Developers Taiwan

See All by LINE Developers Taiwan
進擊的後端
line_developers_tw
PRO
0
150
從心開始的純軟之路
line_developers_tw
PRO
0
290
Utopian Journey: My Ideal Internship Experience at LINE
line_developers_tw
PRO
0
110
打造 LINE Bot 並且加入一個有個性的大腦
line_developers_tw
PRO
1
52
通往Cloud Native的神奇之旅: 自製 Kubernetes 工具大揭秘
line_developers_tw
PRO
0
130
Feature Toggle: Make Development more Efficient
line_developers_tw
PRO
0
9
Beyond Development: Exploring the Multifaceted World of Engineering at LINE as a TECH FRESH
line_developers_tw
PRO
0
43
淺談開發與DevOps
line_developers_tw
PRO
0
220
Empowering Community-Driven Learning through Open Source Practice
line_developers_tw
PRO
0
59

Other Decks in Technology

See All in Technology
Exploring Postgres VACUUM with the VACUUM Simulator
keiko713
5
590
Autonomous Database - Dedicated 技術詳細 / adb-d_technical_detail_jp
oracle4engineer
PRO
2
3.9k
visionOSについてGlobeeが取り組んでいること
toshi0383
0
200
フロントエンドリアーキテクチャリングと開発チームのスキルトランスファーにおける9ヶ月間の奮闘記
wakamsha
5
3.8k
ROSCon 2023参加報告：Real-Time Workshop & Zenoh's Current Status and Forecast
takasehideki
1
190
生成AIでシステム開発はどう変わるか
etaroid
0
150
Railsアプリをコスパよく読むための環境整備
ikumatadokoro
1
130
Self-RAG: Learning to Retrieve, Generate and Critique through Self-Reflections
peisuke
8
830
Kafka Streamsで作る10万rpsを支えるイベント駆動マイクロサービス
joker1007
7
2.3k
噂の Amazon Bedrock を Java から使ってみる #javado
tacck
1
120
走馬灯のIaCは考えておいて
nwiizo
6
3k
知っておきたいRubyKaigiスポンサーのはじめかた / rubykaigi_uragawa
achamixx
1
250

Featured

See All Featured
Side Projects
sachag
450
39k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
10
1.2k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
5
740
The Cost Of JavaScript in 2023
addyosmani
9
3k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
500
140k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
12
1k
Bash Introduction
62gerente
603
210k
Statistics for Hackers
jakevdp
787
220k
Embracing the Ebb and Flow
colly
77
3.8k
A designer walks into a library…
pauljervisheath
199
19k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
26
5.7k
A better future with KSS
kneath
230
16k

Transcript

  1. Wakuwaku!!!!!! 原來⾃然語⾔可以這樣玩
    Danny Lo
    2023/06/09

    View Slide

  2. Danny Lo
    Data Dev, TECH FRESH
    • NTU CSIE
    • Research Assistant @MSLAB
    • LINE TECH FRESH @LINE Data Dev

    View Slide

  3. Large Language Model …?
    ※ Source: generated by Midjourney
    給語言模型大量資料，期待他能展現超越小型語言
    模型的文本理解和生成能力

    View Slide

  4. 準備⼯作
    Model
    Data Device

    View Slide

  5. 建立 NLP pipeline
    Data preparation
    Model
    training
    Model
    Evaluation
    Model
    Validation
    Model
    Analysis

    View Slide

  6. 事情似乎沒有那麼容易
    • 資料量不足，特別是中文的文本和訓練集
    • Error: CUDA out of memory. 👊 👊 👊
    • 訓練時間過長
    • 模型表現不如預期
    ※ Source: generated by Midjourney

    View Slide

  7. 解決⽅法

    View Slide

  8. AS-IS
    專案切換
    效率低落
    ※ Source: generated by Midjourney

    View Slide

  9. TO-BE
    Context Switch
    ※ Source: generated by Midjourney

    View Slide

  10. THANK YOU

    View Slide