Generative AI: Notes from Academia Kan Min-Yen Demystifying ChatGPT: How can Enterprises Leverage Generative AI Images all generated by Stable Diffusion. All slides are all in the public domain 

Some Context: A perfect storm The confluence of gaming, big data and algorithms got us to where we are now. Neural networks process and store text, image and video data all as in long sequences of numbers, known variously as embeddings or vectors. 

Generative AI Learns patterns from large quantities of a data of modality Outputs something highly probable given what it’s seen. • Text: guess a missing or next word • Image: guess a patch of image given a context • Cross Modal: guess an image given a caption Solves the equation 𝑃 𝑜𝑢𝑡𝑝𝑢𝑡 𝑖𝑛𝑝𝑢𝑡) 

Conditional Generative Models Conditioned on some form of input (“prompt” or “instruction”) “Pretend you are an expert programmer. Then …” “In the style of Rene Magritte” Solves the equation 𝑃 𝑜𝑢𝑡𝑝𝑢𝑡 𝑖𝑛𝑝𝑢𝑡, 𝒄𝒐𝒏𝒅𝒊𝒕𝒊𝒐𝒏) 

Hallucination Why does AI hallucinate? AI outputs are probabilistic. Current systems don’t explicitly remember where its sources of evidence are from. When it mixes input that are coherent, we get output which is probable, but is incorrect. ChatGPT summarizing a non-existent New York Times article even without access to the Internet. From Hallucination (Artificial Intelligence), Wikipedia 

Hallucination Why does AI hallucinate? AI outputs are probabilistic. Current systems don’t explicitly remember where its sources of evidence are from. When it mixes input that are coherent, we get output which is probable, but is incorrect. ChatGPT summarizing a non-existent New York Times article even without access to the Internet. From Hallucination (Artificial Intelligence), Wikipedia 

Academic Roadmap • Multistep Reasoning • Improved Multilingual Capability • Better Consistency and Personalization 

Acceleration has it out for us Adapted from Astro Teller’s graph Time Rate of Change Human Adaptability AI Tool Development Government Individuals Companies Humanity Opportunity Gap 

Outlook and relevance to SG Singapore is a strategic bridge between East and West, valued for transparency. Generative AI brings more power to individuals, which means the collective must keep individuals in check. SG Government’s initiatives are aligned in this and fostering partnerships for large and medium sized enterprises to stay ahead of the curve. https://ctic.nus.edu.sg/index.html