Applied NLP in the Age of Generative AI
Video: https://www.youtube.com/watch?v=di670dGu3No
Large Language Models (LLMs) and in-context learning have introduced a new paradigm for developing natural language understanding systems: prompts are all you need! Prototyping has never been easier, but not all prototypes give a smooth path to production. In this talk, I'll share the most important lessons we've learned from solving real-world information extraction problems in industry, and show you a new approach and mindset for designing robust and modular NLP pipelines in the age of Generative AI.
Breaking down larger business problems into actionable machine learning tasks is one of the central challenges of applied natural language processing. I will walk you through example applications and practical solutions, and show you how to use LLMs to their fullest potential, how and where to integrate your custom business logic and how to maximize efficiency, transparency and data privacy.
Ines Montani PRO
Video
Resources
A practical guide to human-in-the-loop distillation
https://explosion.ai/blog/human-in-the-loop-distillation
This blog post presents practical solutions for using the latest state-of-the-art models in real-world applications and distilling their knowledge into smaller and faster components that you can run and maintain in-house.
How S&P Global is making markets more transparent with NLP, spaCy and Prodigy
https://explosion.ai/blog/sp-global-commodities
A case study on S&P Global’s efficient information extraction pipelines for real-time commodities trading insights in a high-security environment using human-in-the-loop distillation.
How GitLab uses spaCy to analyze support tickets and empower their community
https://explosion.ai/blog/gitlab-support-insights
A case study on GitLab’s large-scale NLP pipelines for extracting actionable insights from support tickets and usage questions.
Applied NLP Thinking: How to Translate Problems into Solutions
https://explosion.ai/blog/applied-nlp-thinking
This blog post discusses some of the biggest challenges for applied NLP and translating business problems into machine learning solutions, including the distinction between utility and accuracy.
The Window-Knocking Machine Test
https://ines.io/blog/window-knocking-machine-test/
How will technology shape our world going forward? And what tools and products should we build? When imagining what the future could look like, it helps to look back in time and compare past visions to our reality today.
Practical Tips for Bootstrapping Information Extraction Pipelines
https://speakerdeck.com/honnibal/practical-tips-for-bootstrapping-information-extraction-pipelines
Matt's presentation on approaches for bootstrapping NLP pipelines and retrieval via information extraction, building on top of this talk.