Augmented Design at the Speed of AI - DDX 2024

Are you ready to revolutionize your design workflow? In an era where AI tools are evolving at breakneck speed, staying competitive means understanding how to harness these powerful new capabilities. I'm excited to share a comprehensive look at how AI is transforming design, not in some distant future, but right now.

Whether you're a UI/UX designer overwhelmed by the latest AI features in Figma, an industrial designer curious about generative design, or a creative director wondering how to integrate AI into your team's workflow, this presentation will give you practical insights into what's working, what's not, and what's coming next.

From cutting edge case studies to real world implementation strategies, we'll explore how top design teams are already using AI to accelerate their work while maintaining creative control. More importantly, you'll learn how to position yourself at the forefront of this transformation, turning potential disruption into opportunity.

Join me as we explore how to stay ahead in an AI-augmented design world. The future of design is already here! Let's make sure you're ready for it.

Transcript

1. AUGMENTED DESIGN AT THE SPEED OF AI @kyleledbetter CEO and Cofounder www.askdream.ai
2. AI has come a long way in a short amount of time @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
3. 2021 2022 Dalle2 @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
4. Designers were amused. @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
5. Things progressed quickly 2018 2019 2021 2020 2022 2023 2024 @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI GPT-1 GPT-2 GPT-3 none GPT-3.5 GPT-4 OpenAI-o1 🍓 DALLE 1 DALLE 2 DALLE 3 DALLE 4? Stable Diffusion Stable Diffusion 2 Stable Diffusion 3 Midjourney Midjourney 5 Midjourney 6.1 Suno Suno 3 Runway ML Runway ML 3 Google Bard Google Gemini Anthropic Claude Opus / Sonnet Meta Llama Llama 3.1 Google LaMDA Google Bert Mistral 7B Mistral Pixtral FLUX NOTEABLE AI MILESTONES AND ACCELERATION
6. Moving from novelty to utility March 2023 Medium post on AI workflow productivity July 2022 Tweet about AI images for fun @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
7. Moving from novelty to utility Prototype Sample Data Design Inspiration Icon Design Ideas Product Illustrations Persona Drafts @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
8. Next AI went mainstream Photoshop Generative AI Canva AI Photo Editor AND WAS INSERTED INTO WORKFLOWS AND COMMON TOOL CHAINS @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI Figma AI
9. Design in all industries is being augmented VIDEO GAMES AI-Driven Level Generation AI-Powered Character Animation AI-Assisted Game Balancing @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI AUTOMOTIVE AI-Powered Aerodynamic Optimization AI-Driven Material Selection INTERIOR DESIGN AI-Powered Space Planning AI-Assisted Furniture Selection CINEMATOGRAPHY AI-Powered Shot Selection AI-Assisted Color Grading LANDSCAPE DESIGN AI-Driven Plant Selection AI-Assisted Landscape Planning FASHION DESIGN AI-Powered Trend Forecasting AI-Assisted Pattern Making ARCHITECTURE AI-Powered Structural Analysis AI-Assisted Energy Simulation INDUSTRIAL DESIGN AI-Assisted 3D Printing AI-Powered 3D Scanning
10. I LOVE SYSTEMS also… AI LOVES SYSTEMS @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
11. LLMs make decisions by processing and analyzing the information they have been trained on. When a request is made, the LLM first breaks down the prompt into its constituent parts. It then searches through its vast database of text and code to find relevant information. There are a variety of methods for this to “make a choice”, two of which are: How do LLMs work? 11 Homogeneous “One is to take an average of the choices that other writers have made, as represented by text found on the Internet; that average is equivalent to the least interesting choices possible, which is why A.I.-generated text is often really bland.” Mimicry “Another is to instruct the program to engage in style mimicry, emulating the choices made by a specific writer, which produces a highly derivative story.” @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
12. “Real paintings bear the mark of an enormous number of decisions.” “An artist—whether working digitally or with paint—implicitly makes far more decisions during the process of making a painting than would fit into a text prompt of a few hundred words.” -Ted Chiang @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
13. Design Systems are based on patterns and foundations By defining reusable patterns, Design Systems allow AI to quickly understand and apply design principles, accelerating the creation of new features and interfaces. A PRIMARY REASON TO USE A DESIGN SYSTEM IS TO AVOID TEDIOUS DECISIONS AND ENSURE CONFORMITY & UNIFORMITY @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
14. The Perfect Storm The culmination of LLM capabilities, tools, patterns and systems is having a Voltron-like effect on possibilities. Design Systems Unified design language for consistency UI Platforms Pre-built components for rapid dev. Code Frameworks Structured code for efficient dev. Code Interpretation Understanding code for analysis. Code Execution Running code to test and deploy apps Natural Language Translating human language into code. @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
15. UI Designers & Developers are 1st to benefit Their ability to bridge the gap between abstract concepts and concrete implementations is essential for guiding AI models to produce results that align with their creative vision. THEY ARE USED TO TURNING ABSTRACT IDEAS INTO REALITY. @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
16. The barrier to develop code has dropped. This integrated environment provided a seamless workflow, allowing them to rapidly iterate on designs and code, while receiving intelligent suggestions and assistance from AI. THESE WERE SIGNS OF THE POTENTIAL @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
17. Think of any design related task Writing quality copy is hard and time consuming. AI can take the first pass in any format output. 9am 11am 3pm 10am 1pm Mockup Copy Brainstorming marketing materials and iterating through concepts Asset Creation Scour through session transcripts to synthesize data, group into themes, and deliver actionable insights. User Research Insights Generate lots of quick concepts for presentation slides in seconds. Brainstorming Designs Everyone can now create prototypes with near production quality code. Generating UI Code COMMON DESIGN TASKS WHERE AI AUGMENTATION MAY HELP Claude, ChatGPT, Gemini Flux, Midjourney, Dalle, Stable Diffusion Flux, Midjourney, Dalle, Stable Diffusion v0, Replit, Cursor, Dream Claude, Dream, Dovetail, Divinate
18. User Research Synthesis & Insights AI can almost instantaneously scour through hours of session transcripts to synthesize data, group into themes, and deliver actionable insights. Researchers can spend their valuable time validating the insights and guiding the AI to probe the desired themes and quotes. AREAS WHERE AI SHINES @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
19. Marketing materials & concepts Brainstorming marketing materials and iterating through concepts doesn’t require countless hours from valuable staff or outsourcing to marketing firms anymore. AREAS WHERE AI SHINES @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
20. User Interface Development AREAS WHERE AI SHINES @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
21. But what about AI augmentation outside design? @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
22. @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
23. The barrier of entry has been a text input While the conversation was the unlock for AI and wide exposure (ChatGPT), it has also become the barrier to understanding what LLMs can truly do. If you’re not engineering prompts all day long, it’s hard to think abstractly about the types of solutions AI can provide. IT’S BEEN HARD FOR MOST PEOPLE TO THINK BEYOND THE CONVERSATION THIS IS A WHOLE LOT OF WHITE SPACE AND FEELS TOO WIDE OPEN FOR THE MASSES… HOW DO I START? WHAT DO I SAY? @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
24. Claude Artifacts is a preview of what’s to come AI IS MOVING BEYOND THE CONVERSATION @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
25. AI is waiting to help augment your workflows today @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
26. ChatGPT Rapid Response Times Cost-Effective Versatile Applications Scalability Internet Connectivity SPEED & COST Claude Contextual Projects Powerful Artifacts Contextual Understanding Coding Capabilities Complex Problem-Solving COHESION & CODE Gemini Brand Consistency Massive Context Window Integrated Solution Economical Choice BRAND VOICE Choose the right AI for the job Selecting the ideal AI for a task involves weighing factors like speed, cost, context, creativity, and accuracy. If possible test them in a “bake offˮ for your specific task. Meta Llama Open-source, flexible, fast, and customizable Mistral Open-source, multilingual, reasoning @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI Flexible Model Choices Accurate Citations Knowledge Graph Unique Featureset SEARCH FIRST *o1: Highest Quality *o1-preview makes claims of highest quality as of 9/15/24
27. Consider alternative AI interfaces & tools @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI GET CREATIVE AI Videos AI Music AI Speech AI Images AI Vision AI Search
28. Have an “AI Bake-off” @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI Notion AI vs ChatGPT vs Claude vs Gemini (in Arc browser)
29. Some things to keep in mind USE AI RESPONSIBLY AND ETHICALLY As AI continues to advance, it's crucial to use it responsibly and ethically. This means considering factors like bias, privacy, and transparency. Investing in best practices and testing for fairness, bias, and disparate impact can help identify and address these issues. By prioritizing ethical AI, we can ensure that these technologies benefit society without causing harm LEARN ABOUT ECO FRIENDLY LLM PROVIDERS The environmental impact of AI is a growing concern. Many Large Language Models (LLMs) consume significant amounts of energy. Fortunately, there are eco-friendly LLM providers emerging, focusing on reducing their carbon footprint. Researching and supporting these providers can contribute to a more sustainable future for AI. BE STRATEGIC WHEN AND WHERE YOU USE AI Not every task benefits from AI. It's essential to be strategic about when and where to apply AI. Consider the complexity of the task, the availability of data, and the potential for human error. By carefully evaluating these factors, you can maximize the benefits of AI while minimizing its drawbacks. Data security, resource costs, and user experience are also impacted by these decisions. @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
30. Keep an eye on regulations In most laws and upcoming regulations, companies are required to do these types of things (not limited to): - Share how you’re training your models (SB AB 2013) - Share if you’re using AI for hiring and how (NYC LL144) - Provide a disclaimer for AI generated media (images, audio, video) (CA SB 1047) - Disclose when businesses use generative AI (UT SB 149) - Developers of high risk AI systems must implement risk management & impact assessments like Credo.ai (CO SB 205) ALWAYS BE PREPARED TO DIVULGE HOW YOU USE AI @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
31. And we’re really just getting started @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
32. As of last week Written by o1-preview: REASONING IS JUST ARRIVING… @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
34. Midjourney 6.1 FLUX @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI
36. Thank you! askdream.ai @kyleledbetter - #DDX24 AUGMENTED DESIGN AT THE SPEED OF AI @kyleledbetter askdream.ai