Prompt Engineering Karahan Yavuz KARA 220715001

What does Prompt Engineering mean? -A fancy way of guiding a LLM to produce the desired output.

Terminology, that we will talk about mostly;

Large Language Models(LLMs) Artificial intelligence model trained on massive amounts of text data to understand, generate, and manipulate human language. Definition GPT (Generative Pre-trained Transformer) PaLM (Pathways Language Model) Claude – Developed by Anthropic, LLaMA (Large Language Model Meta AI) Popular LLMs

HOW DOES LLM’S WORK

No content

No content

GPT - Generative, Pre-trained, Transformer

Prompt Construction

No content

Prompt Construction Techniques 🔹"Write three different Instagram bios for a restaurant." 🔹 "Write a React code snippet where clicking a button triggers an alert." 1. Direct Instruction 🔹"I’m an entrepreneur opening a new coffee shop. My Instagram bio should reflect our love for high-quality coffee and our cozy atmosphere. Suggest three different bios." 2. Contextual Prompting 🔹 "Here are two tweet examples: 1️⃣ 'Coffee wakes us up in the morning, but the real magic happens when it’s shared with friends. ☕✨' 2️⃣ 'The best ideas are born over a cup of coffee. What will you create today? 🚀 #coffee' 🔹 Generate two more tweets in a similar style." 3. Few-shot Prompting

Clearly state what you want as the output, with enough detail but in a simple way. President of OpenAI Greg Brockman (2025 feb)

Prompt Injection (AI Manipulating)

Prompt Injection is a type of attack where a user manipulates a language model by injecting misleading or malicious instructions into the input prompt. This technique exploits the model's tendency to follow prompts literally, potentially overriding its original behavior or security constraints.

No content

prompts.chat - developed by github

No content

Temperature and Tokens

What are tokens? A token is the smallest unit of text that a language model processes. A token ID is a unique numerical identifier assigned to a specific token within a language model's vocabulary.

No content

"temperature" parameter controls the randomness and creativity of the generated text. Adjusting this parameter influences the model's selection of words, thereby affecting the diversity and predictability of its output Temperature

I Like The It When That Trains Frogs 0. 05 0. 3 0. 3 0. 15 0. 15 0. 05 probabilities of the next word if you are working with a low temperatured llm the results will not be much creative

it is basically a temperature config for users :) (with much more optimization issues)

No content

Is Prompt Engineering a real skill?

Yes, prompt engineering is a real skill, but its importance depends on the context in which you're using LLMs. Prompt engineering is a skill, but its importance may diminish over time as AI systems become more context-aware. However, for now, those who understand how to structure queries effectively will always have an edge in extracting the best results.

https://www.researchgate.net/figure/Overview-of-prompting-technique- categorization_fig2_377478767 https://platform.openai.com/tokenizer https://pathway.com/bootcamps/rag-and-llms/coursework/module- 3-prompt-engineering-and-token-limits/navigating-token-limits https://community.openai.com/

Thank you! Karahan Yavuz KARA 220715001