Jhana Personal Meditation Guide

Transcript

1. JHĀNA personal meditation guide Bahar Rezaei Jutta Romberg Stephen Stanley Şafak Özden Vincenzo Soragnese Mentors 🙏 Dr. Tristan Behrens Krzysztof Buzar
2. Problems
3. Jhāna Meditation
4. Demo
5. • Language of meditation: 1. Repetition of certain words, mantras 2. Specific foreign terms Challenges Market Analysis
6. Meditation Apps
7. • Language of meditation: 1. Repetition of certain words, mantras 2. Specific foreign terms Challenges Hardware (Muse)
8. Neuro-feedback pipeline Raw EEG signal Hardware
9. Neuro-feedback pipeline Raw EEG signal Hardware Spectrogram
10. Neuro-feedback pipeline Raw EEG signal Hardware Spectrogram
11. Neuro-feedback pipeline Raw EEG signal Spectrogram Metrics calculation Thresholds Hardware
12. • Language of meditation: 1. Repetition of certain words, mantras 2. Specific foreign terms Challenges Pipeline & Model
13. Pipeline Model Output: • Instructions, and • Silent periods
14. Time Pipeline Guided Meditation 1. Play the instruction and stay idle for the silent period Model Output: • Instructions, and • Silent periods
15. Time Pipeline Guided Meditation 1. Play the instruction and stay idle for the silent period During the the silence period I. Read the EEG signal II. Tag the EEG signals Model Output: • Instructions, and • Silent periods
16. Time Pipeline Guided Meditation 1. Play the instruction and stay idle for the silent period During the the silence period I. Read the EEG signal II. Tag the EEG signals 2. Play the next instruction System Feedback Model Output: • Instructions, and • Silent periods
17. Model: • Mistral 7B (Quantized)
18. Model: • Mistral 7B (Quantized) • Fine-tuned with Axolotl
19. Model: • Mistral 7B (Quantized) • Fine-tuned with Axolotl Data: • Transcribed guided meditations: Over 50 hours. • EEG brain wave sensing: 10-day meditation retreat
20. Model: • Mistral 7B (Quantized) • Fine-tuned with Axolotl Data: • Transcribed guided meditations: Over 50 hours. • EEG brain wave sensing: 10-day meditation retreat • Find in Huggingface: carecodeconnect/jhana-mistral-GGUF
21. • Language of meditation: 1. Repetition of certain words, mantras 2. Specific foreign terms Challenges Challenges
22. Language of meditation 1. Repetition of words, mantras 2. Specific foreign terms
23. Testing/Evaluation 1. Metrics? 2. Is it a Jhana meditation? 3. Is it a good Jhana meditation?
24. • Language of meditation: 1. Repetition of certain words, mantras 2. Specific foreign terms Challenges Next Steps
25. Improvements a) Improve quality of current functionality -> RLHF b) Give instructions based on EEG input: Train language model on EEG data -> collect live EEG data, RLHF c) Different types of meditations d) Question Answering e) Optimize/Customize the voice -> Fine-tune TTS
26. Our Mentors: • Dr. Tristan Behrens • Krzysztof Buzar Data Science Retreat SPECIAL THANK YOU 🙏
27. Our Github Repository • Bahar Rezaei • Jutta Romberg • Stephen Stanley • Şafak Özden • Vincenzo Soragnese