Große Sprachmodelle in erweiterten Realitäten

What it is about

In the practicum you will learn how large language models (Large Language Models) can be integrated into applications for virtual (VR) and augmented reality (AR). In the end you will be able to independently develop small AR/VR prototypes with language capabilities, assess their performance, and evaluate ethical as well as social implications.

What you will be able to do

• Use of large language models in AR and VR applications
• Analysis of performance and limits of large language models in practical applications
• Derivation of a research and implementation design with a work plan
• Development of VR/AR applications with integrated chatbots in independent project work
• Working in groups and presentation of the results
• Reflection on ethical and social implications

What the module consists of

• Praktikumpractical exercises and group projects to deepen the techniques
• Vortrag/LehreinheitenIntroduction to fundamentals, architecture, training and evaluation of large language models
• Diskussion/PräsentationDiscussion, reflection and presentation of the project results

Teaching method

• Vorlesungsfolien und aktuelle wissenschaftliche VeröffentlichungenProvision of the theoretical fundamentals and current research
• BeispielcodeGuidance and practical implementation of the techniques shown
• Gruppenarbeit, gemeinsame Konzeption und ProgrammierungPractical project work and deepening of concrete applications
• Diskussionen und PräsentationenDevelopment, reflection and communication of the results