Neural Networks and Deep Learning: From the Neuron to ChatGPT

What it is about

You learn the basics of neural networks and deep learning with a focus on applications in the social sciences. In the end you can develop simple models (e.g., classification, topic modeling, NLP), preprocess data, program networks, and understand the fundamentals of transformers such as ChatGPT.

What you will be able to do

• Build and train neural networks
• Work from a research-question form to fine-tuning a model
• Understand core concepts of NLP and transformers
• Use state-of-the-art tools like Google Colab and HuggingFace

What the module consists of

• Kurs/TutorialsThree course days with theoretical introduction and practical Jupyter Notebook exercises
• Praktische ArbeitData cleaning and programming of initial networks as well as an introduction to basic transformer mechanisms

Teaching method

• Lecture inputConveying the functioning and types of neural networks
• Hands-on exercises with Jupyter NotebooksPractice: clean data, program models and fine-tune
• Online tools (Google Colab, HuggingFace)Work with state-of-the-art tools and resources