NDAK18000U Natural Language Processing (NLP)
Have you ever wondered how to build a system that can process, understand or generate text automatically? For instance, to translate between languages, answer questions, or recognise the names of people in text? Then this course is for you.
This course will introduce the fundamentals of natural language processing (NLP), i.e., computational models of language and their applications to text. Language is at the heart of human intelligence, giving NLP a central role in Artificial Intelligence research and development.
We will combine machine learning (ML), including fundamental formalisms and algorithms, with a strong hands-on experience, i.e., the practical implementation of the methods for concrete NLP problems.
The course will utilise interactive lecture materials built with Jupyter notebook. Course materials from last year are publicly available here: https://github.com/copenlu/stat-nlp-book; and the course will closely follow last year’s iteration. Please skim these materials if you are in doubt about course prerequisites or course content.
The course covers the following tentative topic list:
• NLP tasks: language modelling, text classification, semantics, information extraction, parsing, pragmatics, machine translation, summarisation, question answering
• methods: text classification, structured prediction, representation and deep learning, conditional random fields, beam search
• implementations: relationship between NLP tasks, efficient implementations
Throughout the course, we will also discuss the themes of discriminative and generative learning and different ways of obtaining supervision for training statistical NLP models.
core NLP tasks (e.g. machine translation, question answering, information extraction)
methods (e.g. classification, structured prediction, representation learning)
implementations (e.g. relationship between NLP tasks, efficient implementations)
identify the different kinds of NLP tasks
choose the correct algorithm for a given problem situation
implement core algorithms in Python
assess the most appropriate algorithms to solve a given NLP problem
distinguish and evaluate the advantages of different approaches to the same task
decompose natural language tasks into manageable components
evaluate systems quantitatively and qualitatively
apply the learned skills in a wider context to areas that face similar challenges, for example data science or political science research, or gene sequencing
Selected papers and book chapters. See Absalon when the course is set up.
Academic qualifications equivalent to a BSc degree is recommended.
Relevant machine learning competencies can be obtained through one of the following courses:
- NDAK15007U Machine Learning (ML)
- NDAK16003U Introduction to Data Science (IDS)
- Machine Learning, Coursera
- Theory exercises
- Practical exercises
- Project work
PhD’s can register for MSc-course by following the same procedure as credit-students, see link above.
- 7,5 ECTS
- Type of assessment
- Continuous assessmentThe exam consists of two parts:
1. A group project to count for 50% of the mark, written during the course (either group members hand-in individual reports or they mark their contribution in the group report).
2. A 48-hours take-home exam that counts for 50% of the mark.
- All aids allowed
- Marking scale
- 7-point grading scale
- Censorship form
- No external censorship
Several internal examiners
The re-exam consists of two part:
1) Resubmission of (possibly revised) final project. The revised project has to be handed in no later than 2 weeks before the re-exam week.
2) A 30 minutes individual oral examination without preparation, based on submitted project and full syllabus.
The final grade is based on an overall assesment.
Criteria for exam assesment
See Learning Outcome.