Topics in Machine Learning
Lecturers and Teaching Assistants
Prof. Ohad Shamir
Dr. Itay Safran, Dr. Liran Szlak
Course Schedule and Location
Tuesday, 13:15 - 16:00, Ziskind, Rm 155
Field of Study, Course Type and Credit Points
Mathematics and Computer Science: Lecture; Elective; 3.00 points
Life Sciences (Molecular and Cellular Neuroscience Track): Lecture; Elective; 3.00 points
Life Sciences (Brain Sciences: Systems, Computational and Cognitive Neuroscience Track): Lecture; Elective; 3.00 points
Mathematics and Computer Science (Systems Biology / Bioinformatics): Lecture; Elective; 3.00 points
On 08.01.2019 the lecture will be held in Kimmelman Build. Dov Elad Reading Room.
There are no formal prerequisites. However, the course requires mathematical maturity, and students are expected to be familiar with linear algebra and probability, as taught in undergraduate computer science or math programs.
Attendance and participation
Scheduled date 1
Scheduled date 2
Estimated Weekly Independent Workload (in hours)
This course will provide a self-contained introduction to some of the actively-researched areas in machine learning today. It will cover theoretical principles and challenges as well as practical algorithms. The focus will be on supervised and discriminative learning, where the goal is to learn good predictors from data while making few or no probabilistic assumptions. Along the way, we will introduce and use tools from probability, game theory, convex analysis and optimization. The course will cover the following topics (time permitting):
- Statistical learning: Statistical learning models; Overfitting; Generalization and sample complexity; Uniform Convergence; Stability; Linear predictors; Support Vector Machines
- Online learning and optimization: No-regret learning; Online convex optimization and gradient descent; Online-to-batch methods; Learning from Experts; Follow-the-Leader Algorithms
- Advanced topics -- this will include a subset of the following: Deep learning; Advanced optimization algorithms for learning problems; Learning with information and computation constraints; Learning on distributed systems.
Upon successful completion of this course students should be able to:
- Describe basic concepts, principles and algorithms in the field of machine learning.
- Apply their acquired knowledge of machine learning methods and principles in their own areas of research.