Course Identification

Deep Learning for Computer Vision: Fundamentals and Applications
20244121

Lecturers and Teaching Assistants

Dr. Shai Bagon, Prof. Tali Dekel, Dr. Meirav Galun
Rafail Fridman

Course Schedule and Location

2024
First Semester
Monday, 09:15 - 11:15, Ziskind, Rm 1
Wednesday, 09:15 - 11:15, Ziskind, Rm 1
11/12/2023
28/02/2024

Field of Study, Course Type and Credit Points

Mathematics and Computer Science: Lecture; Elective; Regular; 4.00 points
Chemical Sciences: Lecture; Elective; Regular; 4.00 points
Life Sciences: Lecture; Elective; Regular; 4.00 points
Life Sciences (Brain Sciences: Systems, Computational and Cognitive Neuroscience Track): Lecture; Elective; Regular; 4.00 points

Comments

The course will be held by hybrid learning.

Prerequisites

  • Mathematical background: Basic courses in Linear Algebra, Calculus and Probability. 

  • Programming skills: All class assignments will be in Python. If you have a lot of programming experience but in a different language (e.g. C/C++/Matlab/Javascript) you will probably be fine.

  • We also encourage students to take “Introduction to Computer Vision” course, which provides complimentary fundamental knowledge to ours. 

Restrictions

50

Language of Instruction

English

Attendance and participation

Required in at least 80% of the lectures

Grade Type

Numerical (out of 100)

Grade Breakdown (in %)

100%

Evaluation Type

Final assignment

Scheduled date 1

03/04/2024
Ziskind, Rm 1
0900-1200
N/A

Estimated Weekly Independent Workload (in hours)

3

Syllabus

  • Introduction & ML Basics

  • Basics of Neural Networks

  • Convolutional Neural Network

  • Advanced Neural Networks Training

  • Detection / Segmentation

  • Visualizing and Understanding

  • Sequences (Recurrent Neural Networks, Attention, Transformers)

  • Generative Models (GANs, VAEs)

  • Self-supervision in Images, Videos and Sound

  • Learning from Videos

  • CNN as representations and optimizers

  • Implicit 3D representation 

  • Graph Neural Networks 

  • Deep Learning Theory

Learning Outcomes

Upon successful completion of the course the students will be able to have:

  • In-depth understanding of the fundamentals of deep-learning based methodologies in computer vision  (e.g., convolutional neural networks, optimization, back-propagation, generative image models)

  • Gain knowledge about core deep learning algorithms, modern approaches and cutting-edge research for various visual tasks.

  • Hands-on experience with deep learning for computer vision:

    • Implement neural networks and their components from scratch. 

    • Train, run and debug CNN models using leading frameworks (PyTorch) 

 

Reading List

Website