Sinir Aglari ve Makine Ogrenmesi (YAZ304)

Bahar 2019-2020 (14 hafta, 70 saat)

Carsamba @ 15:50-18:25 (1 ↣ 14 hafta: T-129), Persembe @ 12:10-13:50 (1 ↣ 14 hafta: UNIX Lab)
19 Subat - 28 Mayis, 2020

Egitmen: Mustafa MISIR (Ofis: 203/G @ ISU Topkapi Kampusu), mustafa.misir [at] istinye.edu.tr

Makine Ogrenmesi ile ilgili teorik altyapiyi saglamak suretiyle ogrenme problemleri, karsilasilan zorluklar ve cozum yontemleri islenecektir. Python ile uygulama odakli yurutulecek olan ders kapsaminda, bilinen Makine Ogrenmesi algoritmalarindan biri olan Yapay Sinir Aglari ayrica detaylandirilacktir.

+++ Duyurular ve tartismalar icin Piazza'ya katilin

On Kosullar (Pre-requisites)

YAZ103 - Temel Programlama 1 (Python)
(Tercihen) YAZ207 - Dogrusal Cebir (Linear Algebra)
(Tercihen) Olasilik ve Istatistik (Probability and Statistics)

Ders Kitabi

Yapay Ogrenme, Ethem Alpaydin (4. Baski), 2018, Bogazici Universitesi Yayinevi

Yardimci Kitaplar:

Introduction to Machine Learning, Ethem Alpaydin (3. Baski), 2014, MIT Yayinlari
Understanding Machine Learning: From Theory to Algorithms, Ehai Shalev-Shwartz, Shai Ben-David (1. Baski), 2014, Cambridge Universitesi Yayinlari (Ucretsiz Kitap)
Pattern Recognition and Machine Learning, Christopher Bishop (1. Baski), 2006, Springer (Ucretsiz Kitap)
Learning from Data, Yaser S. Abu-Mostafa, Malik Magdon-Ismail, Hsuan-Tien Lin (1. Baski), 2012, AMLBook
Machine Learning - an Algorithmic Perspective, Stephen Marshland (2. Baski), 2015, CRC Yayinlari
Machine Learning Refined: Foundations, Algorithms, and Applications, Jeremy Watt, Reza Borhani, Aggelos K. Katsaggelos (1. Baski), 2016, Cambridge Universitesi Yayinlari
Foundations of Machine Learning, Mehryar Mohri, Afshin Rostamizadeh, Ameet Talwalkar (2. Baski), 2018, MIT Yayinlari (Ucretsiz Kitap)
Machine Learning: a Probabilistic Perspective, Kevin P. Murphy (1. Baski), 2012, MIT Yayinlari
Machine Learning, Tom Mitchell (1. Baski), 1997, McGraw Hill Yayinlari
A Course in Machine Learning, Hal Daume III (2. Baski), 2017 (Ucretsiz Kitap)
Introduction to Machine Learning, Alex Smola, S.V.N. Vishwanathan (1. Baski), 2008, Cambridge Universitesi Yayinlari (Ucretsiz Kitap)
The Hundred-Page Machine Learning Book, Andriy Burkov, 2019 (Ucretsiz Kitap - Taslak Surumu)
Machine Learning Mastery With Python, Jason Brownlee, 2016
Reinforcement Learning: an Introduction, Richard S. Sutton ve Andrew G. Barto (2. Baski), 2018, MIT Yayinlari
Artificial Intelligence - With an Introduction to Machine Learning, Richard E. Neapolitan, Xia Jiang (2. Baski), 2018, CRC Yayinlari
Machine Learning Yearning, Andrew Ng (1. Baski), 2020, deeplearning.ai (Ucretsiz Kitap - Taslak Surumu)
Machine Learning - The New AI, Ethem Alpaydin (1. Baski), 2016, MIT Yayinlari
Deep Learning with Python, Francois Chollet (2. Baski), Manning Yayinlari (Ucretsiz Kitap)
Derin Ogrenme, Ian Goodfellow, Yoshua Bengio, Aaron Courville (1. Baski), 2018, Buzdagi Yayinevi
Neural Networks and Deep Learning, Michael Nielsen, 2019 (Ucretsiz Kitap)
Neural Networks and Deep Learning: A Textbook, Charu C. Aggarwal (1. Baski), 2018, Springer
Advances in Deep Learning, M. Arif Wani, Farooq Ahmad Bhat, Saduf Afzal ve Asif Iqbal Khan, 2020, Springer
Grokking Deep Learning, Andrew W. Trask (1. Baski), 2019, Manning
Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems, Aurelien Geron (2. Baski), 2019, O'Reilly
Introduction to Machine Learning with Python: A Guide for Data Scientists, Andreas C. MUller, Sarah Guido (1. Baski), 2017, O'Reilly
The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Trevor Hastie, Robert Tibshirani, Jerome Friedman (2. Baski), 2009, Springer (Ucretsiz Kitap)
Mathematics for Machine Learning, Marc Peter Deisenroth, A. Aldo Faisal, Cheng Soon Ong (1. Baski), 2020, Cambridge Universitesi Yayinlari (Ucretsiz Kitap)
Linear Algebra and Optimization for Machine Learning: A Textbook, Charu C. Aggarwal (1. Baski), 2020, Springer
Optimization for Machine Learning, Suvrit Sra, Sebastian Nowozin, Stephen J. Wright (Duzenlenmis -- 1. Baski), 2011, MIT Yayinlari
Convex Optimization, Stephen Boyd, Lieven Vandenberghe (1. Baski), 2004, Cambridge Universitesi Yayinlari (Ucretsiz Kitap)
Data Mining: Concepts and Techniques, Jiawei Han, Micheline Kamber, Jian Pei (3. Baski), 2012, Morgan Kaufmann
Data Mining and Analysis: Fundamental Concepts and Algorithms, Mohammed J. Zaki ve Wagner Meira, Jr. (1. Baski), 2014, Cambridge Universitesi Yayinlari (Ucretsiz Kitap)
Data Mining: Practical Machine Learning Tools and Techniques, Ian H. Witten, Eibe Frank, Mark A. Hall, Christopher J. Pal (4. Baski), 2016, Morgan Kaufmann Yayinlari
Data Mining: The Textbook, Charu C. Aggarwal (1. Baski), 2015, Springer Yayinlari
Data Clustering, Chandan K. Reddy, Charu C. Aggarwal (1. Baski - Ed.), 2014, CRC Yayinlari (Ucretsiz Kitap)

Ders Notlari / Slaytlar

D0 + D1: Makine Ogrenmesine Giris (Introduction to Machine Learning)

Ders Hakkinda Bilgilendirme
Tarihsel Gelisim ve Mevcut Uygulama Ornekleri

D2: Ogrenme Problemi (Learning Problem)

++ Makine Ogrenmesi ile Iliskilendirilmesi

D3-1: Denetimli Ogrenme - Dogrusal Regresyon (Supervised Learning - Linear Regression)

Regresyon (Regression) Problemi
Dereceli Alcalma (Gradient Descent)
Ozellik Onemi (Feature Importance)
Asiri vs. Yetersiz Uyum (Overfitting vs. Underfitting)

D3-2: Denetimli Ogrenme - Lojistik Regresyon (Supervised Learning - Logistic Regression)

Siniflandirma (Classification) Problemi

D3-3: Denetimli Ogrenme - Karar Agaclari (Supervised Learning - Decision Trees)

Entropi (Entropy)

D3-4: Denetimli Ogrenme - k-En Yakin Komsular (Supervised Learning - k-Nearest Neighbors)

Benzerlik (Similarity) / Uzaklik (Distance) Olculeri

D3-5: Denetimli Ogrenme - Naif Bayes (Supervised Learning - Naive Bayes)

Olasilik (Probability)
Bayes Teoremi

D3-6: Denetimli Ogrenme - Destek Vektor Makineleri (Supervised Learning - Support Vector Machines)

Duzenlilestirme (Regularization)
Cekirdek Yontemleri (Kernel Methods)

D3-7: Denetimli Ogrenme - Yapay Sinir Aglari (Supervised Learning - Artificial Neural Networks)

Algilayicilar (Perceptrons)
Cok Katmanli Algilayicilar (Multilayer Perceptrons)
Egilim (Bias)
Ileri Yayilim (Forward Propagation / Pass)
Geri Yayilim (Backward Propagation)

D4-1: Denetimsiz Ogrenme - Kumeleme (Unsupervised Learning - Clustering)

Kumeleme Analizi (Clustering Analysis) ve Uygulamalari
Bolumleme (Partitioning) Yontemleri: k-ortalamalar (k-means) ve k-Medoids

D4-2: Denetimsiz Ogrenme - Boyutsal Indirgeme (Unsupervised Learning - Dimensionality Reduction)

Cok Boyutlu Veri Gorsellestirme (Multi-dimensional Data Visualization)

D5: Veri Onisleme (Data Preprocessing)

Normallestirme (Normalization / Standardization)
Tamamlama (Imputation)

Notlandirma

Laboratuvarlar / Odevler: 30%
Arasinav / Ara-donem Odevi: 30%
Final Sinavi / Odevi: 40%

Diger Kitaplar (Other Books)

Python Programlama (Python Programming):

Think Python: How to Think Like a Computer Scientist, Allen B. Downey (2. Baski), 2016, O'Reilly Yayinlari (Ucretsiz Kitap)
How to Think Like a Computer Scientist: Learning with Python 3, Peter Wentworth, Jeffrey Elkner, Allen B. Downey, Chris Meyers (3. Baski), 2012 (Ucretsiz Kitap)
A Byte of Python, Swaroop C. H. (4. Baski), 2016 (Ucretsiz Kitap)
Project Python, Devin Balkcom, 2011 (Ucretsiz Kitap)
Python for Everybody: Exploring Data in Python 3, Charles Severance, 2016 (Ucretsiz Kitap)
A Hands-On, Project-Based Introduction to Programming, Eric Matthes (2. Baski), 2016, No Starch Yayinlari (Ucretsiz Kitap)
Learn Python 3 the Hard Way, Zed A. Shaw (1. Baski), 2017, Addison-Wesley
Introducing Python: Modern Computing in Simple Packages, Bill Lubanovic (2. Baski), 2019, O'Reilly Yayinlari

Veri Bilimi / Analitigi icin Python Programlama (Python Programming for Data Science / Analytics):

Python Data Science Handbook: Essential Tools for Working with Data, Jake VanderPlas (1. Baski), 2017, O'Reilly Yayinlari
Python for Data Analysis: Data Wrangling with Pandas, NumPy, and IPython, Wes McKinney (2. Baski), 2017, O'Reilly Yayinlari
Data Science from Scratch: First Principles with Python, Joel Grus (2. Baski), 2019, O'Reilly Yayinlari
Introduction to Machine Learning with Python: A Guide for Data Scientists, Andreas C. Muller, Sarah Guido (1. Baski), 2017, O'Reilly Yayinlari

Veri Gorselletirme (Data Visualization):

Data Visualization - A Practical Introduction, Kieran Healy (1. Baski), 2019, Princeton Universitesi Yayinlari
Visualization Analysis and Design,Tamara Munzner (1. Baski), 2014, CRC Yayinlari
The Visual Display of Quantitative Information, Edward R. Tufte (2. Baski), 2001, Graphics Yayinlari
Fundamentals of Data Visualization - A Primer on Making Informative and Compelling Figures, Claus O. Wilke (1. Baski), 2019, O'Reilly Yayinlari (Ucretsiz Kitap)
Making Data Visual - A Practical Guide to Using Visualization for Insight, Danyel Fisher, Miriah Meyer (1. Baski), 2018, O'Reilly Yayinlari