Machine Learning

This is a repository for UJ Machine Learning course. It will contain all the required projects. Each project will have it's own seperate branch with commit history.

The master branch will be constantly updated after each project has been finished.

Project 1 - Clustering

✅ 3.0 - Modify the HCM code to work for three groups

✅ 3.5 - For density clustering, plot the feature space with all element marked with different color, depending on the cluster that it's assigned to

✅ 4.0 - Build a method that plot baed on dendrograms_history and pydot, a dendrogram for the divisive clustering method

✅ 4.5 - Implement the s2 metric

✅ 5.0 - Draw the borders between clusters in the output image

Code: project_1

Project 2 - Linear Regression

✅ 3.0 - Use the cross-validation method to test the linear regression with different α values

✅ 4.0 - Implement a SGD method that will train the Lasso regression for 10 epochs

✅ 5.0 - Extend the Fisher's classifier to work with two features

Code: project_2

Project 3 - Decision Trees

✅ 3.0 - Rewrite the CART method to the Gini index

✅ 3.5 - Use pydot do draw the tree for C4.5 example

✅ 4.0 - Implement the minimum number of objects pruning method

❌ 5.0 - Plot OC1 tree, but instead of elements id, print the feature id it was split by

Code: project_3

Project 4 - Ensemble

✅ 3.0 - Find the best three classifier in the stacking method

✅ 5.0 - Build arcing arc-x4 method

Code: project_4

Project 5 - SVM

✅ 3.0 - Polynomial kernel

❌ 5.0 - Implement a multiclass C-SVM

Code: project_5

Project 6 - NLP

✅ 3.0 - Build tokenizer

✅ 3.5 - Get tags from Trump speech using NLTK

✅ 4.0 - Find the nouns divided by sentencens

✅ 4.5 - Build Bag Of Words implementation

✅ 5.0 - Build a 5-gram model

Code: project_6