awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
zotroneneis avatar

zotroneneis/machine_learning_basics

0
View on GitHub↗

Machine Learning Basics

This project is a collection of foundational machine learning algorithms and tools implemented from scratch in Python. It serves as a library of core implementations for regression, classification, and clustering models, designed to demonstrate the underlying mathematical structures of these algorithms without relying on high-level machine learning frameworks.

The project focuses on the manual implementation of algorithmic logic, including neural networks with forward propagation and weight updates, as well as various supervised and unsupervised learning models. It utilizes NumPy for vectorization to perform matrix calculations and mathematical operations on large datasets.

The toolkit covers a broad range of capabilities, including dimensionality reduction via Principal Component Analysis and data preprocessing for numerical and image datasets. The algorithmic implementations span linear and Bayesian regression, K-Means clustering, and multiple classification methods such as Support Vector Machines, Decision Trees, and K-Nearest Neighbors.

The project is delivered as a series of Jupyter Notebooks.

Features

  • From-Scratch ML Model Implementations - Provides foundational implementations of machine learning models built from first principles without relying on high-level frameworks.
  • Machine Learning Education - Serves as an educational resource for learning the mathematics of ML by building algorithms from scratch.
  • Centroid-Based Clustering - Implements K-Means clustering by iteratively refining center coordinates based on the mean of assigned points.
  • Classification Trees - Implements decision trees specifically for categorizing instances into discrete classes through binary splits.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
4,418 stars·836 forks·Jupyter Notebook·MIT·24 views
  • Gradient-Based Parameter Updates - Implements weight adjustment logic using gradient descent to minimize prediction error.
  • Hyperplane Margin Maximization - Implements the mathematical logic for maximizing margins in Support Vector Machines.
  • K-Means Clustering - Implements centroid-based partitioning of unlabeled data into a specified number of clusters using iterative refinement.
  • K-Nearest Neighbor Classifiers - Implements supervised learning models that assign classes based on the majority vote of the closest training samples.
  • Linear Regression - Implements fundamental statistical methods for modeling relationships between variables using linear equations.
  • Bayesian Regressions - Implements probabilistic linear models that treat parameters as distributions to quantify prediction uncertainty.
  • Logistic Regression Models - Implements algorithms for predicting binary outcomes using the sigmoid function and weight optimization.
  • Machine Learning Implementations - Provides a comprehensive collection of core machine learning algorithms implemented manually in Python.
  • Forward Propagation Engines - Implements forward propagation logic using matrix multiplication to calculate layer outputs.
  • Neural Network Implementations - Implements an artificial neural network from scratch, demonstrating forward propagation and weight updates.
  • Supervised Classification - Implements supervised classification and regression models including Decision Trees and SVMs.
  • Support Vector Machines - Implements support vector machines to establish optimal decision boundaries that maximize the margin between classes.
  • Unsupervised Learning - Implements unsupervised learning algorithms like K-Means to discover patterns in unlabeled data.
  • Educational Python Implementations - Provides algorithmic implementations in pure Python to ensure the internal logic and mathematics are transparent and readable.
  • Softmax Regression - Provides an implementation of softmax regression for multi-class classification probability prediction.
  • NumPy-Based Linear Algebra Implementations - Uses NumPy for vectorization and matrix manipulations to perform efficient mathematical operations on datasets.
  • Perceptrons - Implements a basic linear classifier that learns a weight vector to separate two classes of data.
  • Posterior Distribution Estimators - Implements Bayesian linear regression by calculating posterior probabilities for linear coefficients using prior beliefs.
  • Dimensionality Reduction - Provides mathematical techniques for reducing high-dimensional data into lower-dimensional spaces based on variance.
  • Principal Component Analysis - Implements Principal Component Analysis to reduce dimensionality by transforming variables into uncorrelated components.

    • Star history

    Star history chart for zotroneneis/machine_learning_basicsStar history chart for zotroneneis/machine_learning_basics

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Curated searches featuring Machine Learning Basics

    Hand-picked collections where Machine Learning Basics appears.
    • Neural Network Implementation Projects
    • Machine Learning Textbooks and Guides

    Frequently asked questions

    What does zotroneneis/machine_learning_basics do?

    This project is a collection of foundational machine learning algorithms and tools implemented from scratch in Python. It serves as a library of core implementations for regression, classification, and clustering models, designed to demonstrate the underlying mathematical structures of these algorithms without relying on high-level machine learning frameworks.

    What are the main features of zotroneneis/machine_learning_basics?

    The main features of zotroneneis/machine_learning_basics are: From-Scratch ML Model Implementations, Machine Learning Education, Centroid-Based Clustering, Classification Trees, Gradient-Based Parameter Updates, Hyperplane Margin Maximization, K-Means Clustering, K-Nearest Neighbor Classifiers.

    Which projects share features with zotroneneis/machine_learning_basics?

    Projects with overlapping indexed features include: lawlite19/machinelearning_python — This is a Python machine learning library featuring a collection of core algorithms implemented from scratch to… rasbt/python-machine-learning-book — This project is an educational resource providing practical code examples and implementations of machine learning… biolab/orange3 — Orange3 is a visual data mining platform that provides an interactive canvas for building data analysis workflows… trekhleb/homemade-machine-learning — This project provides a collection of machine learning algorithms implemented from scratch in Python. It serves as an… jack-cherish/machine-learning — This project is a collection of supervised and unsupervised machine learning algorithms implemented from scratch using… ljpzzz/machinelearning — This project is a machine learning implementation library featuring a collection of code examples that implement…

    Projects sharing features with Machine Learning Basics

    These projects share indexed features with Machine Learning Basics. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • lawlite19/machinelearning_pythonlawlite19 avatar

      lawlite19/MachineLearning_Python

      8,526View on GitHub↗

      This is a Python machine learning library featuring a collection of core algorithms implemented from scratch to demonstrate foundational AI concepts. It provides a comprehensive toolkit for supervised learning, unsupervised learning, and neural network development. The project is distinguished by its custom implementation of a neural network framework, which includes multi-layer perceptrons with backpropagation, gradient descent, and weight regularization. It also includes a specialized anomaly detection toolkit that identifies outliers and rare events using Gaussian probability distributions

      Python
      View on GitHub↗8,526
    • rasbt/python-machine-learning-bookrasbt avatar

      rasbt/python-machine-learning-book

      12,614View on GitHub↗

      This project is an educational resource providing practical code examples and implementations of machine learning algorithms using the Python language. It serves as a guide for constructing predictive pipelines, clustering models, and dimensionality reduction within the Scikit-Learn ecosystem. The repository includes comprehensive demonstrations for supervised and unsupervised learning, as well as detailed examples for implementing neural networks and deep architectures. It also provides practical guidance on exporting model parameters to JSON and wrapping trained models in web APIs for produ

      Jupyter Notebook
      View on GitHub↗12,614
    • biolab/orange3biolab avatar

      biolab/orange3

      5,635View on GitHub↗

      Orange3 is a visual data mining platform that provides an interactive canvas for building data analysis workflows without writing code. At its core, it offers a widget-based visual programming environment where users connect configurable components to perform data preprocessing, machine learning model training, statistical evaluation, and interactive visualization. The platform is built on NumPy-backed data tables with domain descriptors that define variable names, types, and roles, and includes a lazy SQL query proxy for working with database tables without loading all data into memory. The

      Python
      View on GitHub↗5,635
  • trekhleb/homemade-machine-learningtrekhleb avatar

    trekhleb/homemade-machine-learning

    24,608View on GitHub↗

    This project provides a collection of machine learning algorithms implemented from scratch in Python. It serves as an educational resource using interactive notebooks that combine code with mathematical explanations to demonstrate the first principles of data science. The repository includes reference implementations for neural networks, such as multilayer perceptrons with backpropagation, and supervised learning models including linear and logistic regression. It also covers unsupervised learning through k-means clustering and Gaussian anomaly detection. The codebase covers a broad range of

    Jupyter Notebook
    View on GitHub↗24,608
    • Compare all 30 related projects→