Monthly Archives: January 2025

PyTorch Neural Network Distillation Using the Teacher-Student Technique

The DeepSeek R1 large language model, announced on January 20 of this year, shocked the deep learning community because it was much less expensive to create and is much less expensive to use, compared to all other current LLMs. According … Continue reading

Posted in PyTorch | 3 Comments

“Gradient Boosting Regression Using C#” in Visual Studio Magazine

I wrote an article titled “Gradient Boosting Regression Using C#” in the January 2025 edition of Microsoft Visual Studio Magazine. See https://visualstudiomagazine.com/Articles/2025/01/15/Gradient-Boosting-Regression-Using-CSharp.aspx. A machine learning gradient boosting regression system, also called a gradient boosting machine (GBM), predicts a single numeric … Continue reading

Posted in Machine Learning | Leave a comment

NFL 2024 Season Super Bowl LIX Prediction – Zoltar Says the Eagles Will Beat the Chiefs 28-27

Zoltar is my NFL football prediction computer program. It uses a neural network and a type of reinforcement learning. Here is Zoltar’s prediction for week #22 (Super Bowl LIX) of the 2024 season. Zoltar: eagles by 1 dog = chiefs … Continue reading

Posted in Zoltar | Leave a comment

Taking Another First Look at Quantum Computing Using the Q# Language

The Q# language from Microsoft is one of several ways to explore quantum computing. Two other ways are using the Qiskit library from IBM and the Cinq library from Google. I first looked at Q# several years ago, but at … Continue reading

Posted in Miscellaneous | Leave a comment

Refactoring My C# Neural Network Regression Implementation to Resemble the scikit-learn Library API

Recently, I had been taking an extended look into implementing various machine learning regression algorithms using C# — linear regression, k-nearest neighbors regression, kernel ridge regression, Gaussian process regression, AdaBoost regression, gradient boosting regression, random forest regression, Poisson regression, naive … Continue reading

Posted in Machine Learning | Leave a comment

Naive Bayes Regression Using C#

I put together a demo of an old regression technique called naive Bayes regression. Naive Bayes regression is essentially a variation of basic linear regression. In simple linear regression, there is a single predictor variable x, and a single target … Continue reading

Posted in Machine Learning | Leave a comment

“Advances in Quantum Computing Portend a Fantastic AI Future” on the Pure AI Web Site

I contributed some technical content and quotes to an article titled “Advances in Quantum Computing Portend a Fantastic AI Future” on the January 2025 edition of the Pure AI web site. See https://pureai.com/Articles/2025/01/08/Two-Interesting-Advances-in-Quantum-Computing.aspx. The article describes two interesting advances that … Continue reading

Posted in Miscellaneous | Leave a comment

NFL 2024 Week 22 (Conference Championships) Predictions – Zoltar Likes the Chiefs over the Bills by 2 Points More Than Las Vegas Does

Zoltar is my NFL football prediction computer program. It uses a neural network and a type of reinforcement learning. Here are Zoltar’s predictions for week #21 (conference championship games) of the 2024 season. Zoltar: eagles by 6 dog = commanders … Continue reading

Posted in Zoltar | Leave a comment

Testing How Well the Newton Iteration Algorithm for Matrix Inverse Works

Finding the inverse of a matrix is one of the most difficult problems in numerical programming. There are dozens of algorithms, each with pros and cons. One of the oldest and simplest techniques is to use the Newton iteration algorithm. … Continue reading

Posted in Machine Learning | Leave a comment

An Experiment with Applying Attention to a PyTorch Regression Model on a Synthetic Dataset

The goal of a machine learning regression problem is to predict a single numeric value. Classical ML regression techniques include linear regression, Gaussian process regression, gradient boosting regression, and others. I’ve been experimenting with a new algorithm for machine learning … Continue reading

Posted in PyTorch, Transformers | Leave a comment