Category Archives: Scikit

Combining a PyTorch Neural Network Regression Model with a scikit Gaussian Process Model

A few days ago I did a comparison of regression (predict a single numeric value) problems using a scikit Gaussian process regression (GPR) model and a PyTorch neural network (NN). See https://jamesmccaffreyblog.com/2023/06/27/showdown-gaussian-process-regression-vs-neural-network-regression/. I figured I’d take a look a combining … Continue reading

Posted in PyTorch, Scikit | Comments Off on Combining a PyTorch Neural Network Regression Model with a scikit Gaussian Process Model

“Gaussian Naive Bayes Classification Using the scikit Library” in Microsoft Visual Studio Magazine

I wrote an article titled “Gaussian Naive Bayes Classification Using the scikit Library” in the June 2023 edition of Microsoft Visual Studio Magazine. See https://visualstudiomagazine.com/articles/2023/05/31/gaussian-naive-bayes.aspx. Gaussian naive Bayes classification is a classical machine learning technique that can be used to … Continue reading

Posted in Scikit | Comments Off on “Gaussian Naive Bayes Classification Using the scikit Library” in Microsoft Visual Studio Magazine

Showdown: Gaussian Process Regression vs Neural Network Regression

The goal of a regression problem is to predict predict a single numeric value. For example, you might want to predict the price of a house based on its area in square feet, number of bedrooms, tax rate, and so … Continue reading

Posted in Machine Learning, PyTorch, Scikit | Comments Off on Showdown: Gaussian Process Regression vs Neural Network Regression

Boston Area House Dataset Problem Using the scikit KNeighborsRegression Module

A regression problem is one where the goal is to predict a single numeric value. A classic example is based on the Boston Area House dataset. The problem is to predict the median price of a house in one of … Continue reading

Posted in Scikit | Comments Off on Boston Area House Dataset Problem Using the scikit KNeighborsRegression Module

Gaussian Process Regression on Synthetic Data Using the scikit Library

I’ve been looking at Gaussian process regression (GPR) recently. There are several libraries available for GPR. GPR is very complex. Overall, the scikit library has pretty good documentation. But the documentation for the scikit GaussianProcessRegressor module is quite weak in … Continue reading

Posted in Scikit | 1 Comment

Four Recommended Techniques for Machine Learning Regression Using the scikit Library and Twelve Techniques to Avoid

A regression problem is one where the goal is to predict a single numeric value. For example, you might want to predict the annual income of a person based on their sex (male or female), age, State of residence, and … Continue reading

Posted in Scikit | Comments Off on Four Recommended Techniques for Machine Learning Regression Using the scikit Library and Twelve Techniques to Avoid

Combining Principal Component Analysis with Gaussian Process Regression

I experimented with a machine learning technique I haven’t seen used before. I used principal component analysis (PCA) to reduce the number of predictor variables in the training data, and then I used the reduced data to train a Gaussian … Continue reading

Posted in Scikit | 1 Comment

Example of Principal Component Regression Using the scikit Library

The goal of a regression problem is to predict a single numeric value. For example, you might want to predict the selling price of a house based on its square footage, number of bedrooms, age, and so on. The simplest … Continue reading

Posted in Scikit | Comments Off on Example of Principal Component Regression Using the scikit Library

Understanding the Name of the scikit-learn Python Machine Learning Library

I was presenting a talk recently. One of my examples used the scikit-learn code library for machine learning. One of the attendees asked about the difference between “scikit” and “scikit-learn”. Briefly, scikit-learn is a Python language code library for machine … Continue reading

Posted in Scikit | Comments Off on Understanding the Name of the scikit-learn Python Machine Learning Library

Using PairwiseKernel in scikit GaussianProcessRegressor for Polynomial Kernel

Briefly, I put together a demo of a scikit Gaussian process regression model that uses the polynomial kernel from the sklearn.metrics.pairwise module via the PairwiseKernel class. Whew, what a mouthful. A Gaussian process regressor model predicts a single numeric value … Continue reading

Posted in Scikit | Comments Off on Using PairwiseKernel in scikit GaussianProcessRegressor for Polynomial Kernel