-
Recent Posts
Recent Comments
Max Moroz on Gaussian kernels Popular DS, AI, ML B… on K-modes TuringBot (@turing_b… on Genetic algorithms and symboli… ct98.aspx on Random forests Paul on Kernels Archives
- December 2016
- November 2016
- October 2016
- June 2016
- April 2016
- January 2016
- November 2015
- October 2015
- July 2015
- June 2015
- May 2015
- January 2015
- September 2014
- June 2014
- May 2014
- March 2014
- February 2014
- January 2014
- December 2013
- October 2013
- September 2013
- August 2013
- July 2013
- June 2013
- May 2013
- April 2013
- March 2013
Categories
Meta
Category Archives: Regression
Genetic algorithms and symbolic regression
A few months ago, I wrote a post about optimization using gradient descent, which involves searching for a model that best meets certain criteria by repeatedly making adjustments that improve things a little bit at a time. In many situations, this works … Continue reading
Posted in Modeling, Regression
1 Comment
Optimization
Optimization is a topic that has come up in a number of posts on this blog, but that I’ve never really addressed directly. So, I though it was about time that I gave it its own post. The term “optimization” … Continue reading
Posted in Classification, Regression
3 Comments
Logistic regression
In the last post, I introduced the Support Vector Machine (SVM) algorithm, which attempts to find a line/plane/hyperplane that separates the two classes of points in a given data set. This algorithm adapts elements of linear regression, a statistical tool (namely, … Continue reading
Posted in Classification, Regression
18 Comments
General regression and over fitting
In the last post, I discussed the statistical tool called linear regression for different dimensions/numbers of variables and described how it boils down to looking for a distribution concentrated near a hyperplane of dimension one less than the total number … Continue reading
Posted in Modeling, Regression
14 Comments
The geometry of linear regression
In this post, we’ll warm up our geometry muscles by looking at one of the most basic data analysis techniques: linear regression. You’ve probably encountered it elsewhere, but I want to think about it from the point of view of … Continue reading
Posted in Modeling, Regression
28 Comments