Paulnkk / Columbia-IEOR-4004

I use a self-implemented Trust-Region-Method to solve the optimization problem and calculate the accuracy based on test data

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Solving-L2-Logistic-Regression-Problem

In the course "Optimization Models and Methods" I implemented a trust-region method which solves the L2 regularized Logistic Regression Problem. The Dogleg method is used to solve the subproblems. The target parameter, beta^(star), is calculated using a Maximum Likelihood approach.

I have implemented the objective function as well as its gradient and Hessian matrix. In addition, I used the following parameters to initialize the method: lambda = 10^(-5), beta^0 = 0 (starting point), t^0 = 1 (starting radius), t^(hat) = 10^4 (maximum radius), Eta = 0.05 and termination tolerance = 10^(-5).

About

I use a self-implemented Trust-Region-Method to solve the optimization problem and calculate the accuracy based on test data


Languages

Language:Python 100.0%