Linear Regression Numpy Code and Python

Python


 In the course today we learned about the following concepts:
  1. Lists 
  2. Dictionaries
  3. Tuples
  4. Sets
  5. Booleans
  6. Dealing with Files in Python
  7. Iterating in a file

Linear Regression Numpy Code

The code was completed and it was:
import math

beta = beta_zero
cost_diff = 100

rmse =-1

for i in range(10000):
    old_rmse = rmse
    y_hatnew = x_data.dot(beta)
        
    y_diff =y_true.reshape(len(x_inputs),1) - y_hatnew
        
    rmse = math.sqrt(y_diff.T.dot(y_diff)/x_data.shape[0])
    print(i,":",rmse)
        
    if abs(rmse-old_rmse) < 0.000000000001:
        break
    
    derivative = 2*y_diff.T.dot(x_data)/x_data.shape[0]
    beta = beta+step*derivative.T
print(beta) 

The next task given to us was to implement the sklearn function of Linear Regression and to compare the results of our version and the sklearn function.

Comments

Post a Comment

Popular posts from this blog

week 11(21-25 october)

Image
After completing my news article recommender last week the upcoming week brought me opportunity to explore a library for high dimensional space visualization t-SNE , I was told by my mentor Mr.Vikram Jha to explore it and tell insights. t-SNE t-Distributed Stochastic Neighbor Embedding (t-SNE) is a ( prize-winning ) technique for dimensionality reduction that is particularly well suited for the visualization of high-dimensional datasets. Before jumping to t-SNE i knew about old technique of dimensionality reduction that is PCA,  Principal Component Analysis, I first studied in ISB videos but when Sarabjot sir explained,it  became thorough PCA Principal component analysis (PCA) is a technique used to emphasize variation and bring out strong patterns in a dataset. It's often used to make data easy to explore and visualize.
Read more

How java is different from c/c++?

How java is different from c? 1. C is structured oriented language(POP) while java is object oriented langauge and has mechanism to define classes and objects. 2. Java does not support an explicit pointer type. 3. Java does not have preprocessor, so we cannot use #define,#include and #ifdef statements. 3. java does not include struct enum and union datatype. 4. Java does not include keyword like goto, sizeof, typedef. 5. Java adds labelled break and continue statement. 6. Java adds many feature required for OOP How Java is different from C++? Features removed in java. 1. Java does not support pointers to void  i.e unauthorized access to memory. 2. Java does not include struct, enum,  union datatype. 3. Java does not support operator overloading. 4. Preprocessor plays less role in C++ and so eliminated entirely in Java. 5. Java does not perform automatic type conversion and result in loss of precision. 6. Java does not support global varia...
Read more

Linear Regression Numpy code

 We finished coding generating data for the numpy version of Linear regression. We didn't use data from an excel sheet or a Kaggle dataset and hence we had to create our own data. For this, we created random integer data for our X and betas. Then we created a noise, as real data always has noise, using this we created Y data. the code for the same was as follows: import numpy as np samplesize=1000 num_attrs= 3 step = 0.1 x_inputs = np.random.rand(samplesize,num_attrs-1) x0 = np.ones((samplesize,1)) x_data = np.concatenate((x0, x_inputs), axis=1) noise = np.random.randn(len(x_inputs),1)  betas = np.random.rand(num_attrs,1) y_true = x_data.dot(betas) + noise  #understand this y_true.reshape(1000,1) Python course  We started an Udemy course on Python. The concepts we covered today were: Pros and Cons of Dynamic Typing String Indexing and Slicing Various String Methods String Interpolation:          ...
Read more