https://www.dataschool.io/simple-guide-to-confusion-matrix-terminology/#:~:text=A%20confusion%20matrix%20is%20a,the%20true%20values%20are%20known.&text=The%20classifier%20made%20a%20total,the%20presence%20of%20that%20disease).
https://towardsdatascience.com/understanding-confusion-matrix-a9ad42dcfd62
Posted in Data Mining, Data Mining
code for exercise :
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 |
#a library(arules) data(Groceries) Groceries #b myrules=apriori(Groceries) inspect(myrules) #c myrules=apriori(Groceries,parameter=list(supp=0.05,conf=0.05)) #d inspect(myrules) myrules=apriori(Groceries,parameter=list(minlen=2)) #e myrules=apriori(Groceries,parameter=list(minlen=1)) inspect(myrules) #f myrules=apriori(Groceries,parameter=list(supp=0.01,conf=0.01,minlen=3)) #g inspect(myrules[20]) #answer lift value: Used to judge the strength of the association rule #if lift value is greater than> 1 some usefulness in that rule #the larger the lift is the greater is the strength of the association #https://www.dataminingapps.com/2017/04/what-is-the-lift-value-in-association-rule-mining/ #h cc=sort(myrules,by="lift") inspect(cc[1:10]) #i hh=subset(myrules,subset=lhs %pin% "pork" & lift>1.2) #pin is using as matching function to match character inspect(hh) |
Posted in Data Mining
K={1, 1.1, 5, 5.1, 1.5, 5.2, 7.9, 1.2, 8.1, 9}
Total item=10
iter1:
m1=5 m2=9
K1={1, 1.1, 5, 5.1, 1.5, 5.2, 1.2} K2={7.9, 8.1, 9}
m1=2.87==approx(3) m2=8.333==approx(9)
iter(2):
K1={1, 1.1, 5, 5.1, 1.5, 5.2, 1.2} ; K2={7.9, 8.1, 9}
m1=approx(3) m2=approx(9)
So, here same mean twice. so we have to stop.
Posted in Data Mining, Data Mining
K-means clustering Algorithm for manually finding from observation:
Step 1: Take mean value
Step 2: Find nearest number of mean and put in cluster
Step 3: Repeat one and two until we get same mean
K={2,3,4,10,11,12,20,25,30}
k=2 [it means we have to create 2 clusters]
iter1:
m1=4 m2=12
k1={2,3,4} [according to nearest distance of 4]
so mean m1=3
k2={10,11,12,20,25,30}
m2=108/6=18
iter2:
k1={2,3,4,10}
m1=4.75==approc(5)
k2={11,12,20,25,30}
m2=19.6==approx(20)
Iter 3:
K1={2,3,4,10,11,12} K2={20,25,30}
m1=7 m2=25
k1={2,3,4,10,11,12} k2={20,25,30}
m1=7, m2=25
Same mean twice. Thus we are getting same mean we have to stop.
Posted in Data Mining, Data Mining
Ensemble Models:
Basics
Boosting
Ranmdom Forests
Support Vector Machines
Basics
Linear Classification
Nonlinear Classification
Properties of SVMs
Discriminant Analysis
Basics
Exercise:
We are going to create some data mining models for classification and compare their performance. The goal with our models is still.
Posted in Data Mining, Data Mining
Design of network topology
Determine:
Number of input nodes
Too few nodes => misclassification
Too many nodes=> overfitting
Problems with dollar sign:
https://stackoverflow.com/questions/42560090/what-is-the-meaning-of-the-dollar-sign-in-r-function
Problem with tilde sign:
https://stackoverflow.com/questions/14976331/use-of-tilde-in-r-programming-language?noredirect=1&lq=1
Posted in Data Mining, Data Mining
Problem statement: Write a program to simulate a car dealership sales process. We will have employees, working selling vehicles to customers.
you have to think about nouns(a person, name or thing) while doing OOP, we have 4 nouns in the problem statement.
Dealership.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
package com.zakilive; public class Dealership { public static void main(String[] args) { Customer cust1=new Customer("Tom", "123 Anything st", 25000); //cust1 is a variable // cust1.setName("Tom"); //cust1 is referencing the things on heap // cust1.setAddress("123 Anything st"); // cust1.setCashOnHand(25000); // Vehicle vehicle=new Vehicle("Honda","Accord", 15000); //we are passing through constructor // vehicle.setMake("Honda"); // vehicle.setModel("Accord"); // vehicle.setPrice(15000); Vehicle vehicle = new Vehicle("BMW","M3",20000); Employee emp=new Employee(); cust1.purchaseCar(vehicle, emp, false); //false Vehicle car=new Vehicle("BMW","M3",20000); boolean value=car.equals(vehicle); System.out.println(value); /*** * * handleCustomer(Customer cust, boolean finance, Vehicle vehicle) * if(finance==true) * runCreditHistory(Customer cust, double doubleAmount) * else if(vehicle.getPrice()<=cust.getCashOnHand()): * processTransaction(Customer cust,Vehicle vehicle) * else: * tell customer bring more money * * * //getters allow us to encapsulate data * */ } } |
Customer.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 |
package com.zakilive; public class Customer { private String name; //this are only accessible in this class private String address; private double cashOnHand; public Customer(String name, String address, double cashOnHand) { this.name = name; this.address = address; this.cashOnHand = cashOnHand; } public String getName() { return name; } public void setName(String name) { this.name = name; } public double getCashOnHand() { return cashOnHand; } public void setCashOnHand(double cashOnHand) { cashOnHand+=500; this.cashOnHand = cashOnHand; } public String getAddress() { return address; } public void setAddress(String address) { address+="Dealership City"; this.address = address; } public void purchaseCar(Vehicle vehicle, Employee emp, boolean finance) //method signature { emp.handleCustomer(this, finance, vehicle); //"this" actually shares the instances of a class to the another class method } } |
Vehicle.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 |
package com.zakilive; public class Vehicle { private String make; private String model; private double price; public Vehicle(String make, String model, double price) { this.make = make; this.model = model; this.price = price; } public String getMake() { return make; } public void setMake(String make) { this.make = make; } public String getModel() { return model; } public void setModel(String model) { this.model = model; } public double getPrice() { return price; } public void setPrice(double price) { this.price = price; } @Override public int hashCode() { return super.hashCode(); } @Override public boolean equals(Object obj) { return super.equals(obj); } @Override public String toString() { return "Vehicle {" + "make='" + make + '\'' + ", model='" + model + '\'' + ", price=" + price + '}'; } } |
Employee.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
package com.zakilive; public class Employee { public void handleCustomer(Customer cust, boolean finance, Vehicle vehicle) { if(finance==true) { //customer pays in loan double loanAmount=vehicle.getPrice()-cust.getCashOnHand(); runCreditHistroy(cust,loanAmount); } else if (vehicle.getPrice()<=cust.getCashOnHand()) //reason for using getters is encapsulating and the data hiding objects, setters to set also for the same purpose { //customer pays in cash processTransaction(cust,vehicle); } else{ System.out.println(" Customer will need more money to purchase vehicle: "+vehicle); } } public void runCreditHistroy(Customer cust, double loanAmount) { System.out.println("Ran credit history for customer...."); System.out.println("Customer has been approved to purchase the vehicle"); } public void processTransaction(Customer cust, Vehicle vehicle){ System.out.println("Customer has purchased the vehicle: " +vehicle+" for the price "+vehicle.getPrice()); } } |
Output:
if false in purchaseCar()
|
1 2 |
Customer has purchased the vehicle: Vehicle {make='BMW', model='M3', price=20000.0} for the price 20000.0 false |
if true in purchaseCar()
|
1 2 3 |
Ran credit history for customer.... Customer has been approved to purchase the vehicle false |
Posted in OO Analysis and Design, OOP
Animal.java class
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
package com.zakilive; public abstract class Animal { //defining attributes String name; int weight; String gender; public Animal(String name, int weight, String gender){ //defining constructors this.name=name; this.weight=weight; this.gender=gender; } //behaviours public void Eat(){ System.out.println(name+" eat"); } public void Sleep(){ System.out.println(name+" Sleep"); } public abstract void move(); //You cannot create instance of a abtract class } |
Fish.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
package com.zakilive; public class Fish extends Animal { public Fish(String name, int weight, String gender) { super(name, weight, gender); } public void move() { System.out.println("Fish is swimming"); } public void Swim() { System.out.println(name + " also Swimming..."); } public static void moveAnimal() { } } |
Zoo.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 |
package com.zakilive; public class Zoo { public static void main(String[] args) { Animal sparrow1=new Sparrow("Bird1",9,"Male"); sparrow1.move(); Animal fish1=new Fish("Hilsha",99,"Male"); fish1.move(); moveAnimals(fish1); moveAnimals(sparrow1); // Animal animal1 = new Animal("Parrot", 20, "Male"); // animal1.Eat(); // // Bird bird1 = new Bird("Parrot", 20, "male"); // //bird1.Fly(); // // Animal animal2 = new Animal("Salmon", 50, "Female"); // animal2.Eat(); // // Fish fish= new Fish("Salmon", 50, "Female"); // fish.Swim(); // // // // Chicken chick1=new Chicken("Murgi",50,"Female"); // chick1.fly(); } private static void moveAnimals(Animal animal) { animal.move(); } } |
Sparrow.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
package com.zakilive; public class Sparrow extends Bird implements Flyable { public Sparrow(String name, int weight, String gender) { super(name, weight, gender); } public void Fly(){ System.out.println("Sparrow flying high...."); } } |
Chicken.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
package com.zakilive; public class Chicken extends Bird{ public Chicken(String name, int weight, String gender) { super(name, weight, gender); } public void fly(){ System.out.println("not able to fly...."); } } |
Bird.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
package com.zakilive; public class Bird extends Animal { //now bird is a child of Animal, Bird is a subclass and Animal is base class public Bird(String name, int weight, String gender) { super(name, weight, gender); } public void move() { System.out.println("Flapping wings"); } } |
Flyable.java
|
1 2 3 4 5 6 7 8 9 10 |
package com.zakilive; public interface Flyable { //interface only has abstract method public void Fly(); //interface has no body } |
Posted in OO Analysis and Design, OOP
Animal.java:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
package com.zakilive; public class Animal { //defining attributes String name; int weight; String gender; public Animal(String name, int weight, String gender){ //defining constructors this.name=name; this.weight=weight; this.gender=gender; } //behaviours public void Eat(){ System.out.println(name+" eat"); } public void Sleep(){ System.out.println(name+" Sleep"); } } |
Zoo.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
package com.zakilive; public class Zoo { public static void main(String[] args) { Animal animal1 = new Animal("Parrot", 20, "Male"); animal1.Eat(); Bird bird1 = new Bird("Parrot", 20, "male"); bird1.Fly(); Animal animal2 = new Animal("Salmon", 50, "Female"); animal2.Eat(); Fish fish= new Fish("Salmon", 50, "Female"); fish.Swim(); } } |
Fish.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 |
package com.zakilive; public class Fish extends Animal{ public Fish(String name, int weight, String gender) { super(name, weight, gender); } public void Swim(){ System.out.println(name+" also Swimming..."); } } |
Bird.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
package com.zakilive; public class Bird extends Animal { //now bird is a child of Animal, Bird is a subclass and Animal is base class public Bird(String name, int weight, String gender) { super(name, weight, gender); } public void Fly() { System.out.println(name+" also Flying..."); } } |
Posted in OO Analysis and Design, OOP
Human.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 |
package com.zakilive; public class Human { String name; int age; int heightInInches; String eyeColor; public Human(String name,int age,int heightInInches,String eyeColor){ //special method/construcotr method same name as class, constructor has no return type this.age=age; //this is a variable which is making it dynamic when it puts this.heightInInches=heightInInches; this.eyeColor=eyeColor; this.name=name; } public void Speak(){ System.out.println("Hello, my name is "+name); System.out.println("I am "+heightInInches+" inches tall"); System.out.println("I am "+age+" years old"); System.out.println("My eye color is "+eyeColor); System.out.println("\n"); } public void eat(){ System.out.println("Eating..."); } public void walk(){ System.out.println("Walking..."); } public void work(){ System.out.println("Working...."); } } |
Earth.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
package com.zakilive; public class Earth { public static void main(String[] args) { Human human1=new Human("Togo",23,67,"Blue"); Human human2=new Human("Bogo",32,7,"BlueOcean"); Human human3=new Human("Zogo",34,889,"purple"); human1.Speak(); human2.Speak(); human3.Speak(); } } |
Posted in Java, OO Analysis and Design, OOP
iT IS HAPPEN WHEN MORE THAN ONE POSSIBLE PREDICTOR VARIABLE.
including more than one independent variable in the regression model, makes us extend the simple linerar regression model to a multiple linear regression model.
Advantages:
Relationship between response variables and several predictors simultaneously.
Disadvantages:
Model building , interpration difficulties due to complexity.
Multiple linear regression with two predictors:
Y=beta0+beta1X1+beta2X2+epsylon
where, Y is the dependent variable.
X1,X2…Xk are predictors(independent variables)
Epsylon is the random error
beta1, beta2, beta0 are unknown regression coefficients
Example=> oil consumption:
Y=oil consumption(per month)
X1=outdoor temperature
X2=size of house(in meter square)
Model:
Y=beta0+beta1X1+beta2X2+epsylon
now beta1 is expected change in Y(oil consiumption) at one unit increase in X1(outdoor temperature), when all other predictors are kept constant, i.e. in this case the size of the house is not changed.
beta1 is estimated with beta1=-27.2 degree C
Assumptions:
The random error term epsylon is normally distributed and has mean zero. i.e. E(epsylon)=0
Epsylon has (unknown) variance sigma epsylon^2. i.e. all random errors have the same variance.
Adjusted R^2
R^2adj=1- SSE/(n-k-1)/SST/(n-1)
As for simple linear regression:
plots of residual against y prime
plots of residuals against xi
normal probability plot of residuals
plots of residuals in observation order
Cook’s distance
Studentized residuals
Standardized residuals
Dffits
Collinearity:
Can only occur for multiple regression.
Predictors explaining the same variation of the response variabl.
Oil consumption continued:
One predictor measuring house size in cm^2 and another predictor in m^2
Variance inflation factor
VIFi=1/1-Ri^2
Condition Index for collinearity:
between 10 and 30=>weak collinearity
between 30 and 100=>moderate
collinearity>100=>strong collinearity
Example of Oil consumption continued:
Assume that we would like to use outdoor temperature X1 and house size X2 as predictors. Additionally, we want to use a third predictor:
X3={1 if extra-thick walls, 0 otherwise
Model:
Y=beta0+beta1X1+beta2X2+beta3X3+epsylon
Model Selection Strategies:
Mldel ranked using R^2, adjusted R^2 or mallow’s Cp
Stepwise selection methods:
Backward, forward, stepwise selection
r^2 Selection
In a data set with 7 possible predictors, there would be 2^7-1=127 possible regression models.
For every model size(k=1,2,…..,p) look at, let say, m models, chosen
Mallow’s Cp:
Large Cp=>biased model
it’s a formula.
where MSEp=mean squared error for a model with p parametes
mean squared error for the full model
n=number of observations
Posted in Data Mining, Data Mining
Writing here to clearing engineering concept of a software for future reference.
Example for Class, Constructors and Methods:
Main.java
|
1 2 3 4 5 6 7 8 |
public static void main(String[] args) { User user=new User("Zaki",30); //user.name="Zaki"; //System.out.println(user.name); user.sayHello(); } |
User.java
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
public class User{ //defining the attribute public String name; //constructor creation public User(String name, int age){ this.name=name; } //method creation public void sayHello{ System.out.println("This is "+name); } //a interface is a contract a capability that a class should provide //interface we can build loose coupled calculator } |
Interface Example
1d theke clear na , eta clear korte hobe , In Sha Allah.
Lagle onno kono tutorial ba example dekhte hobe.
Posted in Data Mining, Data Mining
Software Engineer | Polyglot Programmer | Gym Lover | Cyclist | Algorithm Addict | Programming and Research enthusiast | Life Long Passionate Learner | Love CSE, Backend and Data
Hi, thanks for your interest on my blog 🙂 I am Syed Ahmed Zaki, from Germany. This is my blog “Zakilive.Com” for sharing my knowledge and passion with you all.
I was born in a beautiful country of south asia named Bangladesh. I am a Computer Science and Engineering graduate and currently doing my post graduation in Germany. I am passionate, dedicated, hardworking about my tasks and fond of Algorithms, Competitive Programming, Mathematics, Research in data science(Machine Learning, AI, NLP, Deep Learning), bioinformatics and IoT. I also love software engineering. In software development field I prefer Web Application Engineering.
In my bachelor study life, I tried to participate in several programming contests(online, onsite, intra etc.) and passed some time in ACM training class for sharpening my logical skills. As an ordinary people it was little bit tough for me alongside with academic pressure, thesis and research paper writing but I love challenges so I always tried to push my limits though still I need to improve a lot in everything but I always trust in this quote “Hard work beats talent”. That quote I have learned from my life through bodybuilding of 6 years since 2012 and after losing 33 KG fat in 4 months from 101 KG I developed my fit physique, so I respectfully believe in this sentence and relate this with CSE field. I also love to learn from my failures. I hate excuses while working professionally and I love trying to finish my work with perfection till the last moment before deadline.
I also love to explore and play with new technologies and try to implement it with innovative ideas. In my bachelor university life, I always tried to learn from the basics of Computer Science. So, I have tried to gather Networking to Database Knowledge, OS fundamentals to OOP etc. all fundamental core basics in my skillset in a practical approach.
Alongside with developing some web applications in core php and laravel framework I have also tried to build games with unity3d game engine, built 2 android apps, experimented machine learning with python, data mining with WEKA, AI chatbot, IoT based weather station and some more project works for my undergraduate courses. As I am language and platform agnostic, I enjoyed and learned a lot from all of these works. I also love teamwork. Alongside software engineering and different extra curricular activities I also love teaching. I am also proficient at working with linux and windows based OSes and I feel so lucky if I get chance to contribute in opensource projects. In my linkedin profile you will find more details about me.
However, I am actually a knowledge seeker and life long passionate learner who tries to make his weakness as strength, I was a serious student of all the courses in CS academia that can solve real life problems as I love to explore knowledge in a crafted manner. I love to study books, blogs or whatever philosophically solve my curiosity. For that, I maintain a good collection of various technological, scientific and philosophical books in my small library. Knowledge sharing, analytical thinking, practice and passing the passion of mine with you is one of my motivations for running this blog. I practice to hone my skills with trying to improve my programming and developing skillset day by day and what I learn, I never forget to share here for you.
In my free time I love to do cycling or gym or play racing games in my android phone or watch animated movies and also love to promote positive, fit and healthy lifestyle among people.
Connect with me:
Currently I am working with python technologies. If you have any opportunity/business to work with me or any other query kindly say just hi to me at my mail:
[email protected]