Python and data analytics
-
Upload
shantaben-haribhai-gajera-patel-sankul-amreli -
Category
Education
-
view
93 -
download
0
Transcript of Python and data analytics
Python and Data AnalyticsPython and Data Analytics
•Understand the problem By Understanding the Data•Predictive Model Building: Balancing Performance, Complexity, and theBig Data
Machine learning Machine learning machine learning explores the study and
construction of algorithms that can learn from and make predictions on data.
Predictive model building Predictive model building The process of building a predictive model is called
training.
Attributes: the variables being used to make predictions is known as:◦ Predictors.◦ Features◦ Independent variables ◦ Input
Labels are also known as,◦ Outcomes◦ Targets ◦ Dependent variables ◦ Responses
A machine learning project may not be linear, but it has a number of well known steps:
Define Problem.Prepare Data.Evaluate Algorithms.Improve Results.Present Results.
the iris dataset has following the iris dataset has following structure structure Attributes are numeric so you have to figure out
how to load and handle data.It is a classification problem, allowing you to
practice with perhaps an easier type of supervised learning algorithm.
It is a multi-class classification problem (multi-nominal) that may require some specialized handling.
It only has 4 attributes and 150 rows, meaning it is small and easily fits into memory.
All of the numeric attributes are in the same units and the same scale, not requiring any special scaling or transforms to get started.
Machine Learning in Python: Machine Learning in Python: Step-By-StepStep-By-Step
Installing the Python and SciPy platform.
Loading the dataset.Summarizing the dataset.Visualizing the dataset.Evaluating some algorithms.Making some predictions.
Basic library in python Basic library in python NumPy‘s array type augments the Python language
with an efficient data structure useful for numerical work, e.g., manipulating matrices. NumPy also provides basic numerical routines, such as tools for finding eigenvectors.
SciPy contains additional routines needed in scientific work: for example, routines for computing integrals numerically, solving differential equations, optimization, and sparse matrices.
The matplotlib module produces high quality plots. With it you can turn your data or your models into figures for presentations or articles. No need to do the numerical work in one program, save the data, and plot it with another program.
The Pandas module is a massive collaboration of many modules along with some unique features to make a very powerful module.
Pandas is great for data manipulation, data analysis, and data visualization.
The Pandas modules uses objects to allow for data analysis at a fairly high performance rate in comparison to typical Python procedures. With it, we can easily read and write from and to CSV files, or even databases.
From there, we can manipulate the data by columns, create new columns, and even base the new columns on other column data.
The scikit library used forSimple and efficient tools for data mining and data analysisAccessible to everybody, and reusable in various contextsBuilt on NumPy, SciPy, and matplotlibOpen source, commercially usable
NumPy: Base n-dimensional array package
SciPy: Fundamental library for scientific computing
Matplotlib: Comprehensive 2D/3D plotting
IPython: Enhanced interactive consoleSympy: Symbolic mathematicsPandas: Data structures and analysis
1. Downloading, Installing and Starting Python SciPy
1.1 Install SciPy LibrariesThere are 5 key libraries that you will need to
install. Below is a list of the Python SciPy libraries required for this tutorial:
scipynumpymatplotlibpandassklearn