R8：Learning paths for Data Science[continuous updating…]
Comprehensive learning path – Data Science in Python
Journey from a Python noob to a Kaggler on Python
So, you want to become a data scientist or may be you are already one and want to expand your tool repository. You have landed at the right place. The aim of this page is to provide a comprehensive learning path to people new to python for data analysis. This path provides a comprehensive overview of steps you need to learn to use Python for data analysis. If you already have some background, or don’t need all the components, feel free to adapt your own paths and let us know how you made changes in the path.
Step 0: Warming up
Before starting your journey, the first question to answer is:
Why use Python?
or
How would Python be useful?
Watch the first 30 minutes of this talk from Jeremy, Founder of DataRobot at PyCon 2014, Ukraine to get an idea of how useful Python could be.
Step 1: Setting up your machine
Now that you have made up your mind, it is time to set up your machine. The easiest way to proceed is to just download Anaconda (或者去右边的网址下载：http://www.continuum.io/downloads)from Continuum.io . It comes packaged with most of the things you will need ever. The major downside of taking this route is that you will need to wait for Continuum to update their packages, even when there might be an update available to the underlying libraries. If you are a starter, that should hardly matter.
If you face any challenges in installing, you can find more detailed instructions for various OS here
Step 2: Learn the basics of Python language
You should start by understanding the basics of the language, libraries and data structure. The python track fromCodecademy is one of the best places to start your journey. By end of this course, you should be comfortable writing small scripts on Python, but also understand classes and objects.
Specifically learn: Lists, Tuples, Dictionaries, List comprehensions, Dictionary comprehensions
Assignment: Solve the python tutorial questions on HackerRank. These should get your brain thinking on Python scripting
Alternate resources: If interactive coding is not your style of learning, you can also look at The Google Class for Python. It is a 2 day class series and also covers some of the parts discussed later.
Step 3: Learn Regular Expressions in Python
You will need to use them a lot for data cleansing, especially if you are working on text data. The best way to learn Regular expressions is to go through the Google class and keep this cheat sheet handy.
Assignment: Do the baby names exercise
If you still need more practice, follow this tutorial for text cleaning. It will challenge you on various steps involved in data wrangling.
Step 4: Learn Scientific libraries in Python – NumPy, SciPy, Matplotlib and Pandas
This is where fun begins! Here is a brief introduction to various libraries. Let’s start practicing some common operations.
- Practice the NumPy tutorial thoroughly, especially NumPy arrays. This will form a good foundation for things to come.
- Next, look at the SciPy tutorials. Go through the introduction and the basics and do the remaining ones basis your needs.
- If you guessed Matplotlib tutorials next, you are wrong! They are too comprehensive for our need here. Instead look at this ipython notebook till Line 68 (i.e. till animations)
- Finally, let us look at Pandas. Pandas provide DataFrame functionality (like R) for Python. This is also where you should spend good time practicing. Pandas would become the most effective tool for all mid-size data analysis. Start with a short introduction, 10 minutes to pandas. Then move on to a more detailed tutorial on pandas.
You can also look at Exploratory Data Analysis with Pandas and Data munging with Pandas
Additional Resources:
- If you need a book on Pandas and NumPy, “Python for Data Analysis by Wes McKinney”
- There are a lot of tutorials as part of Pandas documentation. You can have a look at them here
Assignment: Solve this assignment from CS109 course from Harvard.
Step 5: Effective Data Visualization
Go through this lecture form CS109. You can ignore the initial 2 minutes, but what follows after that is awesome! Follow this lecture up with this assignment
Step 6: Learn Scikit-learn and Machine Learning
Now, we come to the meat of this entire process. Scikit-learn is the most useful library on python for machine learning. Here is a brief overview of the library. Go through lecture 10 to lecture 18 from CS109 course from Harvard. You will go through an overview of machine learning, Supervised learning algorithms like regressions, decision trees, ensemble modeling and non-supervised learning algorithms like clustering. Follow individual lectures with the assignments from those lectures.
Additional Resources:
- If there is one book, you must read, it is Programming Collective Intelligence – a classic, but still one of the best books on the subject.
- Additionally, you can also follow one of the best courses on Machine Learning course from Yaser Abu-Mostafa. If you need more lucid explanation for the techniques, you can opt for the Machine learning course from Andrew Ng and follow the exercises on Python.
- Tutorials on Scikit learn
Assignment: Try out this challenge on Kaggle
Step 7: Practice, practice and Practice
Congratulations, you made it!
You now have all what you need in technical skills. It is a matter of practice and what better place to practice than compete with fellow Data Scientists on Kaggle. Go, dive into one of the live competitions currently running onKaggle and give all what you have learnt a try!
Step 8: Deep Learning
Now that you have learnt most of machine learning techniques, it is time to give Deep Learning a shot. There is a good chance that you already know what is Deep Learning, but if you still need a brief intro, here it is.
I am myself new to deep learning, so please take these suggestions with a pinch of salt. The most comprehensive resource is deeplearning.net. You will find everything here – lectures, datasets, challenges, tutorials. You can also try the course from Geoff Hinton a try in a bid to understand the basics of Neural Networks.
P.S. In case you need to use Big Data libraries, give Pydoop and PyMongo a try. They are not included here as Big Data learning path is an entire topic in itself.
LeaRning Path on R – Step by Step Guide to Learn Data Science on R
One of the common problems people face in learning R is lack of a structured path. They don’t know, from where to start, how to proceed, which track to choose? Though, there is an overload of good free resources available on the Internet, this could be overwhelming as well as confusing at the same time.
After digging through endless resources & archives, here is a comprehensive Learning Path on R to help you learn R from ‘the scratch’. This will help you learn R quickly and efficiently. Time to have fun while lea-R-ning!
Step 0: Warming up
Before starting your journey, the first question to answer is: Why use R? or How would R be useful?
Watch this 90 seconds video from Revolution Analytics to get an idea of how useful R could be. Incidentally Revolution Analytics just got acquired by Microsoft.
Step 1: Setting up your machine
Now that you have made up your mind, it is time to set up your machine. The easiest way to proceed is to just download the basic version of R and detailed installation instructions from CRAN (Comprehensive R Archive Network).
You can then install various other packages. There are 9000 packages in R so this can get confusing. Accordingly, we will guide you to install just the basic R packages first. Here is a link to understand packages called CRAN Views. You can accordingly select the sub type of packages that you are interested in.
How to install a package http://www.r-bloggers.com/installing-r-packages/
Some important packages to learn about: http://blog.yhathq.com/posts/10-R-packages-I-wish-I-knew-about-earlier.html
You should install these three GUIs with all dependent packages.
- Rattle for Data Mining [Link] or install.packages(“rattle”, dep=c(“Suggests”))
- R Commander for Basic Statistics [Link] or install.packages(“Rcmdr”)
- Deducer (with JGR) for Data Visualization [Link]
You should also install RStudio. It helps making R coding much easier and faster as it allows you to type multiple lines of code, handle plots, install and maintain packages and navigate your programming environment much more productively.
Assignment:
- Install R, and RStudio
- Install Packages Rcmdr, rattle, and Deducer. Install all suggested packages or dependencies including GUI.
- Load these packages using library command and open these GUIs one by one.
Step 2: Learn the basics of R language
You should start by understanding the basics of the language, libraries and data structure. The R track fromDatacamp is one of the best places to start your journey. Especially see the free Introduction to R course athttps://www.datacamp.com/courses/introduction-to-r. By end of this course, you should be comfortable writing small scripts on R, but also understand data analysis. Alternately, you can also see Code School for R athttp://tryr.codeschool.com/
If you want to learn R offline on your own time – you can use the interactive package swirl fromhttp://swirlstats.com
Specifically learn: read.table, data frames, table, summary, describe, loading and installing packages, data visualization using plot command
Assignment:
- Sign up at http://r-bloggers.com for the daily newsletter concerning R project.
- Create a github account at http://github.com
- Learn to troubleshoot package installation above by googling for help.
- Install package swirl and learn R programming (see above)
- Learn from http://datacamp.com
Alternate resources: If interactive coding is not your style of learning, you can also look at The Two Minute Tutorials on R at http://www.twotorials.com/ . It is a video series and also covers some of the parts discussed here. You can also read a comprehensive blog post titled 50 functions to help you clear a job interview in R here.
Step 3: Learn Data Manipulation
You will need to use them a lot for data cleansing, especially if you are working on text data. The best way is to go through the text manipulation and numerical manipulation exercises. You can learn about connecting to databases through the RODBC package and writing sql queries to data frames through sqldf package.
Assignment:
- Read about split, apply, combine approach for data analysis from Journal of Statisical Software.
- Try learning about tidy data approach for data analysis.
- For connecting to a RDBMS- a MySQL database through R
- You really should do a data quality exercise.
- Bored with analyzing numbers alone. Try sports analysis with a cricket analysis using R.
If you still need more practice, you can sign up for a $25/month subscription at Datacamp that gives you all tutorials . Please go through the slides here for plyr here.
Step 4: Learn specific packages in R– data.table and dplyr
This is where fun begins! Here is a brief introduction to various libraries. Let’s start practicing some common operations.
- Practice the data.table tutorial thoroughly here. Print and study the cheat sheet for data.table
- Next, you can have a look at the dplyr tutorial here.
- For text mining, start with creating a word cloud in R and then learn learn through this series of tutorial: Part 1 and Part 2.
- For social network analysis read through these pages.
- Do sentiment analysis using Twitter data – check out this and this analysis.
- For optimization through R read here and here
Additional Resources:
- If you need a book on R for Business Analytics , “R for Business Analytics by Ajay Ohri.
- If you need a book on learning R quickly , see http://statmethods.net
Step 5: Effective Data Visualization through ggplot2
- Read about Edward Tufte and his principles on how to make (and not make) data visualizations here . Especially read on data-ink, lie factor and data density.
- Read about the common pitfalls on dashboard design by Stephen Few.
- For learning grammar of graphics and a practical way to do it in R. Go through this link from Dr Hadley Wickham creator of ggplot2 and one of the most brilliant R package creators in the world today. You can download the data and slides as well.
- Are you interested in visualzing data on spatial analsysis. Go through the amazing ggmap package.
- Interested in making animations thorugh R. Look through these examples. Animate package will help youhere.
- Slidify will help supercharge your graphics with HTML5.
Step 6: Learn Data Mining and Machine Learning
Now, we come to the most valuable skill for a data scientist which is data mining and machine learning. You can see a very comprehensive set of resources on data mining in R here at http://www.rdatamining.com/ . The rattle package really helps you with an easy to use Graphical User Interface (GUI). You can see a free open source easy to understand book here at http://togaware.com/datamining/survivor/index.html
You will go through an overview of algorithms like regressions, decision trees, ensemble modeling and clustering. You can also see the various machine learning options available in R by seeing the relevant CRAN view here.
Additional Resources:
- If there is one book on data mining using R you want, it is on Rattle
- You can learn on time series forecasting from this booklet – A Little Book for Time Series in R .
- Some machine learning in R is here. You can enroll in a free course here.
Step 7: Practice, practice and Practice
Congratulations, you made it!
You now have all what you need in technical skills.
- It is a matter of practice and what better place to practice than compete with fellow Data Scientists on Kaggle. This practice contest will help you start at https://www.kaggle.com/c/titanic-gettingStarted
- Read about a more advanced Kaggle Analysis here http://0xdata.com/blog/2014/09/r-h2o-domino/
- Stay in touch with what your fellow R coders are doing by subscribing to http://www.r-bloggers.com/
- Interact with them on twitter using the #rstats hashtag.
- Stuck somewhere? This website is great for learning R quickly as it gives you just the right amount of information.
Step 8: Advanced Topics
Now that you have learnt most of data analytics using R , it is time to give some advanced topics a shot. There is a good chance that you already know many of these, but have a look at these tutorials too.
- For using R with Hadoop see this tutorial on using RHadoop.
- A Tutorial on using R with MongoDB.
- Another nice tutorial on Big Data analysis using R in the NoSQL era.
- You can make interactive web applications using Shiny from RStudio.
- Interested in learning R and Python syntax relate. Read through this guide.
P.S. In case you need to use Big Data a lot please also have a look at RevoScaleR package from Revolution Analytics. It is commercial but academic usage is free. An example project is given here.
