Here are my recommended tools. If you're unfamiliar with some of these, don't worry. You'll pick them up as you go along, and they form a powerful suite that will keep you on the cutting edge even as a professional data scientist.
- Hardware - Ideally you want at least 4GB of RAM for larger data sets, but you'll be able to do high-level analysis with almost any modern computing hardware.
- Linux operating system - You can certainly do top-notch data analysis using any operating system, but Linux is an excellent (and free) working environment. There are a variety of ways to install and use Linux, but I'd recommend Ubuntu's Windows installer. This will allow you to easily install Ubuntu alongside Windows, and it also makes it easy to uninstall Ubuntu later (if you choose). Ubuntu is just one of the (many) Linux distributions available, but it's very popular and well supported.
- R programming language - R is a powerful statistical programming language, and it has thousands of available packages available. If you're using Ubuntu, installing R is simple - sudo apt-get install r-base. That's it!
- Python programming language -Python is a powerful and relatively easy to use programming language. One of the most common tasks for sports analytics is web scraping, and Python is an excellent choice thanks to libraries such as Mechanize, Beautiful Soup and lxml. It's also a great language for data cleansing. Installing Python under Ubuntu - sudo apt-get install python.
- PostgreSQL database server - There are many ways to store and analyze data sets, but a dedicated relational database server is necessary tool for high-level analytics. PostgreSQL is my personal recommendation, but there are other good choices (such as MySQL). PostgreSQL is free, fast, powerful and has a huge variety of procedural languages available (including R and Python). Installing PostgreSQL under Ubuntu - sudo apt-get install postgresql-9.2.
- GitHub account - Setting up a GitHub account is free and will allow you to automatically following any changes to various sports analytics GitHub projects (such as mine). Later, you can set up your own repositories if you'd like to share your own work with other people. Don't forget to install git under Ubuntu - sudo apt-get install git.
- We'll start with analyzing hockey. If you'd like to take a look at some of my hockey code and data that I've scraped, you can find them in my hockey GitHub repository. If you've set up Ubuntu and have installed git you can execute the command git clone https://github.com/octonion/hockey.git to make a local copy of my repository.
Here's a basic outline for tackling a new sport.
- Understand how teams win - Build a model to project the likely outcome for a team when facing a particular opponent. Example - Krach for hockey (which is based on the Bradley-Terry model).
- Understand how teams score - Build a model to project how many goals/points/runs teams are likely to score or allow when facing a particular opponent. Exampe - Poisson distribution and hockey.
- Relate the two - Characterize the relationship between scoring and winning or losing. Example - Pythagorean win expectation.
- Understand how players score/prevent scoring - Determine which aspects of player performance impact team offense and defense and by how much.
- Understand player contribution to winning/losing - This is nearly automatic once you understand the relationship between team offense/defense and team winning/losing.
In my next article we'll build a basic power ranking model for hockey to predict likely game outcomes.