analytics
98 posts. All tags
- 2024-01-31
Data, Anecdotes, Maps, Territories
Incredibly, I am now N years old.
- 2018-08-20
Chaining Machine Learning and Optimization Models
Rahul Swamy recently wrote about mixed integer programming and machine learning. I encourage you to go and read his article.
- 2018-06-26
Four Things I Learned from Jack Dongarra
Opening the Washington Post today brought me a Proustian moment: encountering the name of Jack Dongarra.
- 2018-03-14
2018 NCAA Tournament Picks
Every year since 2010 I have used data science to predict the results of the NCAA Men’s Basketball Tournament.
- 2017-11-08
Advice for Underqualified Data Scientists
A talented individual seeking entry level data science roles recently asked me for advice. ” I’ll stick to data science, but much of what I share applies to other roles, too.
- 2017-05-14
Two Frustrations With the Data Science Industry
I saw some serious BS about data science on LinkedIn last night. This is nothing new, but this time I couldn't help myself.
- 2017-04-30
Forecasting iPad Sales using Facebook's Prophet
The past couple of days I've been playing around with Facebook's Prophet, a time series forecasting package.
- 2017-03-28
2017 NCAA Tournament Picks
Every year since 2010 I have used analytics to predict the results of the NCAA Men's Basketball Tournament.
- 2016-08-11
Noise Reduction Methods for Large-Scale Machine Learning
I have two posts remaining in my series on “Optimization Methods for Large Scale Machine Learning” by Bottou, Curtis, and Nocedal. You can find the entire series here.
- 2016-08-04
Analyses of Stochastic Gradient Methods
I am continuing my series on “Optimization Methods for Large Scale Machine Learning” by Bottou, Curtis, and Nocedal. You can find the entire series here.
- 2016-07-30
Stochastic and Batch Methods for Machine Learning
I am continuing my series on “Optimization Methods for Large Scale Machine Learning” by Bottou, Curtis, and Nocedal. You can find the entire series here.
- 2016-07-28
Model Building for Large-Scale Machine Learning
In this post on my series on “Optimization Methods for Large Scale Machine Learning” by Bottou, Curtis, and Nocedal, I want to focus on model building in machine learning.
- 2016-07-26
Optimization Methods for Large-Scale Machine Learning
Hey, so I mostly read a 93 page paper. The topic is a worthy one: optimization methods for large scale machine learning.
- 2016-06-16
Finding Optimal State Capitol Tours on the Cloud with NEOS
My last article showed you how to find an optimal tour of all 48 continental US state capitols using operations research.
- 2016-06-10
Computing Optimal Road Trips Using Operations Research
Randy Olson recently wrote about an approach for finding a road trip that visits all 48 continental US state capitols.
- 2016-06-05
The Logit and Sigmoid Functions
If you mess around with machine learning for long enough, you’ll eventually run into the logit and sigmoid functions.
- 2016-05-24
Checkpointing and Reusing TensorFlow Models
In my last two posts I introduced TensorFlow and wrote a very simple predictive model. run on Optimization objects.
- 2016-05-23
A Simple Predictive Model in TensorFlow
In my previous post I provided a simple introduction to TensorFlow.
- 2016-05-18
An Introduction To TensorFlow
This post walks through a simple Google TensorFlow example. Getting Started TensorFlow is an open source library for analytics.
- 2016-03-17
2016 NCAA Tournament Picks
Every year since 2010 I have used analytics to make my NCAA picks.
- 2016-01-27
Blogs, Research Papers, and Operations Research
There’s an interesting thread on twitter this morning about making Operations Research accessible: Please, ORMS academics take note!
- 2016-01-25
Collaborating via Data Fusion and Analytics
This article was originally published in Chain Store Age. Click here to read it.
- 2015-11-26
Thanksgiving Analytics Reading
Here are a few retail analytics links for your reading enjoyment. Happy Thanksgiving, everyone.
- 2015-10-12
The Data Types And Sources That Drive Grocery Retail
This article was originally posted at Retail TouchPoints. Click here to read it.
- 2015-10-02
Optimization Using SQL: Not Crazy
My sanity was recently called into question, not for the first time: Yet Another Math Programming Consultant: SQL as optimization language?
- 2015-09-25
SQL as an Optimization Modeling Language
Several years ago, a former (awesome) colleague of mine at Microsoft, Bart de Smet, and I discussed the expressibility of optimization problems using SQL syntax.
- 2015-07-31
Your Model / Their Model
In data science, building a model means creating a representation of reality using code and equations. g.
- 2015-07-27
The Future of Spreadsheets in Analytics
It’s hard to think of something relied upon so much and loved as little as the spreadsheet, the Comcast of business analytics.
- 2015-07-21
Free Advice on Building Your Data Science Career
This article is for data scientists who have already been in the field for at least a year, and are thinking about their long term aspirations.
- 2015-07-20
A Missing Data Challenge
Be careful with missing values. I have heard advice recently that it’s often okay to just ignore missing values.
- 2015-07-03
Big Data Hype Yields Real Results in Retail With Advanced Analytics
This article was originally published in Progressive Grocer. Click here to read it.
- 2015-03-20
Hole Hawg: OR’s PR Problem
Analytics is an anonymously collaborative discipline. Raw materials come from blogs, MOOCs, online tutorials, github, stackoverflow.
- 2014-12-18
2014 In Review: Five Data Science Trends
2014 was another transformative, exciting year for data science. Summarizing even one measly year of progress is difficult!
- 2014-10-15
Optimization In Google Sheets
Good news for those of you that use spreadsheets to do analytics: Google recently announced a Linear Optimization add on for Google Sheets, and now Frontline Systems has released
- 2014-10-09
NBA Rosters and Team Changes: 2013-2014
com, and accounted for roster changes (as of Sunday, October 5). Click here to download a CSV file with 2013 2014 NBA rosters.
- 2014-10-09
Predicting the 2014-2015 NBA Season
Over the weekend I created a model in Excel to predict the 2014 2015 NBA season.
- 2014-10-08
Predicting NBA Rookie Performance By Draft Position
Nate Silver (and others) have tracked how NBA draft position relates to total career performance, see for example this article. But what about first year performance?
- 2014-10-04
NBA Game Results: 2013-2014
The NBA preseason is in full swing! For those of you who like to fool around with data, I have prepared a CSV file with game by game results for the 2013 2014 season.
- 2014-09-17
The Only Interesting Thing About the Burrito Bracket Challenge
All models are wrong, but some are useful. Even when it comes to burritos.
- 2014-09-11
Confirmation Bias in Data Science
I thought it would be interesting to talk about a few dangers of data science. Here’s one: confirmation bias.
- 2014-09-08
Software Is Not Eating Data Science
I am growing weary of what I will call data science exceptionalism : assuming that anything associated with data science, analytics, and big data are completely new or different.
- 2014-09-04
Programming for Data Scientists - Types of Programming
This post is part of a series that discusses programming for data scientists.
- 2014-09-03
Domain Expertise and the Data Scientist
When it comes to analytics, domain expertise matters.
- 2014-08-31
Programming for Data Scientists - Guidelines
As a data scientist, you are going to have to do a lot of coding, even if you or your supervisor do not think that you will.
- 2014-08-25
Fantasy Football Ratings 2014
I have prepared fantasy football ratings for the 2014 NFL season based on the data from last year’s season. I hope you will find them useful!
- 2014-07-10
Negative Space and Analytical Models
" Analytical models, borne of math and forged with code, should possess the same properties.
- 2014-07-07
401k Simulation Using Analytic Solver Platform
You can build a pretty decent 401k simulation in a few minutes in Excel using Analytic Solver Platform: Let’s give it a shot! You can download the completed workbook here.
- 2014-07-03
Spark Summit Keynote Notes
Here is a summary of my key impressions from the Day 1 keynotes of the 2014 Spark Summit.
- 2014-07-01
INFORMS Big Data 2014 Conference Notes
Many moons have passed since my last conference report: let’s do this.
- 2014-06-28
Simulating data for a logistic regression model in Excel
Rick Wicklin from SAS recently wrote a very nice article about simulating data for a logistic regression model.
- 2014-06-27
Presenting Analytic Solver Platform 2014-R2
In 2014 Frontline Systems released the newest version of its flagship product, Analytic Solver Platform. You can download a free trial of Analytic Solver Platform here.
- 2014-06-25
Time Series Forecasting using Analytic Solver Platform, Windows Azure Marketplace, and Power Query
In this post, I’ll show you how to use Analytic Solver Platform in Excel 2013 with Power BI to build a time series analysis model using data from the cloud.
- 2014-05-10
Operations Research Education and the Business World
The great Bob Fourer tweeted about an interesting article in Analytics by Prof. co/GFZft9K4o8 — Bob Fourer (@4er) May 9, 2014 Prof.
- 2014-04-26
Planes, Change, and Serotonin
A recent Vox article informed us of something many of my readers already know: the way we board planes makes no sense.
- 2014-03-20
Predicting the NCAA Tournament Using Monte Carlo Simulation
I have created a simulation model in Microsoft Excel using Frontline Systems’ Analytic Solver Platform to predict the 2014 NCAA Tournament using the technique I described in my
- 2014-03-18
NCAA Tournament Analytics Model 2014: Methodology
I revealed my analytics model’s 2014 NCAA Tournament picks in yesterday’s post. Today, I want to describe how the ratings were determined.
- 2014-03-17
NCAA Tournament Analytics Model 2014: Picks
Here are my picks for the 2014 NCAA Tournament, based on the analytics model I described in this post.
- 2014-03-16
Using Analytics to Assess Joel Embiid's Injury and Kansas's Chances
Joel Embiid is the starting center of the Kansas Jayhawks and one of the most talented college basketball players in the country.
- 2014-03-14
Better to Be Right Than Fast
Mae West said that too much of a good thing is wonderful. For we shipbuilders who write numerical code that is certainly true of speed and accuracy.
- 2014-03-13
NCAA Tournament Analytics Model 2014 Preview
My NCAA Tournament Prediction Model posts have traditionally been pretty popular, so I thought I would put in a bit more effort this year.
- 2014-03-11
Beautiful Box Plots in Excel 2013
Box plots are widely used among data scientists and statisticians. They're useful because they show variation both between and within data series.
- 2014-03-08
Build Models To Understand Your Data
I am not at the 2014 INFORMS Optimization Society Conference but good friend and human pyramid obsessive Jeff Linderoth reports the following from Gurobi’s Bob Bixby: "Bixby says"
- 2013-12-16
Marketing Mix Analytics II – Modeling
In my previous post I discussed the challenges in obtaining data to measure marketing effectiveness in marketing mix models.
- 2013-11-26
Marketing Mix Analytics I - Data Acquisition
At last spring's INFORMS Analytics Conference I was invited to speak about Marketing Mix Analytics at Nielsen.
- 2013-11-16
A distasteful analogy for automated analytics systems
I will probably regret writing this post. So perhaps you have seen these touchless toilets in airports.
- 2013-10-29
PowerPoint Tips for Analytics Pros
Data scientists often sabotage their own work by doing a crappy job of presenting it.
- 2013-09-13
Generating random unimodular matrices with a column of ones
In an effort to broaden my blog readership, today’s topic is generating random unimodular matrices with a column of ones.
- 2013-09-10
Models are Analogies
My definition(\ ) of analytics is: Analytics is the practice of building models on computers to learn about the world.
- 2013-03-20
NCAA Tournament Prediction Model 2013
(You might be interested to see the new and improved 2014 model.
- 2013-03-18
NCAA Tournament Prediction Model 2013 Preview
It’s NCAA Tournament selection Sunday! As in past years, I am going to write a program to make my picks following two principles: code it fast and do something reasonable .
- 2013-03-12
How many big data applications are there? [Part II]
I received several insightful replies to my weekend post where I blindly speculated about the number of big data applications.
- 2013-03-09
How many real Big Data applications are there?
I’d like to generate a bit of robust discussion and speculation about the use of analytics in the real world.
- 2013-02-11
Adding Error Bars to Charts in Excel 2013
Excel 2013 makes it easier than ever to create error bars. Hooray!
- 2013-01-31
Nate Silver, Chessboxing, and a place at the table
The best chess player in the world is a grandmaster with a computer. Not Deep Blue, or Kasparov, or Anand.
- 2013-01-20
2012 Fantasy Football Prediction Model: Retrospective
Several months ago I laid out a simple model for forecasting fantasy football performance. My post included a table ranking players by value for draft purposes.
- 2013-01-07
Engineering teams should have an Analyst role
Happy New Year!
- 2012-12-12
Enviable Problems: MIP and Warren Buffett
There’s been some recent talk about just how awesome Warren Buffett actually is. ” Warren Buffett has an enviable problem: how to get superior return on a shit ton of money.
- 2012-11-30
Analytics and the Greg Popovich decision
NBA commissioner David Stern is upset with San Antonio Spurs coach Greg Popovich for sending four of his top players home on a plane to rest, instead of playing them in last
- 2012-11-27
Analytics Decathlon: 10 tasks every pro should know
I tried to think of 10 fundamental tasks that every analytics programmer should know how to do.
- 2012-10-18
Defining “Better”
) Okay, so what is “better” anyway? I get the sense that for many operations research insiders, “better” is another word for “faster”, but that is wrong, wrong, wrong .
- 2012-09-28
Detecting the Sources of Model Infeasibility using Gurobi
Today I come to sing the praises of Irreducible Infeasible Sets (IIS). An IIS is a minimal subset of the constraints of an optimization problem that are self contradictory.
- 2012-09-09
Touchdowns are lognormally distributed
well, not exactly. But it’s snappier if I put it that way.
- 2012-09-03
Fantasy Football Player Forecasting in R
sas]") The R code is a bit shorter (120 lines instead of 157), but they are basically the same complexity.
- 2012-08-28
Fantasy Football Player Forecasting in less than 200 lines of SAS
In my last post I provided data for NFL players and teams for the 2011 season. In this post I develop a simple, pretty darn decent forecasting engine in less than 200 lines of SAS.
- 2012-08-11
McDonald’s Nutritional Information, August 2012
This post provides nutritional information for popular McDonald's items for the USA as of August 7, 2012. Here is a link to the information.
- 2012-07-30
The diet problem revisited: McDonald’s nutritional information in 2012
The so called “diet problem” is familiar to many students of optimization.
- 2012-06-20
Why don't mapping services use robust optimization?
It sure would be great if mapping services like Google Maps and Bing Maps would make better use of robust optimization.
- 2012-06-18
Yes, Virginia, there is a difference between optimization and prescriptive analytics
Eight year old Virginia O'Dual writes: Dear Blogger: I am eight years old. Some of my little friends tell me that prescriptive analytics is just a fancy way to say optimization.
- 2012-05-27
Simple SAS Performance Profiling Macros
As the old saying goes, the first rule of performance is to measure.
- 2011-07-25
O.R. and social networking: A Solver Foundation MIP model to suggest Twitter followers
Please note that Solver Foundation is no longer supported. For this month's INFORMS blog challenge I thought it would be fun to write a simple Solver Foundation Twitter mashup.
- 2011-07-18
Informs Conference on Analytics 2011
Wayyyyy back in April I attended the Informs Conference on Business Analytics and Research in Chicago.
- 2011-07-10
Summer Reading List
Summer time is a good time for reading… Introduction to Bayesian Statistics by William M. Bolstad A clearly written, enjoyable read that starts from first principles.
- 2011-04-09
2011 INFORMS Conference on Analytics
Recently I have been "heads down" on some new stuff we're working on for Technical Computing.
- 2010-03-10
A simple prediction algorithm for the NCAA tournament
A friend of mine asked me if I wanted to participate in an NCAA tournament pool. The twist: you have to write a program to predict the results.
- 2009-09-12
Nash equilibria and 4th down, continued
I left a small cliffhanger in my last post. After a long week I finally had a chance to read through the Adams paper about estimating the value of "going for it" on 4th down.
- 2009-09-08
Dynamic programming, Nash equilibria, and going for it on 4th down
Last weekend marked the first big college football Saturday of the year.
- 2009-08-30
Int'l Symposium on Mathematical Programming 2009, Day 2
Here are my notes from the second day of ISMP.
- 2009-08-26
Int'l Symposium on Mathematical Programming 2009, Day 1
I am attending the ISMP math programming conference in Chicago, representing the Solver Foundation team.