There are some things to like about Statistica. The scatter plot matrix, for one. I’d done a sentiment analysis of a data set on blog posts (not mine). For each post, I had three variables number of negative sentiments expressed in the post, number of positive sentiments expressed in the post total number of comments…
The advantage of learning a new language is it sometimes makes you re-think the old languages you know. For example, here is a problem that happens often: Some people are morons. For example, say I were to ask you the following question: “How old are you?” YOU would probably answer something like, 42 or 21….
There is a huge inequality in the way the economy has played out among people I know. Business is good and has been getting better all year for me. My friend Jake is doing great. He was an anesthesiologist and several years ago became board-certified in geriatrics. He loves working with older people and his…
So I say, “There may be some useful information in the text fields. For example, people who use credit to buy commodities, such as meat may differ from people who buy finished goods like clothing who may differ from people who purchase machinery on credit. Perhaps you may want to consider some kind of clustering.”…
No, this is not a post about politics or life-hacking, although the same title could apply in either case. I am talking about statistical power. People often ask me what the power of a test is, but the problem is that they are asking the wrong question. Power is not a single number. I understand…
In the past, when I had to do any type of parsing of text, I wrote my own code with a zillion SUBSTR functions and IF statements and it did the job but it was *so-o-o ugly and painful that I never even considered including text mining in any courses I taught. I looked into…
Being sick with only half of my brain cells functioning, I spent the weekend reading random articles on some of my favorite sites. I was disappointed, but not surprised, to find one had the stock title: “Do you want to start your own business, escaping the cubicle, be the next Mark Zuckerberg, do you have…
I had a bit of difficulty remembering the exact way push and pop functions in JavaScript work until I thought of the PEZ dispenser. When you have an array that you create like this: var bob = [1,47] ; and you do this: bob.push(9,12) now your new array is [1,47,9,12] In other words, push…
After over a quarter of a century of experience working as a statistical consultant in a wide array of settings, it’s safe to say that a large proportion of the statistics presentations cover topics I have been over before. Still, even if it is a technique I’ve used many times, I almost always come across…
Two years ago, I said that data visualization was the next big thing. I also said that people would stick with SAS because it was easier to use and there are more people who DON’T want to be programmers than do. Fast forward to 2012 and Visual Analytics is all over the place. SAS On-Demand,…