{"id":5286,"date":"2016-10-24T16:18:39","date_gmt":"2016-10-24T21:18:39","guid":{"rendered":"http:\/\/www.thejuliagroup.com\/blog\/?p=5286"},"modified":"2016-10-24T16:19:21","modified_gmt":"2016-10-24T21:19:21","slug":"statistics-answers-the-most-important-social-question","status":"publish","type":"post","link":"https:\/\/www.thejuliagroup.com\/blog\/statistics-answers-the-most-important-social-question\/","title":{"rendered":"Statistics Answers the Most Important Social Question"},"content":{"rendered":"<p>Occasionally, when I am teaching about a topic like repeated measures Analysis of Variance, a brave student will raise a hand and ask,<\/p>\n<blockquote><p>Seriously, professor, WHEN will I ever use this?<\/p><\/blockquote>\n<p class=\"p2\">The aspiring director of a library, clinic, afterschool program, etc. does not see how statistics apply to conducting an outreach campaign or HIV screening or running a recreational program for youth \u2013 or whatever one of hundreds of other good causes that students intend to pursue with their graduate degrees. Honestly, they often look at the required research methods and statistics courses is a waste of time mandated for some unknown reason by the University, probably to keep professors employed. Often, they will find a way to do a dissertation using only qualitative analysis and never think about statistics again.<\/p>\n<p class=\"p2\">This is a huge mistake.<\/p>\n<blockquote>\n<p class=\"p2\">For all of those people who say, &#8220;I never used statistics in my career&#8221;, I would answer, &#8220;well, I never used French in my career either and you know why \u2013 because I never learned it very well.&#8221;<\/p>\n<\/blockquote>\n<p class=\"p2\">Now, those people who don&#8217;t see a real use for French probably aren&#8217;t convinced. However, to me, it&#8217;s pretty evident that if I could speak French I could be making games in both French and English.<\/p>\n<p class=\"p2\">Actually, statistics can answer the very most important question in any social program \u2013 does it work?<\/p>\n<p class=\"p2\">So, I had written a couple of blogs about the presentation I gave at SACNAS (Society for the Advancement of Chicanos and Native Americans in Science) where I discussed\u00a0using statistics to identify need for intervention and mathematics for students prior to middle school.<a href=\"http:\/\/www.thejuliagroup.com\/blog\/?p=5259\"> I also gave examples of teaching statistics concepts in games<\/a>.<\/p>\n<p class=\"p2\">The question is, did these games work for increasing student scores?<\/p>\n<p class=\"p1\">For this \u2013 surprise! Surprise! Drumroll \u2013 \u2013 \u2013 we used repeated measures Analysis of Variance. If you look at the graph below you can see that the students who played the games improved substantially more from pretest to posttest than the students in the control group.<\/p>\n<p class=\"p1\"><a href=\"http:\/\/www.thejuliagroup.com\/blog\/wp-content\/uploads\/2016\/10\/results_spiritlake.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-5288\" src=\"http:\/\/www.thejuliagroup.com\/blog\/wp-content\/uploads\/2016\/10\/results_spiritlake.jpg\" alt=\"graph showing increase from pretest to posttest\" width=\"450\" height=\"248\" srcset=\"https:\/\/www.thejuliagroup.com\/blog\/wp-content\/uploads\/2016\/10\/results_spiritlake.jpg 450w, https:\/\/www.thejuliagroup.com\/blog\/wp-content\/uploads\/2016\/10\/results_spiritlake-300x165.jpg 300w\" sizes=\"auto, (max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<p class=\"p1\">This was a relatively small sample, because it was our first pilot study, and conducted in two small rural schools, that also happen to have very high rates of mobility and absenteeism, so we were only able to obtain complete data from 58 students.<\/p>\n<p class=\"p1\">Now, the results look impressive but where these differences higher than one would expect by chance with four groups (two grades from each school) of a fairly small size?<\/p>\n<p class=\"p1\">Well, when we look at the ANOVA results we see that the time by school interaction, which tests if one school changed more overtime than the other is quite significant (F = 7.13, P = .01). Yes, the P value equaled exactly .0100.<\/p>\n<p class=\"p1\">The time by school by grade 3 \u2013 way interaction was not significant. It&#8217;s worth noting that the fifth grade at the intervention school had less time playing the game due to logistical reasons \u2013 they had to schedule the computer lab as opposed to playing in their classroom, and sometimes, their class being scheduled later in the day, they missed playing the game altogether when school was let out early due to weather.<\/p>\n<p class=\"p1\">One way that I could reanalyze these data \u2013 and I will \u2013 would be to look at it not by grade but by time spent playing. So, instead of four groups, I would have three \u2013 those who played the game not at all, in other words, the control group, those who played at less than recommended and those who played it the recommended amount.<\/p>\n<p class=\"p1\">My point is that repeated measures ANOVA is just one of the many statistical techniques that can answer the most important questions in social programs \u2013 whether something works and under what conditions it works best. There&#8217;s also the question of who it works best for &#8211;\u00a0and statistics can answer that too.<\/p>\n<p class=\"p1\"><em><strong>So, my answer to the student who questions if he or she will ever use this is, &#8220;if you&#8217;re smart you will.&#8221;<\/strong><\/em><\/p>\n<p class=\"p1\"><a href=\"http:\/\/sites.fastspring.com\/7generation\/product\/7gen-combo-offer\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-4819 alignleft\" src=\"http:\/\/www.thejuliagroup.com\/blog\/wp-content\/uploads\/2015\/10\/7genbanner.png\" alt=\"banner\" width=\"186\" height=\"455\" srcset=\"https:\/\/www.thejuliagroup.com\/blog\/wp-content\/uploads\/2015\/10\/7genbanner.png 186w, https:\/\/www.thejuliagroup.com\/blog\/wp-content\/uploads\/2015\/10\/7genbanner-123x300.png 123w\" sizes=\"auto, (max-width: 186px) 100vw, 186px\" \/><\/a><\/p>\n<p class=\"p1\"><a href=\"http:\/\/sites.fastspring.com\/7generation\/product\/7gen-combo-offer\">Check out the games from which these data were collected. They are effective now and we are in the middle of a major update. Did I mention that you get free updates for life with all of our games?<\/a><\/p>\n<p class=\"p1\">For all of those who have asked us if these data are going to be published, the answer is yes, we have two articles in press that should come out in 2017.<\/p>\n<p class=\"p1\">We are working on more in our copious spare time that we do not have, but right now we are focusing on game updates.<\/p>\n<p class=\"p1\">\u00a0and <a href=\"https:\/\/appstore.com\/makingcampfree\">on our new, free iPad game, Making Camp<\/a><\/p>\n<p class=\"p1\"><a href=\"https:\/\/appstore.com\/makingcampfree\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-5290\" src=\"http:\/\/www.thejuliagroup.com\/blog\/wp-content\/uploads\/2016\/10\/bt_wigwam.png\" alt=\"wigwam button\" width=\"50\" height=\"50\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Occasionally, when I am teaching about a topic like repeated measures Analysis of Variance, a brave student will raise a hand and ask, Seriously, professor, WHEN will I ever use this? The aspiring director of a library, clinic, afterschool program, etc. does not see how statistics apply to conducting an outreach campaign or HIV screening&#8230;<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[17,11],"tags":[],"class_list":["post-5286","post","type-post","status-publish","format-standard","hentry","category-computer-games","category-statistics"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/5286","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/comments?post=5286"}],"version-history":[{"count":4,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/5286\/revisions"}],"predecessor-version":[{"id":5292,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/5286\/revisions\/5292"}],"wp:attachment":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/media?parent=5286"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/categories?post=5286"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/tags?post=5286"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}