{"id":4953,"date":"2016-02-03T17:55:47","date_gmt":"2016-02-03T22:55:47","guid":{"rendered":"http:\/\/www.thejuliagroup.com\/blog\/?p=4953"},"modified":"2016-02-03T17:57:27","modified_gmt":"2016-02-03T22:57:27","slug":"watch-me-work-data-project","status":"publish","type":"post","link":"https:\/\/www.thejuliagroup.com\/blog\/watch-me-work-data-project\/","title":{"rendered":"Watch me work: Data Project"},"content":{"rendered":"

On twitter, there were a few comments from people who said they didn’t like to take interns because “More than doing work, they want to watch me work.”<\/p>\n

I see both sides of that. You’re busy. You’re not netflix. I get it. On the other hand, that’s a good way to learn.<\/p>\n

The data are part of the evaluation of the effectiveness of 7 Generation Games in increasing math achievement scores. You can read more about us here. Below is a sneak peek of the artwork\u00a0from the level we are creating now for Forgotten Trail.<\/a><\/p>\n

\"characters<\/a><\/p>\n

So, here you go. I’m starting on a data analysis project today and I thought I’d give you the blow by blow.<\/p>\n

\"phpmyadmin\"<\/a><\/p>\n

It just so happens that the first several steps are all point-y and click-y. You could do it other ways but this is how I did it today. So, step one, I went to phpMyAdmin on the server where the data were saved and clicked Export.<\/p>\n

\"analyze2\"<\/a><\/p>\n

For the format to export, I selected CSV and then clicked on the Go button. Now I have it downloaded to my desktop.<\/p>\n

\"import<\/a><\/p>\n

Step 3: I opened SAS Enterprise Guide and selected Import Data. \u00a0I could have done this with SAS and written code to read the file, but, well, I didn’t. Nope, no particular reason, just this isn’t a very big data set so I thought, what the heck, why not.<\/p>\n

\"boxes<\/a><\/p>\n

Step 4: DO NOT ACCEPT THE DEFAULTS! \u00a0Since I have a comma-delimited file with no field names, I need to uncheck the box that says File contains field names on record number. SAS conveniently shows you the data below so I can see that it is comma-delimited. I know I selected CSV but it’s always god practice to check. I can also see that the data starts at the first record, so I want to change that value in Data records start at record number to 1.<\/p>\n

\"changing<\/a><\/p>\n

Step 5: Change the names \u00a0– I am never going to remember what F1, F2 etc. are, so for the first 5 , I click on the row and edit the names to be the name and label I want.<\/p>\n

That’s it. Now I click the next button on the bottom of the screen until SAS imports my data.<\/p>\n

I could have continued changing all of the variable names, because I KNOW down the line I am not going to remember that F6 is actually the first question or that F25 is question 28a. However, I wanted to do some other things that I thought would be easier to code, so I opened up a program file in SAS Enterprise guide and wrote some code.<\/p>\n

\/* THIS CREATES TWO ARRAYS BECAUSE I AM TOO LAZY<\/p>\n

TO RENAME 32 QUESTIONS INDIVIDUALLY<\/p>\n

THE PRETEST DATA SET WAS CREATED BY THE STEPS ABOVE USING IMPORT DATA *\/<\/p>\n

 <\/p>\n

data<\/b><\/span> pretest2 ;<\/p>\n

\u00a0 \u00a0 set<\/span> pretest ;<\/p>\n

** NOTE THAT THERE IS A $ AFTER THE NUMBER OF ELEMENTS IN THE ARRAY<\/p>\n

** BECAUSE THIS IS A CHARACTER ARRAY ;<\/p>\n

\u00a0 \u00a0 array<\/span> ren{32<\/b><\/span>} $ f6-f37 ;<\/p>\n

array<\/span> qs {32<\/b><\/span>} $ q1-q27 q28a q28b q28c q29 q30;<\/p>\n

do<\/span> i = 1<\/b><\/span> to<\/span> 32<\/b><\/span> ;<\/p>\n

qs{i} = ren{i} ;<\/p>\n

end<\/span> ;<\/p>\n

** YOU CAN ALSO USE A RENAME STATEMENT TO RENAME THE SAME VARIABLES ;<\/p>\n

rename<\/span> f38 = date_test ;<\/p>\n

*** SINCE I NO LONGER NEED THE VARIABLES F6- F37 OR THE INDEX VARIABLE FOR THE<\/p>\n

ARRAY, I DROP THEM HERE ;<\/p>\n

drop<\/span> f6- f37 i ;<\/p>\n

*** SOME STUDENTS SAVED THE TEST MORE THAN ONCE BECAUSE THEY SAVED BEFORE THEY WERE DONE AND AT THE END. SO, I SORT BY USERNAME AND TEST. WE WILL ONLY KEEP THE LAST ONE.<\/p>\n

proc<\/b><\/span> sort<\/b><\/span> data<\/span>=pretest2 ;<\/p>\n

by<\/span> username date_test ;<\/p>\n

*** THIS KEEPS JUST THE LATEST TEST DATE. ALSO, WE TESTED THIS 45 TIMES IN<\/p>\n

THE PROCESS OF GETTING READY FOR USE IN THE SCHOOLS. ALL OF OUR STAFF USED USERNAMES WITH ‘TEST” SO I USED THE INDEX FUNCTION TO FIND IF THERE WAS A “TEST” IN THE USERNAME AND, IF SO, DELETED THAT RECORD ;<\/p>\n

data<\/b><\/span> pretest2 ;<\/p>\n

set<\/span> pretest2;<\/p>\n

by<\/span> username date_test ;<\/p>\n

if<\/span> last.username ;<\/p>\n

if<\/span> index(username,‘TEST’<\/span>) > 0<\/b><\/span> then<\/span> delete;<\/p>\n

run<\/b>;<\/span><\/p>\n

Okay, that’s it. Now I have my data all ready to analyze. Pretty painless, isn’t it?<\/p>\n

Want to learn more about SAS?<\/p>\n

Here is a good paper on Arrays made easy<\/a> .<\/p>\n

If you’re interested in character functions like index, here is a good paper by Ron Cody.<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

On twitter, there were a few comments from people who said they didn’t like to take interns because “More than doing work, they want to watch me work.” I see both sides of that. You’re busy. You’re not netflix. I get it. On the other hand, that’s a good way to learn. The data are…<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[9,11,8],"tags":[],"class_list":["post-4953","post","type-post","status-publish","format-standard","hentry","category-software","category-statistics","category-technology"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/4953","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/comments?post=4953"}],"version-history":[{"count":3,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/4953\/revisions"}],"predecessor-version":[{"id":4963,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/4953\/revisions\/4963"}],"wp:attachment":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/media?parent=4953"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/categories?post=4953"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/tags?post=4953"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}