{"id":2674,"date":"2012-10-02T01:03:15","date_gmt":"2012-10-02T06:03:15","guid":{"rendered":"http:\/\/www.thejuliagroup.com\/blog\/?p=2674"},"modified":"2012-10-02T01:08:00","modified_gmt":"2012-10-02T06:08:00","slug":"little-sas-tips-while-analyzing-timss-data","status":"publish","type":"post","link":"https:\/\/www.thejuliagroup.com\/blog\/little-sas-tips-while-analyzing-timss-data\/","title":{"rendered":"Little SAS tips (& special characters) while analyzing TIMSS data"},"content":{"rendered":"

For reasons I may explain later – or maybe not – I decided to analyze the TIMSS data, which is Trends in International \u00a0Mathematics and Science Study<\/a>.<\/p>\n

Use a colon: Nifty tip #1<\/strong>
\n** Ran this first ***<\/p>\n

libname LIB ‘C:\\TIMSS2007\\Data’;<\/p>\n

proc contents data =\u00a0lib.G4_ACHIEVE07;<\/p>\n

*** Modified to only keep math items ;
\ndata lib.G4_ACHIEVE07;
\nset lib.G4_ACHIEVE07;
\ndrop s: ;<\/p><\/blockquote>\n

I was only interested in the mathematics items, not the science ones, and since I did not want 170+ items cluttering up my data set, I used the statement below<\/p>\n

DROP S: ;<\/p>\n

This statement drops all of the variables beginning with S. You should be cautious of this, because \u00a0if there is a variable with a name like STUDENT_ID that will be dropped also. \u00a0This is why I ran the PROC CONTENTS first and verified that all of the science items and only t hose items began with an S.<\/p>\n

Nifty tip #2 \u00a0– use a %INCLUDE statement<\/strong><\/p>\n

It only appears that the point of today’s blog is to include all possible special characters. That is merely a fringe benefit.<\/p>\n

The %INCLUDE statement essentially copies and pastes code from another file into your program in the spot where you inserted it. I like it for things like 400 lines of formats because just like I don’t like extra variables cluttering up my data set, I don’t like extraneous lines cluttering up my code. I do need to use the PROC FORMAT but I don’t need to see it every time I run the program and I do not want to store it permanently.<\/p>\n

%include “c:\\timss2007\\programs\\achievefmts.sas” ;<\/p><\/blockquote>\n

Problem solved.<\/p>\n

Nifty tip #3 \u00a0Use the LINESIZE option to see all of your results on one line<\/strong><\/p>\n

I am easily annoyed. If you read my blog often, you know that this has been established. If I have 200 variables and the minimum and maximum does not fit on the same line as the mean because the label is<\/p>\n

“This is that question where we asked the student about long division which involves dividing a two- digit number into a three-digit number and has a remainder”<\/p>\n

and then you have the mean and need to scroll down 200 lines to see the minimum and another 200 lines to see the maximum, well it’s annoying.<\/p>\n

Do this:<\/p>\n

OPTIONS LINESIZE = 255 ;<\/p><\/blockquote>\n

or whatever large number you like. No, I don’t have paper that is that wide, but I’m not planning on printing this out, I just want to scroll through and see that the minimum, maximum, mean and standard deviation are reasonable.<\/p>\n

Nifty tip #4 Use a temporary data step to find the number of variables<\/strong><\/p>\n

No, smart ass, PROC CONTENTS would NOT do this. I want to know how many math items there are, not how many total. The math items (now that I deleted the science ones above) are in order. I run this statement, look in my log and it tells me there are 178 variables in the data set.<\/p>\n

data test ;
\nset lib.G4_ACHIEVE07;
\nkeep M031106 –M041191 ;<\/p><\/blockquote>\n

Nifty tips #5 \u00a0and #6 – Create an array and use the VVALUE function to score data<\/strong><\/p>\n

TIMSS has formats (remember the %INCLUDE ) that are things like 98 = “NOT ADMIN.” , 10 = “CORRECT RESPONSE”.<\/p>\n

data lib.G4_scored ;
\nset lib.G4_ACHIEVE07;
\narray ans{*} M031106 –M041191 ;
\narray sc{*} $18 tmp1 – tmp178 ;<\/p><\/blockquote>\n

I created an array of the mathematics items and the ans{*} says to create an array of dimension however many variables there are between\u00a0M031106 and M041191 . The double dashes signify between as in “between locations in the data set” with M031106 coming first. If you use one dash SAS assumes the variables are numbered\u00a0M031106 \u00a0M031107 all the way toM041190\u00a0M041191. Which they are not. Do double dashes count as two special characters or only one?<\/p>\n

I could have used 178 instead of * since I actually knew there were 178 variables, but I wanted to throw in another special character. Yes, I am immature. That was established long ago. The $18 denotes this as an array of character variables and assigns them all a length of 18 which is the length of the maximum formatted response. Also, a $ is another special character.<\/p>\n

do i = 1 to 178 ;
\nsc{i} = trim(vvalue(ans{i})) ;
\nif sc{i} in (“INCORRECT RESPONSE”,”NOT REACHED”, “OMITTED”) then ans{i} = 0 ;
\nelse if sc{i} = “CORRECT RESPONSE” then ans{i} = 1 ;
\nelse if sc{i} = ” PARTIAL RESPONSE” then ans{i} = .5 ;
\nelse if sc{i} = “NOT ADMIN.” then ans{i} = . ;
\nend ;
\ndrop tmp1 – tmp178 M031002 M031223;<\/p><\/blockquote>\n

Here I have my handy do-loop and a VVALUE function. You can use VVALUE when you don’t know the variable format, or, as in my case, are too lazy to look it up and type it in. The formatted value of ans{i} , whatever that format might be, is put into sc{i}. I also used the TRIM function to trim trailing blanks while I was at it.<\/p>\n

Now that I have scored all of the items to suit my nefarious purposes, I drop the temporary variables as well as two variables that it turned out are questions not administered to anyone.<\/p>\n

And that, is my nifty SAS tips of the night.<\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

For reasons I may explain later – or maybe not – I decided to analyze the TIMSS data, which is Trends in International \u00a0Mathematics and Science Study. Use a colon: Nifty tip #1 ** Ran this first *** libname LIB ‘C:\\TIMSS2007\\Data’; proc contents data =\u00a0lib.G4_ACHIEVE07; *** Modified to only keep math items ; data lib.G4_ACHIEVE07;…<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[9,8],"tags":[],"class_list":["post-2674","post","type-post","status-publish","format-standard","hentry","category-software","category-technology"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/2674","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/comments?post=2674"}],"version-history":[{"count":3,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/2674\/revisions"}],"predecessor-version":[{"id":2676,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/posts\/2674\/revisions\/2676"}],"wp:attachment":[{"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/media?parent=2674"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/categories?post=2674"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.thejuliagroup.com\/blog\/wp-json\/wp\/v2\/tags?post=2674"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}