{"id":31,"date":"2015-10-13T15:36:29","date_gmt":"2015-10-13T22:36:29","guid":{"rendered":"https:\/\/microsites.csusm.edu\/ymeulema\/?page_id=31"},"modified":"2016-08-02T20:23:16","modified_gmt":"2016-08-02T20:23:16","slug":"ilp-assessment-plan-2015-16","status":"publish","type":"page","link":"https:\/\/microsites.csusm.edu\/ymeulema\/ilp-assessment-plan-2015-16\/","title":{"rendered":"T&#038;L Assessment Plan 2015-16"},"content":{"rendered":"<p><b>CSUSM Teaching and Learning (T&amp;L)<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Assessment plan for Fall 15 &#8211; Spring 16<\/span><\/p>\n<p><strong>Introduction<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">The purpose of this document is to describe the planned and ongoing assessment activities in T&amp;L for AY 2015-16. It is important to note that this is the first year that T&amp;L has embarked on these activities. The group felt strongly about two principles: \u00a01. that we must experiment with different approaches and strategies in order to determine what has the greatest impact and 2. implement an assessment approach that is sustainable. T&amp;L is also in a transitional period and growing rapidly, making it even more imperative to identify an assessment approach that works for the unit not only in the present, but as the unit changes and grows.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The faculty in T&amp;L had a series of discussions beginning in Fall 2014 about how to start conducting program-level student learning assessment. <a href=\"http:\/\/microsites.csusm.edu\/ilp\/\" target=\"_blank\">T&amp;L faculty first articulated the program\u2019s principles, assessment principles, and ultimately, rubrics to assess to categories of student learning outcomes<\/a> (SLO\u2019s).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">While not finalized at the time of these conversations,<a href=\"http:\/\/www.csusm.edu\/assessment\/studentlearning\/Learning%20Outcomes.html\" target=\"_blank\"> CSUSM\u2019s Undergraduate Learning Outcome 2<\/a> aligns with the aforementioned SLO\u2019s (language specific to information literacy learning outcomes are in italics) :<\/span><\/p>\n<blockquote><p><b>2) \u00a0\u00a0\u00a0\u00a0<\/b><span style=\"font-weight: 400;\">\u00a0<\/span><b>Comprehensive and critical thinkers. Students will be able to:<\/b><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><i><i><span style=\"font-weight: 400;\">Identify key concepts and develop a foundation for future inquiry<br \/>\n<\/span><\/i><\/i><span style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Analyze complex problems and develop solutions by applying quantitative and qualitative reasoning, integrating knowledge and skills from a variety of discipline<\/span><\/span><\/li>\n<li style=\"font-weight: 400;\"><i><i><span style=\"font-weight: 400;\">Construct well-reasoned arguments based on evidence<\/span><\/i><\/i><\/li>\n<\/ul>\n<\/blockquote>\n<p><span style=\"font-weight: 400;\">T&amp;L faculty decided to begin programmatic assessment within the GEL 101 Research Module (RM). All T&amp;L faculty teach the Research Module using a shared curriculum. For this reason, conducting this first assessment cycle within the Research Module could generate findings that would impact all librarians.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><strong>Identifying SLO&#8217;s\/What to assess<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">As with any assessment, T&amp;L faculty then identified which of the T&amp;L SLO\u2019s to assess. The group sought to identify not only those SLO\u2019s they were curious about, but which could have some impact on how to ensure students achieve that outcome. The group decided to assess the SLO \u201cIdentify\/Evaluate\u201d, as noted in the chart below. Language in bold is the specific aspect of the learning outcome that the group chose to focus on. <\/span><\/p>\n<p>&nbsp;<\/p>\n<table>\n<tbody>\n<tr>\n<td><\/td>\n<td><span style=\"font-weight: 400;\">1<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Emerging<\/span><\/td>\n<td><span style=\"font-weight: 400;\">2<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Approaching<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Standard<\/span><\/td>\n<td><span style=\"font-weight: 400;\">3<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Meets<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Standard<\/span><\/td>\n<td><span style=\"font-weight: 400;\">4<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Above Standard<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">Explanation of Issues<\/span><\/p>\n<p><span style=\"font-weight: 400;\">(Identify\/<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Evaluate)<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Limited ability to distinguish fact from opinion; <\/span><b>limited understanding of credible\/relevant sources\/ideas; <\/b><span style=\"font-weight: 400;\">fails to recognize multiple perspectives<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Recognizes fact and opinion as categories; <\/span><b>awareness of standards of credibility in sources\/idea<\/b><span style=\"font-weight: 400;\">; awareness of multiple perspectives<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Distinguishes between fact and opinion; <\/span><b>evaluates sources\/ideas as credible or relevant<\/b><span style=\"font-weight: 400;\">; recognizes multiple perspectives<\/span><\/td>\n<td><b>Clear method of distinguishing<\/b> <b>between<\/b><span style=\"font-weight: 400;\"> fact vs opinion and <\/span><b>credible\/relevant<\/b><span style=\"font-weight: 400;\">; sophisticated understanding of multiple perspectives<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">The language in bold of the above learning outcome is often taught to students as recognizing the characteristics of scholarly articles as opposed to information resources from non-scholarly sources. Within a scholarly community such as a university, the scholarly, peer-reviewed article in a research journal is widely considered to be a highly desirable and credible type of information source. Students\u2019 knowledge of credible information resources is essential to being able to identify academic journal articles.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">To this end, for Fall 2015, the T&amp;L faculty will be assessing students\u2019 ability to determine if an information source is a scholarly journal article or another type of information source that be helpful in defining terms, describing concepts, or providing context to the topic of the student\u2019s inquiry. It most commonly is found in the form of web sites found on open web, Wikipedia entries, or other sources whose audience is not experts in the particular field. Students completing the RM are expected to recognize information sources that are different from scholarly sources. Scholarly sources are produced by experts and are produced for other experts in a field. They are distributed most typically through scholarly journals and are sometimes found in special search engines\/databases. <\/span><\/p>\n<p><strong>GEL Research Module assessment survey<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">T&amp;L decided to create a separate assessment tool for this selected learning outcome for two main reasons: 1. determining if a student achieved the outcome could be done fairly easily and 2. a desire to automate the data collection and analysis because of the significant numbers of first year students taking GEL. <\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">The group also determined that first year students could be expected to achieve a level of \u201cApproaching Standard\u201d on this outcome at the conclusion of the RM. The assessment would be administered at the beginning and end of the RM. Students enrolled in GEL may also be taking GEW 101 and\/or GEO 102. Because students work with a librarian in these courses as well, the assessment tool will include items to determine if students are enrolled or have completed the course. There may be a correlation between students\u2019 performance on the assessment tool and co-enrollment in these courses.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">With these parameters, the assessment tool asked:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">If students were currently enrolled in GEW, GEO, or both courses.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">When provided with two links to a web page, if students could determine whether the page was a scholarly source.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Students to rate their confidence in their determination about the information source they were linked to. \u00a0\u00a0<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">The assessment tool will be administered via CougarCourses to students enrolled in GEL 101 for Fall 2015. The tool will be administered with the homework that is required to be completed immediately before the Research Module. The post-test will be administered at the session after the conclusion of the RM or during the last RM session. Institutional Planning and Assessment (IPA) will be assisting by administering the survey using SurveyGizmo and providing basic data analysis. Results are expected in December 2015-January 2016, and a report will be drafted for T&amp;L\u2019s review. <\/span><\/p>\n<p><strong>GEL Research Module: Analysis of bibliographies in infographics<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">In addition to the assessment described above, T&amp;L faculty decided to analyze the bibliographies of infographics from students in the RM. Since the infographics could be considered a signature assignment of the RM, the bibliographies could provide additional information about students\u2019 abilities to identify credible information sources within the scholarly community. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Library faculty often require different numbers of scholarly articles in an infographic\u2019s bibliography. Some require 1-2 and some require more. During Summer 2015, faculty assessed the bibliographies of 281 infographics by one criterion: Does the bibliography include the required number of scholarly sources? Bibliographies were assessed on a 3 point scale: No scholarly sources, Some (any amount from one to one less than the required amount), All (required number of sources included). \u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This data will be discussed by T&amp;L faculty in Spring 2016, along with the data from the RM assessment that is being administered in Fall 2015.<\/span><\/p>\n<p><strong>Student learning outcomes and assessment plan: Information literacy\u00a0in the first year <\/strong><\/p>\n<p><span style=\"font-weight: 400;\">Lastly, the T&amp;L Director, in collaboration with the recently created First Year Experience Librarian, and course coordinators for GEW 101 (General Education: Writing) and GEO 102 (General Education: Oral Communication) are working to articulate student learning outcomes and an assessment approach for information literacy in the first year. This goes beyond the scope of the GEL RM and includes the information literacy components within all three courses.<\/span><\/p>\n<p><strong>Next steps<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">There are several ongoing efforts within T&amp;L related to assessment during AY 2015-16. This indicates significant interest in this aspect of teaching and learning. A concern, however, is that these efforts are not connected into a single framework or approach. To that end, T&amp;L will be engaging in a review of the assessment efforts for this year at the conclusion of AY 2015-16 to:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Identify how the multiple \u201csets\u201d of student learning outcomes are connected. That is, there are two categories of learning outcomes for T&amp;L as a whole as well as a separate list of SLO\u2019s for first year information literacy.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Consider an assessment approach that is sustainable.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Identify assessment practices from this year that were particularly useful. <\/span><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>CSUSM Teaching and Learning (T&amp;L) Assessment plan for Fall 15 &#8211; Spring 16 Introduction The purpose of this document is to describe the planned and ongoing assessment activities in T&amp;L for AY 2015-16. It is important to note that this is the first year that T&amp;L has embarked on these activities. The group felt strongly [&hellip;]<\/p>\n","protected":false},"author":6,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-31","page","type-page","status-publish","hentry"],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/microsites.csusm.edu\/ymeulema\/wp-json\/wp\/v2\/pages\/31","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/microsites.csusm.edu\/ymeulema\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/microsites.csusm.edu\/ymeulema\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/microsites.csusm.edu\/ymeulema\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/microsites.csusm.edu\/ymeulema\/wp-json\/wp\/v2\/comments?post=31"}],"version-history":[{"count":0,"href":"https:\/\/microsites.csusm.edu\/ymeulema\/wp-json\/wp\/v2\/pages\/31\/revisions"}],"wp:attachment":[{"href":"https:\/\/microsites.csusm.edu\/ymeulema\/wp-json\/wp\/v2\/media?parent=31"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}