Basic Skills in Complex Contexts

FIN Commons

Cerritos College Detailed Inquiry Plan Feb 09

Posted by Jan Connal on February 28, 2009 in Fear, Identity, Learning to Learn, Math, Metacognition, Pre/Post, Revised Inquiry Plans, Student Interviews, Student Voice, Surveys, Writing with No Comments


Summary of Inquiry

The Cerritos College inquiry project will combine two complementary collaborations to develop a deeper understanding about how developmental learners acquire the academic habits of mind needed to succeed in college. Too often, students at risk remain on the margins of the academic community and this project will investigate ways of moving them to the center. The Cerritos College team has a hunch that by improving meta-cognitive functioning and by understanding identity development, students can be helped to adopt a “learner identity,” acquire academic habits of mind, and improve their learning.

Team Leader:
Dr. Jan Connal / Counselor, Developmental Education Chair
562-860-2451 x 2143
jconnal@cerritos.edu

Team Members:
Cheryl Shimazu / Chemistry – Delete
Frank Mixson / English
Lydia Alvarez / English
Mojdeh Nikdel / Math
Marvelina Barcelo/ Counseling

Plans for Data Collection and Analysis

A.  Zoom-Lens Data: Focusing on Students

Spring 2009

Instructional faculty will assess students’ metacognition, using a self-reported inventory of actions (included in our previous proposal), at both the beginning and end of the term for their sections of Math 40 (Pre-algebra), ENGL 20 (Basic Writing – two levels below Freshman Composition), and ENGL 52 (Intro to College Composition – one level below Freshman Composition). Likewise, they will also assess students’ Academic Habits of Mind, using a self-reported inventory of actions (included in our previous proposal).

Sustained, embedded metacognition skills-building classroom activities will be focused on increasing the following self-reported behavors:

MATH

1. When I do not understand something I ask for the help of others.

2. When I am solving a problem I ask myself questions in order to concentrate my attention on the problem.

ENGLISH:

1. While I am writing I wonder if I am communicating what I intend to communicate to my audience.

2. After I finish my work I know how well I performed on it even before it is evaluated.

Faculty will deliberately engage students in thinking and writing about the above behaviors; these reflections will be the basis of the FIG’s discussions at its biweekly meetings in March and April. Faculty will be using the reflections and discussions to better understand the development of metacognitive skills and construct a rubric to capture levels of functioning.

At the 6th week of the term faculty will identify students at risk for dropping out or failing; these students will be invited to participate in a Counselor led focus group.

Counseling faculty will also examine the students’ self-reported actions from the initial administration of the two inventories (surveys) in the above classes and identify a cohort of “at risk” students for a videotaped focus group about their academic self-perceptions, attitudes, goals and behaviors (focus group protocol to be developed).

Student Co-investigators will conduct an in-class activity in other sections of MATH 40, ENGL 20 and ENGL 52 to capture student responses on video as they respond to prompts about their identity (prompts currently in development).

Fall 2009

Instructional faculty will again assess students’ metacognition, using a self-reported inventory of actions (included in our previous proposal), at both the beginning and end of the term for their sections of Math 60 (Pre-algebra), ENGL 20 (Basic Writing – two levels below Freshman Composition), and ENGL 52 (Intro to College Composition – one level below Freshman Composition). Likewise, they will also assess students’ Academic Habits of Mind, using a self-reported inventory of actions (included in our previous proposal).

Faculty will continue the sustained, embedded metacognition skills-building activities and reflections in class. Faculty will also incorporate the Student Focus Group video and the Identity video, developed from the Spring 09 investigation, into classroom instructional activities (i.e., using metacognition to understand identity issues around math) to generate student work products which the FIG will use to examine the relationship between metacognition and identity at its biweekly meetings.

At the 6th week of the term faculty will use the metacognition rubric, developed Spring 09, to identify students who demonstrate minimal metacognitive skills; these students will be invited to participate in a Counselor led focus group. Counseling faculty will again examine the students’ self-reported actions from the initial administration of the two inventories (surveys) in the above classes and identify a cohort of “limited metacognition” students for a videotaped focus group about their academic identity, self-perceptions, attitudes, goals and behaviors (focus group protocol to be developed). This video will contribute to development of a “learner identity” rubric in Spring 10.

Student Co-investigators will again conduct an in-class activity in other sections of MATH 60, ENGL 20 and ENGL 52. This time, however, they will capture student responses on video as they respond to prompts about their Academic Habits of Mind (to be developed). This video will be used Spring 10 for instructional activities and also contribute to the development of the “learner identity” rubric.

B. Mid-Range Shots: Focusing on the Classroom

We will conduct a Lesson Study on a lesson given by Lydia Alvarez in ENGL 52 about the importance of “considering your audience” in communication. The classroom activity will basically engage students in writing to evoke a particular response attached to an opportunity for them to see if the intended response occurred. This lesson is directly related to our inquiry because of the metacognitive processes involved in thinking about what one intends, checking the response against what one intended and identifying improvements needed for achieving what on intends. This lesson study provides a unique opportunity to observe metacogniton in action and will inform our development of a metacognition rubric.

We will plan the lesson and identify each observer’s task at our April 14th FIG meeting. The in class lesson will be observed by Jan Connal, Frank Mixson, Mojdeh Nikdel and Marvelina Barcelo on April 22nd. The FIG will debrief and analyze data captured during the lesson on April 28th.

During the lesson observation, we will initially be looking for signs of student engagement and identifying the types and numbers of questions/comments exchanged between the instructor and students and between students. During the student activity portion of the class period, observers will be assigned a particular quadrant of the class to observe and will be noting students’ “metacognitive” statements (i.e., “I don’t think I did this right.”). Although we do not plan to video tape any portion of the Lesson Study, we will be using our observation notes and the students’ post-activity reflections for our debriefing and rubric building activities.

C. Wide-Angle Lens: Focusing on Trends in Institutional Data

The Institutional Research Office will supply Jan Connal the college Spring 09 MIS data in August, 2009. Jan will then compare the FIG sections with comparable sections (according to section duration and time of day offered) for initial enrollment, 1st census enrollment, retention and grade. Determining student persistence into Fall 09 can be determined in February 2010 once the Fall 09 MIS data has been supplied. Perhaps the institutional data will reveal a difference between the FIG sections and their comparison groups, but we do not believe valid conclusions could be drawn. Not only are our “interventions” in the formative stages (it would be too early in the implementation process), our inquiry is of a “thin slice” of learning and not course grade.

We could use coaching to find better ways of using institutional research, given the fact that we would be limited to using existing data (the IR office is seriously under-staffed and backlogged with other institutional priorities).

D. Additional Video Footage

Our student Co-investigators will be collecting video footage in three classes in Spring 09 and Fall 09. The Counseling faculty will be collecting video footage from two, possibly four, focus groups. Both of these activities will generate footage that is integral to our inquiry by providing direct student evidence for building our understanding of student metacognition, identity and academic habits of mind.

We are depending on FIN leadership for equipment and training to developed “finished” video to be used by instructional faculty in their classrooms and by the FIG in developing rubrics.

E.  Inclusion of Student Voices

Students have been hired to conduct the in-class video activities. They will also play a role with the FIG faculty in identifying promising instructional and counseling activities for improving students’ Academic Habits of Mind.

Team Timeline/Calendar – Spring 09 & Summer 09

Feb 09 – Instructional faculty assess students metacognitive functioning and Academic Habits of Mind using the self-assessment inventories.

Feb – April 09 – FIG meets biweekly to examine student work and videotapes, collaborate on lesson plan, and develop a metacognition rubric.

March 09 – Student Co-investigators conduct classroom video activity in three classrooms.

March 09 – Student Co-investigators videotape Counselor led focus groups.

April 09 – FIG conducts Lesson Study in ENGL 52.

May 09 – Instructional faculty assess students metacognitive functioning and Academic Habits of Mind using the self-assessment inventories.

May 09 – End of the Semester Retreat to bring faculty and student investigators together for dialog and celebration.

June 09 – FIN Summer Institute

June – Aug 09 – Final editing of videos

Aug 09 – Analysis of the institutional research student performance data

Mount San Antonio College revised inquiry plan for 2009

Posted by Becca Walker on February 27, 2009 in Basic Skills in Context, Pre/Post, Revised Inquiry Plans, Student Confidence, Student Voice, Teaching Problem Solving with No Comments


Summary

Mt. San Antonio College’s Earth Sciences & Astronomy Department is conducting an investigation entitled “Designing Field Trips That Improve Critical Thinking, Writing, Communication, and Quantitative Skills: Incorporating Basic Skills Into Natural Sciences Courses.” Team members will develop a suite of activities and field trip materials to increase active learning, analytical writing, speaking, and quantitative and qualitative problem-solving during field trips.  To prepare students applying concepts learned in the classroom to a field environment, new classroom activities will also be designed and implemented before field trips. Faculty and student mentors will work together in the field to provide small-group instruction. The primary focus is to investigate how applying Math, English, and critical thinking in these real-world environments affects students’ basic skill development.

Team Leader:
Becca Walker / Earth Sciences and Astronomy
909-594-5611 x 6339 Fax: 909-468-4036
rwalker@mtsac.edu

Team Members:
Dr. Terri Smith Long / Earth Sciences and Astronomy; tlong@mtsac.edu
Dr. Mark Boryta / Earth Sciences and Astronomy; mboryta@mtsac.edu
Karen Bridges / Earth Sciences and Astronomy; kbridges@mtsac.edu

Plans for Data Collection and Analysis

A.    Zoom-Lens Inquiry: Focusing on Students

1)    What data will you gather and analyze on individual students? (e.g. student work, self-reflections, interviews, videotaped think-alouds or problem-solving)

Video footage of students in the field, reflective writing (journals, field trip reports), observations from student mentors, student focus groups, (possibly) informal student presentations in the field for geol14, objective and written questions on exams related to field trips.

2)    How do you imagine this data will help you understand the problem/issue you’re investigating? In other words, how does the data connect to and inform the overall focus of your inquiry?

I’ve included the questions that our team originally proposed to address. Without data from our students, we can reflect about our teaching and speculate about why students struggle with transferring classroom knowledge to a field environment, but this reflection is not student-centered. The only way to design a student-centered inquiry is to observe our students, hear from our students, read what our students have to say, and assess how our students transfer what they learned in the classroom to a field site (AND how they transfer what they learned in the field to a classroom environment) in the context of exams.

  • Which teaching and learning strategies in the field most effectively maximize self-directed learning and problem-solving?
  • How can we make field trips more meaningful to students enrolled only in the lecture section of a course (as opposed to students enrolled in both lecture and lab)?
  • How can we incorporate more writing and quantitative reasoning into our field trips?
  • How can we prepare our students to apply scientific principles and critical thinking learned in the classroom to both familiar and unfamiliar fields?
  • How can we change students’ expectations about how they should be learning during field trips? How do we move away from the model in which the professor tells the students what they are seeing and toward the model in which students engage in a self-directed inquiry and ask themselves what they are seeing?

3)    When and how will you collect this data? (e.g. Which classes will you target? Where will you conduct interviews or think-alouds?)

Data will be collected from the following courses: geol1 (physical geology); geol8 (Earth science); geol9 (environmental geology); geol14/24 (field studies of Central California). We will collect data from “traditional” field trips during spring 2009 and from “restructured” field trips during fall 2009. Data collection will occur April-May and October-November 2009.

4)    When will you analyze this data? (e.g. mid-semester team retreat, after lesson-study session, at the end of the semester; )

Data analysis will begin in April 2009. We envision the analysis process as being continuous, with focused analysis during group meetings. We think that it would be interesting to have the instructor of the course in question analyze the data separately from the other collaborators and then compare their observations.

5)     What questions/concerns do you have about this element of your Inquiry? How can your Inquiry Coach support you in this phase of your Inquiry?

We have a lot of ideas about data collection during field trips, but we haven’t solidified the types of classroom data that we want to collect. For example, we anticipate including questions on exams to obtain some quantitative classroom data. We are feeling slightly overwhelmed about the volume of video footage that we have the potential to collect in the field. (Our field trips are 2-4 days long!)

B.    Mid-Range Shots: Focusing on the Classroom

1)    Please name ONE specific lesson in a particular course that will give you a good vantage point for observing student learning relevant to your Inquiry.

Weathering is the process by which rocks are broken down physically (i.e., size and shape changes) and chemically (i.e., change in chemical composition by the addition and/or removal of minerals). Weathering has implications for landscape development and natural hazards and is a topic addressed in all four of the courses (physical geology, Earth science, environmental geology, and field studies of Central California) on which our inquiry will focus.

2)    How do you imagine the Lesson Study will help you understand the problem/issue you’re investigating about students and their learning? In other words, how does it connect to and inform the overall focus of your inquiry?

All rocks at the Earth’s surface experience weathering. Weathering is a concept that we teach in the classroom and is observable at every field trip site that we visit. Despite our coverage of weathering in the classroom, students have a difficult time recognizing weathering features in the field. We are scratching our heads about this because when we discuss weathering processes in the classroom, we often show photographs of rocks that have been weathered by the process in question. For example, why is it that students know what “oxidation” means and have seen photographs of oxidized rocks in the classroom but can’t consistently identify oxidized rocks on the field trip?

3)    When and how will your team conduct this Lesson Study? Please detail the time frames and participants for the three parts of the Lesson Study process (collaboratively planning the lesson, teaching/observing the lesson, and debriefing/analyzing videotapes & student work from the lesson).

Lesson study will be designed during the spring 2009 semester by all FIG participants. Lesson studies will differ slightly for all four courses depending on the specific weathering features that will be observed in the field for each course. Boryta will teach the lesson study for physical geology; Bridges will teach the lesson study for environmental geology; Walker will teach the lesson study for Earth science; and Long/Walker will co-teach the lesson study for field studies of Central California. One observer will be present for each lesson study. Debriefing and analysis will occur collaboratively.

4) What questions/concerns do you have about this element of your Inquiry? How can your Inquiry Coach support you in this phase of your Inquiry?

We need to identify the learning objectives related to weathering for each course and develop a rubric for the observers. Video may be utilized.

C.    Wide-Angle Lens: Focusing on Larger Trends in Institutional Data

What data from your Institutional Research Office will you integrate into your Inquiry?

We’re not sure yet! Myra and I talked about how to relate the results of our inquiry to course-level SLOs…..We imagine that how our project and the institutional data fit together will become clearer as we collect and analyze our data.

D.    Video Footage
We are asking each team to collect at least 10 hours of video footage in the Spring semester.

1)    How will this footage inform the central questions of your Inquiry?

The video footage is going to be a huge part of our inquiry because we are often too busy on a field trip to recognize where our students are struggling most. Looking at footage from all of our students will allow us to identify patterns and determine which concepts In addition, we hope that the video footage will give us ideas about which specific skills (i.e., quantitative skills, large-scale observations, small-scale observations, rock descriptions, geologic interpretations, writing, oral communication) are most problematic for our students. Ideally, these data will guide us in changing our classroom instruction and implementation of new field trip activities and teaching strategies.

2)    What questions/concerns do you have about this element of your Inquiry? Is there  any support you’d like from the FIN Leadership Team in this area?

None of us are video experts, and we don’t have time to teach AND film simultaneously in the field. Student mentors and/or volunteers will assume a central role in videotaping in the field. We are concerned about whether or not our students will feel comfortable being videotaped in the field and whether the presence of a camera will change the dynamic on the field trip. We will need to figure out how to make the video process as unobtrusive as possible. Tech support from the FIN leadership team will probably be necessary.

E.    Inclusion of Student Voices

Please describe how you plan to include student voices in your Inquiry (e.g. hiring students to capture video footage, interview other students, review data from your inquiry and tell you what they see).

Student mentors, alumni of the courses in question with strong content knowledge, communication skills, and work ethic, will be involved in the inquiry process. Mentors’ primary role will be working with faculty on field trips to provide small group instruction.  In addition, mentors will assist with the development of video footage designed to model how to think like a geologist in the field. Video footage will show the mentors engaging in self-directed learning at specific field trip sites. Mentors will answer a systematic series of questions while observing the outcrop. This will allow students in the class to understand the metacognitive processes that should occur when they attempt to interpret a geologic outcrop during their upcoming field trip. Because we believe that student mentors will provide valuable observations of student learning in the field, we are still discussing how to best involve student mentors in the analysis phase of our project.

Timeline/Calendar

Winter 2009: FIG members wrote narratives reflecting on their field trip philosophies, their perceived strengths and weaknesses as field trip leaders, and students’ strengths and weaknesses as field trip participants. Walker met with the Institutional Research Department at Mt. SAC to discuss linking project to course-level SLOs. Student mentor selection process began.

Spring 2009:

  • FIG will meet regularly to engage in peer-to-peer faculty development. We plan to discuss our individual experiences with field trips,  share observations that we have made about where our students struggle in the field, reflect on the teaching techniques that we use on in the classroom and on field trips, and hypothesize about which techniques are most beneficial to our students and which could be improved.
  • Finish selecting student mentors and prepare them for field responsibilities.
  • Develop field trip SLOs.
  • Design and implement lesson study.
  • FIG and student mentors will observe student learning during field trips and collect student data through interviews in the field, videotaping, debriefing, journaling, and field trip reports.
  • Note: Because this semester’s field trips will serve as the “control group” in the inquiry process, we do not plan on modifying our field trips significantly during the spring semester. The data from this semester will serve as a basis for comparison to next semester’s field trip data.

Spring and summer 2009:

  • Based on analysis of field trip data from spring 2009, FIG will work collaboratively to develop field trip materials, activities, and pedagogical strategies that target critical thinking, writing, quantitative, and communication skills. Classroom curriculum modifications will be planned as well. Student mentors will assist in the design process.

Fall 2009:

  • We will repeat the process of data acquisition in the field, this time using the field trip materials that we designed targeting basic skills. We will focus our efforts on Geol1 (physical geology), Geol8/8L (Earth science), Geol14/24 (field studies of Central California), and Geol9 (environmental geology).
  • We will conduct a comparison of the “traditional” spring 2009 field trips and the restructured fall 2009 field trips. This comparison will involve faculty and mentor interviews and focus groups, including field trip questions on exams to assess student mastery of basic skills and course concepts, and peer-to-peer discussions within the faculty inquiry group.

Although additional data collection and assessment may occur during year 2 of the project, our focus for year 2 will be dissemination of results to the campus community.

Summary College of the Siskiyous

Posted by Renata Funke on February 26, 2009 in Developing Questions, Faculty Inquiry Groups (FIG), Fear, Identity, Learning to Learn, Making Visible, Math, Metacognition, Pre/Post, Proposals, Student Confidence, Student Interviews, Student Teams, Student Voice, Surveys, Teaching Problem Solving, Using Institutional Research, Video Evidence with No Comments


College of the Siskiyous is focusing on what helps students become more intrinsically motivated as they navigate the intersection between student learning and students’ identities as outsiders or insiders in the college environment. The Inquiry team will use video footage to capture student reflections and experiences, as well as classroom discussions and athletic activities. One student group to be included are African-American student athletes adjusting to the isolation they find in the small rural community of Weed, California near the Oregon border. Another group will be students of Math who started at the college with Pre-Algebra and who are currently enrolled in Intermediate Algebra from a course called “Math for the Confused,” who will describe and analyze their experiences and what helped them succeed in their math courses. A group of students from a Leadership Training class will dialog with a group from a Social Psychology class to explore ways students can become intrinsically motivated. By closely examining data on students’ performance and experiences, the Inquiry team aims to identify blind spots in the college’s approach to basic skills and, ultimately, find ways to “light the fire” in students with histories of low educational attainment.

Team Leader:
Renata Funke / Director, Yreka Campus
530-842-1245 Fax: 530-841-5221
funke@siskiyous.edu

Team Members:
Les Courtemanche / Football/Track assistant coach/instructor of a Leadership Training class
Deborah Randolph / Math instructor of a “Math for the Confused” class (pre-pre-algebra level)
Eve Thompson / English
Patrice Thatcher / ECE Program Coordinator
Catey Olivolo / Nursing
Mark Oliver / Videography

Survey of Students’ Metacognition and Reading

Posted by Katie Hern on February 18, 2009 in Literacy, Metacognition, Pre/Post, Reading, Surveys with 1 Comment


The attached article from the Journal of Educational Psychology includes a useful survey instrument for assessing students’ metacognitive awareness of their own reading strategies. This easy-to-use tool provides feedback to both students and faculty about how students are approaching their academic reading. The survey and scoring rubric are included in the appendix.

Assessing Students’ Metacognitive Awareness of Reading Strategies

About FIN

The Faculty Inquiry Network’s (FIN) purpose is to support professional development which includes: conducting faculty inquiry; revisiting basic skills assumptions; interpreting and integrating data; accessing student voices; developing students as co-inquirers; making visible; using technology for teaching and learning; creating and supporting new initiatives, curriculum and program development; constructing educational tools using digital media; and hosting dialogue around student and faculty learning.

  • Recent Post

  • Tag Cloud