Office of Analysis, Assessment and Accreditation

Utah State University Logo


Survey says...

When asked about the overall quality of research facilities available in their department, 75.8% if the respondents were satisfied or very satisfied.

School of Graduate Studies Survey 2013


Print Version




Faculty Information Form Instructions
IDEA Resources to Facilitate Learning Objectives
IDEA Resources to Support Instruction


Interpreting Results from Idea Center
Interpreting Results (PDF)
Interpreting Diagnostic Form Results (PDF)
Should I use the IDEA Raw, or Adjusted Scores? (PDF)
Basic Data on the IDEA system (IDEA Technical Report No. 12)



IDEA Student Ratings of Instruction


Fall 2011 will mark the launch of a new course evaluation system at Utah State University. The IDEA Center Student Ratings of Instruction assess effectiveness by focusing on learning and curricular objectives. The IDEA system will replace USU's current course evaluation process. The hallmark of the IDEA system is the opportunity for students to provide feedback on their progress in achieving specific learning objectives that are identified by the instructor, while adjusting for extraneous circumstances like class size. The IDEA system has a documented history of reliability and validity, and the IDEA "Diagnostic" also provides specific feedback on teaching methods and practice.

IDEA's focus on Learning Objectives is a change from USU's current course evaluation system, and faculty's selection of objectives and communication of those objectives to students is critical component of the new process. Below, you will find some guidance on selecting IDEA Objectives. At the bottom of the page please find links to documents that can assist faculty in communicating their learning objectives to students (through the syllabus, course announcements, etc.). All faculty teaching courses will receive an email 6-8 weeks prior to the end-date for their classes. This email will include a link to a web page where faculty must enter their selected learning objectives. These objectives are then used for student responses. For more information about the IDEA system, please contact the AAA Office at 435.797.0001

Selecting IDEA Objectives


How many Objectives should I select?: IDEA recommends that a total of 3-5 objectives is a good rule of thumb. You can select them as either "important," or "essential," with essential objectives double weighed (counting twice) in the calculation of your averages. Both important and essential objectives should be counted towards your overall total (e.g. pick 3-5, not 6-10).

The best approach to selecting objectives is to ask three questions:

1. Is this a significant part of the course?
2. Do I do something specific to help students accomplish this objective?
3. Does the student's progress on this objective affect his or her grade?

If you can answer "yes" to all three questions for a particular objective, it should be selected as either "important" or "essential."

Faculty should be "true to their course" when deciding how many objectives to select. In other words, if you are teaching a lab course where only one objective seems appropriate, then just select one. If you are teaching a senior capstone class for the major, and you feel you should select more than five, then feel free to do so. Be true to your course.

The selection of objectives on the Faculty Information Form is a crucial activity for two reasons. First, the IDEA System evaluates teaching by assessing student progress on these unique, instructor-chosen objectives. Second, objectives provide guidance for selecting teaching methods; those that promote progress on one type of objective may differ from those that promote progress on other types. Differential objectives make each course a unique learning experience.

Although objectives can be stated in a variety of ways, they should always focus on expected effects on students, not on the instructor's actions or procedures designed to promote learning. It is desirable for each instructor to develop statements or objectives as precisely and comprehensively as possible. In order to participate effectively in the IDEA program, it will be necessary to interpret these statements within the framework provided by the 12 objectives listed on the Faculty Information Form. The following discussion is intended to help users differentiate meaningfully and accurately among the 12 objectives of the IDEA System.

HOW MANY OBJECTIVES SHOULD BE SELECTED?

Although each of the 12 IDEA objectives is desirable in the abstract, it is unrealistic to think that, in a single course, students can make significant progress on all, or even most, of them.   Most instructors will be unable to address seriously more than three to five objectives. Those choosing more than five objectives commonly spread their efforts too thinly to impact student learning significantly in all areas.

In selecting "Essential" or "Important" objectives for a particular course, ask three questions:
1. Is this a significant part of the course?
2. Do I do something specific to help the students accomplish this objective?
3. Does the student's progress on this objective affect his or her grade?

If the answer to each of these questions is "Yes," then that objective should be identified as E or I on the Faculty Information Form (FIF). The phrase, "Of no more than minor importance," does not mean that such objectives are unimportant. It simply recognizes that such objectives are of considerably less importance than those chosen as E or I; even if some attention is given to them, an M should be selected on the FIF.

WHAT IS MEANT BY EACH IDEA OBJECTIVE?

The 12 IDEA objectives have been developed over a period of 25 years, both through literature reviews and by consulting faculty who have used the IDEA system. The intent is to provide a useful, practical way to describe the objectives of most college courses. 

A brief description of each of these objectives, together with some comments about how they may be compared or contrasted, follows. The objectives are organized into six groups on the basis of statistical and conceptual similarities.  The number used to identify each objective (1-12) corresponds with that used on the Faculty Information Form.



IDEA Objectives click to expand...

I. Basic Cognitive Background

II. Application of Learning

III. Expressiveness

IV. Intellectual Development

V. Lifelong Learning

VI. Team Skills



CONCLUSION
Hopefully, this discussion will help you select IDEA objectives for your courses. To summarize, there are three criteria that are useful in selecting objectives: 
(1) The objective is a significant part of the course;
(2) Specific and substantive techniques and assignments are employed to help the student achieve the objective; and 
(3) Relevant assessments are made of student achievement of the objective. 

Objectives should not be regarded as important unless a substantial and explicit effort on the part of the instructor is directed to the achievement of that objective and unless achievement on the objective is meaningfully reflected in the appraisal of student progress.

Frequently, there are differences between the instructor's and the students' perception of the relevance of a given objective. It is recommended that the course objectives be discussed with the students, preferably early in the term.

Ask them to reflect on their understanding of the course's purposes and the way in which they believe the various parts of the course fit into each of the 12 objectives. Student learning will be enhanced if they are committed to clearly formulated objectives.

Based on interviews with a small number of students, we do not believe that holding such a discussion before the students fill out the IDEA Survey Form will bias results. Students claim that their report of progress on objectives is uninfluenced by the knowledge that the instructor selected the objective as relevant. However, progress is more likely if students and faculty are agreed on the major purposes of the course. Hence, a discussion of such purposes will not only improve the quality of responses to the IDEA form but also be beneficial to the learning process.

Memo to all USU Faculty Re: Implementing the IDEA System in Fall 2011






Video: Completing the Faculty Information Form



Podcast:
Full Idea Center Faculty Presentation (84 Minutes)


Student Ratings
Faculty Information Form

Student Ratings
Short Form

Student Ratings
Diagnostic Form