Formative Evaluation Plan

The New Guide to Grammar Fun

 

One-to-One Formative Evaluation

Participants

  • The former director of the University of South Alabama Writing Center
  • An instructional design professor from the University of South Alabama
  • A student currently rolled in EN 101, Effective English

Location and Time

Monday, April 3, 2006
The Writing Center at USA – 2 participants (will meet with each separately)

Tuesday, April 4, 2006
The College of Education – The professor’s office

Selection Process for Participants

Participants were solicited to take part in the evaluation based on their availability and/or expertise.

Confidentiality and Anonymity

Each participant was assured in writing that all information collected would be strictly confidential. No participant will be identified by name, nor will any documentation be collected that may reflect a participant’s identity. No information of a personal nature, other than possible demographic information, will be solicited. Participants may choose to discontinue their participation at any time during the evaluation process.

Participants have been advised that the evaluation process will be videotaped for documentation purposes. The videotapes will be transcribed and used in the preparation of the evaluation report. All information collected will be stored in a secure area until the completion of the final evaluation report.  At that time, all video and audio tapes of the evaluation process will be destroyed.

The participants have signed a confidentiality agreement stating that they will not discuss their participation in the evaluation process, including but not limited to, the content, strategies, or delivery method of the instructional product.

Data Collection Procedures

Participants will be provided with:

  • Objectives and expectations of the evaluation
  • Confidentiality and anonymity agreements

The study will begin by participant the instructional product with an evaluator discussing the product with the participant.  Participants will answer questions about the design of the product:

  • Aesthetic
    • Style
    • Color
  • Instructional design
    • Instructional strategy
    • Organization
    • Assessment items
    • Motivational elements
    • Interactivity
    • Clarity of the objectives
  • Content
    • Grammar
    • Spelling
    • Current information

This information will be collected three ways:

  • Project coordinator notes from evaluation
  • Video transcription of each participant’s meeting
  • Oral discussions with participants

Instruments and materials:
Evaluator will have the following at the session:

  • Confidentiality agreement
  • Copies of the instructional product
  • Prepared questions for participants
  • Video transcript journal
  • Video camera, tape and attachments

Small Group Formative Evaluation

Participants

Six students who currently rolled in EN 101, Effective English at the University of South Alabama

Location and Time

Wednesday, April 17, 2006
The Writing Center at USA

Selection Process for Participants

Participants were solicited to take part in the evaluation based on their availability and/or expertise.  Some were referred by their English professors.

Confidentiality and Anonymity

Each participant was assured in writing that all information collected would be strictly confidential. No participant will be identified by name, nor will any documentation be collected that may reflect a participant’s identity. No information of a personal nature, other than possible demographic information, will be solicited. Participants may choose to discontinue their participation at any time during the evaluation process.

Participants have been advised that the evaluation process will be videotaped for documentation purposes. The videotapes will be transcribed and used in the preparation of the evaluation report. All information collected will be stored in a secure area until the completion of the final evaluation report.  At that time, all video and audio tapes of the evaluation process will be destroyed.

The participants have signed a confidentiality agreement stating that they will not discuss their participation in the evaluation process, including but not limited to, the content, strategies, or delivery method of the instructional product.

Data Collection Procedures

Participants will be provided with:

  • Objectives and expectations of the evaluation
  • Confidentiality and anonymity agreements

The study will begin by participant the instructional product with an evaluator discussing the product with the participant.  Participants will answer questions about the design of the product:

  • Aesthetic
    • Style
    • Color
  • Instructional design
    • Instructional strategy
    • Organization
    • Assessment items
    • Motivational elements
    • Interactivity
    • Clarity of the objectives
  • Content
    • Grammar
    • Spelling
    • Current information

This information will be collected three ways:

  • Questionnaires
  • Video transcription of the evaluation
  • Oral discussions with participants

Instruments and materials:
Evaluator will have the following at the session:

  • Confidentiality agreement
  • Copies of the instructional product
  • Prepared questions for participants
  • Video transcript journal
  • Video camera, tape and attachments
  • Focus group guide