Evaluation

Ideally, evaluation activities should be conducted throughout every phase of building a repository. It was recommended that you conduct a needs assessment during the early planning phases of your project. That output should have been consider during all of the subsequent planning activities.

During the Operational Planning & Details phase, evaluation activities should support how the repository is implemented. Data can be used to ensure that the repository, as it is being built, continues to meet institutional and statewide goals; and, data can be used to report progress or challenges. The Evaluation Worksheet is useful in this phase since it helps map evaluation activities from large project goals, through data collection and analysis.

Sometimes the most difficult part of conducting evaluations is effectively communicating the results to support informed decisions. There are many stakeholders interested in the implementation of a repository and who will also have an interest in the opportunity to collect data and to review the results. When preparing reports on evaluation activities, know the limits of your data and make sure that the questions asked directly address the issue you are investigating (e.g., do not try to use the results from a faculty survey on preparedness to use technology in the classroom to make decisions about allocating funds for library technology.). You should also be sure to report data at the appropriate level (e.g., do not include ten pages of faculty comments about their attitudes about technology in a report to the provost).

Finally, when planning evaluation activities, consult your institution's IRB or research compliance office to ensure you follow the appropriate guidelines. Also, your institution's social sciences department can be a rich resource for assistance in planning and conducting evaluations.

Resources

• Evaluation Worksheet (coming soon)
• Surveys: http://en.wikipedia.org/wiki/Statistical_survey
• Altschuld, James William and Witkin, Belle Ruth. (1999). From Needs Assessment to Action: Transforming Needs into Solution Strategies. Thousand Oaks, Sage Publications.
• Rossi, Peter H., Freeman, Howard E., and Lipsey, Mark W. (1999). Evaluation: A Systematic Approach. (Sixth edition.) Thousand Oaks, Sage Publications.
• Tashakkori, Abbas and Teddlie, Charles. (1998). Mixed Methodology: Combining Qualitative And Quantitative Approaches. Thousand Oaks, Sage Publications.
• Vogt, Paul W. (1998). Dictionary of Statistics and Methodology: A Non-Technical Guide. (Second edition.) Thousand Oaks, Sage Publications.
• Fitz-Gibbon, C.T. (1987). How to Analyze Data. Newbury Park, Sage Publications.
• Torres, Rosalie, Preskill, Hallie and Piontek, Mary. (1996). Evaluation Strategies for Communicating and Reporting. Thousand Oaks, Sage Publications.