Evaluation

As part of the Global Operations initiative, an external evaluator was engaged to understand the extent to which Global Operations is effectively managing the University of Minnesota's risk related to its mission of research and discovery, teaching and learning, and outreach and public service.

The evaluation helps us answer the questions:

  • How do we know if we’re successful?
  • What does success look like and how do we measure it?
  • Are we accomplishing what we set out to accomplish?

A formal evaluation by a third party also provides:

  • Data and statistics regarding project details
  • Specific, impartial feedback from users
  • Recommendations to improve the initiative

The evaluator provides Global Operations staff with an annual evaluation report. Emphasis of the evaluation changes from year to year depending on the needs and the progress of the Global Operations initiative (i.e. formative in the beginning, summative in following years). The executive summary and evaluation recommendations are included below:

Year One (February 2012 – June 2013)

Results of this first evaluation suggest that Global Operations has effectively met a need at the University of Minnesota. Since its inception in February 2012, Global Operations’ staff has responded to findings from formal and informal evaluation activities by making changes to their protocols and communication strategies. The recommendations offered in the evaluation report, most of which have already been addressed, focus on communication with current and potential constituents and the A-Team, continued monitoring of case activity, and possible restructuring of the roles and expectations of the A-Team. Each recommendation is listed in the table below and described in more detail in the report.

Evaluation Recommendations

Evaluation Component Recommendations
Concierge Service - Set clear expectations about what the service is (and is not).
- Create case communication protocol.
- Increase outreach and communication to campus communities about Global Operations.
Advisory Team - Rethink communication to Advisory Team members regarding specific cases.
- Create additional mechanisms for Advisory Team members to learn about cases.
- Reconsider Advisory Team meetings in terms of format and content.
- Assess Advisory Team membership and involvement.
External Consultant (HSP) - Schedule a meeting with HSP to discuss expectations and disappointments.
- Continue to record all constituent issues and HSP responses for each case.

Year Two (July 2013 – June 2014)

Results of this second evaluation suggest that Global Operations has again effectively met a need at the University of Minnesota.  The recommendations offered in this evaluation report focus on improving promotion, allocating resources for a part-time Associate Director, increasing engagement of the Advisory Team, revising case communication to internal experts, and continued monitoring and communication with Radius.  Changes made throughout the year, in response to formal and informal evaluation activities from Year One and Year Two, serve as a testament to the commitment to ongoing program improvement and the building of an evaluation culture.  Each recommendation is listed in the table below and described in more detail in the report.

Evaluation Recommendations

Evaluation Component Recommendations
Concierge Service

- Increase outreach and communication to the campus community about Global Operations.

- Revise case communication protocol with the Advisory Team and other experts.

- Continue to allocate resources to fund an Associate Program Director to coordinate Global Operations part-time. 

Advisory Team

- Provide opportunities for Advisory Team members and other supporters to promote Global Operations.

- Assess Advisory Team membership and involvement.

External Consultant (HSP)

- Schedule a meeting with Radius to discuss selected evaluation findings related to the cases and Radius.

- Continue to record all constituent issues and Radius responses for each case.

Year Three (July 2014 – June 2015)

Results of the third and final evaluation suggest that Global Operations has again effectively met a need at the University of Minnesota and helped manage the risk associated with work abroad. The recommendations offered in this evaluation report focus on maintaining current Concierge Service protocols, allocating funding for the Associate Program Director position, monitoring the Advisory Team, and how best to move forward with Radius. Each recommendation is listed in the table below and described in more detail in the report.

Evaluation Recommendations

Evaluation Component Recommendations
Concierge Service

- Continue case communication protocol with the Advisory Team and other experts.
- Maintain Year Two’s level of outreach and promotion activities.
- Continue to allocate resources to fund an Associate Program Director to coordinate Global Operations part-time, but explore alternative funding sources.

Advisory Team - Monitor the Advisory Team membership.
External Consultant (Radius) - Continue the contract with Radius.
- Continue to record all constituent issues and Radius responses for each case.

 

Contact

Learn More

Wonder where Global Operations has provided assistance? Or what colleges have used us before?

pie chart graphic

View charts and statistics