Frequently Asked Questions

Annual Assessment Results Report in TK20

Q: What do I do if my program/unit decided to add, delete, revise the expected outcomes and/or measures after the fall 2017 comprehensive assessment plan submission deadline but before the 2017-2018 October 1, 2018 annual results reporting period? Am I still expected to report results?

A: Programs and units are welcome to revise their comprehensive assessment plans (CAP), in
part or in whole, at any in time during the four-year data collection period. However, the Annual
Assessment Results Report (ANNUAL REPORT), due on October 1, 2018, is intended for
programs/units to report results for the previous year (2017-2018). This means that any results
reported on October 1, 2018 should reflect outcomes data collected through August 31, 2018. If
the data you collected through August 31, 2018 no longer match the CAP you submitted fall
2017 (or any subsequent versions), go ahead and report those results in Tk20, but also provide
the Office of Academic and Institutional Excellence with an updated CAP reflecting the revised
assessment outcomes, measures, methods, etc. If the data was collected after August 31, 2018,
we ask that you wait to report those results until the next annual reporting period. Please send
updated CAPs to your college/divisional assessment liaison and copy our office via email
assessment@utrgv.edu. If you are still unsure what to report given the changes to your plan,
please contact our office.

Q: What do I do if my program/unit will continue to collect outcome data, but will not implement changes to any aspect of the curriculum, operations, service delivery, assessment methods and/or any other efforts to seek improvements until after the 2018-2019 assessment period?

A: UTRGV’s Assessment Framework was designed to provide programs/units the flexibility for
when and how often they implement improvements based on assessment data. Given that
changes/enhancements do not need to be implemented every year, you can simply state in the
Improvements section of the 2017-2018 ANNUAL REPORT when your program/unit plans to
identify and develop its improvements; however, at minimum, on the 2018-2019 ANNUAL
REPORT, you must be prepared to report on any of the following: 1) improvements the
program/unit intends to implement (proposed changes) in 2019-2020, 2) improvements the
program/unit started but were not completed (changes in progress) in 2018-2019, or 3) changes
implemented in 2018-2019 (after the October 1, 2018 ANNUAL REPORT deadline). Please keep
in mind that, although the program/unit, has flexibility regarding when and how often to
implement improvements, improvements must be implemented at least once over the four-year
data collection period.

Q: What do I do if my program/unit is has collected outcomes data for 2017-2018, but is not quite ready to report on its plans to seek improvements? This might occur either because the program/unit has not met to determine improvements needed or has identified improvements needed, but plans for improvements have not been finalized.

A: If the information for the Improvements section of the ANNUAL REPORT is either not yet
developed or tentative, you can simply state that on the appropriate field entries in Tk20.
Provide any information that you have available by the Oct. 1, 2018 deadline and update it at a
later time. Please note that the reporting template in Tk20 will be locked shortly after the
reporting deadline. If you would like to update the Improvements section after the 2017-2018
ANNUAL REPORT has been locked in Tk20, please email the Tk20 Administrator at
tk20@utrgv.edu to update your entries.

Q: What do I do if I was recently given responsibility for leading/coordinating assessment efforts for my program or unit? Am I expected to complete the Annual Assessment Results Report?

A: Please contact our office at assessment@utrgv.edu. and let us know that you are newly
appointed to this responsibility. We will orient you to the institutional assessment framework
and reporting process. Together, we will review the existing plan for your program/unit and
identify the outcomes/measures that should be reported in the ANNUAL REPORT.

Q: What do I do if my program/unit did not collect data on some of the outcomes in my assessment plan during 2017-2018. Do I still need to complete the Annual Assessment Results Report? If so, how?

A: The short answer is: report what you have and explain what you did or did not/could not do.
The ANNUAL REPORT provides space for you to report the measures (Tab 1), summary of results
(Tab 2), analysis (Tab 3), and improvements (Tab 4) for each outcome in your assessment plan. If
you collected data for a particular outcome/measure, you should be able to complete Tabs 1-3.
If you have identified how you are using results for seeking improvements associated to those
outcomes/measures, then you will complete Tab 4. If you did not collect data for an
outcome/measure in your assessment plan, complete what you can for Tab 1 (e.g., outcome
statement, measure description, benchmark) and in the results field entry, state that no results
were collected for that outcome/measure. Then, navigate directly to the Improvements section
(Tab 4) and identify any changes/enhancements you seek to make regarding the collection of
assessment data for the year ahead. You can provide more context/explanation for why data was
not collected in the Lessons Learned section of the reporting template in Tab 4.

Q: Can I edit/update the Annual Assessment Results Report after saving the information on Tk20? How about after the October 1, 2018 deadline?

A: The ANNUAL REPORT will remain open to all assessment coordinators for a period of time
after the Oct. 1, 2018 deadline. After this time period, the reporting template will be locked out
to all users. Special requests for editing and/or updating their annual results report beyond this
timeline can be made via email to the Tk20 Administrator at tk20@utrgv.edu.

Q: Why does the template ask for a results to be reported in the “Measures” section (Tab 1) and a summary of results in the “Summary of Results” section (Tab 2) of the Annual Assessment Results Report? Isn’t it asking for the same information?

A: The minimum institutional expectation is to use one measure per outcome. However, many
units/programs have elected to use multiple measures per outcome. Therefore, the reporting
template must accommodate this variation in assessment methodologies in Tab 1, Measures.
Program/units with only one measure will likely find it easy to draw a conclusion regarding
whether the outcome was met or not met in Tab 2, Summary of Results; however,
programs/units with multiple measures will have to weigh the evidence across measures to form
a judgment about whether the outcome was met or not met. That is, in Tab 1, you will report
results vis-à-vis the benchmarks for each measure. While in Tab 2, you will make a judgment
about whether the expected outcome was not met, partially met, or met based across all
measures used to evaluate an expected outcome. If only one measure was identified and that
benchmark was achieved, then the outcome would be met. If, however, your program/unit had
multiple measures and some benchmarks were achieved, while others were not, then a
judgment would have to be made about whether the outcome was met or not. There is space
in the field entry to describe how/why you made your judgment about this. Programs/units
have the autonomy to determine whether and to what extent the expected outcome was met.

Q: I’m having trouble coming up with the Improvements section of the Annual Assessment Results Report. How should I best approach this section?

A: It is recommended that you refer to the responses you provided in Tab 3, Analysis, which
includes disaggregation of the data in terms of strengths/weaknesses. The responses provided
should guide you in developing action plans for seeking improvements/enhancements to your
program/unit’s curriculum, operations, and/or any aspect of service delivery. The key is to think
about whether changing any of these things in some way will lead to improvements in results.
Another place to look for developing actions for seeking improvements is by reflecting on the
strengths/weaknesses of your assessment methods. Think about whether your measures and
benchmarks are adequate, clearly aligned to your expectations, and provide you with relevant
information about how to make decisions about your operations/service delivery. Our office is
happy to facilitate a discussion for how to best think about developing the information required
in the Improvements section of the ANNUAL REPORT. So, please schedule a one-one-one
consultation with our institutional assessment team via email at assessment@utrgv.edu.

Q: Do I need to complete the “Improvements” section every year?

A: The institutional expectation is that programs/units implement actions to seek improvements
at least once over the four data collection period for each outcome; however, most
programs/units will want to implement those actions more frequently. Additionally, some
outcomes may warrant immediate action especially when data indicate a decline in
performance. Keep in mind that UTRGV’s assessment framework consists of three phases:
Assess, Intervene, and Reassess. A program/unit may cycle through these phases as many or as
few times as makes sense given the outcomes and context. Although this approach provides
significant flexibility, it puts the onus on the program/unit to keep track of where they are in the
assessment cycle at all times. To that end, programs/units will likely find it helpful to provide
some sort of narrative in the Improvements section of the ANNUAL REPORT on an annual basis
even if there are no changes proposed, in progress or implemented to report. Sample narrative
for programs/units not ready to report on changes might look like:


Program/unit XX has collected data on this outcome; however, changes are under
development (or will be developed) and will not be implemented until 2019-2020.

Moreover, the program/unit may find it valuable to implement more frequent, minor actions for
seeking improvements from year to year instead making major changes that occur only
occasionally. Such actions can be reported annually. Doing so may make it easier for
programs/units to keep track of where they are in the assessment cycle and will likely lead to
regular and consistent use of program/unit data.

Q: What do I do if the changes/enhancements in the Improvements section of the reporting template are only tentative ideas and no formal plan of action has been developed or implemented by my program/unit? Should I still report the tentative ideas?

A: Yes. Report the program/unit’s tentative actions plans for seeking improvements and check
the box that says “proposed.” As these action plans become more fully developed, you are free
to update the reporting template and indicate that the changes are “in-progress” or
“implemented.” Keep in mind that you will have a chance to provide us with an update on the
Improvements section every year in the ANNUAL REPORT.

Q: What do you mean by drilling-down or disaggregating assessment data for the “Analysis” section of the ANNUAL REPORT?

A: This essentially means making insightful contrasts and comparisons of the assessment data to
identify patterns of strengths and weaknesses beyond the overall benchmark. Because there are
a myriad of approaches for disaggregating data to identify strengths/weaknesses,
programs/units have autonomy to define their approach (as identified if their assessment plan)
and report it in the Analysis section of the ANNUAL REPORT. Some examples of data
disaggregation include rubric item analysis, exam section analysis, respondent subpopulation
analysis, time-series analysis, matched-pair analysis, cross-sectional analysis.

Q: How can I develop an action plan for seeking improvements to the program or unit when the assessment results show that we meet or exceed expectations? Can’t we simply state, “no change needed?”

A: Before any decisions are made regarding any efforts to seek improvements to your
curriculum, operations, service delivery, and/or assessment methods, the assessment data need
to be analyzed in multiple ways. For example, your program/unit should identify any areas of
strength and weakness using subpopulation analysis, time-series analysis, cross-sectional
analysis, etc. This will point to any areas that should be changed/enhanced to ensure any
weaknesses are addressed and/or strengths are replicated or scaled up. If an extensive analysis
reveals there are no weaknesses, the next step is to reflect on the assessment methods. Perhaps
data from multiple sources needs to be used to triangulate (and perhaps confirm) that
achievement is as high as it is. This could also include collecting data on student achievement
throughout the program rather than only during culminating experiences. Alternatively, the
benchmarks may need to be raised so that achievement is aspirational. Perhaps expectations
and/or achievements need to be communicated with colleagues and stakeholders. The main
thing to takeaway for every program/unit, is that regardless of performance level, there is an
opportunity to grow and improve. Therefore, the Improvements section of the reporting
template asks programs/units to think about how they want to move in that direction.

Q: I typically compare assessment results between the fall and spring within the same academic year for my program/unit. How should I report these results in the ANNUAL REPORT?

A: Making improvements between semesters is best suited to assessment in units; however, some programs measuring high-stakes outcomes (e.g., those with certification or licensing exams) may find it necessary to make improvements from semester to semester on occasion. Nevertheless, if a unit/program has adopted an assessment timeline that focuses on improvements that occur from semester to semester, then the rule of the thumb is report the results of the most recent semester (or other period) in Tab 1, Measures. In the results description of Tab 1, Measure, please be sure to provide a description indicating when the data were collected (e.g., spring 2018). Then, in Tab 2, Summary of Results, in the section titled “prior results” report the results from the previous semester (fall 2017) and provide a brief narrative to describe any notable trends within that academic year.

Q: How do I access the Tk20 Login Page?

A: Visit the following URL: utrgv.tk20.com and enter your UTRGV credentials.

Q: What username and password do I use to log into Tk20?

A: Use your UTRGV credentials to log in.

Q: What should I do if I receive an “invalid username/password” error message?

A: If you are unable to log in, please contact the Tk20 Administrator via email at tk20@utrgv.edu.

Q: What browser should I use?

A: The preferred browser for navigating Tk20 is Google Chrome

Q: The site seems to crash when I use the back button on my browser. How can I address this?

A: Please use the Assessment Planning menu to navigate through the various sections and
modules in Tk20 and refrain from using the back button on your browser.

Q: How long does it take for Tk20 to time out when no activity occurs?

A: Tk20 will time out after approximately three (3) hours of idle activity. However, it is strongly
recommended that work is saved regularly.

Q: Does Tk20 have an autosave function for recording entries?

A: Tk20 will not automatically save your entries. Users must click on the save button located at
the bottom of the window.

Q: Can I share the Tk20 report with others so they can edit and/or contribute to the Annual Assessment Results Report?

A: Others may have access to enter/edit information on the Annual Assessment Results Report,
however, their names must be provided to our office for processing. Please send all user
requests to tk20@utrgv.edu.

Q: Am I able to print the report when I complete all the components on Tk20?

A: To print the Annual Assessment Results Report follow these steps: 1. Under Assessment
Planning menu item, select “View Plans” 2. Call the report by selecting the outcome. 3 On your
keyboard type CNTRL + P (PC users) or Command+P (Mac users) and save destination as PDF.

Q: Is your office able to populate Tk20 with the necessary information from the four-year Comprehensive Assessment Plan?

A: Our office will enter information by request. Please send requests via email to
assessment@utrgv.edu.