| download
this report in
Assessment activities in the College of Business during
2002 included assessment of business core knowledge, student
satisfaction, and academic programs.
Business Core Knowledge Assessment
The business core exam from the Educational Testing Service
was administered to business seniors in spring of 2002. Scores
on assessment indicators were compared to institutional mean
scores of 441 business schools. The following data indicate
the percent of schools below the UALR mean scores on the
stated indicators for the 2000 through 2002 calendar years.
| |
Assessment Indicators |
| Acct |
Econ |
Mgmt |
Quant |
Finc |
Mktg |
Legal/Social |
Int'l |
| 1998-2001 |
|
|
|
|
|
|
|
|
| Institutional Mean |
|
|
|
|
|
|
|
|
| 441 Schools |
47.5 |
39.8 |
51.8 |
48.8 |
37.6 |
46.8 |
40.9 |
44.0 |
| |
|
|
|
|
|
|
|
|
| UALR Mean |
|
|
|
|
|
|
|
|
| Spring, 2000 |
46.9 |
36.5 |
50.6 |
48.9 |
36.6 |
44.0 |
38.4 |
42.0 |
| Fall, 2000 |
48.4 |
40.8 |
50.9 |
50.4 |
37.6 |
47.6 |
37.4 |
40.8 |
| Spring,
2001 |
44.3 |
39.5 |
52.7 |
48.3 |
38.3 |
43.0 |
38.3 |
45.1 |
| Fall,
2001 |
45.7 |
39.0 |
50.7 |
46.6 |
37.7 |
44.5 |
37.4 |
42.7 |
| Spring, 2002 |
47.6 |
45.4 |
59.6 |
61.4 |
41.4 |
45.2 |
52.3 |
48.8 |
| |
|
|
|
|
|
|
|
|
| % of Schools Below UALR
Mean |
|
|
|
|
|
|
|
|
| Spring, 2000 |
32% |
20% |
29% |
36% |
37% |
24% |
22% |
32% |
| Fall, 2000 |
43% |
47% |
29% |
51% |
41% |
43% |
15% |
22% |
| Spring,
2001 |
24% |
38% |
40% |
36% |
49% |
22% |
22% |
50% |
| Fall,
2001 |
28% |
38% |
29% |
24% |
41% |
24% |
15% |
32% |
| Spring,
2002 |
37% |
80% |
90% |
98% |
68% |
31% |
98% |
71% |
Assessment Indicators |
These assessment indicators in 2002 reflect the highest
scores achieved with the exception of Accounting and Finance
(see "Percent
of Schools Below UALR Mean"). In addition, the UALR institutional
mean score has ranged as follows over the three years: spring,
2000, 150.5; fall, 2000, 152.7; spring, 2001, 151.0; fall,
2001, 150.7; spring, 2002, 154.9-all within one standard
deviation of the comparative institutional mean/median scores
(441 schools)
of 152.3/153.2. Thus UALR business seniors consistently
perform at a level consistent with the mission of the college.
Student Satisfaction
AACSB/Educational Benchmarking Student Satisfaction Exit
Survey results for 2002 in comparison to the four previous
years are as follows:
| Factor |
2002 |
Comparison to 2001 |
Comparison to 2000 |
Comparison to 1999 |
Comparison to 1998 |
|
Mean |
% Diff |
Mean |
% Diff |
Mean |
% Diff |
Mean |
% Diff |
| Faculty and Instruction for Required
Courses |
4.45 |
4.48 |
-1% |
4.34 |
3% |
4.26 |
4% |
3.74 |
19% |
| Fac Resp/Grades/ St Effort in Required
Courses |
5.10 |
5.09 |
0% |
5.01 |
2% |
4.93 |
3% |
4.62 |
10% |
| Faculty and Instruction for Major
Courses |
4.98 |
5.00 |
0% |
4.95 |
1% |
4.68 |
6% |
4.16 |
20% |
| Fac Resp/Grades/St Effort in Major
Courses |
5.58 |
5.61 |
-1% |
5.34 |
4% |
5.29 |
5% |
4.80 |
16% |
| Breadth of the Curriculum |
4.79 |
5.06 |
-5% |
4.73 |
1% |
4.56 |
5% |
4.14 |
16% |
| Amount of and Value of Student
Teamwork |
4.90 |
5.20 |
-6% |
4.79 |
2% |
4.35 |
13% |
4.23 |
16% |
| Size of Enrollments for Required/Major
Courses |
5.25 |
5.25 |
0% |
5.34 |
-2% |
5.26 |
0% |
4.92 |
7% |
| Student Organizations and Extracurricular
Activities |
4.24 |
4.59 |
-8% |
4.25 |
0% |
4.11 |
3% |
3.64 |
16% |
| Extent and Quality of Skills Training |
5.36 |
5.41 |
-1% |
4.94 |
9% |
4.89 |
10% |
4.38 |
22% |
| Advising and Course Availability |
4.32 |
4.50 |
-4% |
4.23 |
2% |
4.27 |
1% |
3.72 |
16% |
| Facilities and Computing Resources |
4.82 |
5.05 |
-5% |
4.77 |
1% |
4.75 |
1% |
4.34 |
11% |
| Acad. Quality/Teamwork/ Camaraderie
of Classmates |
5.15 |
5.14 |
0% |
4.90 |
5% |
4.68 |
10% |
4.23 |
22% |
| Placement and Career Services |
4.03 |
4.21 |
-4% |
3.97 |
2% |
3.75 |
7% |
3.34 |
21% |
| Overall Satisfaction with Program |
4.66 |
4.77 |
-2% |
4.50 |
4% |
4.31 |
8% |
4.13 |
13% |
Longitudinal Analysis-1998-2002 |
2001 factor scores were up in 13 of 14 categories compared
to 2000-exception, factor 7 is down 1%. Scores are up in
all but two cells comparing 2001 scores to the previous three
years-exception, factor 7, compared to 2000 and 1999.
2002 factor scores are comparable or somewhat lower than
in 2001 but consistently higher than previous years; only
three factor scores, #8, 11, and 14 have a difference of >-5%
compared to 2001.
The increase in student satisfaction since 1998 may have
resulted from college actions such as the following:
- Increased attention to student advising, including assignment
of academic advisors within the college.
- Increased student and faculty involvement in the cooperative
education program.
- Increased faculty involvement in student placement.
- Continuous curriculum revision based on evolving assessment
strategies.
- Improved course scheduling to provide flexibility for
both day and evening students.
Program Assessment
The 2002 Program Assessment Review Committee consisted
of the following reviewers: David Blevins (2000-2004), Eric
Elder (2000-2004), James Karrh (2002-2005), Cynthia Taylor
(2000-2003), and Robert Mitchell, chair (2000-2003). The
committee used the same evaluation rubric as last year; specific
review procedures were discussed prior to the evaluation
to increase inter-rater reliability. Each report was evaluated
based on assessment progress in relation to the previous
year's critique and stated suggestions.
The following table documents the evaluation of assessment
progress in academic programs within the College of Business
as reported in the 2002 assessment reports. Use of assessment
for program-building and improvement, faculty and stakeholder
involvement, and approach were evaluated using the following
evaluative scale:
4, excellent use; 3, reasonable use; 2,
limited use; 1 inadequate use; 0, not reported.
The following table documents the evaluation of assessment
progress in academic programs within the College of Business
as reported in the 2002 assessment reports. Use of assessment
for program-building and improvement, faculty and stakeholder
involvement, and approach were evaluated using the following
evaluative scale: 4, excellent use; 3, reasonable use; 2,
limited use; 1 inadequate use; 0, not reported. Comparable
ratings were used in 2000 and 2001; the 2000 average rating
serves as a benchmark.
| Program |
Use of Data for Program Building |
Faculty and Stakeholder Involvement |
Assessment Approach |
2003 Rating |
2002 Rating |
2001 Rating |
2000 Average |
| Accounting |
2.5 |
1.7 |
2.8 |
2.40 |
2.50 |
2.50 |
1.67 |
| Advertising & Publ Rel |
3.25 |
3.125 |
2.75 |
3.06 |
3.75 |
2.50 |
2.67 |
| Economics |
3.4 |
2.3 |
3.2 |
3.20 |
3.25 |
3.25 |
1.83 |
| Finance |
3.25 |
2.75 |
2.7 |
3.00 |
2.50 |
3.00 |
2.53 |
| *International Business |
|
|
|
|
3.00 |
0.00 |
0.00* |
| Management |
3.0 |
3.3 |
3.25 |
3.15 |
3.00 |
2.75 |
2.83 |
| Management Info Systems |
2.9 |
3.2 |
3.3 |
3.00 |
3.50 |
3.15 |
2.67 |
| Marketing |
3.0 |
1.6 |
2.5 |
2.80 |
3.00 |
3.00 |
2.50 |
| MS in MIS |
2.25 |
3.0 |
2.875 |
2.50 |
|
|
|
| *MBA |
|
|
|
|
1.50 |
2.00 |
2.17 |
| Average 2003 |
2.94 |
2.62 |
2.92 |
2.89 |
|
|
|
| Average 2002 |
|
|
|
|
2.88 |
|
|
| Average 2001 |
2.59 |
2.88 |
2.84 |
|
|
2.77 |
|
| Average 2000 |
2.51 |
2.19 |
2.38 |
|
|
|
2.36 |
The College of Business assessment
progress reports are categorized as follows:
- Excellent
- Advertising and Public Relations
- Economics
- Management Information Systems
- Reasonable
- Accounting
- Finance
- International Business
- Management
- Marketing
- Limited
In 2000 the college assessment review committee established
2.5 as the "satisfactory progress" point for assessment evaluations;
56 percent of the programs reached or exceeded that criterion. In
2001 78 percent of the programs reached or exceeded that
criterion. By 2002 the percent is up to 88 percent. The
International Business Program now has an assessment plan. The
college review committee has provided input. A revised draft
will be sent to PAAG during April.
All programs with assessment plans have been given specific
written feedback for continued assessment progress. The
committee has asked that the Accounting and MBA program assessment
coordinators to submit to the committee by April 30, 2003,
the specific assessment activities planned for fall, 2003,
to assure outcomes-based data collection. During April,
2003, the assessment review committee will meet with each
program coordinator to discuss 2002 assessment reviews and
how program assessment can be strengthened.
Program Assessment Accomplishments/Strengths
- An assessment plan is operation for all programs.
- The current assessment evaluation system within the college
is providing continuity in process feedback and improvement.
- All programs have been given specific feedback to assure
a workable assessment, including clearly identified program
goals and outcomes-based learning objectives.
- Assessment has resulted in identified curriculum changes
in Advertising and Public Relations, Economics, International
Business, Management, and Management Information Systems,
with a foundation for change in additional programs.
- Substantial improvement has occurred in involving a variety
of stakeholders in the assessment process.
- Major progress is observed in integrating assessment
into the culture of the college.
- The AACSB review team complimented the assessment program
of the college and university.
Program Assessment Deficiencies/Emphasis for Change
- Emphasis must be placed on monitoring
curricular changes resulting from assessment.
- Continued involvement of multiple stakeholders
(faculty, students, employers) must be encouraged.
Action Plan for 2002-2003
- The Accounting and MBA programs will be monitored to
assure that outcomes-based assessment occurs fall, 2003.
- A college assessment web page will be
developed to document program assessment plans, activities,
and resulting curricular
changes. This activity should assist in involving faculty
and students in the assessment process.
- Increased involvement of faculty in the assessment system
will be encouraged, including sending additional faculty
to assessment conferences during 2003-2004.
2002 Curricular Changes Resulting from Assessment
- Resequenced and changed content of Economics 2322 and
2323.
- Implemented required student projects in Intermediate
Macroeconomic Theory and International Economics.
- Added "Idea Derby" to Advertising 3300.
- Incorporated idea generation component to Advertising
3300.
- Added instruction in integrating marketing communications
into Advertising 4310.
- Incorporated in Management 1310 increased use of problem-solving
activities involving logic and use of logical functions.
- Required all sections of Management 1310 to use standardized
exams and SAM (training software).
- Incorporated object-oriented analysis and design experiential
activities/assignments in the MIS curriculum.
- Provided concentrated instruction on bid and offer quotes
in Economics 4320.
- Incorporated increased free trade applications in Management
4377.
download
this report in Word (101Kb)
or Acrobat (33Kb)
format |
| |
|
|