DSU Assessment Plan for the Master's in Information Systems

Date: August 8, 2000 

A. Copy of goals, outcomes and assessment criteria.

Goal 1:
Students will lead organizations in the effective implementation and utilization of information systems.

Student outcome:

1.  Students will implement managerial techniques to measure and improve information systems efficiency and effectiveness. 

Assessment criteria

1. Employer Survey: 80% of the employers will rate the graduates as good or very good managers.  
2. Graduate Survey: 80% of the graduates will be satisfied or very satisfied with their ability to use managerial techniques to improve information systems.  
3. Course grades: 90% will successfully complete INFS 612 and INFS 755 with a grade of B or higher.  
4. ICCP exam: 75% of graduates will successfully complete (at the entry level) the portions of the exam related to management and strategy. In particular, ICCP sections 1.1 Business Environment and 1.2 Management.

Student outcome:

1. Students will provide leadership in the organization’s efforts to adopt new technologies.  

Assessment criteria

1. Employer Survey: 80% of the employers will indicate that the graduates can provide leadership in technology decisions.
2. Graduate Survey: 80% will be satisfied or very satisfied with their leadership abilities.  
3. MSIS Project: 90% of the students will successfully complete an information systems project in INFS 790 that features incorporation of new/changed technology into a corporate infrastructure.  
4. ICCP exam: 75% of graduates will successfully complete (at the entry level) the portions of the exam related to systems and technology. In particular, ICCP sections 2 System Concepts, 4 Systems Development, and 5 Technology.

Goal 2:
Students will demonstrate extensive, current technical knowledge of computer and communication technologies and tools.

Student outcome:

1. Students will demonstrate knowledge of information systems, telecommunication protocols and computer network theory, hardware and practice. 

Assessment criteria

1. Employer Survey: 80% of the employers will indicate that the graduates demonstrate sufficient knowledge of current technologies.
2. Course grades: 90% of the students will successfully complete INFS 601, INFS 612, INFS 634, INFS 730, and INFS 750 with a grade of B or higher.
3.  ICCP exam: 75% of graduates will successfully complete (at the entry level) the portions of the exam related to technology. In particular, ICCP section 5 Technology.
4. MSIS Advisory board will meet annually to ensure that the topics remain up to date and evolve with technological advances.
   
   

Student Outcome:

1. Students will understand and apply current and emerging computer software technologies including CASE, DSS, programming, database management, electronic commerce, Internet application, network operating environments. 

Assessment criteria

1. Employer Survey: 80% of the employers will indicate that the graduates understand current software technologies such as e-commerce, programming and database management. 
2. MSIS Project: 90% of the students will make appropriate use of emerging technologies in the capstone project. 
3. Course Grades: 90% of the students will successfully complete the INFS 634, INFS 684, INFS 730, and INFS 750 with a grade of B or higher. 
4. ICCP exam: 75% of graduates will successfully complete (at the entry level) the portions of the exam related to systems development and data and information. In particular, ICCP sections 2.1 Types of Systems, 4 Systems Development, and 5.2 Software. 
5. MSIS Advisory board will meet annually to ensure that the topics remain up to date and evolve with technological advances.

Goal 3:
Students will demonstrate the ability to select and implement appropriate computer technologies to solve specific business problems.

Student Outcome:

1. Students will translate user requirements into effective computer-based systems and networks.

Assessment Criteria:

1. Employer Survey: 80% of the employers will indicate that the graduates can translate user requirements into computer-based systems and networks. 
2. Course Grades: 90% of the students will successfully complete INFS 634 and INFS 750 with a grade of B or higher. 
3. ICCP exam: 75% of graduates will successfully complete (at the entry level) the portions of the exam related to systems and technology. In particular, ICCP section 4 Systems Development. 
4. MSIS Project: 80% of the students will demonstrate the ability to move user descriptions into completed projects.
   

Student Outcome:

2. Students will effectively manage existing information systems application projects.

Assessment Criteria:

1. Employer Survey: 80% of the employers will indicate that the DSU MSIS graduates are good or very good in their ability to manage existing information systems projects.
2. Course Grades: 90% of the students will successfully complete INFS 612 and INFS 684 with a grade of B or higher.
3. ICCP exam: 75% of graduates will successfully complete (at the entry level) the portions of the exam related to project management. In particular, ICCP section 1.2 Management.
   

Goal 4:
Students will demonstrate the broad range of knowledge and skills required by an Information Systems professional.

Student Outcome:

1. Students will be able to perform the tasks of an Information Systems professional.

Assessment Criteria:

1. ICCP exam: 75% of graduates will achieve a satisfactory score (at the entry level) on the full ICCP core exam.
2. Graduate Survey: 90% of graduates will be satisfied with the level and range of knowledge they have acquired through the program. 
3. Employer Survey: 90% of employers will indicate that they are satisfied with the overall performance of the graduate. 
4. MSIS Advisory board will meet annually to refine the expectations of an IS professional.

Student Outcome:

2. Students will be able to successfully adapt to new environments and technologies.

Assessment Criteria:

1. Graduate Survey: 90% of graduates will be feel that their educational experience has prepared them for the challenges of new positions. 
2. Employer Survey: 90% of employers will indicate that they are satisfied with the ability of the graduate to become proficient with the job-related technologies.

B. Copy of proposed assessment process.

Entry-level assessment

• Baccalaureate degree from an institution of higher education 
• GMAT (Graduate Management Admission Test) – Minimum score of 500 
  or GRE (Graduate Record Examination) – Minimum score of 1000 (verbal and quantitative)
• G.P.A. (grade point average) – Minimum of 2.5
• Demonstrated basic knowledge in both business fundamentals and information systems.Basic knowledge can be demonstrated in one of the following ways: 
  1. BS in management information systems.
  2. BS in business administration combined with information systems work experience.
  3. A combination of any baccalaureate degree and appropriate work experience.

Mid-level assessment

• MSIS project proposal
  1. Preliminary discussion with advisor
  2. Proposal must be presented to and accepted by the project committee. If the proposal is unsatisfactory, the student will be informed of the deficiencies and asked to resubmit.
• MSIS project updates
  3. The student and advisor are expected to hold meetings to monitor progress on the project. This will allow the advisor to provide feedback to the student before the final presentation.
  4. Committee members will also provide feedback as appropriate.
• MSIS project evaluation – Final presentation
  5. The project will be presented to the project committee.
  6. The project will be evaluated according to the Project Evaluation Form.
  7. The project advisor will ensure that minor problems requiring only small updates are properly handled.
  8. Major deficiencies will require that the student modify the project and then go through the report/presentation process again.

Major-field assessment

• ICCP exam
  • Course-ICCP mapping: Detailed scoring from the ICCP results will allow assessment of particular courses and/or subject areas. Exam scores may be useful in identifying strengths/shortcomings in courses.
• MSIS project presentation and report

Direct measures of student learning

• ICCP exam
  • Course-ICCP mapping: Detailed scoring from the ICCP results will allow assessment of particular courses and/or subject areas. Exam scores may be useful in identifying strengths/shortcomings in courses.
• Grades
• MSIS project evaluations

Indirect measures of student learning

• Graduate surveys
• Employer surveys

C. Brief statements describing:

1. Relation of goals to DSU mission.

The South Dakota Board of Regents Policy Manual states, “Dakota State University is an institution specializing in programs in computer management, computer information systems, and other related undergraduate and graduate programs as outlined in SDCL 13-59-2.2. 

The Master of Science in Information Systems degree follows naturally from this mission statement. Furthermore, this program complements the existing undergraduate degrees in Information Systems, Computer Science, and E-Commerce.

2. Faculty involvement in development of goals, outcomes and criteria (i.e., college committees). Include date of faculty approval of plan.

The program proposal originated from within the faculty ranks by members of the College of Business and Information Systems, and Liberal Arts. After faculty were identified to be in the program, they have met regularly to work on curriculum, goals, assessment, coordination of the program, and other issues. 

The faculty committee approved the plan on August 9, 2000.

3. Validity and reliability of assessment instrument, if applicable.

The Graduate Survey and Employer Survey are similar to those used for undergraduate assessment and thus would have the same statement of validity and reliability.

The Institute for Certification of Computing Processionals (ICCP) is acknowledged throughout the information and technology sectors as the most important source of professional certification. ICCP is the standard in professional certification for 23 national and international professional computing societies. The ICCP certification programs are intended to establish recognized professional standards within the information systems and information technology industry. The examination demands a high degree of professional competence from those who pass.

4. Program/curriculum review (i.e., how do faculty use the results of assessment activities for program review).

The assessment results will be presented to the MSIS Graduate Committee, the MSIS Graduate Faculty, the DSU Assessment Coordinating Committee, and the MSIS Advisory Board.

The Graduate Committee will study assessment results as they become available. This group will be the first line in interpreting the results as well as reacting to the information they produce. Actions may include investigation of course content or teaching techniques, modification of program expectations, etc. Furthermore, the subject area breakdown provided by the ICCP exam may prove valuable in assessing instructor and student performance in particular courses, independently of grades.

The assessment results will be presented to the MSIS Graduate Faculty on an annual basis. This activity will also include revising the assessment mechanism in order to update them for future measurements. Similarly, the results will be presented to the university’s Assessment Coordinating Committee for review.

The MSIS Advisory Board has been formed to facilitate communication between corporate leaders and the MSIS program. Representatives from several companies are currently serving on the board. The board will assess the program requirements and content. They will be able to offer unique perspectives on the interpretation of assessment data from the employer viewpoint. Additionally, they will have insight into employees/graduates that are coming from other programs.

5. Method for providing feedback to graduates.

• Course grades
• Evaluation of project plan and presentation
• ICCP scores - breakdown summary of scores nationally and for DSU students

6. Specific dates for implementation, if not already in place.

• Entry-level assessment activities: In place, since program began.
• Mid-level assessment activities: In place, project planning for students since Spring/Summer 2000.
• Major-field assessment activities: Fall 2000
• Advisory Board: first meeting Fall 2000