Learning & Talent Management Technology Evaluation

Learning & Talent Management Technology Evaluation 
Enter name of supplier to evaluate here:
Capabilities and Platform Features
Item General Platform Capabilities Organization Requirement Weight  
Provides fully integrated learning content development, learning management, talent management, performance management, learning content management and virtual classroom technologies in one easy to use solution.
 
All interfaces, including virtual classrooms, must provide access by all contemporary browsers, tablets and mobile devices utilizing HTML5 without the need for customized browser settings, plug-ins or downloads.
 
The Learning Management System must conform to all SCORM requirements including support and reporting of all data elements. The LMS interface must be customer configurable, allow for easy branding, support localization, provide an intuitive interface and enable supervisors to manage subordinate assignments and evaluations.
 
Provides a complete course development system based on HTML5 technology that supports advanced sequencing and navigation, reusable learning objects, internal (SCO to SCO) element pre-requisite management and customization of the course delivery environment. The authoring tools must be cloud/server based and be available for unlimited use with no additional licensing fees.
 
Provides a highly granular reusable content object reference library for rapid development of materials based on content already deployed to support programs.  This library must provide a single source repository of reusable content objects that can be used in course outlines, classes and continuums without being replicated.  The content management system must support content version management, individual consumption and completion status recording in conjunction with or independent of the tracking performed with course/class completion.  Reporting features should also provide usage statistics for materials designated for performance support or microlearning at a highly granular level.
 
Provides a performance and talent management system that enables both managers and employees to participate in achieving organizational staffing and recruiting objectives. The system must be based on position profiles that maintain qualification elements associated with each position, including requisite education, certifications and licenses. The system must be supported by a classification matrix that can be used by the content management system for the organization of content, documentation and learning elements.  The system must provide full automation of assignments, including notifications for employee and supervisor for all elements associated with the position profiles (qualifications, certification, licensing, etc.). 
 
Provides the ability to leverage third-party courses and content with fully automated processing of SCORM Content Packages. This capability must provide for both the import and export of learning content without user intervention.
 
Provides a virtual classroom technology that will record sessions for on demand replay and automatically load them into the LCMS/LMS.  This technology must be provided without per-user fees to enable programs to reach all users.  The on-demand playback feature must enable full participation of the students during playback of materials, including recording of user interactions with forms, surveys, simulations, games and exams.
 
Points: General Requirements
Item Learning Management Requirements Requirement Weight  
Provides custom contact information for support services
Provides standard help files and tutorials
Provides reporting tools for generation of custom reports that allow selection of any data element, sort criteria and filtering of selections
 
Makes real-time student progress information available to supervisors and other authorized users without the need to access administrative interfaces
 
Provides the ability for Instructors to manage attendance and completion data for assigned courses
 
Enables the creation and replication of separate instances of a class based on a single course with options to have unique attributes for each class
 
Provides the ability to assign unique names for each scheduled learning event/activity
 
Indicates 'owner' of the learning event with contact information for the students/participants
 
Proves the ability to select from an available list of facilities/virtual classrooms during creation of event to avoid resource conflicts
 
Provides a calendar interface for each student that is populated with the dates/times for all enrolled events
 
Provides the ability to create and manage a learning event, notify participants and schedule associated resources
 
Provides information regarding the total seats available, wait listing options or that the session is already full for students during the registration process
 
Enables the ability to schedule an instructor(s) for a learning event and provide the instructor with the materials (student handouts, presentation guides, etc.) and information required to conduct the event
 
Provides the ability to qualify instructors for conduct of classes, including basic instructor qualifications and management of advanced requirements for specific course/specialty qualification
 
Enables the assignment of  class equipment and materials data on an ad-hoc basis
 
Enables the selections of required equipment and materials for a session from a listing of available resources
 
Enables instructors to augment rosters, equipment and resource requirements as needed to support class conduct
 
Provides a class availability calendar that is tailored to the signed-in user (location, available/required classes, etc.)
 
Makes facility information available with the class roster for instructors to view (location, special access requirements, etc.)
 
Provides a comprehensive set of standard reports 
Enables the export report data in Excel formats for external data manipulation
 
Allow reports to generated based on the authority and role of the currently signed-in user (company, supervisor status, instructor status, etc.)
 
Provides an acceptable data export for import into financial systems
 
Provides tracking / reporting for e-commerce activity
Enables control of test attempts allowed on a per exam basis
 
Provides the creation and management of multi-level certification and certificate programs
 
Provides an enhanced attendance verification capability for the issuance of certificates or continuing education units
 
Provides the ability to assign multiple instructors for independent periods of time to a class.  This requirement includes the ability to schedule instructor activities prior to class convening and following class completion.
 
Provides the ability to assign multiple resources (facilities, support equipment, supplies) for independent periods of time to a class.  This requirement includes the ability to schedule resources prior to class convening and following class completion.
 
Provides a class management system that supports waitlist functionality, automated reminders and self cancellation features
 
Supports the ability to easily apply a unique brand interface for all organizational entities (companies, brands, affiliates, regions, etc.)
 
Automatically calculate all position qualifications, roles and certifications for all users to facilitate gap management and succession management programs
 
Dynamically provide permissible functionality and access based on login credentials
 
Provides a comprehensive catalog management system that offers unlimited sub catalog levels, each with distinct and inherited access permissions and display characteristics
 
Supports system recommendations and student self-selection of learning offerings
 
Supports supervisor or management assigned learning, including manual batch assignments
 
Regulates registrations to not exceed available seats
Provides for administrator initiated registration and cancellations
 
Populates and categorizes unique domain catalogs with any published content
 
Clearly identifies all offerings as being 'required' versus 'available' on a user by user basis
 
Supports individual and group assignment based on Boolean logic operators for any element associated with a user (including achievements and failures)
 
Provides the tools to complete a look forward analysis for each individual in the organization based on the organization's talent management program to determine potential future individual advancement opportunities
 
Identifies target audiences for receipt of assignments based on defined criteria and enables automated and progressive assignments
 
Provides for the creation of unlimited continuums of assignment associated with personnel classifications, certification and licensing programs
 
Provides for the automated selection of target audiences based on learner attributes to promote or assign learning programs
 
Provides for configurable administrative cancellations for any type of learning program (course, class, event, etc.) on a course or group basis, including required notifications
 
Makes position, certification and other progress information available to learners via the learner interface
 
Indicates the percentage of learning elements completed compared to the total number of learning elements that exist within a continuum
 
Includes an ecommerce system that provides robust capabilities to define pricing discounts based on user attributes, a shopping cart and fully integrated tax management
 
Provides a course catalog system that support anonymous catalog browsing prior to system log-on
 
Supports security with SSL, SSO and other authentication models
 
Provides access to a searchable content and job performance aid library for just-in-time training
 
Provides for the development of reports, graphs, charts and maps to facilitate the program and provide information to participants. Reports must include drill-down features to enable in-depth reviews and the enable managers to identify issues and take action as required.
 
Provides users  and supervisors access to transcripts, certificates, license information and other data related to their classification and authority
 
Provides the ability to add, edit and delete administrative permissions associated with a user profile
 
Restricts access to functionality based on login credentials
 
Provides employee access to completed personnel evaluations and peer reviews, including resulting assignments
 
Points: Learning Management 
Item Talent Management Requirements Requirement Weight  
1 Provides the ability to identify and/or create a position requirement, including identification of all pre-hire qualifications and post hire training and certification requirements
 
Provides the ability to determine the qualification of internal candidates for available positions, including assessment of individuals with gaps that may be able to qualify for the position in the timeframe prescribed by the hiring manager
 
Provides the ability to collect the submission of applications using web interfaces to collect information associated with position specific elements. 
 
Allows for the collection of applications from individuals not applying for a specific position, enabling the applicant to have a guided process based on a series of data collection and assessment processes
 
Provides for pre-hire testing of applicants to determine the quality of the application information submitted and their ability to meet the requirements expected for the position
 
Provides for the automatic creation of an individual learning and certification plan to enable internal applicants to meet open position requirements
 
Automatically tracks the status of applications, assignment of hiring managers and completion of pre-hire/internal assignment steps, including associated documentation, evaluation outcomes and assessments
 
Integrates with HR and payroll processing systems to ensure synchronization with all employment related data
 
Provides for the fully automated assignment of courses, evaluations and continuums based on any defined set of Boolean rules. This must include recertification, recurring and regulatory training requirements and rehire deficiencies
 
Automated assignments must consider prerequisite requirements, availability of assignment, location, language skills and other factors.
 
Tracks assessment completions and associated scores as independent objects when required
 
Continuums of training must provide for step level assignment (i.e. level 1 must be completed before the continuum events associated with level 2 are available)
 
Certification programs and continuums of training must allow for blended learning opportunities and alternate methods of accomplishment should the primary method be unavailable to certain individuals (location restrictions, class seat availability, etc.)
 
Provide organizational hierarchy views of the talent management program, including all gaps, qualification deficiencies and any individual lapse of certification or license.
 
Tailored organizational hierarchy views must be available to all supervisors and managers with automated notifications before a deficiency occurs with sufficient time to remedy the concern. Up chain notifications must be provided to ensure management visibility of potential issues
 
The reporting tools associated with the talent management program must be comprehensive and enable any system data element to be included in a report. 
 
Provide peer review and collaboration tools to enable specialties within the organization to leverage individual expertise to improve organizational performance
 
Provide a comprehensive performance evaluation program with unlimited variations of evaluation forms
 
Provide a library of all performance evaluation criteria to enable review of outcomes and statistical analysis across forms and organizational entities
 
Provide automated and manual methods of personnel evaluation assignments, including notifications, deadline management gap analysis
 
All reports must be able to automatically constrain their output based on the authority, role and position of the requesting user
 
The system must be able to produce visualizations, including geographic (map-based), graph and Gantt formats leveraging any data element maintained by the system, including customer defined elements
 
The system must be able to reconcile company job levels, position descriptions and unique assignment requirements, including the ability to provide variance reports on a person-by-person basis
 
Points: Talent Management
Item Learning Content Management Requirements Requirement Weight  
Supports the ability to develop and publish instructor guides, trainee guides, eLearning, microlearning, exams and reference publications
 
Provides a comprehensive examination system that is suitable for certification, licensure and other high-stakes and regulatory programs
 
Supports import/export and tracking of all SCORM  learning objects
 
Can be directly integrated with 3rd party SCORM content authoring applications and 3rd party hosted content (Skillsoft, Vubiz, etc.)
 
Associates detailed knowledge, skill and ability attributes for each Reusable Learning Object (RLO) for ease of searching and assignment
 
Provides for the creation of a learning path from learning objects and/or courses
 
Provides the ability to track and manage the revision and maintenance status of all content
 
Allows for the timed release of content
Provides full content search facilities for performance and knowledge management utilization
 
Provides for independent weighted exam scoring for courses that have a multiple exams
 
Tracks assessment completions and associated scores as independent objects when required
 
Associates pre-requisites for learning objects and/or courses/continuums
 
Provides for the creation of blended learning paths (may include any/all types of learning objects)
 
Provides for the creation of certification tracks
Supports customized naming conventions for all learning paths
 
Provides gamified learning element interfaces and supporting leaderboards without programming
 
Provides collaboration facilities (chat, messages board, etc.) as measurable learning objects within a learning element (certification, continuum, course, class, etc.)
 
Provides automatic reminders for periodic review of a courses, exams and content objects
 
Provides for export of SCORM compliant courses for use by 3rd party learning systems
 
Provides a comprehensive integrated authoring environment for all types of learning and performance support content
 
Provides for remote content authoring over the web or intranet
 
Course authoring environment does not require programming knowledge
 
Can support unlimited authors simultaneously
Allows for author access and checkout control of content
Provides collaboration facilities and forums for general use (virtual conferencing, chat rooms, discussion boards, etc.)
 
Supports publishing of a URL as a learning object with SCORM usage tracking
 
Imports standard files/docs (MS-Word, Excel, PowerPoint) for use a learning elements, supporting content and/or job-aids
 
Integrates streaming or other video/audio, including user provided content
 
Supports text, image, multimedia etc.
SCORM based authoring tools that support all run-time environment variables and course constructs
 
Third party authoring tools can be used to author content in conjunction with the system provided authoring environment
 
Restricts content access by user authority, role, permissions, organizational affinity and location
 
Provides reusable exams, assessments and surveys
Includes a test item management repository with full statistical tracking and reusability of test items, survey questions and performance evaluation indicators. This requirement includes identification of problem test items at all levels of use (course, class, system-wide, etc.)
 
Provides timed testing capability
Supports randomization and question pool testing methods
 
Provides for in-person and virtual proctored testing
Includes a complete evaluation and testing system that provides true/false, multiple choice, multi-selection, matching and  fill-in-the-blank questions
 
Has standardized templates for exams, surveys and performance evaluations
 
Provides comprehensive, SCORM conformant cloud/server based eLearning and microlearning authoring tools that are fully integrated with the content management system and allow for unlimited users, including student provided content submissions.
 
Allows embedded images/video/audio and microlearning  to be used with test items as references and as remediation elements
 
Points: Content Management
Item Virtual Classroom Technology Requirements Requirement Weight  
Provides video, audio, chat, screen sharing, polling, private messaging, breakout rooms, ad-hoc content and roster management.
 
Is fully integrated with the LMS and LCMS for all participant registration, access, role determination and grade-book management
 
Enables presentation recording with automatic creation of a reusable content object in the LCMS upon completion of an event.
 
Enables all live participant interactions to be experienced by on-demand users, including exams, games, surveys, simulations and eLearning elements.
 
The technology must provide full SCORM tracking and reporting (test item responses, survey responses, progress, time and completion status recording of all interactive and pushed elements)
 
Provides the ability to include moderated message forums and other communication tools to support "after the class" interactions with the instructor or other experts that can facilitate student support and answer questions regarding materials presented. This capability must also include automatic notifications on entries requiring moderation and responses provided.
 
Moderated message forums and other communications tools provided to live event participants must also be available to students that access the recorded event as on-demand users.
 
The technology must provide full SCORM tracking for all elements delivered to students during  to the recorded replays, including all test item responses.
 
Technology provides attendee participation in multiple modes, including listen only, with microphone/telephone, with webcam/video.
 
Enables the instructor to demonstrate software applications using the presenter workstation. This feature must include the ability to annotate screens, enable students to add annotations and synchronize user text inputs to provide notes for after event review.
 
Enable the instructor to "push" any web deliverable content, including 3rd party hosted eLearning/microlearning elements to participants with full SCORM tracking or student interactions/responses
 
Enable the instructor to deliver surveys to live participants and share the results in graphical, geographical (map based) or tabular formats to the participants if desired
 
Provides the ability to deliver graded exams to live participants. This capability must also include the ability to conduct exam proctoring and provide isolated student testing cubicles that produce a video/audio record of the exam conduct for each individual student.
 
Enable use of off the shelf tools (like MS PowerPoint/MS Word, etc.) for content creation
 
Technology that is scalable to class sizes of at least 500 simultaneous students
 
The technology must provide customizable leaderboards for all measureable elements, including games, exams, simulations and other interactive content to promote competitive learning activities for both the live and subsequent on-demand users.
 
Points: Virtual Classroom 
Total All Requirements
User, Cost and Pricing Information
User Information Elements
Users
Number of Current Users
Number of Additional Potential Users (customers, suppliers, agents, partners)
Cost Elements (three years)
  License, User, Maintenance and Upgrade Fees (current users)  
  Additional User Fees (customers, suppliers, agents, partners)  
  Migration, Integration and Startup Fees  
Total Three Year Cost of Ownership/Operation
Evaluated Technology Points Deficit
Evaluated Requirements Percentage Met
Evaluated Cost Per Requirement Point
Three Year Evaluated Value to Organization Based on Requirements Met
Three Year Amount Overpaid (Underpaid) Based On Comparison
Instructions and Cell Reference Information What to do
  Areas highlighted in grey are calculated cells and should not require modification.            
  Areas highlighted in yellow are based on published baseline LMS information for a
leading vendor and may require modification.  Please contact your vendor for additional details. 		Answer "Yes" in the cells where the capability is available from your alternate vendor.  "No" indicates the capability is not provided by your alternate vendor.  
  Areas highlighted in green are reference cells and should not require modification.    
  Areas in white require entry/modification based on organizational needs. Assign points to each requirement based on organization need.  Assign more relative points to important elements.  
  Areas in red require entry and may vary greatly based on the total number of end-users. Please contact your vendor for details. Enter cost information for your current or alternate vendor(s).  Estimate cost impact to extend use of technology to customers, suppliers, partners, agents, etc.