HRD evaluation is impacted greatly by changes and advances in technology. In general, data collection for HRD research purposes should be easier to collect via the Internet. However, this is not universally true. Here’s how an online or e-learning course might be evaluated using Kirkpatrick’s four levels: Reaction is easy to gather online through continuous feedback. Trainers could use a discussion thread or chat room to allow trainees to discuss their experiences with online learning.

Learning is very easy to test electronically (at least for objective tests). Trainers can also link to a learning management system that reports results to trainees and stores these results for organizational purposes. Behavior is very hard to capture electronically, although some relevant data may be available in other information systems, for example, appraisals, promotions, turnover, and discipline data. Results are even harder to gather online than traditionally, without face-to-face interaction, feedback, and buy-in. Conservative estimates of online course impact should be used to build credibility.

Collecting measures before and after training should be easier electronically than in the traditional classroom. This is especially true for reaction and learning measures. At the least, it will take more work and ingenuity to measure behavior and results electronically.