Average duration pro-deposits IOA. If the number of calendars is high, it is important to limit data aggregation in order to identify possible variations in the permanent data of two observers. The average duration IOA algorithm per deposit achieves this by determining an IOA score for each timing, and then by deifing them by the total number of timings in which the two observers collected data. Note that this approach is similar to the approach described above of partial agreement at regular intervals. In the example of Figure 3, there were 99.7, 2.3, 69.2 and 92.7% approval levels for intervals 1 to 4, respectively. The average of these four levels of the agreement results in an average of 66% per event agreement – a much more conservative estimate than that of the statistics of the total duration of the IOA. This is not a very strict agreement procedure, since a total of 100% could be determined if two observers recorded totally different cases of target responses within the same 15-metre observation. In the data flow example shown in Figure 1, Observer 1 records three target response instances during the 3 m (one per minute) of its observation, two instances per minute 4 and misses all other instances for the remaining 12 meters. During the same hypothetical observation, Observer 2 missed all three instances during 1-3 minutes, recorded a target response instance in minute 4, but recorded four instances in minute 15. Although these are totally different events, the total number of IAOs that would result would still be 100%. This technical report provides detailed information on the reasons for using a common computer computing program (Microsoft ExcelÂ®) to calculate different forms of interobserver agreement for continuous and discontinuous datasets. In addition, we offer a brief tutorial for using an Excel table to automatically calculate the traditional total number, partial match in intervals, exact tuning, trial test, interval interval, multiple interval, total duration and average duration of interobserver duration algorithms.

We conclude with a discussion of how practitioners can integrate this tool into their clinical work. Precise agreement IOA. It is clear that the approach to partial agreement at regular intervals is stricter than the overall census as a measure of the agreement between two observers.