| 1 | 2 | kdv | IEEE 1180 report for mpeg2decode fast integer IDCT:
 | 
      
         | 2 |  |  |  
 | 
      
         | 3 |  |  | From stefan@lis.e-technik.tu-muenchen.de Thu May 26 08:18:36 1994
 | 
      
         | 4 |  |  |  
 | 
      
         | 5 |  |  | IEEE test conditions: -L = -256, +H = 255, sign = 1, #iters = 10000
 | 
      
         | 6 |  |  | Peak absolute values of errors:
 | 
      
         | 7 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 8 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 9 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 10 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 11 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 12 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 13 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 14 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 15 |  |  | Worst peak error = 1  (meets spec limit 1)
 | 
      
         | 16 |  |  |  
 | 
      
         | 17 |  |  | Mean square errors:
 | 
      
         | 18 |  |  |    0.0058   0.0118   0.0097   0.0057   0.0055   0.0117   0.0120   0.0063
 | 
      
         | 19 |  |  |    0.0106   0.0157   0.0142   0.0099   0.0115   0.0168   0.0154   0.0123
 | 
      
         | 20 |  |  |    0.0128   0.0156   0.0152   0.0095   0.0115   0.0147   0.0173   0.0096
 | 
      
         | 21 |  |  |    0.0055   0.0115   0.0103   0.0078   0.0069   0.0092   0.0113   0.0071
 | 
      
         | 22 |  |  |    0.0057   0.0134   0.0123   0.0067   0.0050   0.0109   0.0128   0.0065
 | 
      
         | 23 |  |  |    0.0101   0.0172   0.0159   0.0093   0.0097   0.0148   0.0163   0.0130
 | 
      
         | 24 |  |  |    0.0113   0.0171   0.0148   0.0103   0.0110   0.0153   0.0149   0.0093
 | 
      
         | 25 |  |  |    0.0064   0.0123   0.0104   0.0065   0.0064   0.0111   0.0099   0.0066
 | 
      
         | 26 |  |  | Worst pmse = 0.017300  (meets spec limit 0.06)
 | 
      
         | 27 |  |  | Overall mse = 0.010998  (meets spec limit 0.02)
 | 
      
         | 28 |  |  |  
 | 
      
         | 29 |  |  | Mean errors:
 | 
      
         | 30 |  |  |    0.0014   0.0004   0.0003   0.0017   0.0003   0.0011   0.0010  -0.0001
 | 
      
         | 31 |  |  |    0.0000   0.0003   0.0010   0.0003   0.0007  -0.0006   0.0004   0.0033
 | 
      
         | 32 |  |  |    0.0000  -0.0008  -0.0006   0.0009  -0.0015  -0.0013  -0.0017  -0.0008
 | 
      
         | 33 |  |  |   -0.0017   0.0019  -0.0005   0.0010   0.0005   0.0000  -0.0017  -0.0001
 | 
      
         | 34 |  |  |    0.0007   0.0034   0.0015   0.0021   0.0016   0.0007  -0.0006   0.0011
 | 
      
         | 35 |  |  |   -0.0007   0.0004  -0.0001   0.0003   0.0003   0.0004   0.0031  -0.0010
 | 
      
         | 36 |  |  |    0.0009  -0.0005  -0.0004   0.0003   0.0008  -0.0015  -0.0007  -0.0007
 | 
      
         | 37 |  |  |    0.0024   0.0001   0.0018  -0.0003  -0.0006  -0.0001   0.0009   0.0018
 | 
      
         | 38 |  |  | Worst mean error = 0.003400  (meets spec limit 0.015)
 | 
      
         | 39 |  |  | Overall mean error = 0.000352  (meets spec limit 0.0015)
 | 
      
         | 40 |  |  |  
 | 
      
         | 41 |  |  |  
 | 
      
         | 42 |  |  |  
 | 
      
         | 43 |  |  |  
 | 
      
         | 44 |  |  | 25.8u 0.1s 0:27 95% 0+216k 0+2io 0pf+0w
 | 
      
         | 45 |  |  | IEEE test conditions: -L = -5, +H = 5, sign = 1, #iters = 10000
 | 
      
         | 46 |  |  | Peak absolute values of errors:
 | 
      
         | 47 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 48 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 49 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 50 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 51 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 52 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 53 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 54 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 55 |  |  | Worst peak error = 1  (meets spec limit 1)
 | 
      
         | 56 |  |  |  
 | 
      
         | 57 |  |  | Mean square errors:
 | 
      
         | 58 |  |  |    0.0008   0.0008   0.0006   0.0006   0.0006   0.0006   0.0007   0.0005
 | 
      
         | 59 |  |  |    0.0005   0.0003   0.0005   0.0001   0.0003   0.0007   0.0007   0.0004
 | 
      
         | 60 |  |  |    0.0004   0.0012   0.0011   0.0007   0.0010   0.0008   0.0010   0.0003
 | 
      
         | 61 |  |  |    0.0004   0.0004   0.0001   0.0002   0.0004   0.0007   0.0009   0.0004
 | 
      
         | 62 |  |  |    0.0005   0.0005   0.0004   0.0002   0.0006   0.0004   0.0012   0.0003
 | 
      
         | 63 |  |  |    0.0008   0.0006   0.0007   0.0007   0.0003   0.0012   0.0011   0.0004
 | 
      
         | 64 |  |  |    0.0006   0.0002   0.0001   0.0002   0.0005   0.0005   0.0007   0.0005
 | 
      
         | 65 |  |  |    0.0008   0.0004   0.0006   0.0003   0.0008   0.0006   0.0002   0.0003
 | 
      
         | 66 |  |  | Worst pmse = 0.001200  (meets spec limit 0.06)
 | 
      
         | 67 |  |  | Overall mse = 0.000561  (meets spec limit 0.02)
 | 
      
         | 68 |  |  |  
 | 
      
         | 69 |  |  | Mean errors:
 | 
      
         | 70 |  |  |    0.0008   0.0006   0.0000   0.0006   0.0006   0.0002   0.0005   0.0003
 | 
      
         | 71 |  |  |    0.0005   0.0003   0.0003   0.0001   0.0001   0.0001   0.0005   0.0002
 | 
      
         | 72 |  |  |    0.0004   0.0006   0.0005   0.0007   0.0006   0.0004   0.0002  -0.0001
 | 
      
         | 73 |  |  |    0.0002   0.0002   0.0001   0.0002   0.0004   0.0005   0.0003   0.0002
 | 
      
         | 74 |  |  |    0.0003   0.0003   0.0004   0.0002   0.0006   0.0000   0.0002   0.0003
 | 
      
         | 75 |  |  |   -0.0002   0.0004   0.0007   0.0005   0.0001   0.0010   0.0005  -0.0002
 | 
      
         | 76 |  |  |    0.0004   0.0000   0.0001   0.0000   0.0001   0.0003   0.0005   0.0003
 | 
      
         | 77 |  |  |    0.0006   0.0000   0.0002   0.0003   0.0004   0.0002   0.0002   0.0001
 | 
      
         | 78 |  |  | Worst mean error = 0.001000  (meets spec limit 0.015)
 | 
      
         | 79 |  |  | Overall mean error = 0.000311  (meets spec limit 0.0015)
 | 
      
         | 80 |  |  |  
 | 
      
         | 81 |  |  |  
 | 
      
         | 82 |  |  |  
 | 
      
         | 83 |  |  |  
 | 
      
         | 84 |  |  | 25.7u 0.1s 0:27 95% 0+216k 0+3io 0pf+0w
 | 
      
         | 85 |  |  | IEEE test conditions: -L = -300, +H = 300, sign = 1, #iters = 10000
 | 
      
         | 86 |  |  | Peak absolute values of errors:
 | 
      
         | 87 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 88 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 89 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 90 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 91 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 92 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 93 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 94 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 95 |  |  | Worst peak error = 1  (meets spec limit 1)
 | 
      
         | 96 |  |  |  
 | 
      
         | 97 |  |  | Mean square errors:
 | 
      
         | 98 |  |  |    0.0068   0.0097   0.0119   0.0064   0.0065   0.0105   0.0112   0.0050
 | 
      
         | 99 |  |  |    0.0088   0.0130   0.0128   0.0088   0.0111   0.0152   0.0139   0.0109
 | 
      
         | 100 |  |  |    0.0114   0.0127   0.0157   0.0099   0.0114   0.0137   0.0153   0.0109
 | 
      
         | 101 |  |  |    0.0052   0.0097   0.0120   0.0060   0.0067   0.0114   0.0099   0.0065
 | 
      
         | 102 |  |  |    0.0062   0.0096   0.0091   0.0064   0.0076   0.0092   0.0111   0.0058
 | 
      
         | 103 |  |  |    0.0096   0.0139   0.0166   0.0112   0.0092   0.0141   0.0122   0.0103
 | 
      
         | 104 |  |  |    0.0121   0.0138   0.0131   0.0089   0.0108   0.0172   0.0127   0.0104
 | 
      
         | 105 |  |  |    0.0070   0.0109   0.0092   0.0055   0.0057   0.0128   0.0102   0.0069
 | 
      
         | 106 |  |  | Worst pmse = 0.017200  (meets spec limit 0.06)
 | 
      
         | 107 |  |  | Overall mse = 0.010316  (meets spec limit 0.02)
 | 
      
         | 108 |  |  |  
 | 
      
         | 109 |  |  | Mean errors:
 | 
      
         | 110 |  |  |   -0.0010   0.0015   0.0001  -0.0004   0.0005  -0.0001   0.0008   0.0000
 | 
      
         | 111 |  |  |    0.0004   0.0016   0.0006   0.0000  -0.0001   0.0004   0.0011   0.0001
 | 
      
         | 112 |  |  |   -0.0008   0.0013   0.0015   0.0003   0.0010   0.0005  -0.0005   0.0021
 | 
      
         | 113 |  |  |    0.0006   0.0013  -0.0004   0.0000   0.0007  -0.0002  -0.0009   0.0003
 | 
      
         | 114 |  |  |    0.0004   0.0004  -0.0001  -0.0004   0.0014   0.0018   0.0017  -0.0002
 | 
      
         | 115 |  |  |    0.0024   0.0007  -0.0002  -0.0018   0.0004   0.0001   0.0010   0.0009
 | 
      
         | 116 |  |  |    0.0001  -0.0002   0.0005   0.0003  -0.0016   0.0004   0.0013  -0.0006
 | 
      
         | 117 |  |  |   -0.0012  -0.0017  -0.0008   0.0003   0.0001   0.0018   0.0008  -0.0005
 | 
      
         | 118 |  |  | Worst mean error = 0.002400  (meets spec limit 0.015)
 | 
      
         | 119 |  |  | Overall mean error = 0.000309  (meets spec limit 0.0015)
 | 
      
         | 120 |  |  |  
 | 
      
         | 121 |  |  |  
 | 
      
         | 122 |  |  |  
 | 
      
         | 123 |  |  |  
 | 
      
         | 124 |  |  | 25.8u 0.0s 0:27 95% 0+216k 0+4io 0pf+0w
 | 
      
         | 125 |  |  | IEEE test conditions: -L = -256, +H = 255, sign = -1, #iters = 10000
 | 
      
         | 126 |  |  | Peak absolute values of errors:
 | 
      
         | 127 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 128 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 129 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 130 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 131 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 132 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 133 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 134 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 135 |  |  | Worst peak error = 1  (meets spec limit 1)
 | 
      
         | 136 |  |  |  
 | 
      
         | 137 |  |  | Mean square errors:
 | 
      
         | 138 |  |  |    0.0061   0.0118   0.0097   0.0057   0.0058   0.0113   0.0115   0.0061
 | 
      
         | 139 |  |  |    0.0105   0.0159   0.0138   0.0097   0.0113   0.0166   0.0149   0.0123
 | 
      
         | 140 |  |  |    0.0129   0.0155   0.0152   0.0095   0.0112   0.0145   0.0173   0.0094
 | 
      
         | 141 |  |  |    0.0059   0.0112   0.0105   0.0076   0.0071   0.0091   0.0113   0.0073
 | 
      
         | 142 |  |  |    0.0061   0.0130   0.0128   0.0066   0.0051   0.0108   0.0126   0.0067
 | 
      
         | 143 |  |  |    0.0099   0.0168   0.0161   0.0095   0.0100   0.0149   0.0166   0.0132
 | 
      
         | 144 |  |  |    0.0113   0.0171   0.0150   0.0101   0.0110   0.0157   0.0152   0.0094
 | 
      
         | 145 |  |  |    0.0062   0.0121   0.0102   0.0065   0.0061   0.0112   0.0099   0.0065
 | 
      
         | 146 |  |  | Worst pmse = 0.017300  (meets spec limit 0.06)
 | 
      
         | 147 |  |  | Overall mse = 0.010980  (meets spec limit 0.02)
 | 
      
         | 148 |  |  |  
 | 
      
         | 149 |  |  | Mean errors:
 | 
      
         | 150 |  |  |   -0.0005   0.0006   0.0001  -0.0007   0.0006  -0.0003  -0.0003   0.0011
 | 
      
         | 151 |  |  |    0.0011   0.0003  -0.0002   0.0005  -0.0001   0.0008   0.0001  -0.0027
 | 
      
         | 152 |  |  |    0.0013   0.0015   0.0010  -0.0001   0.0020   0.0019   0.0025   0.0016
 | 
      
         | 153 |  |  |    0.0023  -0.0008   0.0011  -0.0002   0.0007   0.0003   0.0019   0.0009
 | 
      
         | 154 |  |  |   -0.0003  -0.0030  -0.0002  -0.0012  -0.0009   0.0000   0.0010  -0.0005
 | 
      
         | 155 |  |  |    0.0009   0.0002   0.0015   0.0007   0.0002   0.0001  -0.0026   0.0018
 | 
      
         | 156 |  |  |    0.0001   0.0011   0.0010   0.0005  -0.0004   0.0023   0.0014   0.0014
 | 
      
         | 157 |  |  |   -0.0014   0.0007  -0.0014   0.0009   0.0013   0.0006  -0.0007  -0.0007
 | 
      
         | 158 |  |  | Worst mean error = 0.003000  (meets spec limit 0.015)
 | 
      
         | 159 |  |  | Overall mean error = 0.000355  (meets spec limit 0.0015)
 | 
      
         | 160 |  |  |  
 | 
      
         | 161 |  |  |  
 | 
      
         | 162 |  |  |  
 | 
      
         | 163 |  |  |  
 | 
      
         | 164 |  |  | 25.8u 0.1s 0:27 95% 0+216k 0+3io 0pf+0w
 | 
      
         | 165 |  |  | IEEE test conditions: -L = -5, +H = 5, sign = -1, #iters = 10000
 | 
      
         | 166 |  |  | Peak absolute values of errors:
 | 
      
         | 167 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 168 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 169 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 170 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 171 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 172 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 173 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 174 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 175 |  |  | Worst peak error = 1  (meets spec limit 1)
 | 
      
         | 176 |  |  |  
 | 
      
         | 177 |  |  | Mean square errors:
 | 
      
         | 178 |  |  |    0.0010   0.0007   0.0008   0.0004   0.0008   0.0004   0.0005   0.0007
 | 
      
         | 179 |  |  |    0.0005   0.0007   0.0005   0.0004   0.0006   0.0005   0.0005   0.0003
 | 
      
         | 180 |  |  |    0.0003   0.0011   0.0009   0.0007   0.0008   0.0006   0.0011   0.0006
 | 
      
         | 181 |  |  |    0.0003   0.0004   0.0002   0.0002   0.0003   0.0006   0.0008   0.0006
 | 
      
         | 182 |  |  |    0.0004   0.0005   0.0006   0.0006   0.0003   0.0007   0.0007   0.0003
 | 
      
         | 183 |  |  |    0.0013   0.0006   0.0008   0.0005   0.0004   0.0006   0.0008   0.0004
 | 
      
         | 184 |  |  |    0.0003   0.0003   0.0003   0.0002   0.0005   0.0004   0.0006   0.0005
 | 
      
         | 185 |  |  |    0.0005   0.0003   0.0006   0.0005   0.0011   0.0007   0.0005   0.0003
 | 
      
         | 186 |  |  | Worst pmse = 0.001300  (meets spec limit 0.06)
 | 
      
         | 187 |  |  | Overall mse = 0.000561  (meets spec limit 0.02)
 | 
      
         | 188 |  |  |  
 | 
      
         | 189 |  |  | Mean errors:
 | 
      
         | 190 |  |  |    0.0002   0.0005   0.0008   0.0000   0.0002   0.0004   0.0003   0.0007
 | 
      
         | 191 |  |  |    0.0001   0.0003   0.0003   0.0002   0.0006   0.0003   0.0001   0.0003
 | 
      
         | 192 |  |  |   -0.0001   0.0007   0.0003   0.0001   0.0002   0.0006   0.0005   0.0006
 | 
      
         | 193 |  |  |    0.0001   0.0004   0.0002   0.0002   0.0001   0.0002   0.0004   0.0004
 | 
      
         | 194 |  |  |    0.0002   0.0005   0.0006   0.0004   0.0001   0.0005   0.0005   0.0003
 | 
      
         | 195 |  |  |    0.0009   0.0002   0.0000   0.0001   0.0004   0.0000   0.0006   0.0004
 | 
      
         | 196 |  |  |    0.0003   0.0003   0.0003   0.0002   0.0003   0.0000   0.0004   0.0003
 | 
      
         | 197 |  |  |    0.0003   0.0003   0.0004   0.0003   0.0007   0.0005   0.0005   0.0003
 | 
      
         | 198 |  |  | Worst mean error = 0.000900  (meets spec limit 0.015)
 | 
      
         | 199 |  |  | Overall mean error = 0.000333  (meets spec limit 0.0015)
 | 
      
         | 200 |  |  |  
 | 
      
         | 201 |  |  |  
 | 
      
         | 202 |  |  |  
 | 
      
         | 203 |  |  |  
 | 
      
         | 204 |  |  | 25.7u 0.1s 0:27 95% 0+216k 0+0io 0pf+0w
 | 
      
         | 205 |  |  | IEEE test conditions: -L = -300, +H = 300, sign = -1, #iters = 10000
 | 
      
         | 206 |  |  | Peak absolute values of errors:
 | 
      
         | 207 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 208 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 209 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 210 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 211 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 212 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 213 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 214 |  |  |    1   1   1   1   1   1   1   1
 | 
      
         | 215 |  |  | Worst peak error = 1  (meets spec limit 1)
 | 
      
         | 216 |  |  |  
 | 
      
         | 217 |  |  | Mean square errors:
 | 
      
         | 218 |  |  |    0.0067   0.0097   0.0118   0.0060   0.0066   0.0107   0.0113   0.0049
 | 
      
         | 219 |  |  |    0.0082   0.0132   0.0128   0.0088   0.0110   0.0152   0.0140   0.0109
 | 
      
         | 220 |  |  |    0.0122   0.0125   0.0156   0.0098   0.0113   0.0139   0.0152   0.0106
 | 
      
         | 221 |  |  |    0.0054   0.0097   0.0121   0.0064   0.0067   0.0110   0.0096   0.0062
 | 
      
         | 222 |  |  |    0.0064   0.0099   0.0090   0.0067   0.0078   0.0089   0.0112   0.0057
 | 
      
         | 223 |  |  |    0.0098   0.0136   0.0165   0.0111   0.0090   0.0138   0.0120   0.0103
 | 
      
         | 224 |  |  |    0.0121   0.0135   0.0131   0.0087   0.0107   0.0168   0.0128   0.0102
 | 
      
         | 225 |  |  |    0.0069   0.0109   0.0091   0.0057   0.0061   0.0125   0.0103   0.0070
 | 
      
         | 226 |  |  | Worst pmse = 0.016800  (meets spec limit 0.06)
 | 
      
         | 227 |  |  | Overall mse = 0.010283  (meets spec limit 0.02)
 | 
      
         | 228 |  |  |  
 | 
      
         | 229 |  |  | Mean errors:
 | 
      
         | 230 |  |  |    0.0015  -0.0009   0.0006   0.0012   0.0002   0.0007  -0.0001   0.0005
 | 
      
         | 231 |  |  |    0.0004  -0.0010   0.0000   0.0004   0.0006   0.0004  -0.0004   0.0007
 | 
      
         | 232 |  |  |    0.0018  -0.0009  -0.0006   0.0000  -0.0003  -0.0001   0.0014  -0.0006
 | 
      
         | 233 |  |  |   -0.0002  -0.0011   0.0009   0.0004  -0.0003   0.0010   0.0010   0.0000
 | 
      
         | 234 |  |  |    0.0004   0.0001   0.0010   0.0011  -0.0008  -0.0017  -0.0006   0.0009
 | 
      
         | 235 |  |  |   -0.0020   0.0000   0.0007   0.0021   0.0002   0.0002  -0.0004  -0.0003
 | 
      
         | 236 |  |  |    0.0003   0.0005  -0.0003  -0.0001   0.0017   0.0002  -0.0004   0.0010
 | 
      
         | 237 |  |  |    0.0015   0.0023   0.0013   0.0003   0.0005  -0.0011  -0.0003   0.0006
 | 
      
         | 238 |  |  | Worst mean error = 0.002300  (meets spec limit 0.015)
 | 
      
         | 239 |  |  | Overall mean error = 0.000252  (meets spec limit 0.0015)
 | 
      
         | 240 |  |  |  
 | 
      
         | 241 |  |  |  
 | 
      
         | 242 |  |  |  
 | 
      
         | 243 |  |  |  
 | 
      
         | 244 |  |  | 25.8u 0.0s 0:27 94% 0+216k 0+3io 0pf+0w
 | 
      
         | 245 |  |  |  
 |