Pay-per-request model inference.
| # | API | ||||||
|---|---|---|---|---|---|---|---|
| 1 | $17.37* | 7,190▼ 94.4% | $0.002 – $0.03 | 121 | 40 ms | 98 | |
| 2 | $17.37* | 7,190▼ 94.4% | $0.001 – $0.02 | 135 | 23 ms | 98 | |
| 3 | $17.37 | 7,190▼ 94.4% | $0.002 – $0.05 | 121 | 44 ms | 98 | |
| 4 | $94.14*▲ 513.0% | 4,083▲ 1.2% | $0.002 | 1 | 420 ms | 96 | |
| 5 | $20.54*▼ 30.8% | 5,703▼ 89.3% | $0.00115 – $0.115 | 27 | 446 ms | 96 | |
| 6 | $40.38*▲ 999.0% | 10,536▼ 45.4% | $0.001 – $0.125 | 2004 | 10 ms | 96 | |
| 7 | $40.38*▲ 999.0% | 10,536▼ 45.4% | $0.002 – $0.025 | 53 | 28 ms | 96 | |
| 8 | — | — | $0.0105 | 19 | 2774 ms | 93 | |
| 9 | $19.99*▲ 52.5% | 1,768▼ 3.4% | $0.005 | 2 | 464 ms | 93 | |
| 10 | $20.90*▼ 85.4% | 1,596▼ 85.2% | $0.001 – $40 | 278 | 362 ms | 93 | |
| 11 | $145.92* | 1,344▼ 100.0% | — | 13 | 383 ms | 93 | |
| 12 | $145.92* | 1,344▼ 100.0% | — | 10 | 427 ms | 93 | |
| 13 | $6.98* | 1,139▲ 286.3% | $0.002 | 1 | 720 ms | 92 | |
| 14 | $6.07*▲ 122.3% | 1,214▼ 16.7% | $0.001 | 1 | 35 ms | 92 | |
| 15 | $12.32* | 1,295▼ 66.6% | $0.003 | 1 | 155 ms | 92 | |
| 16 | $12.32* | 1,295▼ 66.6% | $0.020144 | 1 | 164 ms | 92 | |
| 17 | $12.32* | 1,295▼ 66.6% | $0.004 | 1 | 153 ms | 92 | |
| 18 | $12.32* | 1,295▼ 66.6% | $0.003 | 1 | 156 ms | 92 | |
| 19 | $12.32* | 1,295▼ 66.6% | $0.004 | 1 | 154 ms | 92 | |
| 20 | $12.32* | 1,295▼ 66.6% | $0.020192 | 1 | 146 ms | 92 | |
| 21 | $76.34*▲ 102.0% | 5,540▲ 999.0% | $0.01 | 6 | 211 ms | 92 | |
| 22 | $12.32* | 1,295▼ 66.6% | $0.020145 | 1 | 145 ms | 92 | |
| 23 | $12.32* | 1,295▼ 66.6% | $0.003 | 1 | 198 ms | 92 | |
| 24 | $12.32* | 1,295▼ 66.6% | $0.002 | 1 | 217 ms | 92 | |
| 25 | $12.32* | 1,295▼ 66.6% | $0.003 | 1 | 169 ms | 92 | |
| 26 | $12.32* | 1,295▼ 66.6% | $0.02 | 1 | 180 ms | 92 | |
| 27 | $5.61*▲ 999.0% | 944 | $0.001 – $0.025 | 153 | 8 ms | 91 | |
| 28 | $14.24* | 1,886▼ 65.0% | $0.002 – $19 | 574 | 48 ms | 91 | |
| 29 | $21.77*▲ 167.8% | 2,177▼ 19.2% | $0.01 | 23 | 286 ms | 91 | |
| 30 | $8.09*▼ 34.7% | 789▼ 57.0% | $0.01 | 1 | 303 ms | 90 | |
| 31 | $2.14* | 843▼ 100.0% | $0.001 – $0.05 | 2 | 413 ms | 90 | |
| 32 | $18.08* | 750▲ 68.5% | $0.004 – $0.2 | 18 | 114 ms | 90 | |
| 33 | $2.14* | 843▼ 100.0% | $0.001 | 2 | 364 ms | 90 | |
| 34 | $917.81▼ 98.4% | 889▼ 100.0% | $0.003 – $1 | 7 | 295 ms | 90 | |
| 35 | $8.09*▼ 34.7% | 789▼ 57.0% | $0.01 | 2 | 288 ms | 89 | |
| 36 | $1.40*▲ 460.0% | 521▲ 91.3% | $0.001 – $0.67584 | 120 | 37 ms | 88 | |
| 37 | $20.57* | 516▼ 44.5% | $0.01 | 1 | 146 ms | 88 | |
| 38 | $20.57* | 516▼ 44.5% | $0.1 | 1 | 167 ms | 88 | |
| 39 | $20.57* | 516▼ 44.5% | $0.002 | 1 | 205 ms | 88 | |
| 40 | $12.32* | 1,295▼ 66.6% | $0.020177 | 1 | 233 ms | 87 | |
| 41 | $72.86*▲ 327.3% | 466▲ 8.3% | $0.01 – $5 | 38 | 248 ms | 87 | |
| 42 | $15.65*▼ 20.7% | 580▲ 137.5% | $0.001 – $5 | 162 | 50 ms | 87 | |
| 43 | $46.24▲ 999.0% | 1,075▼ 66.7% | $0.002 – $0.408886 | 38 | 141 ms | 87 | |
| 44 | $2.40* | 508▼ 93.1% | $0.002 – $0.02 | 54 | 482 ms | 87 | |
| 45 | $2.40* | 508▼ 93.1% | $0.002 – $0.02 | 4 | 177 ms | 87 | |
| 46 | $72.86*▲ 327.3% | 466▲ 8.3% | $0.01 – $5 | 37 | 503 ms | 87 | |
| 47 | $30.48*▲ 999.0% | 1,314▼ 100.0% | $0.02 | 7 | 502 ms | 86 | |
| 48 | $30.48*▲ 999.0% | 1,314▼ 100.0% | $0.02 | 8 | 448 ms | 86 | |
| 49 | $30.48*▲ 999.0% | 1,314▼ 100.0% | $0.02 | 9 | 410 ms | 86 | |
| 50 | $1.10*▲ 161.9% | 358▼ 67.9% | $0.001 – $0.005 | 60 | 112 ms | 86 |