Exective Summary: something, almost certainly MI code, significantly

worsened clock drift in late June.  This is a bug in my book.

On Tue, 29 Jul 1997 01:42:16 -0700, I wrote:

>Even on a crufty old DECstation 5000/240, my clock runs at under 9ppm
>as measured against a stratum-1 NTP server. And that'd be more
>accurate if marginally slower if I paid the CPU cycles for a real
>divide, instead of approximating division by 1024 by a shift-and-add hack.

On  Tue, 29 Jul 1997 02:04:37 -0700,
   "Erik E. Fair" <fair@clock.org> replies:


>Sounds like the pmax port is pretty clean, interrupt-latency wise.
>Here are some additional data points:

  [54 ppm clocks on  sparcs snipped]

Ok, I went back and looked.  The clock on a 5000/240 has logged a
frequency error of about 9 ppm since I patched NTP into the kernel in
my own tree (i.e,. about two years).  

On June 25 I isntalled a new kernel built from -current sometime
between june 20 and june 25.  After booting that kernel, NTP's
frequency error steadily rose to 54 ppm and has stayed there ever
since.

I'm seeing the 54 ppm with both 14-month-old static binaries I built
from xntpd-3.5f, and with xntp in our tree.

I conclude something -- possibly spl-related changes?? -- has
badly impacted clock-interrupt response.  

Erik, is it possible to build a Sparc kernel built from early
June source, and try that on your sun4ms?

Boring xntpd logs from a 5000/240 (after rebooting a new kernel on june 25) follow.



Reno> cat /var/spool/ntpstats/loopstats.19970625
50624 22795.683 0.018035 -13.6990 6
50624 22859.682 0.004867 -13.6990 6
50624 22923.680 0.004706 -13.6990 6
50624 22987.680 0.004545 -13.6817 6
50624 23051.680 0.008712 -13.6484 6
50624 23115.682 0.008712 -13.6152 6
50624 23179.682 0.016178 -13.5535 6
50624 23243.682 0.019834 -13.4778 6
50624 23307.682 0.022990 -13.3902 6
50624 23371.678 0.025859 -13.2915 6
50624 23435.679 0.028606 -13.1824 6
50624 23499.680 0.031165 -13.0635 6
50624 23563.680 0.034071 -12.9336 6
50624 23627.680 0.036033 -12.7961 6
50624 23691.678 0.038328 -12.6499 6
50624 23755.680 0.040276 -12.4963 6
50624 23819.681 0.042580 -12.3338 6
50624 23883.678 0.043824 -12.1667 6
50624 23947.681 0.045259 -11.9940 6
50624 24011.679 0.046874 -11.8152 6
50624 24075.680 0.048576 -11.6299 6
50624 24139.679 0.049744 -11.4402 6
50624 24203.680 0.051164 -11.2450 6
50624 24267.680 0.052243 -11.0457 6
50624 24331.684 0.052935 -10.8438 6
50624 24395.682 0.054293 -10.6367 6
50624 24459.679 0.055285 -10.4258 6
50624 24523.697 0.055285 -10.2149 6
50624 24587.683 0.057374 -9.9960 6
50624 24651.684 0.057218 -9.7778 6
50624 24779.681 0.059227 -9.3259 6
50624 24843.681 0.060441 -9.0953 6
50624 24907.688 0.060472 -8.8647 6
50624 24971.680 0.060608 -8.6335 6
50624 25035.681 0.061299 -8.3996 6
50624 25099.680 0.060567 -8.1686 6
50624 25163.685 0.061421 -7.9343 6
50624 25227.682 0.061431 -7.7000 6
50624 25419.722 0.061825 -6.9924 6
50624 25483.719 0.063848 -6.7489 6
50624 25547.681 0.063820 -6.5054 6
50624 25611.683 0.063820 -6.2620 6
50624 25675.683 0.063684 -6.0190 6
50624 25739.684 0.063565 -5.7766 6
50624 25803.684 0.064096 -5.5321 6
50624 25867.681 0.064000 -5.2879 6
50624 26059.684 0.064221 -4.5530 6
50624 26123.698 0.064530 -4.3068 6
50624 26251.682 0.064586 -3.8141 6
50624 26315.681 0.064268 -3.5689 6
50624 26379.682 0.064268 -3.3237 6
50624 26443.681 0.064216 -3.0788 6
50624 26507.680 0.064105 -2.8342 6
50624 26571.685 0.064561 -2.5880 6
50624 26699.687 0.063289 -2.1051 6
50624 26763.684 0.064027 -1.8609 6
50624 26827.684 0.064290 -1.6156 6
50624 26891.683 0.063552 -1.3732 6
50624 26955.681 0.062100 -1.1363 6
50624 27019.718 0.062371 -0.8984 6
50624 27083.686 0.062371 -0.6605 6
50624 27147.681 0.062077 -0.4237 6
50624 27211.683 0.061578 -0.1888 6
50624 27275.685 0.062102 0.0481 6
50624 27339.684 0.060878 0.2803 6
50624 27467.681 0.061208 0.7473 6
50624 27531.683 0.061465 0.9818 6
50624 27595.681 0.060211 1.2114 6
50624 27659.701 0.060564 1.4425 6
50624 27723.680 0.060268 1.6724 6
50624 27851.779 0.060549 2.1343 6
50624 27915.684 0.059911 2.3629 6
50624 28043.683 0.060179 2.8220 6
50624 28171.685 0.059052 3.2725 6
50624 28235.684 0.058402 3.4953 6
50624 28299.696 0.058402 3.7181 6
50624 28363.683 0.058449 3.9410 6
50624 28427.679 0.058157 4.1629 6
50624 28555.683 0.057499 4.6015 6
50624 28619.685 0.057049 4.8192 6
50624 28683.683 0.057344 5.0379 6
50624 28747.684 0.056474 5.2533 6
50624 28811.686 0.056411 5.4685 6
50624 28875.683 0.056553 5.6842 6
50624 28939.683 0.056352 5.8992 6
50624 29067.680 0.055849 6.3253 6
50624 29131.681 0.055468 6.5369 6
50624 29195.679 0.055399 6.7482 6
50624 29323.683 0.055074 7.1684 6
50624 29387.684 0.053716 7.3733 6
50624 29451.686 0.054746 7.5821 6
50624 29515.683 0.053863 7.7876 6
50624 29579.682 0.053545 7.9919 6
50624 29643.683 0.053327 8.1953 6
50624 29707.683 0.054101 8.4016 6
50624 29771.683 0.053933 8.6074 6
50624 29899.734 0.052958 9.0114 6
50624 29963.684 0.051957 9.2096 6
50624 30027.683 0.052601 9.4103 6
50624 30091.688 0.052601 9.6109 6
50624 30155.683 0.051876 9.8088 6
50624 30219.683 0.051468 10.0051 6
50624 30283.686 0.052160 10.2041 6
50624 30347.687 0.051364 10.4001 6
50624 30411.682 0.051631 10.5970 6
50624 30539.681 0.050179 10.9798 6
50624 30603.682 0.050341 11.1719 6
50624 30667.682 0.050341 11.3639 6
50624 30731.681 0.050519 11.5566 6
50624 30795.685 0.050259 11.7483 6
50624 30859.681 0.049828 11.9384 6
50624 30987.682 0.048748 12.3103 6
50624 31051.682 0.049153 12.4978 6
50624 31115.691 0.048390 12.6824 6
50624 31179.682 0.048492 12.8674 6
50624 31243.681 0.047942 13.0503 6
50624 31307.679 0.048008 13.2334 6
50624 31371.680 0.047308 13.4139 6
50624 31435.681 0.047039 13.5933 6
50624 31499.685 0.047650 13.7751 6
50624 31627.688 0.045690 14.1236 6
50624 31691.682 0.046820 14.3022 6
50624 31755.681 0.046784 14.4807 6
50624 31819.686 0.046784 14.6592 6
50624 31883.682 0.046188 14.8354 6
50624 31947.682 0.045906 15.0105 6
50624 32011.680 0.045594 15.1844 6
50624 32075.680 0.045584 15.3583 6
50624 32139.679 0.045091 15.5303 6
50624 32203.685 0.044984 15.7019 6
50624 32267.682 0.044749 15.8726 6
50624 32331.682 0.044683 16.0430 6
50624 32395.683 0.044452 16.2126 6
50624 32523.683 0.044766 16.5542 6
50624 32651.681 0.043884 16.8890 6
50624 32715.681 0.042958 17.0528 6
50624 32779.680 0.043415 17.2184 6
50624 32843.684 0.043028 17.3826 6
50624 32907.682 0.043095 17.5470 6
50624 32971.684 0.043095 17.7113 6
50624 33035.683 0.042254 17.8725 6
50624 33099.683 0.041976 18.0326 6
50624 33163.686 0.041976 18.1928 6
50624 33227.683 0.042351 18.3543 6
50624 33291.681 0.041601 18.5130 6
50624 33419.680 0.041522 18.8298 6
50624 33483.683 0.041320 18.9874 6
50624 33547.684 0.041711 19.1465 6
50624 33675.682 0.041018 19.4595 6
50624 33739.682 0.041056 19.6161 6
50624 33803.683 0.041392 19.7740 6
50624 33867.683 0.040936 19.9301 6
50624 33931.680 0.040103 20.0831 6
50624 33995.681 0.039653 20.2344 6
50624 34059.680 0.039869 20.3864 6
50624 34123.685 0.039869 20.5385 6
50624 34187.683 0.039405 20.6888 6
50624 34251.682 0.039144 20.8382 6
50624 34315.682 0.038933 20.9867 6
50624 34379.683 0.038100 21.1320 6
50624 34443.681 0.038613 21.2793 6
50624 34507.681 0.038493 21.4261 6
50624 34635.681 0.037978 21.7159 6
50624 34699.679 0.038012 21.8609 6
50624 34763.686 0.038012 22.0059 6
50624 34827.683 0.037523 22.1490 6
50624 34891.684 0.037825 22.2933 6
50624 34955.682 0.037210 22.4353 6
50624 35019.683 0.038282 22.5813 6
50624 35083.682 0.036950 22.7222 6
50624 35147.681 0.037045 22.8635 6
50624 35211.682 0.036923 23.0044 6
50624 35275.680 0.036549 23.1438 6
50624 35403.682 0.036056 23.4189 6
50624 35467.684 0.035387 23.5539 6
50624 35531.682 0.036019 23.6913 6
50624 35595.682 0.035447 23.8265 6
50624 35659.681 0.035835 23.9632 6
50624 35723.681 0.035639 24.0991 6
50624 35851.681 0.035833 24.3725 6
50624 35915.681 0.035244 24.5069 6
50624 35979.685 0.034891 24.6400 6
50624 36043.683 0.034590 24.7719 6
50624 36107.684 0.034328 24.9029 6
50624 36171.684 0.034715 25.0353 6
50624 36235.682 0.033950 25.1648 6
50624 36299.681 0.034149 25.2951 6
50624 36363.680 0.033979 25.4247 6
50624 36427.685 0.033544 25.5526 6
50624 36491.679 0.033553 25.6806 6
50624 36555.679 0.033360 25.8079 6
50624 36683.684 0.033044 26.0600 6
50624 36747.686 0.033611 26.1882 6
50624 36811.691 0.033408 26.3156 6
50624 36875.682 0.033570 26.4437 6
50624 36939.681 0.033041 26.5697 6
50624 37003.682 0.032957 26.6954 6
50624 37131.679 0.032236 26.9414 6
50624 37195.683 0.031648 27.0621 6
50624 37259.683 0.031818 27.1835 6
50624 37323.681 0.031847 27.3050 6
50624 37387.682 0.031287 27.4243 6
50624 37451.681 0.031312 27.5437 6
50624 37579.682 0.031546 27.7844 6
50624 37643.680 0.030578 27.9011 6
50624 37707.680 0.031369 28.0207 6
50624 37771.684 0.031700 28.1416 6
50624 37835.683 0.030847 28.2593 6
50624 37899.682 0.030551 28.3758 6
50624 37963.683 0.031256 28.4951 6
50624 38027.683 0.030288 28.6106 6
50624 38091.681 0.030291 28.7262 6
50624 38155.685 0.030291 28.8417 6
50624 38219.682 0.028794 28.9515 6
50624 38283.682 0.029840 29.0654 6
50624 38347.688 0.029840 29.1792 6
50624 38411.682 0.029323 29.2910 6
50624 38475.684 0.029323 29.4029 6
50624 38603.687 0.029323 29.6266 6
50624 38667.682 0.028587 29.7356 6
50624 38731.681 0.029138 29.8468 6
50624 38795.686 0.029138 29.9579 6
50624 38923.683 0.028731 30.1771 6
50624 38987.682 0.028236 30.2848 6
50624 39051.682 0.028545 30.3937 6
50624 39115.682 0.028126 30.5010 6
50624 39243.698 0.028126 30.7156 6
50624 39307.692 0.028126 30.8229 6
50624 39371.680 0.027364 30.9272 6
50624 39435.687 0.027501 31.0322 6
50624 39499.684 0.027796 31.1382 6
50624 39563.683 0.027762 31.2441 6
50624 39691.682 0.027256 31.4520 6
50624 39755.684 0.027256 31.5560 6
50624 39819.681 0.026831 31.6583 6
50624 39883.680 0.027050 31.7615 6
50624 40011.684 0.026581 31.9643 6
50624 40075.712 0.025208 32.0605 6
50624 40139.688 0.025208 32.1566 6
50624 40203.684 0.026373 32.2572 6
50624 40267.683 0.025349 32.3539 6
50624 40331.680 0.026048 32.4533 6
50624 40395.680 0.025865 32.5520 6
50624 40459.682 0.025865 32.6506 6
50624 40523.684 0.025605 32.7483 6
50624 40587.683 0.025570 32.8458 6
50624 40715.682 0.025167 33.0378 6
50624 40779.683 0.025058 33.1334 6
50624 40843.683 0.024951 33.2286 6
50624 40907.681 0.024866 33.3234 6
50624 40971.680 0.025066 33.4191 6
50624 41035.683 0.024697 33.5133 6
50624 41099.687 0.025138 33.6091 6
50624 41227.682 0.024415 33.7954 6
50624 41291.683 0.023654 33.8856 6
50624 41355.683 0.025142 33.9815 6
50624 41419.681 0.023853 34.0725 6
50624 41483.681 0.024160 34.1647 6
50624 41547.684 0.024160 34.2569 6
50624 41611.679 0.023622 34.3470 6
50624 41675.684 0.023622 34.4371 6
50624 41803.682 0.023284 34.6147 6
50624 41867.682 0.023424 34.7041 6
50624 41931.681 0.023052 34.7920 6
50624 41995.681 0.022821 34.8790 6
50624 42059.682 0.023557 34.9689 6
50624 42123.680 0.022904 35.0563 6
50624 42187.684 0.022430 35.1418 6
50624 42251.693 0.022430 35.2274 6
50624 42315.682 0.022571 35.3135 6
50624 42379.685 0.022571 35.3996 6
50624 42443.681 0.022397 35.4850 6
50624 42507.680 0.022080 35.5692 6
50624 42635.679 0.022148 35.7382 6
50624 42699.687 0.022148 35.8227 6
50624 42763.683 0.022443 35.9083 6
50624 42827.686 0.022443 35.9939 6
50624 42955.692 0.020112 36.1473 6
50624 43019.682 0.020725 36.2264 6
50624 43083.682 0.022058 36.3105 6
50624 43147.686 0.022058 36.3947 6
50624 43211.684 0.021527 36.4768 6
50624 43339.683 0.020459 36.6329 6
50624 43403.685 0.020459 36.7109 6
50624 43467.682 0.021532 36.7930 6
50624 43531.681 0.020614 36.8717 6
50624 43595.686 0.020650 36.9504 6
50624 43659.679 0.020338 37.0280 6
50624 43723.685 0.019858 37.1037 6
50624 43787.682 0.020521 37.1820 6
50624 43851.686 0.020521 37.2603 6
50624 43915.684 0.020547 37.3387 6
50624 43979.681 0.019937 37.4147 6
50624 44043.683 0.019937 37.4908 6
50624 44171.680 0.020157 37.6445 6
50624 44235.686 0.020157 37.7214 6
50624 44299.684 0.020426 37.7993 6
50624 44363.683 0.019338 37.8731 6
50624 44427.683 0.019230 37.9465 6
50624 44491.683 0.019970 38.0226 6
50624 44555.683 0.020048 38.0991 6
50624 44619.681 0.019019 38.1716 6
50624 44747.685 0.019066 38.3171 6
50624 44811.683 0.019138 38.3901 6
50624 44875.683 0.019051 38.4628 6
50624 44939.683 0.018566 38.5336 6
50624 45003.681 0.018826 38.6054 6
50624 45067.683 0.018826 38.6772 6
50624 45131.680 0.019143 38.7502 6
50624 45195.681 0.018197 38.8196 6
50624 45259.705 0.018692 38.8909 6
50624 45323.696 0.018692 38.9622 6
50624 45387.690 0.018833 39.0341 6
50624 45451.683 0.018833 39.1059 6
50624 45515.683 0.018292 39.1757 6
50624 45579.685 0.018292 39.2455 6
50624 45643.682 0.018566 39.3163 6
50624 45707.680 0.017740 39.3840 6
50624 45836.356 0.016402 39.5101 6
50624 45899.683 0.017531 39.5759 6
50624 45963.683 0.016859 39.6402 6
50624 46027.687 0.016859 39.7045 6
50624 46091.693 0.016552 39.7676 6
50624 46155.681 0.017583 39.8347 6
50624 46219.682 0.016581 39.8979 6
50624 46283.909 0.016581 39.9612 6
50624 46411.696 0.016581 40.0877 6
50624 46475.706 0.016581 40.1509 6
50624 46539.680 0.017747 40.2186 6
50624 46603.695 0.017747 40.2863 6
50624 46667.686 0.017747 40.3540 6
50624 46795.683 0.016996 40.4837 6
50624 46859.695 0.016996 40.5485 6
50624 46923.688 0.016996 40.6133 6
50624 46987.691 0.016996 40.6782 6
50624 47051.690 0.016996 40.7430 6
50624 47115.710 0.013582 40.7948 6
50624 47179.689 0.013582 40.8466 6
50624 47243.687 0.015234 40.9047 6
50624 47307.685 0.015701 40.9646 6
50624 47371.686 0.016260 41.0266 6
50624 47435.685 0.015159 41.0845 6
50624 47499.688 0.015159 41.1423 6
50624 47563.696 0.015159 41.2001 6
50624 47627.701 0.015159 41.2579 6
50624 47691.699 0.015159 41.3157 6
50624 47755.698 0.015159 41.3735 6
50624 47819.691 0.013825 41.4263 6
50624 47883.686 0.017238 41.4920 6
50624 47947.702 0.017238 41.5578 6
50624 48011.694 0.017238 41.6235 6
50624 48139.688 0.012990 41.7226 6
50624 48203.689 0.013313 41.7734 6
50624 48267.694 0.013313 41.8242 6
50624 48395.695 0.011502 41.9119 6
50624 48459.704 0.011502 41.9558 6
50624 48523.700 0.011502 41.9997 6
50624 48587.705 0.011502 42.0435 6
50624 48651.707 0.011502 42.0874 6
50624 48715.684 0.015970 42.1483 6
50624 48779.705 0.015970 42.2092 6
50624 48843.691 0.015970 42.2702 6
50624 48907.699 0.015970 42.3311 6
50624 48971.693 0.015970 42.3920 6
50624 49035.694 0.015970 42.4529 6
50624 49099.695 0.011734 42.4977 6
50624 49163.697 0.011734 42.5424 6
50624 49227.705 0.011734 42.5872 6
50624 49291.699 0.008130 42.6182 6
50624 49419.708 0.007406 42.6747 6
50624 49483.711 0.007406 42.7029 6
50624 49547.711 0.007406 42.7312 6
50624 49612.611 0.007406 42.7598 6
50624 49675.699 0.008768 42.7928 6
50624 49739.739 0.008768 42.8262 6
50624 49803.715 0.008768 42.8596 6
50624 49867.703 0.010851 42.9010 6
50624 49931.711 0.010851 42.9424 6
50624 49995.713 0.010851 42.9838 6
50624 50123.709 0.006809 43.0357 6
50624 50187.711 0.006809 43.0617 6
50624 50251.714 0.006809 43.0877 6
50624 50315.707 0.010449 43.1275 6
50624 50443.713 0.015256 43.2439 6
50624 50507.716 0.015256 43.3021 6
50624 50571.701 0.014452 43.3573 6
50624 50635.717 0.014452 43.4124 6
50624 50699.705 0.014452 43.4675 6
50624 50763.713 0.014452 43.5226 6
50624 50827.702 0.010972 43.5645 6
50624 50891.709 0.010972 43.6064 6
50624 50955.710 0.010972 43.6482 6
50624 51019.730 0.010972 43.6901 6
50624 51083.719 0.010972 43.7319 6
50624 51147.713 0.010972 43.7738 6
50624 51211.722 0.006205 43.7974 6
50624 51275.712 0.006886 43.8237 6
50624 51339.714 0.006886 43.8500 6
50624 51403.714 0.006070 43.8731 6
50624 51467.716 0.006070 43.8963 6
50624 51531.710 0.010349 43.9357 6
50624 51659.714 0.010349 44.0147 6
50624 51723.708 0.013533 44.0663 6
50624 51787.711 0.013533 44.1179 6
50624 51915.718 0.013533 44.2212 6
50624 51979.707 0.010695 44.2619 6
50624 52043.722 0.010695 44.3027 6
50624 52171.718 0.014855 44.4161 6
50624 52235.722 0.014855 44.4727 6
50624 52299.726 0.014855 44.5294 6
50624 52363.709 0.014855 44.5860 6
50624 52427.708 0.009541 44.6224 6
50624 52491.710 0.009616 44.6591 6
50624 52555.715 0.009616 44.6958 6
50624 52619.873 0.009616 44.7325 6
50624 52683.713 0.009616 44.7691 6
50624 52747.711 0.008870 44.8030 6
50624 52811.714 0.008142 44.8340 6
50624 52939.711 0.012770 44.9315 6
50624 53003.710 0.012770 44.9802 6
50624 53067.710 0.012770 45.0289 6
50624 53131.712 0.012770 45.0776 6
50624 53195.717 0.012770 45.1263 6
50624 53259.707 0.009645 45.1631 6
50624 53323.720 0.009645 45.1999 6
50624 53387.719 0.009645 45.2366 6
50624 53451.730 0.009645 45.2734 6
50624 53579.730 0.009645 45.3470 6
50624 53707.715 0.006498 45.3966 6
50624 53771.711 0.008745 45.4299 6
50624 53835.715 0.008745 45.4633 6
50624 53899.714 0.009547 45.4997 6
50624 53963.714 0.009547 45.5361 6
50624 54027.713 0.009547 45.5725 6
50624 54091.725 0.009547 45.6089 6
50624 54155.710 0.009323 45.6445 6
50624 54219.723 0.009323 45.6800 6
50624 54283.711 0.008395 45.7121 6
50624 54347.725 0.008395 45.7441 6
50624 54411.706 0.013646 45.7961 6
50624 54539.724 0.013646 45.9002 6
50624 54603.722 0.013646 45.9523 6
50624 54667.726 0.013646 46.0043 6
50624 54731.719 0.013646 46.0564 6
50624 54795.709 0.010118 46.0950 6
50624 54859.717 0.010118 46.1335 6
50624 54923.725 0.010118 46.1721 6
50624 54987.727 0.010118 46.2107 6
50624 55051.724 0.010118 46.2493 6
50624 55179.719 0.004250 46.2817 6
50624 55243.725 0.004250 46.2979 6
50624 55371.723 0.004250 46.3304 6
50624 55435.722 0.004549 46.3477 7
50624 55499.709 0.011420 46.3913 7
50624 55532.726 0.011420 46.3969 7
50624 55596.723 0.011420 46.4078 7
50624 55724.705 0.012152 46.4310 7
50624 55852.714 0.012152 46.4541 7
50624 55980.718 0.012152 46.4773 6
50624 56058.709 0.010511 46.5262 6
50624 56122.714 0.009801 46.5636 6
50624 56186.715 0.008495 46.5959 6
50624 56250.709 0.012125 46.6422 6
50624 56314.724 0.012125 46.6884 6
50624 56378.731 0.012125 46.7347 6
50624 56442.705 0.013795 46.7873 6
50624 56506.728 0.013795 46.8399 6
50624 56634.716 0.013795 46.9452 6
50624 56698.722 0.013795 46.9978 6
50624 56762.714 0.008694 47.0309 6
50624 56826.719 0.008694 47.0641 6
50624 56890.730 0.008694 47.0972 6
50624 56954.723 0.008694 47.1304 6
50624 57018.716 0.005924 47.1530 6
50624 57082.712 0.006805 47.1790 6
50624 57210.712 0.010220 47.2569 6
50624 57274.721 0.010220 47.2959 6
50624 57338.714 0.007924 47.3261 6
50624 57402.726 0.007924 47.3564 6
50624 57466.721 0.007924 47.3866 6
50624 57530.723 0.007924 47.4168 6
50624 57658.726 0.004165 47.4486 6
50624 57722.731 0.004165 47.4645 6
50624 57786.718 0.006904 47.4908 6
50624 57850.707 0.012099 47.5370 6
50624 57914.710 0.012099 47.5831 6
50624 57978.706 0.010757 47.6241 6
50624 58042.716 0.010757 47.6652 6
50624 58106.715 0.010757 47.7062 6
50624 58170.728 0.010757 47.7472 6
50624 58234.718 0.010757 47.7883 6
50624 58298.724 0.010757 47.8293 6
50624 58426.712 0.007197 47.8842 6
50624 58490.704 0.010975 47.9260 6
50624 58554.701 0.013214 47.9764 6
50624 58618.710 0.013214 48.0268 6
50624 58682.720 0.013214 48.0772 6
50624 58810.724 0.013214 48.1781 6
50624 58874.707 0.008899 48.2120 6
50624 58938.699 0.012408 48.2593 6
50624 59066.710 0.012408 48.3540 6
50624 59130.699 0.010675 48.3947 6
50624 59194.704 0.010675 48.4354 6
50624 59258.706 0.010675 48.4761 6
50624 59322.712 0.010675 48.5168 6
50624 59450.717 0.010675 48.5983 6
50624 59514.717 0.010675 48.6390 6
50624 59578.717 0.010675 48.6797 6
50624 59642.717 0.010675 48.7204 6
50624 59706.719 -0.000677 48.7178 6
50624 59770.703 0.007803 48.7476 6
50624 59834.721 0.007803 48.7773 6
50624 59898.719 0.007803 48.8071 6
50624 59962.709 0.007803 48.8368 6
50624 60026.726 0.007803 48.8666 6
50624 60090.716 0.007803 48.8963 7
50624 60154.703 0.007114 48.9235 7
50624 60200.704 0.006278 48.9278 7
50624 60264.725 0.006278 48.9338 7
50624 60392.703 0.006659 48.9465 7
50624 60520.712 0.006659 48.9592 7
50624 60648.721 0.006659 48.9718 7
50624 60776.722 0.006659 48.9845 7
50624 60904.710 0.004852 48.9938 7
50624 61032.719 0.004852 49.0030 7
50624 61160.719 0.004852 49.0123 7
50624 61288.721 0.002140 49.0164 7
50624 61672.712 0.008399 49.0644 7
50624 61928.721 0.008399 49.0964 7
50624 62312.727 0.007302 49.1382 7
50624 62568.719 0.005179 49.1580 7
50624 62696.727 0.005179 49.1678 7
50624 62824.723 0.006785 49.1808 7
50624 63080.719 0.007736 49.2103 7
50624 63208.729 0.007736 49.2250 7
50624 63336.723 0.007207 49.2388 8
50624 63464.722 0.007959 49.2539 8
50624 63573.734 0.007959 49.2572 8
50624 63701.722 0.008329 49.2611 8
50624 63957.725 0.006200 49.2670 9
50624 64361.727 0.009721 49.2707 9
50624 64617.721 0.012564 49.2737 9
50624 65129.716 0.016711 49.2816 9
50624 65641.723 0.027262 49.2946 9
50624 66153.715 0.021143 49.3047 9
50624 66665.726 0.016253 49.3124 9
50624 67177.729 0.017134 49.3206 9
50624 67689.731 0.020761 49.3305 9
50624 68201.722 0.023850 49.3418 9
50624 69225.726 0.025545 49.3662 9
50624 69737.727 0.028548 49.3798 8
50624 70215.723 0.029043 49.4315 8
50624 70727.731 0.024808 49.4788 7
50624 70897.736 0.022699 49.5363 7
50624 71153.731 0.023198 49.6248 7
50624 71409.750 0.023198 49.7133 7
50624 71537.714 0.029859 49.7702 6
50624 71642.717 0.028078 49.9460 6
50624 71706.724 0.028078 50.0531 6
50624 71770.720 0.022835 50.1402 6
50624 71834.726 0.022835 50.2273 6
50624 71898.729 0.022835 50.3144 6
50624 71962.710 0.023851 50.4053 6
50624 72026.722 0.023851 50.4963 6
50624 72090.727 0.023851 50.5873 6
50624 72154.730 0.023851 50.6783 6
50624 72218.722 0.023851 50.7692 6
50624 72346.727 0.023851 50.9512 6
50624 72474.733 0.023851 51.1331 6
50624 72538.727 0.008031 51.1638 6
50624 72602.720 0.008129 51.1948 6
50624 72666.722 0.007325 51.2227 6
50624 72730.718 0.008062 51.2535 6
50624 72794.717 0.010666 51.2941 6
50624 72922.726 0.007180 51.3489 6
50624 72986.728 0.007180 51.3763 6
50624 73178.718 0.008234 51.4705 6
50624 73242.723 0.008234 51.5019 6
50624 73306.727 0.008234 51.5333 6
50624 73370.720 0.007811 51.5631 6
50624 73562.826 0.007811 51.5631 6
50624 73690.729 -0.007131 51.5631 6
50624 73754.740 -0.007131 51.5631 6
50624 73946.723 0.012613 51.5631 6
50624 74010.720 0.000789 51.5631 6
50624 74074.720 -0.000836 51.5631 6
50624 74138.719 0.004347 51.5631 6
50624 74202.728 0.004347 51.5631 6
50624 74266.720 -0.007356 51.5631 6
50624 74330.722 -0.007356 51.5631 7
50624 74394.725 -0.007356 51.5351 7
50624 74428.723 0.008990 51.5396 7
50624 74492.718 0.009508 51.5487 7
50624 74620.732 0.009508 51.5668 7
50624 74748.730 0.009508 51.5849 8
50624 74876.718 0.010533 51.6050 8
50624 74975.725 0.010533 51.6089 8
50624 75359.725 0.005187 51.6163 8
50624 75615.713 0.013373 51.6290 9
50624 75871.727 0.013373 51.6418 9
50624 76037.720 0.008908 51.6432 9
50624 76805.719 0.010265 51.6505 9
50624 77829.730 0.009052 51.6591 10
50624 78341.731 0.008838 51.6633 10
50624 78749.706 0.022693 51.6655 10
50624 79261.709 0.022586 51.6682 10
50624 80285.721 0.026445 51.6745 9
50624 80874.697 0.032848 51.6925 9
50624 81386.704 0.028815 51.7062 8
50624 81651.700 0.030406 51.7362 8
50624 81907.692 0.032467 51.7672 7
50624 82027.692 0.031789 51.8240 7
50624 82155.701 0.031789 51.8846 7
50624 82283.686 0.032995 51.9476 6
50624 82383.703 0.032995 52.1442 6
50624 82575.694 0.032995 52.5218 6
50624 82639.709 0.032995 52.6477 6
50624 82703.702 0.032995 52.7735 6
50624 82767.697 0.014766 52.8298 6
50624 82831.704 0.014766 52.8862 6
50624 82895.705 0.016730 52.9500 6
50624 82959.703 0.016730 53.0138 6
50624 83023.688 0.016304 53.0760 6
50624 83087.684 0.017663 53.1434 6
50624 83343.685 0.012740 53.3378 6
50624 83407.684 0.014280 53.3922 6
50624 83471.684 0.011280 53.4353 6
50624 83535.690 0.011280 53.4783 6
50624 83663.693 0.011280 53.5643 6
50624 83727.695 0.011280 53.6074 6
50624 83791.693 0.007741 53.6369 6
50624 83855.691 0.007741 53.6664 6
50624 83919.693 0.007741 53.6960 6
50624 83983.685 0.006910 53.7223 6
50624 84047.682 0.008038 53.7530 6
50624 84175.754 0.008192 53.8155 6
50624 84239.688 0.008192 53.8467 6
50624 84303.696 0.008192 53.8780 6
50624 84367.695 0.008192 53.9092 6
50624 84431.696 0.008192 53.9405 6
50624 84495.688 0.003999 53.9557 6
50624 84559.687 0.005467 53.9765 6
50624 84623.686 0.003397 53.9895 6
50624 84687.690 0.003397 54.0025 6
50624 84751.685 0.003272 54.0149 6
50624 84815.681 0.004954 54.0338 6
50624 84879.685 0.004954 54.0527 6
50624 84943.686 0.004954 54.0716 6
50624 85007.691 0.004954 54.0905 6
50624 85071.684 0.003867 54.1052 6
50624 85135.708 0.003867 54.1200 6
50624 85199.689 0.003196 54.1322 6
50624 85263.691 0.003196 54.1444 6
50624 85327.707 0.002052 54.1522 6
50624 85391.685 0.003799 54.1667 6
50624 85455.693 0.003799 54.1812 6
50624 85519.688 0.003799 54.1957 6
50624 85583.691 -0.000866 54.1924 6
50624 85647.684 0.002157 54.2006 6
50624 85775.688 0.003397 54.2265 6
50624 85839.687 0.003397 54.2395 6
50624 85903.685 0.000688 54.2421 6
50624 85967.689 0.000688 54.2447 6
50624 86031.696 0.000688 54.2473 7
50624 86141.687 0.000798 54.2486 7
50624 86205.687 0.000171 54.2488 7