Parameters Range Best Measurement
Uncertainty
Length 0 to 200 feet +/- .000003"
Mass 5500 lbs dead weight
0mg to 200g
+/- 4.5mg

+/-.0066mg
200g to 5kg +/- .002g
10 lbs to 100lbs +/- .00002lbs
Force-Tension 0 to 100,000 lbf +/- .001%
Force-Compression 0 to 200,000 lbf +/- .001%
Torque 0 to 2,000 ftlb +/- .061%
Pressure-Pneumatic 0 to 5,000 psi +/- 15 ppm
Pressure-Hydraulic 0 to 25,000 psi +/- .015%
Vacuum 0 to 30 inhg +/- 4.66x10E-6 Torr
Flow-liquid 0 to 150 gpm +/- .11%
Flow-Gaseous 0 to 100 scfm +/- .5%
Air Velocity 0 to 6500 fpm +/- 1.12%
Temperature -70 to 1000 Deg. C +/- .005 Deg. C
Humidity-Dew Point 0 to 100% RH +/-.04C Dew Point
Specific Gravity .695 to 2.000 +/- .0005 Sp. Gr.
pH 0 to 14pH +/- .01%
DC & AC Volts 0 to 40,000 V +/- 2.1 uV
Amperage 0 to 2,000 Amps +/- .1%
Resistance 001 Ohm to
1Tetra Ohm
+/- 2.0E-6 Ohms
Capacitance .0001aF to 9999.9F +/- 76.8 ppm
Inductance .0001 nH to 9999.9 MH +/- 76.8 ppm
Frequency 1Hz to 40Ghz +/- 1.0E-12Hz
Hardness Micro to Brinell ASTM E14
Flatness Plates to 60X120" +/- .00001"
Timers .01 sec to 24 hours +/- .001 sec
Level to 8 feet in length +/- .00001 in/ft
RPM 0 to 20,000 +/- .01%FS
Conductivity (Liquids) 10 to 10,000 u mhos/cm +/- .25%
Conductivity (metals) 9.7 to 101.0 IACS +/- .35 IACS
Magnetics 100 to 10,000 Gauss +/- .5%
Acceleration 0 to 10,000 HZ & +/- 50 g +/- 1.6%
Viscosity 1.0 to 2,200 cSt +/- .4%

Note: Uncertainty listed is best measurement in any range.  All % values are % of reading unless noted.  Standards are traceable to the NIST, Intrisinc standards or suitable reference materials.
 



1533 Lincoln Avenue • Holbrook, New York 11741
Phone (631) 471-6900 • Fax (631) 471-6902
Toll Free 1-800-790-0512