Why Your EDM Reading Might Be Slightly Lying to You
An EDM instrument never returns a wrong number on purpose. But it also never tells you when the number is quietly off by a few millimetres, or worse, a few centimetres, because of something it cannot see: the air it just fired a beam through, or a tiny offset baked into its own hardware. Today we play detective and track down exactly where those hidden errors come from.
Manufacturers advertise accuracy as something like ±(5 mm + 5 ppm). That looks like one clean number. It is actually two separate suspects working together, and understanding both is the difference between trusting a reading and second-guessing it on a critical construction control survey.
Line-Up: The Usual Suspects
🌡️ Temperature & Pressure
Air temperature and atmospheric pressure change how fast the measuring wave actually travels, altering the refractive index of the atmosphere the beam passes through.
🎯 Zero Point Offset
Every instrument has a small internal offset between its electrical measuring center and its physical center, corrected at the factory but never perfectly zero.
💎 Prism Constant
Light travels slower inside glass than air, so a prism adds its own small delay that must be subtracted out, or every reading carries a silent bias.
📐 Incidence Angle
A prism tilted away from the instrument reflects the beam less cleanly, and the resulting error grows fast as the tilt angle increases.
Case File: How Far Does the Error Actually Reach?
The instrument error is fixed, it does not care how far you are measuring. The ppm error scales with distance. That means the exact same instrument can feel razor-sharp on a short shot and noticeably looser on a long one. Run the numbers yourself below.
🔎 Accuracy Calculator: How Big Is the Error, Really?
Drag the distance slider to see how the total possible error changes for a typical ±(5 mm + 5 ppm) instrument.
Notice the pattern: at 100 metres, a ±5 mm instrument error alone represents roughly 1/20,000 accuracy. Stretch the same instrument to 1000 metres, and that same fixed error shrinks to 1/200,000 relative accuracy, because the constant part matters less as distance grows. The ppm part is the one that keeps adding up.
The Zero Correction Alibi
Here is a detail most people skip past: the distance an EDM actually measures runs from its electrical center to the back of the prism glass, not the physical center of either device. Manufacturers correct for this at the factory, a process called zero correction, but it means two different instrument and prism combinations are never perfectly interchangeable without a check.
Field crews verify this by measuring a long line with an intermediate point, comparing the whole line against the sum of the two halves. Any consistent leftover difference is the instrument-prism constant hiding in plain sight, exactly the kind of check we build into every stakeout and control survey before trusting the numbers downstream.
An instrument spec sheet tells you the best case. The field, temperature swings, prism tilt, atmospheric haze, decides what you actually get.
Error Contribution at a Glance
| Incidence Angle | Approx. Error |
|---|---|
| 0° | 0 mm |
| 10° | 0.6 mm |
| 20° | 2.5 mm |
| 30° | 5.7 mm |
| 40° | 10.3 mm |
Approximate values from a 1 km test section. A tilted prism is not a small mistake, it is a measurable one.
Frequently Asked Questions
It means the instrument has a fixed error of about 5 mm regardless of distance, plus an additional 5 mm of error for every kilometre measured. Both parts combine into the total possible error at any given distance.
Yes, especially over longer distances. Temperature and pressure change the refractive index of air, which changes wave speed. Most modern instruments allow these values to be entered so the correction is applied automatically.
A cube corner prism is designed to reflect light straight back to its source, but at higher incidence angles the reflected signal weakens and shifts slightly, introducing a measurable distance error.
Surveyors lay out a long line with an intermediate station, measure the full line and the two partial segments, then compare the totals. Any consistent leftover difference reveals the instrument-prism constant.
The ppm error matters far more on long lines, since it accumulates with distance. On short lines, the fixed instrument error usually dominates the total possible error.
