Three-dimensional shape measurement using a structured light system with dual projectors.

Published on May 10, 2018in Applied Optics1.961
· DOI :10.1364/AO.57.003983
Chufan Jiang6
Estimated H-index: 6
(Purdue University),
Beatrice Lim1
Estimated H-index: 1
(Purdue University),
Song Zhang55
Estimated H-index: 55
(Purdue University)
This paper introduces a structured light system with two projectors and one camera for three-dimensional (3D) shape measurement to alleviate problems created by a single projector such as the shadow problem. In particular, we developed (1) a system calibration framework that can accurately calibrate each such camera-projector system; (2) a residual error correction method based on the system error function; and (3) a data fusion method utilizing the angle between the projection direction and surface normal. Experimental results demonstrate that the proposed dual-projector structured light system improves the measurement accuracy besides extending the measurement range of a single projector system.
📖 Papers frequently viewed together
4 Authors (Maodong Ren, ..., Wenyan Pai)
9 Citations
166 Citations
3 Authors (Fengkai Ke, ..., Youping Chen)
11 Citations
#1Chufan Jiang (Purdue University)H-Index: 6
#2Song Zhang (Purdue University)H-Index: 55
This paper proposes an absolute phase unwrapping method for three-dimensional measurement that uses two cameras and one projector. On the left camera image, each pixel has one wrapped phase value, which corresponds to multiple projector candidates with different absolute phase values. We use the geometric relationship of the system to map projector candidates into the right camera candidates. By applying a series of candidate rejection criteria, a unique correspondence pair between two camera im...
7 CitationsSource
#1GuiHua Liu (SWUST: Southwest University of Science and Technology)H-Index: 2
#2Xian-Yong Liu (SWUST: Southwest University of Science and Technology)H-Index: 3
Last. Quan-Yuan FengH-Index: 3
view all 3 authors...
This paper presents a method that allows a conventional dual-camera structured light system to directly acquire the three-dimensional shape of the whole surface of an object with high dynamic range of surface reflectivity. To reduce the degradation in area-based correlation caused by specular highlights and diffused darkness, we first disregard these highly specular and dark pixels. Then, to solve this problem and further obtain unmatched area data, this binocular vision system was also used as ...
41 CitationsSource
#1Weiguang Zhang (Xi'an Jiaotong University)H-Index: 1
#2Hong Zhao (Xi'an Jiaotong University)H-Index: 14
Last. Xiang Zhou (Xi'an Jiaotong University)H-Index: 6
view all 3 authors...
A multiresolution 3-D measurement system using multiple cameras and a light sectioning method is developed to measure complex-profile objects for which other optical measuring methods are less suited. The system is composed of four cameras, which can select different system parameters to measure the whole profile and some details of an object at the same time. Thus, the system has a multiresolution measuring feature. We mainly focus on the imaging system model, system calibration, and the data m...
14 CitationsSource
#1Sai Siva Gorthi (EPFL: École Polytechnique Fédérale de Lausanne)H-Index: 15
#2Pramod Rastogi (EPFL: École Polytechnique Fédérale de Lausanne)H-Index: 22
Keywords: Fourier-Transform Profilometry ; 3-Dimensional Shape Measurement ; Phase-Unwrapping Algorithm ; Continuous Wavelet Transform ; Surface Profile Measurement ; 3-D Object Shapes ; Structured Light Pattern ; 4-Core Optical-Fiber ; Deformation Measurements ; Shifting Profilometry Reference IMAC-REVIEW-2009-001doi:10.1016/j.optlaseng.2009.09.001View record in Web of Science Record created on 2009-09-02, modified on 2016-08-08
820 CitationsSource
Over the past few years, we have been developing techniques for high-speed 3D shape measurement using digital fringe projection and phase-shifting techniques: various algorithms have been developed to improve the phase computation speed, parallel programming has been employed to further increase the processing speed, and advanced hardware technologies have been adopted to boost the speed of coordinate calculations and 3D geometry rendering. We have successfully achieved simultaneous 3D absolute ...
699 CitationsSource
#1Song Zhang (Harvard University)H-Index: 55
#2Xiaolin LiH-Index: 1
Last. Shing-Tung Yau (Harvard University)H-Index: 10
view all 3 authors...
A multilevel quality-guided phase unwrapping algorithm for real-time 3D shape measurement is presented. The quality map is generated from the gradient of the phase map. Multilevel thresholds are used to unwrap the phase level by level. Within the data points in each level, a fast scan-line algorithm is employed. The processing time of this algorithm is approximately 18.3 ms for an image size of 640×480 pixels in an ordinary computer. We demonstrate that this algorithm can be implemented into our...
152 CitationsSource
#1Song Zhang (Harvard University)H-Index: 55
#2Peisen S. Huang (SBU: Stony Brook University)H-Index: 23
We describe a high-resolution, real-time 3-D shape measurement system based on a digital fringe projection and phase-shifting technique. It utilizes a single-chip digital light processing projector to project computer-generated fringe patterns onto the object, and a high-speed CCD camera synchronized with the projector to acquire the fringe images at a frame rate of 120 frames/s. A color CCD camera is also used to capture images for texture mapping. Based on a three-step phase-shifting technique...
250 CitationsSource
#1Song Zhang (Harvard University)H-Index: 55
#2Peisen S. Huang (SBU: Stony Brook University)H-Index: 23
System calibration, which usually involves complicated and time-consuming procedures, is crucial for any 3-D shape measurement system. In this work, a novel systematic method is proposed for accurate and quick calibration of a 3-D shape measurement system we developed based on a structured light technique. The key concept is to enable the projector to "capture" images like a camera, thus making the calibration of a projector the same as that of a camera. With this new concept, the calibration of...
489 CitationsSource
#1Song Zhang (Harvard University)H-Index: 55
#2Shing-Tung Yau (Harvard University)H-Index: 10
We describe a high-resolution, real-time 3D absolute coordinate measurement system based on a phase-shifting method. It acquires 3D shape at 30 frames per second (fps), with 266K points per frame. A tiny marker is encoded in the projected fringe pattern, and detected by software from the texture image and the gamma map. Absolute 3D coordinates are obtained from the detected marker position and the calibrated system parameters. To demonstrate the performance of the system, we measure a hand movin...
219 CitationsSource
#2Thorsten BotheH-Index: 9
Last. Werner JüptnerH-Index: 19
view all 3 authors...
A procedure is proposed to calibrate a generic structured light system, consisting of one camera and one projector. The proposed pro- cedure is based on defining a unique coordinate system for both devices in the structured light system, and thus, a rigidity constraint is introduced into the transformation process. This constraint is used to derivate a simple function for the simultaneous estimation of the parameters, result- ing in parameters that are more reliable. The performance of the pro- ...
150 CitationsSource
Cited By23
#1Yi Wu (Hohai University)
#2Zhou Yaqin (Hohai University)H-Index: 3
Last. Qingwu Li (Hohai University)H-Index: 7
view all 5 authors...
Surface defect inspection for underwater structures is important. However, the inspection technologies based on passive vision cannot meet accuracy requirements. In this paper, we propose a two-stage method based on structured light images for defect detection. In the first stage, light stripes are extracted based on the analysis of hue, saturation, value (HSV) space and gray space. Then a hole-filling method is applied to ensure stripe integrity. In the second stage, depth information for all l...
#1Shijie Feng (Nanjing University of Science and Technology)H-Index: 24
#2Chao Zuo (Nanjing University of Science and Technology)H-Index: 39
Last. Qian Chen (Nanjing University of Science and Technology)H-Index: 72
view all 8 authors...
Abstract Fringe projection profilometry is widely used for three-dimensional (3D) measurements. System calibration is crucial to fringe projection systems, since it determines how the phase is converted into 3D geometry. Many methods and studies on calibration have been presented in the last few years. However, a comparative overview on the accuracy and the implementation details is still lacking. In this work, we present a review of some of the most used calibration methods. First, the basic pr...
12 CitationsSource
#1Hao Zhu (NJIT: Nanjing Institute of Technology)
#2Mulan Wang (NJIT: Nanjing Institute of Technology)
Last. Weiye Xu (University of Leicester)
view all 3 authors...
In binocular vision inspection system, the calibration of detection equipment is the basis to ensure the subsequent detection accuracy. The current calibration methods have the disadvantages of complex calculation, low precision, and poor operability. In order to solve the above problems, the calibration method of binocular camera, the correction method of lens distortion, and the calibration method of projector in the binocular vision system based on surface structured light are studied in this...
#1Jin Yu (HEBUT: Hebei University of Technology)H-Index: 2
#2Nan Gao (HEBUT: Hebei University of Technology)H-Index: 10
Last. Zonghua Zhang (HEBUT: Hebei University of Technology)H-Index: 23
view all 4 authors...
Abstract Structured light measurement system that consists of a camera and a projector has been widely used in three-dimensional (3-D) shape measurement. The premise of measurement is to calibrate the structured light system, and the calibration accuracy directly affects the accuracy of 3-D measurement system. The traditional calibration board-based methods suffer from either complex operations or uncompetitive accuracy. To overcome these limitations, this paper proposes a novel calibration meth...
1 CitationsSource
#1Zhang YuanjunH-Index: 1
#2Xinghua QuH-Index: 11
view all 4 authors...
1 CitationsSource
#1Yan LiuH-Index: 1
#2Bingxue LvH-Index: 1
Last. Wei HuangH-Index: 1
view all 4 authors...
Deep end-to-end learning based stereo matching methods have achieved great success as witnessed by the leaderboards across different benchmarking datasets. Depth information in stereo vision systems are obtained by a dense and accurate disparity map, which is computed by a robust stereo matching algorithm. However, previous works adopt network layer with the same size to train the feature parameters and get an unsatisfactory efficiency, which cannot be satisfied for the real scenarios by existin...
#2Wei Liu (DUT: Dalian University of Technology)H-Index: 86
Automated and high-accuracy three-dimensional (3D) shape measurement is required in quality control of large-size components for the aerospace industry. To eliminate the contradiction between global measurement and local precision measurement control in 3D digitalization for the key local features of the large-size components, a combined measurement method is proposed, including a 3D scanner, a laser tracker, and an industrial robot used as an orienting device, to achieve high-accuracy measureme...
#1Rigoberto Juarez-Salazar (IPN: Instituto Politécnico Nacional)H-Index: 9
#2Juana Martinez-Laguna (IPN: Instituto Politécnico Nacional)
Last. Victor H. Diaz-Ramirez (IPN: Instituto Politécnico Nacional)H-Index: 11
view all 3 authors...
Abstract Phase-shifting is a powerful phase demodulation method for three-dimensional imaging by fringe projection. However, numerous fringe patterns, which encode a single-phase function, are required. In this paper, the use of intensity patterns, which encode multiple phase functions, is proposed. A multi-demodulation phase-shifting algorithm and the intensity pattern projection profilometry approach are developed. A computer simulation and an experimental three-dimensional object measurement ...
#1Jin Yu (HEBUT: Hebei University of Technology)H-Index: 2
#2Nan Gao (HEBUT: Hebei University of Technology)H-Index: 10
Last. Zhaozong Meng (HEBUT: Hebei University of Technology)H-Index: 9
view all 4 authors...
Abstract Phase sensitivity plays a vital role in accurately retrieving three-dimensional (3D) shape of diffused objects in fringe projection profilometry (FPP). With regard to traditional means that simply project horizontal or vertical fringe patterns, the fringe frequency and direction may not be the best choice to acquire optimal sensitivity to depth variations. To overcome this problem, this paper proposes a novel method to obtain 3D shape with high accuracy by combining the optimal fringe f...
2 CitationsSource