Single Camera Pick

## Single Camera Pick
Calculates and outputs the robot arm pick coordinates based on the workpiece position captured by the camera. (Camera position is fixed)

## Module Principle

Using the captured image, optimized feature matching locates the image pick point, which is then converted to a mechanical point via calibration for the equipment to pick. This module is for the **Eye-to-Hand** mode, meaning the camera's shooting position for each pick is fixed.

![](/media/202603/2026-03-12_165842_0106640.4039169607715437.png)

Mechanical models are divided into XYR, XR, YR (with angle) and XY, X, Y (without angle) types. The calculation methods for the two types of picking are different. Picking with an angle requires the input calibration data to also be of the XYR, XR, YR type with an angle. Picking without an angle has no requirement for calibration.
When the pick mode is multiple targets, both input and output are in array form. For the compensation amount in a mechanical model with angle R, the compensated R will affect the XY values. (That is, if only R is compensated, the XY position where the robot arm picks the workpiece will not change, but the actual mechanical XY coordinates will change slightly to compensate for the rotation.)
#### Teaching

![](/media/202603/2026-03-12_165859_8773740.3855715078369426.png)
Teaching is the process where an operator or engineer teaches the system how to identify target objects, understand the scene, or execute specific visual tasks before or during the picking process. The operation steps are: place a material on the picking plane, get its workpiece pixel point and workpiece pixel angle on the image, and record it by clicking **Learn Current Value**. Then manually align the robot arm with the teaching workpiece and record the picking pose to **Teach Pick Pose**.
**Teaching** must be performed again every time a new pick module is created, calibration changes, or the robot arm's pick position changes.

## Usage Scenarios
Before performing picking or pick-and-place, the robot arm and camera calibration must be completed and introduced in the module.
Single camera picking is the most basic and commonly used technical solution in machine vision. It obtains 2D image information of the target object through a single industrial camera and combines image processing algorithms to achieve object identification, positioning, and picking.

## Usage Method

### Pre/Post-Sequence Modules
**Camera Image Acquisition**, **Optimized Feature Matching** to get the workpiece image point coordinates for single camera picking, **Calibration Reference** to introduce calibration for converting image point coordinates.
After completing the port connections, run once first to learn the input image point coordinates, then manually align the mechanism to get the teach mechanical point input. Run subsequently to get the pick coordinate output.

![](/media/202603/2026-03-12_165912_1207090.5537442717367798.png)
## Parameter Configuration Description

Mechanical Model:
【XYR】 Mechanical structure XY axes can translate and rotate.
【XY】 Mechanical structure XY axes can translate, but cannot rotate or do not need to rotate.
【XR (Y Separated)】 Mechanical structure only has X-axis translation and can rotate, Y-axis structure is separated.
【YR (X Separated)】 Mechanical structure only has Y-axis translation and can rotate, X-axis structure is separated.
【X (Y Separated)】 Mechanical structure only has X-axis translation, Y-axis structure is separated.
【Y (X Separated)】 Mechanical structure only has Y-axis translation, X-axis structure is separated.
【Pick Mode】 Single Target: Pick only once; Multiple Targets: Pick multiple targets in the field of view sequentially.
【Mechanical Travel】 Allowed travel range of the robot arm; exceeding the range will report an error.
【Compensation Amount】 Mechanical coordinates, compensated in the mechanical coordinate system. When clicking subscribe, the compensation amount can be introduced via the port.
【Reference Image】 The image taken by the camera during mechanical picking.

![](/media/202601/2026-01-15_174516_7994290.8984229842643191.png)
【Teach Pixel Pose】 Image coordinates, used for the pixel pose of the teaching material. Can be manually entered based on the port's workpiece pixel point and angle, or click Learn Current Value to automatically learn the current workpiece pixel point/angle. At this time, ensure the learned workpiece pixel image is the teaching material image. Only needs to be learned once; if the image coordinates of the teaching material change, it needs to be learned again.
【Teach Pick Pose】 Mechanical coordinates, used for the mechanical end coordinates when picking the teaching material. Can be manually entered or click Subscribe to get the pose via the port value. Only needs to be taught once; if the teaching position changes, it needs to be taught again.

![](/media/202601/2026-01-15_175235_6118250.21388362441746556.png)
Mechanical travel represents the movable range of the mechanism. When the output absolute coordinates are greater than the mechanical travel, an error will be reported, but it will not affect the result output.
## Output Description

![](/media/202601/2026-01-15_175306_6259700.7410542326276847.png)
The output has two sets: Pick Pose and Offset Pose. Pick Pose is the actual picking pose of the robot arm, which is also the judgment range for [Mechanical Travel]. Offset Pose is the offset of the robot arm relative to the teaching position and does not judge mechanical travel.

| Feature | Pick Pose | Offset Pose |
|---|---|---|
| Coordinate Type | Absolute Coordinate (GPS style) | Relative Coordinate (Reference object style) |
| Safety Check | Full check of mechanical travel | No range check |
| Main Function | Final execution position | Position fine-tuning |
| Analogy | Detailed delivery address | "Front left of you" |
| Dependency | Absolute Coordinate (GPS style) | Contains teach coordinates + offset based only on teach coordinates |
## Precautions

1. When using a bottom camera, the X-axis needs to be mirrored because the coordinate system of the mechanism captured by the bottom camera is opposite to the actual one.
2. When using a pick type with an angle, the input calibration data is also required to be of the XYR, XR, YR type with an angle.
3. Every time a new pick module is created, calibration changes, or the robot arm's pick position changes, teaching must be performed again.
4. Learning the teach image point requires running once first to get the input before learning.
   
## Error Troubleshooting
1. When picking is inaccurate, prioritize reteaching and testing again.
2. Pay attention to whether the feature matching module acquires an accurate image.
3. If still unable to pick accurately, test the accuracy of the calibration (the calibration module introduces testing).
4. If there is a large offset angle leading to inaccurate XY, it may be caused by an error in the calculation of the calibration rotation center. Try to recalibrate, modify the calibration method, and improve the calculation of the rotation center (add calibration verification or use the long radius calibration module).
5. If the center is accurate but there is XY deviation around the periphery, consider image distortion (use the Image Distortion Correction module), or calibration scale calculation error (use the Calibration Correction module).

---

Click here to jump to the corresponding Chinese manual page: [Single Camera Pick](/doc/142)