Selected work

Case study 03 / Robotics & machine vision

Guiding a robot with machine vision.

A vision system that let a robot pick workpieces from varying positions on a pallet and place them into a CNC machine.

Company
Kontakt
Project date
Aug 2017
Focus
Robotics & machine vision

Client: Omco, Hum na Sutli, Croatia

03 / Robotics & machine vision
Guiding a robot with machine vision — conceptual diagramConceptual cell: vision locates a workpiece on the pallet; the robot picks it and transfers it into the CNC machine.VisionPalletRobotCNC
Conceptual cell: vision locates a workpiece on the pallet; the robot picks it and transfers it into the CNC machine.
Conceptual system view

Conceptual cell: vision locates a workpiece on the pallet; the robot picks it and transfers it into the CNC machine.

01 / Context

The challenge

The workpiece position on a pallet could vary. The application needed to connect machine vision with robot movement so that the robot could find a part, pick it up, and place it in a CNC machine.

02 / Ownership

My contribution

Application architecture, machine vision design, robot programming, and team management for Omco in Hum na Sutli, Croatia.

  • Designing the application architecture
  • Designing the machine vision system
  • Team management
  • Programming the robot to perform pick and place tasks

03 / Engineering

The approach

Start with the physical workpiece

I designed the machine vision system around locating workpieces on the pallet, where a fixed pick position was not enough.

Connect vision to movement

I designed the application architecture and programmed the robot to perform the pick-and-place task, connecting the software work to the physical cell.

Bring the disciplines together

The project combined machine vision, application development, and robot programming. I also managed the team working on the solution.

04 / Delivery

What it enabled

The robot could pick workpieces from varying positions on the pallet and place them in the CNC machine using the machine vision system.

Engineering perspective

Software becomes tangible when a coordinate turns into a physical movement.

Tools & technologies

  • C#
  • SQL
  • Machine Learning
  • Machine Vision
  • Open CV
Next case study / Quadrivia AIOrchestrating patient communication