Computer Vision Solution for a Large Industrial Client
Employee safety is an important focus of every industrial plant which makes it essential for companies to track the compliance of personal safety. Many organizations are putting forth a significant effort into implementing automation systems that use AI to track and document whether employees are complying with personal safety requirements. This is a complex effort which involves many studies of AI. First Line Software has already taken part in one of those studies.
The Task
The client requested that First Line use the existing live video streaming capabilities of its CCTV cameras as the foundation for implementing an AI capability to monitor whether the company’s safety requirements were being met. This required that the AI system be able to identify specific plant production lines, employees, and key safety elements.
The Process
The First Line Software engineers created a convolutional neural network and taught it to identify the specific staff members, safety equipment elements (helmets, safety jackets, etc.) and the production line types, using the live stream from the CCTV cameras.
The pilot version of the system can track and react to the three most common scenarios of human behavior:
- Whether the staff is wearing the necessary safety equipment (helmet and safety jackets)
- Whether the individual has covered his helmet with a hood (which is strictly forbidden)
- Whether an individual has attached a rope when performing high-altitude work
Dataset
The typical problem of this type of research task is the lack of exact cases and the scenarios which can be used to “teach” the neural network. In order to solve this challenge, First Line had to create all the potential positive and negative scenarios of an individual’s behavior. The process also involved analyzing and creating 56 models of human behavior that could be displayed on-site at the plant.
As you can see in the photos, some of the employees were fully equipped and met the safety requirements, while some part of employees did not. The system uses 12 pivot points to analyze each individual and additional pivot points to analyze the safety equipment. Each video frame has a specific color identification as well as the text frame. In addition, the viewer can see the in-plant location trigger.
Object recognition
The algorithm developed by First Line analyzes the data in three steps. The first step is to analyze the CCTV captured frame and analyze the human presence. If a human is detected the algorithm pushes the frame to the convolutional neural network. Once this step is completed the network uses the pivot points to identify the person and the safety equipment elements – helmets and/or a safety rope. Using the “support vector” algorithm, the program compares the captured image of the person with the scheme, which is stored in database. If the algorithm detects that the safety rules have been broken, it transmits a message to the management staff.
The technology
In order to achieve the best results, First Line used Mask R-CNN (Detection Platform) to analyze the captured frames. This framework was chosen because it was the best fit for the required task and can identify and highlight objects with the frames. We taught the neural network using the transfer learning script. This script was chosen since there are no requirements to collect statistics about the completed work or the number of workers at the plant, and no need to identify the specific department where each employee spends the majority of their time at work.
The result
First Line was able to achieve the sustainable analytics of the live video with the ability to detect the objects and classification of the same. The detection ratio varies from 77 to 100 percent. The pilot project showed great results and the customer is currently running in-debt testing on their premises.
Request documents
Request project documents
related projects
Image Recognition Solution for a Media Company
Our customer asked our engineers to develop an online system that could identify and recognize military equipment in a photograph.
Show details
Machine Learning for Data Governance in a Hospital Setting
Wide-spread adoption of EHR systems brings along large amount of data available for reporting and other analytical insights. Health organizations routinely generate thousands of such analytical artifacts on daily or weekly basis.
Show details
Using Machine Learning to Solve Critical Challenges in Healthcare IT
Artificial Intelligence and Machine Learning are rapidly gaining momentum in Healthcare and - as some say - on the verge of becoming the most important breakthrough for healthcare since penicillin.
Show detailsNeed more details?
Fill in the form and we’ll contact you as soon as possible.
David Tedford has over 20 years of sales experience within the IT/software industry. He excels at being immersed in a customer's environment, understanding his customers requirements, crafting solutions to meet those requirements, and ultimately providing solutions to his customers.
As the head of business development for First Line Software, Vladimir heads up business development in Western Europe and Russia.
Vladimir began his career in IT in 2002, when, as a student of Faculty of Automation of Computer Science of the First Electrotechnical University (ETU “LETI”), he began his work at The Morfizpribor Central Research Institute (CRI). Vladimir joined the StarSoft team (predecessor of First Line Software) in 2004 as a Junior Software Developer. As he gained experience with more and more projects, he was promoted to leadership roles.
The Hague, Netherlands
Richard has over 15 years of sales and account management expertise in the IT and Tech sector. He has worked on many outsourcing engagements with global companies.
Gloucestershire, United Kingdom
David is a business development professional with more than 20 years’ experience as a specialist in the acquisition of partnerships and IT/software services for associations, not-for profits and corporations in Australia, New Zealand and USA. He has specific expertise in the healthcare, legal and hospitality industries.