Smear image acquisition and analysis system
1. A smear image acquisition and analysis system comprising:
the objective table is used for bearing the cell smear;
the motor control device is connected with the object stage and used for controlling the object stage to move in a three-dimensional space, and the motor control device comprises:
a transmission mechanism for controlling the object stage to move in a three-dimensional space,
a motor respectively connected with the transmission mechanism and the main controller, for controlling the transmission mechanism and driving the transmission mechanism based on the defocusing measurement value detected by the image quality detection device,
an LED array circuit connected to the main controller for providing illumination to the stage and varying the intensity of the illumination based on the brightness detected by the image quality detection device,
the limit detection sensor is connected with the main controller and is used for detecting whether the edge of the cell smear is positioned in the visual field of the microscope;
an objective lens switching device;
the microscope is connected with the objective lens conversion device and is used for observing the cell smear;
the camera is connected with the microscope and is used for shooting an image observed by the microscope;
an image quality detection apparatus connected to the camera, for controlling photographing of the camera, receiving an image photographed by the camera, and detecting a defocus value and brightness of the image, the image quality detection apparatus comprising:
a camera driving circuit connected to the camera for driving the camera,
the image transmission circuit is connected with the camera driving circuit and is used for acquiring images shot by the camera, preprocessing the images and transmitting the images to the first controller to be transmitted to the image quality detection device through the main controller,
the microprocessor is connected with the main controller, is respectively connected with the camera and the camera driving circuit, and is used for calculating a defocusing metric value according to images shot by the camera when the microscope is at different heights from the objective table, and sending the defocusing metric value to the main controller through the image transmission circuit, so that the main controller can control the motion of the motor control device according to the defocusing metric value; and the circuit is used for calculating the brightness of the image shot by the camera and the complexity of the image, and sending the brightness and the complexity to the main controller through the image transmission circuit so that the main controller can control the LED array circuit according to the brightness and the complexity;
the main controller is respectively connected with the image quality detection device, the objective lens conversion device and the motor control device, is used for receiving the defocusing measurement value and the brightness of the image quality detection device to control the motor control device, and is used for controlling the objective lens conversion device to perform objective lens conversion; and
the image analysis device is connected with the main controller and is used for receiving the images transmitted by the image quality detection device and splicing and analyzing the images;
the main controller is configured to perform an initialization step, the initialization step including:
an object stage initialization step: controlling the objective lens switching device to align a low power objective lens with the objective table, and controlling the motor control device to make the objective table reach a position closest to the low power objective lens and align a scanning origin of the cell smear with the low power objective lens;
a first focus adjustment step: controlling the motor control device to enable the objective lens to be far away from the objective lens in the vertical direction to a first preset distance, receiving the first low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the first low-power image to obtain a first defocusing metric value; controlling the motor control device to enable the objective lens to be continuously far away from the objective lens in the vertical direction to a second preset distance, receiving a second low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the second low-power image to obtain a second defocusing metric value; when the first defocusing measurement value is smaller than the second defocusing measurement value, continuing the motor control device to enable the objective table to be away from the objective lens in the vertical direction and receive the low-power image obtained by shooting of the camera until the defocusing measurement value obtained through calculation is larger than or equal to the defocusing measurement value obtained through the next calculation, and taking the position with the largest defocusing measurement value as an in-focus position; and
and a brightness adjusting step: receiving the brightness of the image and the complexity of the image sent by a brightness detection circuit, and controlling an LED array circuit to increase the illumination intensity under the condition that the brightness of the image is smaller than a first threshold and the complexity of the image is smaller than a second threshold, wherein the first threshold and the second threshold are set to adjust the brightness of a light source by simultaneously considering the sensitivity of human eyes to the brightness and the complexity of the image, so that the image is clearer;
the complexity of the image is calculated by using a weighted average of absolute values of differences between the luminance values of the pixels of the low-magnification image and the luminance average of the low-magnification image.
2. The system of claim 1, wherein the master controller, after performing the initialization step, further performs an under-image transfer step, the under-image transfer step comprising:
controlling the motor control device to control the object stage by a first further distance, so that a camera shoots the cell smear according to rows and obtains a low-power image, and transmitting the low-power image, the low-power image number and corresponding object stage coordinates to the image analysis device;
and under the condition that a limit detection sensor detects that the edge of the cell smear is positioned in the visual field of the microscope, receiving an edge detection signal sent by the limit detection sensor, controlling the motor control device to enable the cell smear to move for a pixel block distance in the direction vertical to the row on the horizontal plane, and then shooting the next row.
3. The system of claim 2, wherein the main controller further performs a high power image transfer step after performing the low power image transfer step, the high power image transfer step comprising:
under the condition that the image analysis device splices and analyzes all low-power images transmitted by the main controller to obtain at least one interesting low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned with the objective table, and the motor control device is controlled to enable the objective table to move to an objective table coordinate position corresponding to the at least one interesting low-power image on a horizontal plane;
in the case where the camera takes a high power image of the cell smear corresponding to the at least one low power image of interest, the high power image is received and the high power image, a high power image number and corresponding stage coordinates are transmitted to the image analysis device.
4. The system of claim 3, wherein the main controller further performs a high power image transfer step after performing the low power image transfer step, the high power image transfer step comprising:
under the condition that the image analysis device splices and analyzes all the low-power images transmitted by the main controller to obtain at least one interested low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned to the objective table, and the coordinate range of the motor control device for controlling the movement of the objective table is calculated based on the at least one interested low-power image and the corresponding objective table coordinate according to the relation between the low-power objective lens and the high-power objective lens;
controlling the motor control device to control the object stage by a second stepping distance so that the object stage moves in the coordinate range, wherein the second stepping distance is smaller than the first stepping distance;
and under the condition that the camera shoots the cell smear and obtains a high-power image, receiving the high-power image and transmitting the high-power image to the image analysis device, so that the image analysis device can splice and analyze the high-power image.
5. The system of claim 4, wherein the image analysis device comprises: a memory, a processor and a display device, the processor being connected to the memory and the display device, respectively, wherein,
a database is stored in the memory, and historical images with the same source as the cell smear are stored in the database;
the processor is connected with the main controller and used for receiving the image transmitted by the image quality detection device, comparing the image with historical images in the database and judging the types of cells in the image;
the display device is used for displaying the judgment result of the processor.
6. The system of claim 5, wherein the memory further stores a computer program executable by the processor, wherein the processor, when executing the computer program, performs the steps of:
low-power image splicing: and receiving the macroscopic image, the macroscopic image number and the corresponding objective table coordinate sent by the main controller, and splicing the macroscopic image into a complete macroscopic image of the cell smear according to the macroscopic image number and the corresponding objective table coordinate.
7. The system of claim 6, wherein after the low power image stitching step, the processor when executing the computer program further performs the steps of:
an image segmentation step: and carrying out image segmentation on the complete low-power image, carrying out black-and-white reverse color processing, obtaining the outer contour of the region of interest through edge detection, taking the low-power image containing the outer contour as the interesting low-power image, and sending the number of the interesting low-power image and the corresponding objective table coordinate to the main controller.
Background
To diagnose whether a patient suffers from or is predisposed to cancer, it is necessary to remove a cell sample from the patient and to perform a thorough analysis of the cell sample in order to assess whether abnormal or abnormal cells are present. The pathologist or other skilled medical practitioner makes a diagnosis based primarily on the specific characteristics of the cells in the sample. These cytological tests are based on the two-dimensional representation of the cells present in the sample and mostly require the immobilization of the cells on a matrix and the visualization of specific features of the cells using dyes or stains. In the prior art, although automatic processing of sampling, smear preparation or cell identification exists, the actual judgment also needs the participation of medical staff, for example, the control of a stage, the judgment of cell identification, the preparation of an analysis report and the like, and the detection efficiency and the result accuracy are influenced due to the difference of the levels of the medical staff.
Disclosure of Invention
It is an object of the present application to overcome the above problems or to at least partially solve or mitigate the above problems.
According to one aspect of the present application, there is provided a smear image acquisition and analysis system comprising:
the objective table is used for bearing the cell smear;
the motor control device is connected with the objective table and used for controlling the objective table to move in a three-dimensional space;
an objective lens switching device;
the microscope is connected with the objective lens conversion device and is used for observing the cell smear;
the camera is connected with the microscope and is used for shooting an image observed by the microscope;
the image quality detection device is connected with the camera and used for controlling shooting of the camera, receiving an image shot by the camera and detecting a defocusing measurement value and brightness of the image;
the main controller is respectively connected with the image quality detection device, the objective lens conversion device and the motor control device, is used for receiving the defocusing measurement value and the brightness of the image quality detection device to control the motor control device, and is used for controlling the objective lens conversion device to perform objective lens conversion; and
and the image analysis device is connected with the main controller and is used for receiving the images transmitted by the image quality detection device and splicing and analyzing the images.
The system can automatically photograph the cell smear through the cooperation of the microscopic imaging device and the main controller, analyzes the image quality, adjusts the illumination, obtains clear images, can obtain complete cell smear photos through image splicing, and can perform image analysis more completely and comprehensively.
Optionally, the motor control device comprises:
the transmission mechanism is used for controlling the object stage to move in a three-dimensional space;
the motor is respectively connected with the transmission mechanism and the main controller, is used for controlling the transmission mechanism, and drives the transmission mechanism based on the defocusing measurement value detected by the image quality detection device;
an LED array circuit connected to the main controller for providing illumination to the stage and varying the intensity of the illumination based on the brightness detected by the image quality detection device; and
and the limiting detection sensor is connected with the main controller and is used for detecting whether the edge of the cell smear is positioned in the visual field of the microscope.
Optionally, the image quality detection apparatus includes:
a camera driving circuit connected to the camera for driving the camera;
the image transmission circuit is connected with the camera driving circuit and used for acquiring images shot by the camera, preprocessing the images and transmitting the images to the first controller and transmitting the images to the image quality detection device through the main controller; and
the microprocessor is connected with the main controller, is respectively connected with the camera and the camera driving circuit, and is used for calculating a defocusing metric value according to images shot by the camera when the microscope is at different heights from the objective table, and sending the defocusing metric value to the main controller through the image transmission circuit, so that the main controller can control the motion of the motor control device according to the defocusing metric value; and the LED array circuit is used for calculating the brightness of the image shot by the camera and the complexity of the image, and sending the brightness and the complexity to the main controller through the image transmission circuit, so that the main controller can control the LED array circuit according to the brightness and the complexity.
Optionally, the main controller is configured to perform an initialization step, the initialization step including:
an object stage initialization step: controlling the objective lens switching device to align a low power objective lens with the objective table, and controlling the motor control device to make the objective table reach a position closest to the low power objective lens and align a scanning origin of the cell smear with the low power objective lens;
a first focus adjustment step: controlling the control motor control device to enable the objective lens to be far away from the objective lens in the vertical direction to a first preset distance, receiving a first low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the first low-power image to obtain a first defocusing metric value; controlling the control motor control device to enable the objective table to keep away from the objective lens in the vertical direction to a second preset distance, receiving a second low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the second low-power image to obtain a second defocusing metric value; when the first defocus metric value is smaller than the second defocus metric value, continuing to control the motor control device to enable the objective table to be away from the objective lens in the vertical direction and receive the low-power image obtained by shooting by the camera until the calculated defocus metric value is larger than or equal to the defocus metric value obtained by the next calculation, and taking the position with the largest defocus metric value as the focusing position; and
and a brightness adjusting step: and receiving the brightness of the image and the complexity of the image sent by the brightness detection circuit, and controlling the LED array circuit to increase the illumination intensity when the brightness of the image is less than a first threshold value and the complexity of the image is less than a second threshold value.
Optionally, after the initialization step, the main controller further performs a low-power image transmission step, where the low-power image transmission step includes:
controlling the motor control device to control the object stage by a first further distance, so that a camera shoots the cell smear according to rows and obtains a low-power image, and transmitting the low-power image, the low-power image number and corresponding object stage coordinates to the image analysis device;
and under the condition that a limit detection sensor detects that the edge of the cell smear is positioned in the visual field of the microscope, receiving an edge detection signal sent by the limit detection sensor, controlling the motor control device to enable the cell smear to move for a pixel block distance in the direction vertical to the row on the horizontal plane, and then shooting the next row.
Optionally, after the low-power image transmission step, the main controller further performs a high-power image transmission step, where the high-power image transmission step includes:
under the condition that the image analysis device splices and analyzes all low-power images transmitted by the main controller to obtain at least one interesting low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned with the objective table, and the motor control device is controlled to enable the objective table to move to an objective table coordinate position corresponding to the at least one interesting low-power image on a horizontal plane;
in the case where the camera takes a high power image of the cell smear corresponding to the at least one low power image of interest, the high power image is received and the high power image, a high power image number and corresponding stage coordinates are transmitted to the image analysis device.
Optionally, after the low-power image transmission step, the main controller further performs a high-power image transmission step, where the high-power image transmission step includes:
under the condition that the image analysis device splices and analyzes all the low-power images transmitted by the main controller to obtain at least one interested low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned to the objective table, and the coordinate range of the motor control device for controlling the movement of the objective table is calculated based on the at least one interested low-power image and corresponding objective table coordinates according to the relationship between the low-power objective lens and the high-power objective lens;
controlling the motor control device to control the object stage by a second stepping distance so that the object stage moves in the coordinate range, wherein the second stepping distance is smaller than the first stepping distance;
and under the condition that the camera shoots the cell smear and obtains a high-power image, receiving the high-power image and transmitting the high-power image to the image analysis device, so that the image analysis device can splice and analyze the high-power image.
Optionally, the image analysis apparatus comprises: a memory, a processor and a display device, the processor being connected to the memory and the display device, respectively, wherein,
a database is stored in the memory, and historical images with the same source as the cell smear are stored in the database;
the processor is connected with the main controller and used for receiving the image transmitted by the image quality detection device, comparing the image with historical images in the database and judging the types of cells in the image;
the display device is used for displaying the judgment result of the processor.
Optionally, the memory further stores a computer program executable by the processor, wherein the processor executes the computer program to implement the following steps:
low-power image splicing: and receiving the macroscopic image, the macroscopic image number and the corresponding objective table coordinate sent by the main controller, and splicing the macroscopic image into a complete macroscopic image of the cell smear according to the macroscopic image number and the corresponding objective table coordinate.
Optionally, after the low-magnification image stitching step, the processor executes the computer program to further implement the following steps:
an image segmentation step: and carrying out image segmentation on the complete low-power image, carrying out black-and-white reverse color processing, obtaining the outer contour of the region of interest through edge detection, taking the low-power image containing the outer contour as the interesting low-power image, and sending the number of the interesting low-power image and the corresponding objective table coordinate to the main controller.
The above and other objects, advantages and features of the present application will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.
Drawings
Some specific embodiments of the present application will be described in detail hereinafter by way of illustration and not limitation with reference to the accompanying drawings. The same reference numbers in the drawings identify the same or similar elements or components. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the drawings:
FIG. 1 is a schematic block diagram of a smear image acquisition and analysis system according to the present application;
FIG. 2 is a schematic block diagram of a motor control device of the system according to the present application;
FIG. 3 is a schematic block diagram of an image quality detection device of a system according to the present application;
fig. 4 is a schematic configuration diagram of an image analysis apparatus of the system according to the present application.
Detailed Description
The above and other objects, advantages and features of the present application will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.
Embodiments of the present application provide a smear image acquisition and analysis system. FIG. 1 is a schematic block diagram of a smear image acquisition and analysis system according to the present application. The system comprises: the objective table is used for bearing the cell smear; the motor control device is connected with the objective table and used for controlling the objective table to move in a three-dimensional space; an objective lens switching device; the microscope is connected with the objective lens conversion device and is used for observing the cell smear; the camera is connected with the microscope and is used for shooting an image observed by the microscope; the image quality detection device is connected with the camera and used for controlling shooting of the camera, receiving an image shot by the camera and detecting a defocusing measurement value and brightness of the image; the main controller is respectively connected with the image quality detection device, the objective lens conversion device and the motor control device, is used for receiving the defocusing measurement value and the brightness of the image quality detection device to control the motor control device, and is used for controlling the objective lens conversion device to perform objective lens conversion; and the image analysis device is connected with the controller and is used for receiving the image transmitted by the image quality detection device and splicing and analyzing the image.
The object stage, the motor control device, the objective lens conversion device, the microscope, the camera and the image quality detection device form a microscopic imaging device.
The system can automatically photograph the cell smear through the cooperation of the microscopic imaging device and the main controller, analyzes the image quality, adjusts the illumination, obtains clear images, can obtain complete cell smear photos through image splicing, and can perform image analysis more completely and comprehensively.
Fig. 2 is a schematic block diagram of a motor control device of the system according to the present application. Optionally, the motor control device comprises: the transmission mechanism is used for controlling the object stage to move in a three-dimensional space; the motor is respectively connected with the transmission mechanism and the main controller, is used for controlling the transmission mechanism, and drives the transmission mechanism based on the defocusing measurement value detected by the image quality detection device; an LED array circuit connected to the main controller for providing illumination to the stage and varying the intensity of the illumination based on the brightness detected by the image quality detection device; and the limit detection sensor is connected with the main controller and is used for detecting whether the edge of the cell smear is positioned in the visual field of the microscope.
Optionally, the main controller controls the programmable LED array circuit to display the required illumination intensity through the COM1 communication port; controlling a motor through a COM2 communication port to drive a transmission mechanism to change the position of the cell smear from the microscope; the image quality detection device provides a trigger signal through the level conversion chip to trigger the camera to work. The motor control device defines a data protocol based on serial port transmission. In the LED array circuit driving data protocol, a main controller sends a control command to an LED array circuit through a COM1 communication port to control the working state of the LED array circuit, so that the LED array circuit outputs different working mode signals to a programmable LED array for display. The operation modes may include: the system comprises a dark light mode, a strong light mode, a light field mode, a differential imaging mode and a user-defined mode, wherein under the user-defined mode, the light intensity can realize multi-level conversion.
Adopt motor control device can enough control the smear position, can control illumination intensity again to can obtain clear image.
Fig. 3 is a schematic configuration diagram of an image quality detection apparatus of the system according to the present application. Optionally, the image quality detection apparatus includes: a camera driving circuit connected to the camera for driving the camera; the image transmission circuit is connected with the camera driving circuit and used for acquiring images shot by the camera, preprocessing the images and transmitting the images to the first controller and transmitting the images to the image quality detection device through the main controller; the microprocessor is connected with the main controller, is respectively connected with the camera and the camera driving circuit, and is used for calculating a defocusing metric value according to images shot by the camera when the microscope is at different heights from the objective table, and sending the defocusing metric value to the main controller through the image transmission circuit, so that the main controller can control the motion of the motor control device according to the defocusing metric value; and the LED array circuit is used for calculating the brightness of the image shot by the camera and the complexity of the image, and sending the brightness and the complexity to the main controller through the image transmission circuit, so that the main controller can control the LED array circuit according to the brightness and the complexity.
Through this image quality detection device, can carry out the analysis to the image of shooing to judge whether the light intensity of LED array circuit is suitable, thereby shoot out more clear image.
Optionally, the main controller is configured to perform an initialization step, the initialization step including:
an object stage initialization step: controlling the objective lens switching device to align a low power objective lens with the objective table, and controlling the motor control device to make the objective table reach a position closest to the low power objective lens and align a scanning origin of the cell smear with the low power objective lens;
a first focus adjustment step: controlling the control motor control device to enable the objective lens to be far away from the objective lens in the vertical direction to a first preset distance, receiving a first low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the first low-power image to obtain a first defocusing metric value; controlling the control motor control device to enable the objective table to keep away from the objective lens in the vertical direction to a second preset distance, receiving a second low-power image obtained by shooting through the camera, and calculating the sum of gray difference absolute values of the second low-power image to obtain a second defocusing metric value; when the first defocus metric value is smaller than the second defocus metric value, continuing to control the motor control device to enable the objective table to be away from the objective lens in the vertical direction and receive the low-power image obtained by shooting by the camera until the calculated defocus metric value is larger than or equal to the defocus metric value obtained by the next calculation, and taking the position with the largest defocus metric value as the focusing position; and
and a brightness adjusting step: and receiving the brightness of the image and the complexity of the image sent by the brightness detection circuit, and controlling the LED array circuit to increase the illumination intensity when the brightness of the image is less than a first threshold value and the complexity of the image is less than a second threshold value.
In the method, for a first low-magnification image shot by a camera, a defocus metric function is adopted to calculate a first defocus metric value, and the defocus metric function adopts a gray variance function of a gray gradient operator, namely, second-order partial derivatives are calculated in XY directions. The horizontal position of the objective table is unchanged, the vertical position is reduced, for a second low-power image shot by the camera, a second out-of-focus metric value is calculated by adopting an out-of-focus metric function, if the first out-of-focus metric value is smaller than the second out-of-focus metric value, the objective table is continuously reduced, the low-power image is continuously obtained, the out-of-focus metric value of the low-power image obtained every time is compared with the previous value, until the out-of-focus metric value obtained when the objective table is adjusted for a certain time is larger than the out-of-focus metric value obtained when the objective table is adjusted for the next time, the objective table is adjusted to the position of the time, focusing is finished, if the out-of-focus metric value obtained when the objective table is adjusted for a certain time is equal to the out-of-focus metric value obtained when the objective table is adjusted for the next time, and the position of the objective table at the next time is used as the focal position.
It is understood that, in addition to using the gray variance function, the defocus metric function can be implemented using a Brenner gradient function, a Tenengrad gradient function, a Laplacian gradient function, a variance function, an energy gradient function, an entropy function, and a Vollath function.
The complexity of the image is calculated using a weighted average of the absolute values of the differences between the luminance values of the pixels of the low-magnification image and the luminance average of the low-magnification image.
The human eye is more sensitive to image quality degradation on low frequency images than high frequency images, and at the same time, images with high complexity have high spatial frequencies, and the human eye is not easily aware of the image quality degradation. As for the brightness, the eye is likely to perceive the image quality deterioration in the dark area, and is less likely to perceive the image quality deterioration in the bright area. The purpose of setting the first threshold and the second threshold is therefore to adjust the brightness of the light source taking into account the sensitivity of the human eye to the brightness and complexity of the image at the same time, so that the image is more clearly imaged.
Optionally, after the initialization step, the main controller further performs a low-power image transmission step, where the low-power image transmission step includes:
controlling the motor control device to control the object stage by a first further distance, so that a camera shoots the cell smear according to rows and obtains a low-power image, and transmitting the low-power image, the low-power image number and corresponding object stage coordinates to the image analysis device;
and under the condition that a limit detection sensor detects that the edge of the cell smear is positioned in the visual field of the microscope, receiving an edge detection signal sent by the limit detection sensor, controlling the motor control device to enable the cell smear to move for a pixel block distance in the direction vertical to the row on the horizontal plane, and then shooting the next row.
Wherein, the corresponding object stage coordinate can be calculated by the movement of the motor control device. The motor control device scans the image in a zigzag sequence, scans one line first, moves the object stage to the end of the second line, scans from the end of the second line to the starting point of the second line, moves to the third line, and so on until the scanning is finished. The limit detection sensor can be an infrared laser geminate transistor and is respectively arranged on the objective lens conversion device and a microscope support below the objective table, the middle of the general objective table is a transparent part, and the periphery of the transparent part is a non-transparent part. When the object stage moves, the infrared laser pair tube is relatively static. If the transparent part is positioned under the objective lens, the infrared laser geminate transistor is connected, and if the non-transparent part is positioned under the objective lens, the infrared laser geminate transistor is not connected, so that the fact that the edge of the cell smear is reached is judged. Adopt spacing detection sensor can adapt to the objective table that transparent part area is different to adapt to the cell smear of not using the size.
Optionally, after the low-power image transmission step, the main controller further performs a high-power image transmission step, where the high-power image transmission step includes:
under the condition that the image analysis device splices and analyzes all low-power images transmitted by the main controller to obtain at least one interesting low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned with the objective table, and the motor control device is controlled to enable the objective table to move to an objective table coordinate position corresponding to the at least one interesting low-power image on a horizontal plane;
in the case where the camera takes a high power image of the cell smear corresponding to the at least one low power image of interest, the high power image is received and the high power image, a high power image number and corresponding stage coordinates are transmitted to the image analysis device.
And (3) obtaining a suspicious cell area in the low-power image through image analysis, and preparing to observe the suspicious area under the high-power objective lens, wherein the main controller can calculate the operation instruction of the motor and the position of the objective table required to move according to the position of the interested low-power image, so that the corresponding area on the cell smear is positioned under the high-power objective lens. Because the stepping frequency of the motor is different and the moving speed of the objective table is different under the low-power objective lens and the high-power objective lens, the main control computer can calculate the moving times, distance and moving range of the objective table according to the position of the low-power image.
Optionally, after the low-power image transmission step, the main controller further performs a high-power image transmission step, where the high-power image transmission step includes:
under the condition that the image analysis device splices and analyzes all the low-power images transmitted by the main controller to obtain at least one interested low-power image, the objective lens conversion device is controlled to enable the high-power objective lens to be aligned to the objective table, and the coordinate range of the motor control device for controlling the movement of the objective table is calculated based on the at least one interested low-power image and corresponding objective table coordinates according to the relationship between the low-power objective lens and the high-power objective lens;
controlling the motor control device to control the object stage by a second stepping distance so that the object stage moves in the coordinate range, wherein the second stepping distance is smaller than the first stepping distance;
and under the condition that the camera shoots the cell smear and obtains a high-power image, receiving the high-power image and transmitting the high-power image to the image analysis device, so that the image analysis device can splice and analyze the high-power image.
Fig. 4 is a schematic configuration diagram of an image analysis apparatus of the system according to the present application. Optionally, the image analysis apparatus comprises: a memory, a processor and a display device, the processor being connected to the memory and the display device, respectively, wherein,
a database is stored in the memory, and historical images with the same source as the cell smear are stored in the database;
the processor is connected with the main controller and used for receiving the image transmitted by the image quality detection device, comparing the image with historical images in the database and judging the types of cells in the image;
the display device is used for displaying the judgment result of the processor.
For example, the source of the cell smear is plant, animal or human, and the historical image data of the cell smear before the source is stored in the database, wherein the historical image data is analyzed, classified and counted. When the cell smear is analyzed at this time, the cell smear is compared with historical data, and the classification of the cells can be rapidly judged, so that the processing and analyzing speed is improved.
Optionally, the memory further stores a computer program executable by the processor, wherein the processor executes the computer program to implement the following steps:
low-power image splicing: and receiving the macroscopic image, the macroscopic image number and the corresponding objective table coordinate sent by the main controller, and splicing the macroscopic image into a complete macroscopic image of the cell smear according to the macroscopic image number and the corresponding objective table coordinate.
Optionally, after the low-magnification image stitching step, the processor executes the computer program to further implement the following steps:
an image segmentation step: and carrying out image segmentation on the complete low-power image, carrying out black-and-white reverse color processing, obtaining the outer contour of the region of interest through edge detection, taking the low-power image containing the outer contour as the interesting low-power image, and sending the number of the interesting low-power image and the corresponding objective table coordinate to the main controller.
After the image segmentation step, the processor may further perform a feature extraction step, the image features including: gray scale, roundness, area, perimeter, major axis length, minor axis length, compactness, eccentricity and the like.
And (3) classification step: and respectively calculating the influence factors of each characteristic by adopting a python decision tree to obtain a calculation formula of the cell, and screening out the target cell.
The image analysis device stores all target cell outputs as a first result. And comparing the data such as the number of the cells, the average area of the cells, the average gray value of the cells and the like with the historical data respectively by combining the historical data to generate a corresponding change trend chart as a second result. And generating a corresponding chart of the partial characteristic values of the image as a third diagnosis result, for example, a histogram of the cell area corresponding to the number of cells. These results are saved in a database and can be printed by a printer.
And inputting the first result, the second result and the third result into the trained artificial neural network, so as to obtain health indexes of plants, animals and human bodies. The artificial neural network is obtained by repeatedly training the neural network by using a large number of results.
The above description is only for the preferred embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
- 上一篇:石墨接头机器人自动装卡簧、装栓机
- 下一篇:组合的样品检查