FazBrowse Wikipedia Viewer | Main Page |
Search Wikipedia:
|
Viewing: https://en.wikipedia.org/wiki/Image_processing

Digital image processing

Contents
History
    Image sensors
    Image compression
    Digital signal processor (DSP)
    Affine transformations
        Results
    Digital camera images
    Film
    Face detection
    Improvement of image quality method

History

edit
digital picture processing as it was often called, were developed in the 1960s, at Bell Laboratories, the Jet Propulsion Laboratory (JPL), Massachusetts Institute of Technology, University of Maryland, and a few other research facilities, with applications in satellite imagery, wire-photo standards conversion, medical imaging, videophone, character recognition, and photograph enhancement. The purpose of early image processing was to improve the quality of the image. In image processing, the input is a low-quality image, and the output is an image with improved quality. Common image processing includes image enhancement, restoration, encoding, and compression. The first successful application was at JPL where they used image processing techniques such as geometric correction, gradation transformation, noise removal, etc. on the thousands of lunar photos sent back by Ranger 7 in 1964, taking into account the position of the Sun and the environment of the Moon. The impact of the successful mapping of the Moon's surface by the computer was a success. Later, more complex image processing was performed on the nearly 100,000 photos sent back by the spacecraft, so that the topographic map, color map and panoramic mosaic of the Moon were obtained, which achieved extraordinary results and laid a solid foundation for human landing on the Moon.

The cost of processing was fairly high, however, with the computing equipment of that era. That changed in the 1970s, when digital image processing proliferated as cheaper computers and dedicated hardware became available. This led to images being processed in real-time, for some dedicated problems such as television standards conversion. As general-purpose computers became faster, they started to take over the role of dedicated hardware for all but the most specialized and computer-intensive operations. With the fast computers and signal processors available in the 2000s, digital image processing has become the most common form of image processing, and is generally used because it is not only the most versatile method, but also the cheapest.

Image sensors

edit
 μm NMOS integrated circuit sensor chip. Since the first commercial optical mouse, the IntelliMouse introduced in 1999, most optical mouse devices use CMOS sensors.

Image compression

edit
as of 2015.

Medical imaging techniques produce very large amounts of data, especially from CT, MRI and PET modalities. As a result, storage and communication of electronic image data are prohibitive without the use of compression. JPEG 2000 image compression is used by the DICOM standard for storage and transmission of medical images. The cost and feasibility of accessing large image data sets over low or various bandwidths are further addressed by use of another DICOM standard, called JPIP, to enable efficient streaming of the JPEG 2000 compressed image data.

Digital signal processor (DSP)

edit

Affine transformations

edit

Affine transformations enable basic image transformations including scale, rotate, translate, mirror and shear as is shown in the following examples:

Transformation Name Affine Matrix Example
Identity [cx=2000cy=10001]
Rotate y are the row and column of a pixel in the image matrix. This allows the coordinate to be multiplied by an affine-transformation matrix, which gives the position that the pixel value will be copied to in the output image.

However, to allow transformations that require translation transformations, 3-dimensional homogeneous coordinates are needed. The third dimension is usually set to a non-zero constant, usually 1, allows translation.

Because matrix multiplication is associative, multiple affine transformations can be combined into a single affine transformation by multiplying the matrix of each individual transformation in the order that the transformations are done. This results in a single matrix that, when applied to a point vector, gives the same result as all the individual transformations performed on the vector (0, 0), then perform the rotation, and lastly translate the origin B=[121211103],B:𝒮→ℝ,𝒮={−1,0,1}2.

Here, B(m,n) bias the image during dilation and erosion.

Dilation
Grayscale dilation is defined as:

(f⊕B)(1,1)=max⁡(f(0,0)+B(−1,−1),45+1;f(1,0)+B(0,−1),50+2;f(2,0)+B(1,−1),65+1;f(0,1)+B(−1,0),40+2;f(1,1)+B(0,0),60+1;f(2,1)+B(1,0),55+1;f(0,2)+B(−1,1),25+1;f(1,2)+B(0,1),15+0;f(2,2)+B(1,1)5+3)=66.

Erosion
Grayscale erosion is defined as:

(f⊖B)(1,1)=min⁡(f(0,0)−B(−1,−1),45−1;f(1,0)−B(0,−1),50−2;f(2,0)−B(1,−1),65−1;f(0,1)−B(−1,0),40−2;f(1,1)−B(0,0),60−1;f(2,1)−B(1,0),55−1;f(0,2)−B(−1,1),25−1;f(1,2)−B(0,1),15−0;f(2,2)−B(1,1)5−3)=2.

Results

edit

After applying dilation to f: B would first reduce small details (through erosion) and then restore the main shapes (through dilation). This ensures that unwanted noise is removed without significantly altering the size or shape of larger objects.

  • Closing: This operation is performed by applying dilation first, followed by erosion. Closing is typically used to fill small holes or gaps within objects and to connect broken parts of the foreground. It works by initially expanding the boundaries of objects (through dilation) and then refining the boundaries (through erosion).

For instance, applying closing to the same image [111111111]

Use Matlab to dilation
imwrite(image,'scene_ero.jpg'); extractmin=zeros(size(image),class(image)); fori=1:time ero_image=imread('scene_ero.jpg'); forcol=(halfW+1):(c-halfW) forrow=(halfH+1):(r-halfH) pointDown=row-halfH; pointUp=row+halfH; pointLeft=col-halfW; pointRight=col+halfW; neighbor=ero_image(pointDown:pointUp,pointLeft:pointRight); filter=neighbor(se); extractmin(row,col)=min(filter); end end imwrite(extractmin,"scene_ero.jpg"); end
Opening [111111111] Use Matlab to Closing

Digital camera images

edit

Digital cameras generally include specialized digital image processing hardware – either dedicated chips or added circuitry on other chips – to convert the raw data from their image sensor into a color-corrected image in a standard image file format. Additional post-processing techniques increase edge sharpness or color saturation to create more naturally looking images.

Film

edit

Westworld (1973) was the first feature film to use digital image processing to pixellate photography to simulate an android's point of view. Image processing is also vastly used to produce the chroma key effect that replaces the background of actors with natural or artistic scenery.

Face detection

edit
Face detection process

Face detection can be implemented with mathematical morphology, the discrete cosine transform (DCT), and horizontal projection.

General method with feature-based method

The feature-based method of face detection uses skin tone, edge detection, face shape, and features of a face (like eyes, mouth, etc.) to achieve face detection. The skin tone, face shape, and all the unique elements that only the human face can be described as features.

Process explanation

  1. Given a batch of face images, first, extract the skin tone range by sampling face images. The skin tone range is just a skin filter.
    1. Structural similarity (SSIM) can be applied to compare images in terms of extracting the skin tone.
    2. Normally, HSV or RGB color spaces are suitable for the skin filter. E.g., in HSV mode, the skin tone range is [0,48,50] ~ [20,255,255]
  2. After filtering images with skin tone, to get the face edge, morphology and DCT are used to remove noise and fill up missing skin areas.
    1. Opening method or closing method can be used to fill in missing skin.
    2. DCT is used to avoid objects with skin-like tone. Since human faces always have higher texture.
    3. Sobel operator or other operators can be applied to detect face edges.
  3. To position human features like eyes, using the projection and finding the peak of the histogram of the projection helps to get the detailed features like mouth, hair, and lip.
    1. Projection is just projecting the image to see the high frequency, which is usually the feature position.

Improvement of image quality method

edit

Image quality can be influenced by camera vibration, overexposure, gray level distribution being too centralized, and noise, etc. For example, the noise problem can be solved by smoothing, while the gray level distribution problem can be improved by histogram equalization.

Smoothing method

In drawing, if there is a dissatisfied color, taking some color around the dissatisfied color and averaging them.

The smoothing method can be implemented with a mask and convolution. Take a small image and mask, for instance, as below.

image is [25653910619927322]

Observing image[1, 1], image[1, 2], image[2, 1], and image[2, 2].

The original image pixels are 1, 4, 28, 30. After the smoothing mask, the pixels become 9, 10, 9, 9, respectively.

new image[1, 1] = 19 * (5+6+5+1+4+6+28+30+2)) = 10

new image[2, 1] = floor(∑i=0kH(pi)(see figure 1), while the area of the uniform distribution is qi is ∫q0qN2qk−q0ds=∫p0pH(s)ds.

Moreover, based on the definition of a function, the Gray level histogram method is like finding a function

  1. ↑ Chakravorty, Pragnan (2018). "What is a Signal? [Lecture Notes]". IEEE Signal Processing Magazine. 35 (5): 175–177. Bibcode:2018ISPM...35e.175C. doi:10.1109/MSP.2018.2832195. S2CID 52164353.
  2. ↑ Yamni, Mohamed; Daoui, Achraf; Abd El-Latif, Ahmed A. (February 2024). "Efficient color image steganography based on new adapted chaotic dynamical system with discrete orthogonal moment transforms". Mathematics and Computers in Simulation. 225: 1170–1198. doi:10.1016/j.matcom.2024.01.023.
  3. ↑ Gonzalez, Rafael C. (2008). Digital image processing. Woods, Richard E. (Richard Eugene), 1954– (3rd ed.). Upper Saddle River, N.J.: Prentice Hall. pp. 23–28. ISBN 978-0-13-168728-8. OCLC 137312858.
  4. 1 2 3 KAHNG, D. (1961). "Silicon-Silicon Dioxide Surface Device". Technical Memorandum of Bell Laboratories: 583–596. doi:10.1142/9789814503464_0076. ISBN 978-981-02-0209-5.{{cite journal}}: ISBN / Date incompatibility (help)CS1 maint: periodical has ISBN (link)
  5. ↑ Lojek, Bo (2007). History of Semiconductor Engineering. Springer Science & Business Media. p. 120. ISBN 978-3-540-34258-8.
  6. ↑ Fossum, Eric R. (12 July 1993). "Active pixel sensors: Are CCDS dinosaurs?". In Blouke, Morley M. (ed.). Charge-Coupled Devices and Solid State Optical Sensors III. Proceedings of the SPIE. Vol. 1900. pp. 2–14. Bibcode:1993SPIE.1900....2F. doi:10.1117/12.148585. S2CID 10556755.
  7. ↑ Fossum, Eric R.; Hondongwa, D. B. (2014). "A Review of the Pinned Photodiode for CCD and CMOS Image Sensors". IEEE Journal of the Electron Devices Society. 2 (3): 33–43. Bibcode:2014IJEDS...2...33F. doi:10.1109/JEDS.2014.2306412.
  8. ↑ Lyon, Richard F. (August 1981). "The Optical Mouse, and an Architectural Methodology for Smart Digital Sensors" (PDF). In H. T. Kung; Robert F. Sproull; Guy L. Steele (eds.). VLSI Systems and Computations. Computer Science Press. pp. 1–19. doi:10.1007/978-3-642-68402-9_1. ISBN 978-3-642-68404-3. S2CID 60722329. Archived (PDF) from the original on 26 February 2014.
  9. ↑ Ahmed, Nasir (January 1991). "How I Came Up With the Discrete Cosine Transform". Digital Signal Processing. 1 (1): 4–5. Bibcode:1991DSP.....1....4A. doi:10.1016/1051-2004(91)90086-Z. Archived from the original on 10 June 2016. Retrieved 10 October 2019.
  10. ↑ Caplan, Paul (24 September 2013). "What Is a JPEG? The Invisible Object You See Every Day". The Atlantic. Archived from the original on 9 October 2019. Retrieved 13 September 2019.
  11. ↑ Dhouib, D.; Naït-Ali, A.; Olivier, C.; Naceur, M.S. (June 2021). "ROI-Based Compression Strategy of 3D MRI Brain Datasets for Wireless Communications". IRBM. 42 (3): 146–153. doi:10.1016/j.irbm.2020.05.001. S2CID 219437400. Because of the large amount of medical imaging data, the transmission process becomes complicated in telemedicine applications. Thus, in order to adapt the data bit streams to the constraints related to the limitation of the bandwidths a reduction of the size of the data by compression of the images is essential.
  12. ↑ Shirriff, Ken (30 August 2016). "The Surprising Story of the First Microprocessors". IEEE Spectrum. 53 (9). Institute of Electrical and Electronics Engineers: 48–54. doi:10.1109/MSPEC.2016.7551353. S2CID 32003640. Archived from the original on 13 October 2019. Retrieved 13 October 2019.
  13. 1 2 Zhang, M. Z.; Livingston, A. R.; Asari, V. K. (2008). "A High Performance Architecture for Implementation of 2-D Convolution with Quadrant Symmetric Kernels". International Journal of Computers and Applications. 30 (4): 298–308. doi:10.1080/1206212x.2008.11441909. S2CID 57289814.
  14. 1 2 Solomon, C.J.; Breckon, T.P. (2010). Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab. Wiley-Blackwell. doi:10.1002/9780470689776. ISBN 978-0-470-84473-1.
  15. Rafael C. Gonzalez; Richard E. Woods; Steven L. Eddins (2004). Digital Image Processing using MATLAB. Pearson Education. ISBN 978-81-7758-898-9.
  16. Milan Sonka; Vaclav Hlavac; Roger Boyle (1999). Image Processing, Analysis, and Machine Vision. PWS Publishing. ISBN 978-0-534-95393-5.

View original on Wikipedia | Back | FazBrowse Home