SlideShare a Scribd company logo
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
DOI : 10.5121/ijit.2015.4101 1
AN EFFICIENT FUSION BASED UP-SAMPLING
TECHNIQUE FOR RESTORATION OF SPATIALLY
COMPRESSED IMAGES
Girinandini Sahoo1
and Aditya Acharya2
Department of Electronics and Telecommunication Engineering
Silicon Institute of Technology, Bhubaneswar, Odisha, India
ABSTRACT
The various up-sampling techniques available in the literature produce blurring artifacts in the up-
sampled, high resolution images. In order to overcome this problem effectively, an image fusion based
interpolation technique is proposed here to restore the high frequency information. The Discrete Cosine
Transform interpolation technique preserves low frequency information whereas Discrete Sine Transform
preserves high frequency information. Therefore, by fusing the DCT and DST based up-sampled images,
more high frequency, relevant information of both the up-sampled images can be preserved in the restored,
fused image. The restoration of high frequency information lessens the degree of blurring in the fused
image and hence improves its objective and subjective quality. Experimental result shows the proposed
method achieves a Peak Signal to Noise Ratio (PSNR) improvement up to 0.9947dB than DCT
interpolation and 2.8186dB than bicubic interpolation at 4:1 compression ratio.
KEYWORDS
Interpolation, DCT, DST, Image Up-Sampling, Image fusion.
1. INTRODUCTION
Resolution of an image has been always an important issue in many images and video processing
application, such as video resolution enhancement, feature extraction and image resolution
enhancement. Interpolation in image processing is a method to increase the number of pixels in a
digital image. Many image interpolation schemes have been proposed in [1]-[4]. There are four
well-known interpolation techniques, namely, nearest neighbour, bilinear, bicubic, Lanczos.
Discrete Cosine Transform is also playing a significant role in many image processing
applications. The conventional discrete cosine transform (DCT) is used to perform two-
dimensional (2D) interpolation of real sequences. Similarly Discrete Sine Transform (DST) is
also used for interpolation. The 2-D Discrete Sine Transform of an image is performed by
applying the 1-D Discrete Sine Transform (DST) along the rows of the image first, and again in
the columns of the image. Literatures [5]-[7] is schemed a fusion technique. It can earn much
better objective quality comparing with simple bilinear, bicubic interpolation in spatial domain
and DCT, DST in frequency domain. The DCT interpolation technique preserves low frequency
information and DST preserves high frequency information. Therefore by unite the DST and
DCT based up-sampled images, both high and low frequency can be preserved in the restored up-
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
2
sampled image. As a result the fused image contains all the significant information of the input
images. The quality of the fused image is superior to any of the input images.
The rest of this paper is organized as follows: Section II provides a brief description of related
work which is used for image interpolation. A detail of the proposed fusion technique is described
in Section III. Section IV presents the experimental results to show the performance of the
proposed method. Section V concludes this paper.
2. RELATED WORK
Interpolation filters are used to interpolate new sample values at arbitrary time instants between
the existing discrete time samples. Bilinear and Bicubic interpolations are two simple up-
sampling techniques with low complexity. Bilinear interpolation is the combination of two linear
interpolations. The bicubic interpolation gives smother surface than bilinear interpolation. Hence,
such interpolation techniques often lead to several types of visual degradation in which the
blurring effect is one of the most noticeable artifacts.
DCT based interpolation gives better image’s visual quality. [8] It shows a signal or image can be
transformed from spatial domain to frequency domain using DCT. The DCT has the property
that, for a typical image, most of the visually significant information about the image is
concentrated in just a few coefficients of the DCT. For this reason, the DCT is often used in
image compression application. It preserves the low frequency components. Again the discrete
sine transform is a Fourier related transform similar to discrete Fourier transform (DFT), but
using a purely real matrix. It preserves the high frequency components. According to research
reported in [9]-[10], interpolation in compressed domain can produce better objective quality such
as PSNR than those with a simple bilinear, bicubic, DST based interpolation. Due to zero padding
in high frequency components usually lead to blocking artifacts.
Based on above investigation, we develop the weighted fusion technique. It estimates the high
frequency components from DST-based interpolation and combines them with low frequency
components derived directly from DCT-based interpolation. Thus, a complete frequency domain
reconstruction can be achieved by the fusion technique. The key idea in the proposed fusion
technique is to restore the high frequency components as well as the low frequency components
of the up-sampled image from frequency domain interpolation. Here a better execution is
supposed to achieve both in visual and objective quality so as to keep all the important
information (low, high frequency) of the interpolated image.
3. FUSION BASED INTERPOLTION
As discussed in section 2, any approach in either spatial or frequency domain, is applied to
achieve an interpolation that is high in both visual and objective quality. Since the high frequency
components are mostly contributed from sharp regions like edges. Therefore, fusion technique is
expected to achieve quality improvement in both visual and objective measures. We can also
apply fusion technique to both DCT and DST up-sampled images.
3.1. A. Image up-Sampling in DCT Domain
To implement up-sampling in DCT domain, we only need to add zeros in the high frequency
regions.DCT is calculated for an image of size NM × is given below:
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
3
( ) ( ) ( ) ( ) ( )
∑∑
−
=
−
=





 +





 +
=
1
0
1
0 2
12
cos
2
12
cos,
M
x
N
y N
vy
M
ux
vwuwvuc
ππ
(1)
where
3.2 B. Image up-Sampling in DST Domain
The 2-D Discrete Sine Transform of an image is performed by applying the 1-D Discrete Sine
Transform (DST) along the rows of the image first, and again in the columns of the image. DST
is calculated for an image of size NM × is give below:
( ) ( ) 





+






++
= ∑∑
−
=
−
= 1
sin.
1
sin.,
1
2
,
1
0
1
0 N
vy
M
ux
yxf
N
vuc
M
x
N
y
ππ
(2)
3.3. C. Fusion Based Interpolation Method
The process of image fusion the good information from each of the given images is fused together
to form a resultant image whose quality is superior to any of the input image. Image fusion is
applied in every field where image are ought to be analyzed. For example, medical image
analysis, microscopic imaging, analysis of image from satellite, remote sensing application,
computer vision, robotics etc. Due to limited focus depth of the optical lens it is often not possible
to get an image which contains all the relevant objects in focus. To obtain an image with every
object in focus a fusion process is required to fuse the images giving a better view for human or
machine perception. Block diagram for fusion process is shown in Fig.1.
Fig.1: Fusion based Interpolation
The 4:1 compressed image is interpolated by using the DST and DCT based interpolation
techniques. Then both DST and DCT up-sampled images are sharpened using Laplacian,
( ) ( ) ( ){ }yxfkyxfyxg ,,, 2
∇⋅+= (3)
where and denote sharpened image and weight factor respectively. The amount of image
sharpening is a function of weight factor k which ranges from 0 to 1. So, the blurring effect is
( ) ( )





≠≠
==
=
ovufor
N
ovufor
N
vwuw
,02
,01
,
Up sampled
image using
DCT
Interpolation
Weighted
sharpening
Up sampled
image using
DST
Interpolation
Weighted
sharpening
Image
fusion
Restored
Image
Sub
Sampled
Image
Sub
Sampled
Image
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
4
reduced considerably. In this proposed method a better PSNR value is achieved for DCT up-
sampled image at k=0.2, similarly at k=0.01 for DST up-sampled image the PSNR value remains
high. The sharpened images are fused together by using the weighted fusion technique. Finally,
the output is obtained in the form of restored image.
( ) ( ) ( )yxgkyxgkyxf ,,,ˆ
2211 ⋅+⋅= (4)
where, and are the sharpened images of DCT and DST up-sampled images respectively. The k1
and k2 are standardized as k1=0.95, k2=0.05 which is implemented to different images where a
high PSNR value is achieved. The flowchart of the proposed method is shown below:
Fig. 2 flowchart of proposed method
4. RESULTS AND DISCUSSION
The proposed technique has been tested on several different images and videos. Here, two quality
metrics are used to test the performance of the proposed algorithm. One metric is Peak Signal to
Noise Ratio (PSNR) and another is Root Mean Square Error (RMSE).
( ) ( )[ ]∑∑
−
=
−
=
−=
1
0
1
0
2
,ˆ,
1 M
x
N
y
yxfyxf
MN
MSE (5)
MSERMSE = (6)
( )
MSE
PSNRdB
2
10
255
log10= (7)
Fig. 2 flowchart of proposed method
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
5
4.1. Experimental results are tabulated in Table-1, Table-2 and Table-3.
TABLE-1: Describe RMSE values of different interpolation techniques.
IMAGES
RMSE
Bicubic DCT DST PROPOSED
METHOD
Cameraman 0.0428 0.0462 0.0543 0.0452
Mandrill 0.0342 0.0277 0.0374 0.0330
Pirate 0.0282 0.0264 0.0335 0.0258
Lena 0.0355 0.0337 0.0435 0.0330
Womandarkhair 0.0086 0.0079 0.0242 0.0077
Barbara 0.0540 0.0551 0.0594 0.0552
Boat 0.0318 0.0300 0.0364 0.0293
House 0.0229 0.0221 0.0381 0.0219
TABLE-2: Comparison between different interpolation techniques
IMAGES
PSNR(dB)
Bicubic DCT DST PROPOSED
METHOD
Cameraman 26.3320 26.7114 25.2983 26.8954
Mandrill 29.3243 31.1482 28.5383 32.1429
Pirate 31.0088 31.5531 29.4954 31.7791
Lena 28.9962 29.4411 27.2239 29.6291
Womandarkhair 41.2920 42.0834 32.3350 42.2730
Barbara 25.3521 25.1834 24.5267 25.1911
Boat 29.9515 30.4661 28.7703 30.6771
House 32.7884 33.1034 28.3715 33.1850
TABLE-3: Describe average PSNR values of different interpolation techniques for video intra frame.
VIDEOS
AVERAGE PSNR(dB)
Bicubic Lanczos DCT PROPOSED
METHOD
Coastguard 26.9185 27.2261 27.3210 27.5092
Football 25.1483 25.3806 25.5689 25.7384
Bus 25.2624 25.7167 25.7945 26.0532
Flower 19.3140 19.5015 19.4884 19.5880
Foreman 31.6336 32.0842 32.4367 32.7824
Hallmanitor 25.2644 25.6082 25.9646 26.2007
Ice 27.6814 28.0695 28.8634 29.2924
News 25.0578 25.4683 25.6087 25.8619
Salesman 28.9969 29.2500 29.3382 29.4858
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
6
4.2. Simulation results
(a) (b)
(c) (d)
Fig.3: Subjective Evaluation of House using different Interpolation Techniques: (a) source image (b)
Bicubic method (c) DCT method (d) Proposed Method.
From the experimental results, it is observed that the proposed method is giving better result (high
PSNR value).
Experiments are also performed with Cameraman and Lena images. Results are shown in
Fig.4and Fig. 5 respectively
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
7
(a) (b)
(c) (d)
Fig.4: Subjective Evaluation of Cameraman using different Interpolation Techniques: (a) source image (b)
Bicubic method (c) DCT method (d) Proposed Method.
(a) (b)
(c) (d)
Fig.5: Subjective Evaluation of Lena using different Interpolation Techniques: (a) Source image (b)
Bicubic method (c) DCT method (d) Proposed Method.
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
8
(a)
(b)
(c)
Fig.6. PSNR (dB) comparison of different sequences using different interpolation techniques at 4:1
compression ratio of :(a) coastguard (b) News (c) foreman.
International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015
9
Figure 6 represents the PSNR (dB) Vs frame index plot of different video sequences using
various interpolation techniques at 4:1 compression ratio. Experimental results show, the
proposed method yields better objective quality for different types of sequences having dissimilar
characteristics.
5. CONCLUSIONS
In this paper the proposed algorithm exploits the advantages of both spatial domain and frequency
domain processing for improved up-sampling performance in terms of PSNR (dB). The proposed
algorithm provides both subjective and objective improvement in comparison to other
interpolation techniques irrespective of change in the resolution and compression ratio. In the
reconstructed image the blurring is reduced considerably due to high frequency restoration
through fusion based scheme. Furthermore, the proposed technique can also be adopted for local
based and fuzzy based interpolation technique.
ACKNOWLEDGEMENTS
The authors would like to thank everyone, just everyone!
REFERENCES
[1] Lu Jing, Xiong Si, Wu Shihong, “An improved bilinear interpolation algorithm of converting standard
defination images to high defination images,” WASE International Conference on Information
Engineering, pp. 441-444, 2009.
[2] R.G. Keys, “Cubic convolution interpolation for digital image processing,” IEEE Trans. Acoust.,
speech, signal Processing, vol. ASSP- 29, no.6, pp. 1153-1160, Dec.1981.
[3] S.E. Reichenbach and F. Geng, “Two-dimensional cubic convolution,” IEEE Trans. Image
Processing, vol. 12, no.8, pp. 857-865, Aug. 2003.
[4] Zhou Dengwen, “An edge directed bicubic interpolation algorithm,” CISP, pp. 1186-1189, 2010.
[5] G.Ramesh Babu and K.Veera Swamy, “Image Fusion using various Transforms,” IPASJ International
Journal of Computer Science (IIJCS), vol. 2, no.1, pp. 51-58, Jan. 2014.
[6] M.P.Parsai Deepak Kumar Sahu, “Different Image Fusion Techniques –A Critical Review,”
International Journal of Modern Engineering Research (IJMER), vol. 2, no. 5, pp. 4298-4301, Sep.-
Oct. 2012.
[7] Arpinder Singh Shaveta Mahajan, “A Comparative Analysis of Different Image Fusion Techniques,”
IPASJ International Journal of Computer Science (IIJCS), vol. 2, no.1, pp. 8-15, Jan. 2014.
[8] J. Mukherjee and S. K. Mitra, “Image resizing in the compressed domain using subband DCT,” IEEE
Trans. Circuits, Syst., Video Technol., vol. 12, pp. 620-627, July 2002.
[9] R. Dugad and N. Ahuja, “A fast scheme for image size change in the compressed domain,” IEEE
Trans. Circuits Syst. Video Technol., vol. 11, no.4, pp. 461-474, Apr. 2001.
[10] Zhenyu Wu, Hongyang Yu, and Chang Wen Chen, “A new hybrid DCT Wiener based interpolation
scheme for video intraframe up-sampling,” IEEE signal processing letters, vol. 17, no.10, pp. 827-
830, Oct. 2010.

More Related Content

PDF
Different Image Fusion Techniques –A Critical Review
PDF
A New Approach of Medical Image Fusion using Discrete Wavelet Transform
PDF
Image Fusion
PPTX
Wavelet based image fusion
PPTX
IMAGE FUSION IN IMAGE PROCESSING
PDF
A NOVEL ALGORITHM FOR IMAGE DENOISING USING DT-CWT
PDF
Wavelet based image fusion
PDF
Medical image fusion based on NSCT and wavelet transform
Different Image Fusion Techniques –A Critical Review
A New Approach of Medical Image Fusion using Discrete Wavelet Transform
Image Fusion
Wavelet based image fusion
IMAGE FUSION IN IMAGE PROCESSING
A NOVEL ALGORITHM FOR IMAGE DENOISING USING DT-CWT
Wavelet based image fusion
Medical image fusion based on NSCT and wavelet transform

What's hot (19)

PDF
E1083237
PDF
Single image super resolution with improved wavelet interpolation and iterati...
PDF
L0351007379
PPTX
Comparison of image fusion methods
PDF
Pixel Recursive Super Resolution. Google Brain
PDF
Content Based Image Retrieval Using 2-D Discrete Wavelet Transform
PDF
Image Resolution Enhancement by using Wavelet Transform
PDF
An Application of Second Generation Wavelets for Image Denoising using Dual T...
PPTX
New microsoft power point presentation
PDF
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
PDF
The super resolution technology 2016
PDF
Image compression using discrete wavelet transform
PDF
An efficient image compression algorithm using dct biorthogonal wavelet trans...
PDF
Image compression using embedded zero tree wavelet
PDF
Ijetr011837
PPTX
image denoising technique using disctere wavelet transform
PDF
IMPROVEMENT OF BM3D ALGORITHM AND EMPLOYMENT TO SATELLITE AND CFA IMAGES DENO...
PDF
Sub-windowed laser speckle image velocimetry by fast fourier transform techni...
PDF
Survey on Various Image Denoising Techniques
E1083237
Single image super resolution with improved wavelet interpolation and iterati...
L0351007379
Comparison of image fusion methods
Pixel Recursive Super Resolution. Google Brain
Content Based Image Retrieval Using 2-D Discrete Wavelet Transform
Image Resolution Enhancement by using Wavelet Transform
An Application of Second Generation Wavelets for Image Denoising using Dual T...
New microsoft power point presentation
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
The super resolution technology 2016
Image compression using discrete wavelet transform
An efficient image compression algorithm using dct biorthogonal wavelet trans...
Image compression using embedded zero tree wavelet
Ijetr011837
image denoising technique using disctere wavelet transform
IMPROVEMENT OF BM3D ALGORITHM AND EMPLOYMENT TO SATELLITE AND CFA IMAGES DENO...
Sub-windowed laser speckle image velocimetry by fast fourier transform techni...
Survey on Various Image Denoising Techniques
Ad

Similar to An efficient fusion based up sampling technique for restoration of spatially compressed images (20)

PDF
A Review on Image Compression using DCT and DWT
PDF
International Journal of Engineering Research and Development
PDF
40 9148 satellite image enhancement using dual edit tyas
PPTX
Super Resolution
PDF
REVIEW ON TRANSFORM BASED MEDICAL IMAGE COMPRESSION
PDF
MULTIFOCUS IMAGE FUSION USING MULTIRESOLUTION APPROACH WITH BILATERAL GRADIEN...
PPT
Discrete cosine transform
PDF
H0144952
PDF
Adaptive lifting based image compression scheme using interactive artificial ...
PDF
Image compression using Hybrid wavelet Transform and their Performance Compa...
PDF
www.ijerd.com
PDF
Fusion for medical image based on discrete wavelet transform coefficient
PDF
An Efficient Approach for Image Enhancement Based on Image Fusion with Retine...
PDF
IRJET- Satellite Image Resolution Enhancement
PDF
IRJET- Lunar Image Fusion based on DT-CWT, Curvelet Transform and NSCT
PDF
A COMPARATIVE STUDY OF IMAGE COMPRESSION ALGORITHMS
PDF
High Speed and Area Efficient 2D DWT Processor Based Image Compression
PDF
iaetsd Image fusion of brain images using discrete wavelet transform
PDF
I017125357
PDF
Comparative Study between DCT and Wavelet Transform Based Image Compression A...
A Review on Image Compression using DCT and DWT
International Journal of Engineering Research and Development
40 9148 satellite image enhancement using dual edit tyas
Super Resolution
REVIEW ON TRANSFORM BASED MEDICAL IMAGE COMPRESSION
MULTIFOCUS IMAGE FUSION USING MULTIRESOLUTION APPROACH WITH BILATERAL GRADIEN...
Discrete cosine transform
H0144952
Adaptive lifting based image compression scheme using interactive artificial ...
Image compression using Hybrid wavelet Transform and their Performance Compa...
www.ijerd.com
Fusion for medical image based on discrete wavelet transform coefficient
An Efficient Approach for Image Enhancement Based on Image Fusion with Retine...
IRJET- Satellite Image Resolution Enhancement
IRJET- Lunar Image Fusion based on DT-CWT, Curvelet Transform and NSCT
A COMPARATIVE STUDY OF IMAGE COMPRESSION ALGORITHMS
High Speed and Area Efficient 2D DWT Processor Based Image Compression
iaetsd Image fusion of brain images using discrete wavelet transform
I017125357
Comparative Study between DCT and Wavelet Transform Based Image Compression A...
Ad

Recently uploaded (20)

PPTX
Spectroscopy.pptx food analysis technology
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Approach and Philosophy of On baking technology
PDF
Machine learning based COVID-19 study performance prediction
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PPTX
Tartificialntelligence_presentation.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPT
Teaching material agriculture food technology
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PPTX
TLE Review Electricity (Electricity).pptx
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Spectroscopy.pptx food analysis technology
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Approach and Philosophy of On baking technology
Machine learning based COVID-19 study performance prediction
Building Integrated photovoltaic BIPV_UPV.pdf
Univ-Connecticut-ChatGPT-Presentaion.pdf
Tartificialntelligence_presentation.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Teaching material agriculture food technology
Spectral efficient network and resource selection model in 5G networks
Mobile App Security Testing_ A Comprehensive Guide.pdf
Per capita expenditure prediction using model stacking based on satellite ima...
Assigned Numbers - 2025 - Bluetooth® Document
TLE Review Electricity (Electricity).pptx
MIND Revenue Release Quarter 2 2025 Press Release
Group 1 Presentation -Planning and Decision Making .pptx
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
gpt5_lecture_notes_comprehensive_20250812015547.pdf

An efficient fusion based up sampling technique for restoration of spatially compressed images

  • 1. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 DOI : 10.5121/ijit.2015.4101 1 AN EFFICIENT FUSION BASED UP-SAMPLING TECHNIQUE FOR RESTORATION OF SPATIALLY COMPRESSED IMAGES Girinandini Sahoo1 and Aditya Acharya2 Department of Electronics and Telecommunication Engineering Silicon Institute of Technology, Bhubaneswar, Odisha, India ABSTRACT The various up-sampling techniques available in the literature produce blurring artifacts in the up- sampled, high resolution images. In order to overcome this problem effectively, an image fusion based interpolation technique is proposed here to restore the high frequency information. The Discrete Cosine Transform interpolation technique preserves low frequency information whereas Discrete Sine Transform preserves high frequency information. Therefore, by fusing the DCT and DST based up-sampled images, more high frequency, relevant information of both the up-sampled images can be preserved in the restored, fused image. The restoration of high frequency information lessens the degree of blurring in the fused image and hence improves its objective and subjective quality. Experimental result shows the proposed method achieves a Peak Signal to Noise Ratio (PSNR) improvement up to 0.9947dB than DCT interpolation and 2.8186dB than bicubic interpolation at 4:1 compression ratio. KEYWORDS Interpolation, DCT, DST, Image Up-Sampling, Image fusion. 1. INTRODUCTION Resolution of an image has been always an important issue in many images and video processing application, such as video resolution enhancement, feature extraction and image resolution enhancement. Interpolation in image processing is a method to increase the number of pixels in a digital image. Many image interpolation schemes have been proposed in [1]-[4]. There are four well-known interpolation techniques, namely, nearest neighbour, bilinear, bicubic, Lanczos. Discrete Cosine Transform is also playing a significant role in many image processing applications. The conventional discrete cosine transform (DCT) is used to perform two- dimensional (2D) interpolation of real sequences. Similarly Discrete Sine Transform (DST) is also used for interpolation. The 2-D Discrete Sine Transform of an image is performed by applying the 1-D Discrete Sine Transform (DST) along the rows of the image first, and again in the columns of the image. Literatures [5]-[7] is schemed a fusion technique. It can earn much better objective quality comparing with simple bilinear, bicubic interpolation in spatial domain and DCT, DST in frequency domain. The DCT interpolation technique preserves low frequency information and DST preserves high frequency information. Therefore by unite the DST and DCT based up-sampled images, both high and low frequency can be preserved in the restored up-
  • 2. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 2 sampled image. As a result the fused image contains all the significant information of the input images. The quality of the fused image is superior to any of the input images. The rest of this paper is organized as follows: Section II provides a brief description of related work which is used for image interpolation. A detail of the proposed fusion technique is described in Section III. Section IV presents the experimental results to show the performance of the proposed method. Section V concludes this paper. 2. RELATED WORK Interpolation filters are used to interpolate new sample values at arbitrary time instants between the existing discrete time samples. Bilinear and Bicubic interpolations are two simple up- sampling techniques with low complexity. Bilinear interpolation is the combination of two linear interpolations. The bicubic interpolation gives smother surface than bilinear interpolation. Hence, such interpolation techniques often lead to several types of visual degradation in which the blurring effect is one of the most noticeable artifacts. DCT based interpolation gives better image’s visual quality. [8] It shows a signal or image can be transformed from spatial domain to frequency domain using DCT. The DCT has the property that, for a typical image, most of the visually significant information about the image is concentrated in just a few coefficients of the DCT. For this reason, the DCT is often used in image compression application. It preserves the low frequency components. Again the discrete sine transform is a Fourier related transform similar to discrete Fourier transform (DFT), but using a purely real matrix. It preserves the high frequency components. According to research reported in [9]-[10], interpolation in compressed domain can produce better objective quality such as PSNR than those with a simple bilinear, bicubic, DST based interpolation. Due to zero padding in high frequency components usually lead to blocking artifacts. Based on above investigation, we develop the weighted fusion technique. It estimates the high frequency components from DST-based interpolation and combines them with low frequency components derived directly from DCT-based interpolation. Thus, a complete frequency domain reconstruction can be achieved by the fusion technique. The key idea in the proposed fusion technique is to restore the high frequency components as well as the low frequency components of the up-sampled image from frequency domain interpolation. Here a better execution is supposed to achieve both in visual and objective quality so as to keep all the important information (low, high frequency) of the interpolated image. 3. FUSION BASED INTERPOLTION As discussed in section 2, any approach in either spatial or frequency domain, is applied to achieve an interpolation that is high in both visual and objective quality. Since the high frequency components are mostly contributed from sharp regions like edges. Therefore, fusion technique is expected to achieve quality improvement in both visual and objective measures. We can also apply fusion technique to both DCT and DST up-sampled images. 3.1. A. Image up-Sampling in DCT Domain To implement up-sampling in DCT domain, we only need to add zeros in the high frequency regions.DCT is calculated for an image of size NM × is given below:
  • 3. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 3 ( ) ( ) ( ) ( ) ( ) ∑∑ − = − =       +       + = 1 0 1 0 2 12 cos 2 12 cos, M x N y N vy M ux vwuwvuc ππ (1) where 3.2 B. Image up-Sampling in DST Domain The 2-D Discrete Sine Transform of an image is performed by applying the 1-D Discrete Sine Transform (DST) along the rows of the image first, and again in the columns of the image. DST is calculated for an image of size NM × is give below: ( ) ( )       +       ++ = ∑∑ − = − = 1 sin. 1 sin., 1 2 , 1 0 1 0 N vy M ux yxf N vuc M x N y ππ (2) 3.3. C. Fusion Based Interpolation Method The process of image fusion the good information from each of the given images is fused together to form a resultant image whose quality is superior to any of the input image. Image fusion is applied in every field where image are ought to be analyzed. For example, medical image analysis, microscopic imaging, analysis of image from satellite, remote sensing application, computer vision, robotics etc. Due to limited focus depth of the optical lens it is often not possible to get an image which contains all the relevant objects in focus. To obtain an image with every object in focus a fusion process is required to fuse the images giving a better view for human or machine perception. Block diagram for fusion process is shown in Fig.1. Fig.1: Fusion based Interpolation The 4:1 compressed image is interpolated by using the DST and DCT based interpolation techniques. Then both DST and DCT up-sampled images are sharpened using Laplacian, ( ) ( ) ( ){ }yxfkyxfyxg ,,, 2 ∇⋅+= (3) where and denote sharpened image and weight factor respectively. The amount of image sharpening is a function of weight factor k which ranges from 0 to 1. So, the blurring effect is ( ) ( )      ≠≠ == = ovufor N ovufor N vwuw ,02 ,01 , Up sampled image using DCT Interpolation Weighted sharpening Up sampled image using DST Interpolation Weighted sharpening Image fusion Restored Image Sub Sampled Image Sub Sampled Image
  • 4. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 4 reduced considerably. In this proposed method a better PSNR value is achieved for DCT up- sampled image at k=0.2, similarly at k=0.01 for DST up-sampled image the PSNR value remains high. The sharpened images are fused together by using the weighted fusion technique. Finally, the output is obtained in the form of restored image. ( ) ( ) ( )yxgkyxgkyxf ,,,ˆ 2211 ⋅+⋅= (4) where, and are the sharpened images of DCT and DST up-sampled images respectively. The k1 and k2 are standardized as k1=0.95, k2=0.05 which is implemented to different images where a high PSNR value is achieved. The flowchart of the proposed method is shown below: Fig. 2 flowchart of proposed method 4. RESULTS AND DISCUSSION The proposed technique has been tested on several different images and videos. Here, two quality metrics are used to test the performance of the proposed algorithm. One metric is Peak Signal to Noise Ratio (PSNR) and another is Root Mean Square Error (RMSE). ( ) ( )[ ]∑∑ − = − = −= 1 0 1 0 2 ,ˆ, 1 M x N y yxfyxf MN MSE (5) MSERMSE = (6) ( ) MSE PSNRdB 2 10 255 log10= (7) Fig. 2 flowchart of proposed method
  • 5. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 5 4.1. Experimental results are tabulated in Table-1, Table-2 and Table-3. TABLE-1: Describe RMSE values of different interpolation techniques. IMAGES RMSE Bicubic DCT DST PROPOSED METHOD Cameraman 0.0428 0.0462 0.0543 0.0452 Mandrill 0.0342 0.0277 0.0374 0.0330 Pirate 0.0282 0.0264 0.0335 0.0258 Lena 0.0355 0.0337 0.0435 0.0330 Womandarkhair 0.0086 0.0079 0.0242 0.0077 Barbara 0.0540 0.0551 0.0594 0.0552 Boat 0.0318 0.0300 0.0364 0.0293 House 0.0229 0.0221 0.0381 0.0219 TABLE-2: Comparison between different interpolation techniques IMAGES PSNR(dB) Bicubic DCT DST PROPOSED METHOD Cameraman 26.3320 26.7114 25.2983 26.8954 Mandrill 29.3243 31.1482 28.5383 32.1429 Pirate 31.0088 31.5531 29.4954 31.7791 Lena 28.9962 29.4411 27.2239 29.6291 Womandarkhair 41.2920 42.0834 32.3350 42.2730 Barbara 25.3521 25.1834 24.5267 25.1911 Boat 29.9515 30.4661 28.7703 30.6771 House 32.7884 33.1034 28.3715 33.1850 TABLE-3: Describe average PSNR values of different interpolation techniques for video intra frame. VIDEOS AVERAGE PSNR(dB) Bicubic Lanczos DCT PROPOSED METHOD Coastguard 26.9185 27.2261 27.3210 27.5092 Football 25.1483 25.3806 25.5689 25.7384 Bus 25.2624 25.7167 25.7945 26.0532 Flower 19.3140 19.5015 19.4884 19.5880 Foreman 31.6336 32.0842 32.4367 32.7824 Hallmanitor 25.2644 25.6082 25.9646 26.2007 Ice 27.6814 28.0695 28.8634 29.2924 News 25.0578 25.4683 25.6087 25.8619 Salesman 28.9969 29.2500 29.3382 29.4858
  • 6. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 6 4.2. Simulation results (a) (b) (c) (d) Fig.3: Subjective Evaluation of House using different Interpolation Techniques: (a) source image (b) Bicubic method (c) DCT method (d) Proposed Method. From the experimental results, it is observed that the proposed method is giving better result (high PSNR value). Experiments are also performed with Cameraman and Lena images. Results are shown in Fig.4and Fig. 5 respectively
  • 7. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 7 (a) (b) (c) (d) Fig.4: Subjective Evaluation of Cameraman using different Interpolation Techniques: (a) source image (b) Bicubic method (c) DCT method (d) Proposed Method. (a) (b) (c) (d) Fig.5: Subjective Evaluation of Lena using different Interpolation Techniques: (a) Source image (b) Bicubic method (c) DCT method (d) Proposed Method.
  • 8. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 8 (a) (b) (c) Fig.6. PSNR (dB) comparison of different sequences using different interpolation techniques at 4:1 compression ratio of :(a) coastguard (b) News (c) foreman.
  • 9. International Journal on Information Theory (IJIT),Vol.4, No.1, January 2015 9 Figure 6 represents the PSNR (dB) Vs frame index plot of different video sequences using various interpolation techniques at 4:1 compression ratio. Experimental results show, the proposed method yields better objective quality for different types of sequences having dissimilar characteristics. 5. CONCLUSIONS In this paper the proposed algorithm exploits the advantages of both spatial domain and frequency domain processing for improved up-sampling performance in terms of PSNR (dB). The proposed algorithm provides both subjective and objective improvement in comparison to other interpolation techniques irrespective of change in the resolution and compression ratio. In the reconstructed image the blurring is reduced considerably due to high frequency restoration through fusion based scheme. Furthermore, the proposed technique can also be adopted for local based and fuzzy based interpolation technique. ACKNOWLEDGEMENTS The authors would like to thank everyone, just everyone! REFERENCES [1] Lu Jing, Xiong Si, Wu Shihong, “An improved bilinear interpolation algorithm of converting standard defination images to high defination images,” WASE International Conference on Information Engineering, pp. 441-444, 2009. [2] R.G. Keys, “Cubic convolution interpolation for digital image processing,” IEEE Trans. Acoust., speech, signal Processing, vol. ASSP- 29, no.6, pp. 1153-1160, Dec.1981. [3] S.E. Reichenbach and F. Geng, “Two-dimensional cubic convolution,” IEEE Trans. Image Processing, vol. 12, no.8, pp. 857-865, Aug. 2003. [4] Zhou Dengwen, “An edge directed bicubic interpolation algorithm,” CISP, pp. 1186-1189, 2010. [5] G.Ramesh Babu and K.Veera Swamy, “Image Fusion using various Transforms,” IPASJ International Journal of Computer Science (IIJCS), vol. 2, no.1, pp. 51-58, Jan. 2014. [6] M.P.Parsai Deepak Kumar Sahu, “Different Image Fusion Techniques –A Critical Review,” International Journal of Modern Engineering Research (IJMER), vol. 2, no. 5, pp. 4298-4301, Sep.- Oct. 2012. [7] Arpinder Singh Shaveta Mahajan, “A Comparative Analysis of Different Image Fusion Techniques,” IPASJ International Journal of Computer Science (IIJCS), vol. 2, no.1, pp. 8-15, Jan. 2014. [8] J. Mukherjee and S. K. Mitra, “Image resizing in the compressed domain using subband DCT,” IEEE Trans. Circuits, Syst., Video Technol., vol. 12, pp. 620-627, July 2002. [9] R. Dugad and N. Ahuja, “A fast scheme for image size change in the compressed domain,” IEEE Trans. Circuits Syst. Video Technol., vol. 11, no.4, pp. 461-474, Apr. 2001. [10] Zhenyu Wu, Hongyang Yu, and Chang Wen Chen, “A new hybrid DCT Wiener based interpolation scheme for video intraframe up-sampling,” IEEE signal processing letters, vol. 17, no.10, pp. 827- 830, Oct. 2010.