Open Access Open Access  Restricted Access Subscription or Fee Access

Feature Extracting from Video Encoded for Searching Using Improved Methods


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/irecap.v7i6.13612

Abstract


There is a need for the transportation of visual content from a particular node to a computation unit, on a network limited by bandwidth for distributed visual analysis applications, like mobile visual search or Visual Sensor Networks (VSNs). The proposed system uses the video compression technique to transfer information over a communication network. The system is used for key point detection, descriptor calculation and feature matching. The proposed system provides key points to the server as side data to retrieve only the relevant points from the encoded video. In the proposed encoding approach, the User chooses the video from the dataset, extracts frames from the video and then extracts the key point of the selected frame and encodes the string or the key point on the extracted frame to then reconstruct or compress the video and upload it on the server. For decoding, whenever the user enters the search query on the browser, the server receives the search query. The server then selects the video, which is stored on the server, and extracts frames from the video, then key point or encoded data from the selected frame using decoding, and then compares the search query and the decoded data. If it is true, the video is sent to the user. The results show that the proposed approach offers significantly improved feature matching and image retrieval performance at given bitrates.
Copyright © 2017 Praise Worthy Prize - All rights reserved.

Keywords


Coding; 64bit Encoder; H.264; Key Points; Matching; Prediction; Retrieval; SIFT

Full Text:

PDF


References


J. Chao and E. Steinbach, Keypoint encoding and transmission for improved feature extraction from compressed video at low bitrates, IEEE Transactions on Multimedia, Volume: 18, Issue: 1, Jan. 2016.
http://dx.doi.org/10.1109/tmm.2015.2502552

Chao, E. Steinbach, and L. Xie, Keypoint encoding and transmission for improved feature extraction from compressed images, in Proc. IEEE Multimedia and Expo (ICME), pp. 16, Jun-Jul. 2015.
http://dx.doi.org/10.1109/icme.2015.7177388

J. Chao, R. Huitl, E. Steinbach, and D. Schroeder, A Novel Rate Control Framework for SIFT/SURF Feature Preservation in H.264/AVC Video Compression, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 25, Issue: 6, June 2015.
http://dx.doi.org/10.1109/tcsvt.2014.2367354

http://mpeg.chiariglione.org/standards/mpeg-7/compact-descriptors-visual-search

Chen, Tsai Sam, G. Takacs, V. Chandrasekhar, M. Makar, R. Grzeszczuk, and B. Girod, Improved coding for image feature location information, in Proc. SPIE, vol. 8499,2012.
http://dx.doi.org/10.1117/12.935619

H. Yue, X. Sun, F. Wu, and J. Yang, SIFT-Based Image Compression, in IEEE International Conference, September 2012.
http://dx.doi.org/10.1109/icme.2012.52

M. Fischler and R.C. Bolles, Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography, Communications of the ACM, vol. 24, no. 6, pp. 381395.
http://dx.doi.org/10.1145/358669.358692

M. Makar, S. S. Tsai, V. Chandrasekhar, D. Chen, and B. Girod, Interframe coding of canonical patches for low bit-rate mobile augmented reality, Int. J. Semantic Computer., vol. 7, no. 1, pp. 524, 2013.
http://dx.doi.org/10.1109/ism.2012.18

Lowe, Distinctive Image Features From Scale-Invariant Keypoints, International Journal of Computer Vision, vol. 60, pp. 91-110, Nov. 2004.
http://dx.doi.org/10.1023/b:visi.0000029664.99615.94

L. Baroffio, M. Cesana, A. Redondi, M. Tagliasacchi, and S. Tubaro, Hybrid coding of visual content and local image features, CoRR, 2015.
http://dx.doi.org/10.1109/icip.2015.7351258

L. Baroffio, M. Cesana, A. Redondi, and M. Tagliasacchi, “Compress-then-analyze vs. analyse-then-compress: Two paradigms for image analysis in visual sensor networks in IEEE International Workshop on Multimedia Signal Processing (MMSP) 2013, Pula, Italy, September 2013.
http://dx.doi.org/10.1109/mmsp.2013.6659301

S. S. Tsai, D. Chen, G. Takacs, V. Chandrasekhar, M. Makar, R. Grzeszczuk, and B. Girod, Improved coding for image feature location information”, in Proc. SPIE, vol. 8499, 2012.
http://dx.doi.org/10.1117/12.935619

L. Baroffio, J. Ascenso, M. Cesana, A. Redondi, and M. Tagliasacchi, Coding binary local features extracted from video sequences, in Proc. IEEE Int. Conf. on Image Process., pp. 2794-2798, Oct. 2014.
http://dx.doi.org/10.1109/icip.2014.7025565

S. S. Tsai, D. Chen, G. Takacs, V. Chandrasekhar, M. Makar, R. Grzeszczuk, and B. Girod, Improved coding for image feature location information, in Proc. SPIE, Vol. 8499, 2012.
http://dx.doi.org/10.1117/12.935619

S. Leutenegger, M. Chli, and R. Y. Siegwart, BRISK: Binary robust invariant scalable keypoints, in Proc. Int. Conf. Comput. Vis., pp. 2548-2555, Nov.2011.
http://dx.doi.org/10.1109/iccv.2011.6126542

S. S. Tsai, D. Chen, G. Takacs, V. Chandrasekhar, M. Makar, R. Grzeszczuk, and B. Girod, Improved coding for image feature usngr canonical patches , in Proc. SPIE, vol. 9945, 2012.
http://dx.doi.org/10.1117/12.935619

Bahri, N., Werda, I., Grandpierre, T., Ben Ayed, M., Masmoudi, N., Akil, M., Optimizations for Real-Time Implementation of H264/AVC Video Encoder on DSP Processor, (2013) International Review on Computers and Software (IRECOS), 8 (9), pp. 2025-2035.

Wafa, R., Mbainaibeye, J., Image Modeling Based on Complex Wavelet Decomposition: Application to Image Compression and Texture Analysis, (2017) International Review on Computers and Software (IRECOS), 12 (1), pp. 1-20.
http://dx.doi.org/10.15866/irecos.v12i1.10586

Vijayarajan, V., Dinakaran, M., Feature Based Image Retrieval Using Fused Sift and Surf Features, (2013) International Review on Computers and Software (IRECOS), 8 (10), pp. 2500-2506.

Udaya Kumar, N., Krishna Rao V., E., Madhavi Latha, M., Multi Directional Wavelet Filter Based Region of Interest Compression for Low Resolution Images, (2015) International Journal on Communications Antenna and Propagation (IRECAP), 5 (2), pp. 54-62.
http://dx.doi.org/10.15866/irecap.v5i2.4554


Refbacks

  • There are currently no refbacks.



Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize