Open Access Open Access  Restricted Access Subscription or Fee Access

Spectral-Based Temporal-Constraint Estimation for Semi-Automatic Video Object Segmentation


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/irecos.v10i9.7542

Abstract


This paper presents an approach to estimate the constraints on semi-automatic video object segmentation. It is performed by the assumption that a motion vector space is pixels movement direction of current to subsequent frame. The motion vector value is calculated by applying the Block Matching Algorithm (BMA). Its result is added to pixels image coordinates affiliated to the constraint in current frame in order to create onein subsequent frame. Subsequently, constraints are applied as a companion of an input image for the objects extraction conducted by matting technique. After segmentation resultsevaluation, the error rate of matte extraction has highresults, since the pixel constraints in subsequent frames is spreading and getting away from the object area. It is as a result of difference motion vector values in adjacent blocks. We create the adaptive block around user constraint in order to overcome this problem. Then, the motion vector value is computed by the Euclidean Distance between the current and subsequent frame based on the Hue angle, Saturation, and Value (HSV) color models. When this algorithm is applied to separate the objects on the frame, sequences are reducing error up to 63.60%
Copyright © 2015 Praise Worthy Prize - All rights reserved.

Keywords


Object Segmentation; Temporal Constraint; Motion Estimation

Full Text:

PDF


References


M. Hariadi, H. Loy and T. AOKI, "Semi-Automatic Video Object Segmentation using LVQ with Color and Spatial Features," IEICE Transaction Information and System, Vols. E88-D, no. 7, pp. 1553-1560, 2005.
http://dx.doi.org/10.1093/ietisy/e88-d.7.1553

K. H, Distributed Multimedia Database Technologies supported by MPEG-7 and MPEG- 2, CRC Press, 2003.
http://dx.doi.org/10.1201/9780203009338

L. Chiariglione, "The MPEG-4 Standard," Journal of China Institute of Communications,, pp. 54-67, 1998.

R. Koenen, F. Pereira and L. Chiariglione, "MPEG-4: Context and Objectives," Signal Processing: Image Communication, vol. 9, pp. 295-304, 1997.
http://dx.doi.org/10.1016/s0923-5965(97)00003-9

A. Yong-Jo, H. Tae-Jin, S. Dong-Gyu and H. Woo-Jin, "Implementation of Fast HEVC Encoder Based on SIMD and Data-level Parallelism," EURASIP Journal on Image and Video Processing, vol. 16, pp. 1-19, 2014., vol. 16, pp. 1-19, 2014.
http://dx.doi.org/10.1186/1687-5281-2014-16

O. Jens-Rainer, G. J. Sullivan, H. Schwarz, T. Tan and T. Wiegand, "Comparison of the Coding Efficiency of Video Coding Standards - Including High Efficiency Video Coding (HEVC)," IEEE Transaction on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1669-1684, 2012.
http://dx.doi.org/10.1109/tcsvt.2012.2221192

G. J. Sullivan, O. Jens-Rainer, W. Han and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) Standard," IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1668, 2012.
http://dx.doi.org/10.1109/tcsvt.2012.2221191

I. Richardson, "HEVC : An Introduction to High Efficiency Video Coding (Summary)," CODEX Video Compression, 2013.
http://dx.doi.org/10.1007/978-3-319-06895-4_1

A. Bovic, The Hand Book of Image and Video Processing, Academic Press, 1998.

R. Basuki, M. Soeleman, M. Hariadi, M. Purnomo, R. Pramunendar and A. Yogananti, "Spectral-Based Video Object Segmentation using Alpha Matting and Background Subtraction," in IIEEJ the 4th International Workshop on Image Electronics and Visual Computing, Koh Samui, Thailand, 2014.

C. Toklu, A. Tekalp and A. T. Erdem, "Semi-Automatic Video Object Segmentation in the Presence of Occlusion," IEEE Transaction on Circuits and Systems for Video Technology, vol. 10, no. 4, pp. 624 - 629, 2000., vol. 10, no. 4, pp. 624-629, 2000.
http://dx.doi.org/10.1109/76.845008

Y. Tsaig and A. Averbuch, "Automatic Segmentation of Moving Objects in Video Sequences: A Region Labeling Approach," IEEE Transactions on Circuits and Systems for Video Technology, vol. 12, no. 7, pp. 597- 612, 2002.
http://dx.doi.org/10.1109/tcsvt.2002.800513

H. Li and K. Ngan, "Automatic Video Segmentation and Tracking for Content-Based Applications," Advances in Visual Content Analysis and Adaptation for Multimedia Communications, pp. 27-33, 2007.
http://dx.doi.org/10.1109/mcom.2007.284535

T. Meier and K. Ngan, "Automatic Segmentation of Moving Objects for Video Object Plane Generation," IEEE Transaction on Circuits and Systems for Video Technology, vol. 8, no. 5, pp. 525-538, 1998.
http://dx.doi.org/10.1109/76.718500

A. Levin, D. Lischinski and Y. Weiss, "A Closed-Form Solution to Natural Image Matting," IEEE Transactions on Pattern Analysis And Machine Intelligence, vol. 30, no. 2, pp. 1-15, 2008.
http://dx.doi.org/10.1109/tpami.2007.1177

A. Levin, A. Rav-Acha and D. Lischinski, "Spectral matting," IEEE Transactions on Pattern Analysis And Machine Intelligence, vol. 30, no. 10, pp. 1699-1712, 2008.
http://dx.doi.org/10.1109/tpami.2008.168

B. Arroh, Block Matching for Motion Estimation, IEEE DIP 6620 Spring 2004 Final Project Paper, 2004.

C. Yong-Sheng, H. Yi-Ping and F. Chiou-Shann , "Fast Block Matching Algorithm Based on the Winner-Update Strategy," IEEE Transaction on Image Processing, vol. 10, no. 8, 2001.
http://dx.doi.org/10.1109/83.935037

H. Seung-Ryong, T. Yamasaki and K. Aizawa, "Time-Varying Mesh Compression Using an Extended Block Matching Algorithm," IEEE Transaction on Circuits and Systems for Video Technology, vol. 17, no. 11, pp. 1506 - 1518, 2007.
http://dx.doi.org/10.1109/tcsvt.2007.903810

H. Jiang, G. Zhang, H. Wang and H. Bao, "Spatio-Temporal Video Segmentation of Static Scenes and Its Applications," IEEE Transaction on Multimedia, vol. 17, no. 1, pp. 3 - 15, 2015.
http://dx.doi.org/10.1109/tmm.2014.2368273

N. Apostoloff and A. Fitzgibbon, "Bayesian Video Matting Using Learnt Image Priors," in IEEE Conf. Computer Vision and Pattern Recognition, 2004.
http://dx.doi.org/10.1109/cvpr.2004.1315061

Y. Chuang, A. Agarwala, B. Curless, D. Salesin and R. Szeliski, "Video Matting of Complex Scenes," ACM Trans. Graphics, vol. 21, no. 3, pp. 243-248, 2002.
http://dx.doi.org/10.1145/566654.566572

J. Sun, J. Jia, C. Tang, and H. Shum, "Poisson Matting," ACM Trans. Graphics, vol. 23, no. 3, pp. 315-321, 2004.
http://dx.doi.org/10.1145/1015706.1015721

Dhahri, S., Zitouni, A., Torki, K., An Adaptive Motion Estimator Design for High Performances H.264/AVC Codec, (2013) International Review of Automatic Control (IREACO), 6 (2), pp. 221-227.

Hassen, W., Amiri, H., A Subpel Motion Vector Estimation for Embedded Video Encoder, (2015) International Review on Computers and Software (IRECOS), 10 (2), pp. 157-163.
http://dx.doi.org/10.15866/irecos.v10i2.5404

T. Porter and T. Duff , "Compositing digital images," Computer Graphics, vol. 18, no. 3, pp. 253-259, 1984.
http://dx.doi.org/10.1145/964965.808606

L. Maddalena and A. Petrosino, "A Self-Organizing Approach to Background Subtraction for Visual Survellance Applications," IEEE Transactions on Image Processing , vol. 17, no. 7, pp. 1168-1177, 2008.
http://dx.doi.org/10.1109/tip.2008.924285


Refbacks

  • There are currently no refbacks.


Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize