基于单幅微距图像的布料丝线结构建模

吴洪宇; 陈小武; 张晨旭; 周彬; 赵沁平

doi:10.1631/FITEE.1800693

Your Location：

Home >

Browse articles >

基于单幅微距图像的布料丝线结构建模

虚拟现实专题 | Updated：2022-05-19

- 基于单幅微距图像的布料丝线结构建模
- Modeling yarn-level geometry from a single micro-image
- 信息与电子工程前沿（英文） 2019年20卷第9期页码：1165-1174
- Affiliations：
  
  State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University, Beijing 100191, China
- Author bio：
  
  Hong-yu WU, whyvrlab@buaa.edu.cn
  [ "Xiao-wu CHEN, chen@buaa.edu.cn" ]
  [ "Chen-xu ZHANG, zhangchenxu528@buaa.edu.cn" ]
  [ "Bin Zhou, zhoubin@buaa.edu.cn" ]
- Funds：
  
  Project supported by the National Natural Science Foundation of China (Nos. 61532003 and 61902014) and the National Key Research and Development Plan, China (No. 2018YFC0831003)
- DOI：10.1631/FITEE.1800693
  中图分类号： TP391.9
- 收稿：2018-11-04，
  
  修回：2019-;8-23，
  
  纸质出版：2019-09
- Accepted：
Scan QR Code
吴洪宇, 陈小武, 张晨旭, 等. 基于单幅微距图像的布料丝线结构建模[J]. 信息与电子工程前沿（英文）, 2019,20(9):1165-1174.

Hong-yu WU, Xiao-wu CHEN, Chen-xu ZHANG, et al. Modeling yarn-level geometry from a single micro-image[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(9): 1165-1174.
吴洪宇, 陈小武, 张晨旭, 等. 基于单幅微距图像的布料丝线结构建模[J]. 信息与电子工程前沿（英文）, 2019,20(9):1165-1174. DOI： 10.1631/FITEE.1800693.

Hong-yu WU, Xiao-wu CHEN, Chen-xu ZHANG, et al. Modeling yarn-level geometry from a single micro-image[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(9): 1165-1174. DOI： 10.1631/FITEE.1800693.

摘要

真实世界的布料具有不同的微观丝线结构，导致不同布料具有各种各样外观。布料真实感绘制在影视制作、电子商务等领域具有重要应用价值。为获取布料微观丝线几何信息，传统方法需要微米CT扫描仪等昂贵复杂设备，并且采集过程费时费力，难以普及。为降低布料丝线获取复杂度，本文提出一种基于单幅微距图像的丝线获取与建模方法，仅需装有微距镜头的普通消费级相机拍摄的微距图像。该方法首先通过单幅微距图像的明暗信息获得丝线的大尺度几何；然后，通过丝线追踪算法获得丝线上的纤维细节；最后将这两者结合，得到布料丝线的微观尺度几何。实验结果表明，本方法能够高效获取各种类型布料丝线几何。

Abstract

Different types of cloth show distinctive appearances owing to their unique yarn-level geometrical details. Despite its importance in applications such as cloth rendering and simulation

capturing yarn-level geometry is nontrivial and requires special hardware

e.g.

computed tomography scanners

for conventional methods. In this paper

we propose a novel method that can produce the yarn-level geometry of real cloth using a single micro-image

captured by a consumer digital camera with a macro lens. Given a single input image

our method estimates the large-scale yarn geometry by image shading

and the fine-scale fiber details can be recovered via the proposed fiber tracing and generation algorithms. Experimental results indicate that our method can capture the detailed yarn-level geometry of a wide range of cloth and reproduce plausible cloth appearances.

关键词

Keywords

references

M Aittala , , , T Weyrich , , , J Lehtinen . . Two-shot SVBRDF capture for stationary materials . . ACM Trans Graph , , 2015 . . 34 ( ( 4 ): ): Article 110 DOI: 10.1145/2766967 http://doi.org/10.1145/2766967 . .

V Asha , , , P Nagabhushan , , , NU Bhajantri . . Automatic extraction of texture-periodicity using superposition of distance matching functions and their forward differences . . Patt Recogn Lett , , 2012 . . 33 ( ( 5 ): ): 629 - - 640 . . DOI: 10.1016/j.patrec.2011.11.027 http://doi.org/10.1016/j.patrec.2011.11.027 . .

ML Chai , , , LD Wang , , , YL Weng , , , 等 . . Single-view hair modeling for portrait manipulation . . ACM Trans Graph , , 2012 . . 31 ( ( 4 ): ): Article 116 DOI: 10.1145/2185520.2185612 http://doi.org/10.1145/2185520.2185612 . .

ML Chai , , , LJ Luo , , , K Sunkavalli , , , 等 . . High-quality hair modeling from a single portrait photo . . ACM Trans Graph , , 2015 . . 34 ( ( 6 ): ): Article 204 DOI: 10.1145/2816795.2818112 http://doi.org/10.1145/2816795.2818112 . .

ML Chai , , , TJ Shao , , , HZ Wu , , , 等 . . AutoHair: fully automatic hair modeling from a single image . . ACM Trans Graph , , 2016 . . 35 ( ( 4 ): ): Article 116 DOI: 10.1145/2897824.2925961 http://doi.org/10.1145/2897824.2925961 . .

XW Chen , , , HY Wu , , , X Jin , , , 等 . . Face illumination manipulation using a single reference image by adaptive layer decomposition . . IEEE Trans Image Process , , 2013a . . 22 ( ( 11 ): ): 4249 - - 4259 . . DOI: 10.1109/TIP.2013.2271548 http://doi.org/10.1109/TIP.2013.2271548 . .

XW Chen , , , DQ Zou , , , SZ Zhou , , , 等 . . Image matting with local and nonlocal smooth priors . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2013b . . p.1902 - - 1907 . . DOI: 10.1109/CVPR.2013.248 http://doi.org/10.1109/CVPR.2013.248 . .

G Cirio , , , J Lopez-Moreno , , , D Miraut , , , 等 . . Yarn-level simulation of woven cloth . . ACM Trans Graph , , 2014 . . 33 ( ( 6 ): ): Article 207 DOI: 10.1145/2661229.2661279 http://doi.org/10.1145/2661229.2661279 . .

AA Efros , , , WT Freeman . . Image quilting for texture synthesis and transfer . . Proc 28 th Annual Conf on Computer Graphics and Interactive Techniques , , 2001 . . p.341 - - 346 . . DOI: 10.1145/383259.383296 http://doi.org/10.1145/383259.383296 . .

Z Farbman , , , R Fattal , , , D Lischinski , , , 等 . . Edgepreserving decompositions for multi-scale tone and detail manipulation . . ACM Trans Graph , , 2008 . . 27 ( ( 3 ): ): Article 67 DOI: 10.1145/1360612.1360666 http://doi.org/10.1145/1360612.1360666 . .

PF Felzenszwalb , , , RB Girshick , , , D McAllester , , , 等 . . Object detection with discriminatively trained partbased models . . IEEE Trans Patt Anal Mach Intell , , 2010 . . 32 ( ( 9 ): ): 1627 - - 1645 . . DOI: 10.1109/TPAMI.2009.167 http://doi.org/10.1109/TPAMI.2009.167 . .

P Irawan , , , S Marschner . . Specular reflection from woven cloth . . ACM Trans Graph , , 2012 . . 31 ( ( 1 ): ): Article 11 DOI: 10.1145/2077341.2077352 http://doi.org/10.1145/2077341.2077352 . .

W Jakob . . Mitsuba Physically Based Renderer . . 2010 . . http://www.mitsuba-renderer.org http://www.mitsuba-renderer.org , , . .

MK Johnson , , , F Cole , , , A Raj , , , 等 . . Microgeometry capture using an elastomeric sensor . . ACM Trans Graph , , 2011 . . 30 ( ( 4 ): ): Article 46 DOI: 10.1145/2010324.1964941 http://doi.org/10.1145/2010324.1964941 . .

P Khungurn , , , D Schroeder , , , S Zhao , , , 等 . . Matching real fabrics with micro-appearance models . . ACM Trans Graph , , 2015 . . 35 ( ( 1 ): ): Article 1 DOI: 10.1145/2818648 http://doi.org/10.1145/2818648 . .

J Leaf , , , RD Wu , , , E Schweickart , , , 等 . . Interactive design of periodic yarn-level cloth patterns . . ACM Trans Graph , , 2018 . . 37 ( ( 6 ): ): Article 202 DOI: 10.1145/3272127.3275105 http://doi.org/10.1145/3272127.3275105 . .

GN Li , , , CL Wu , , , C Stoll , , , 等 . . Capturing relightable human performances under general uncontrolled illumination . . Comput Graph Forum , , 2013 . . 32 ( ( 2pt3 ): ): 275 - - 284 . . DOI: 10.1111/cgf.12047 http://doi.org/10.1111/cgf.12047 . .

LB Liu , , , KK Yin , , , B Wang , , , 等 . . Simulation and control of skeleton-driven soft body characters . . ACM Trans Graph , , 2013 . . 32 ( ( 6 ): ): Article 215 DOI: 10.1145/2508363.2508427 http://doi.org/10.1145/2508363.2508427 . .

SR Marschner , , , HW Jensen , , , M Cammarano , , , 等 . . Light scattering from human hair fibers . . ACM Trans Graph , , 2003 . . 22 ( ( 3 ): ): 780 - - 791 . . DOI: 10.1145/882262.882345 http://doi.org/10.1145/882262.882345 . .

G Nam , , , JH Lee , , , HZ Wu , , , 等 . . Simultaneous acquisition of microscale reflectance and normals . . ACM Trans Graph , , 2016 . . 35 ( ( 6 ): ): Article 185 DOI: 10.1145/2980179.2980220 http://doi.org/10.1145/2980179.2980220 . .

I Sadeghi , , , O Bisker , , , J de Deken , , , 等 . . A practical microcylinder appearance model for cloth rendering . . ACM Trans Graph , , 2013 . . 32 ( ( 2 ): ): Article 14 DOI: 10.1145/2451236.2451240 http://doi.org/10.1145/2451236.2451240 . .

K Schrder , , , A Zinke , , , R Klein . . Image-based reverse engineering and visual prototyping of woven cloth . . IEEE Trans Vis Comput Graph , , 2015 . . 21 ( ( 2 ): ): 188 - - 200 . . DOI: 10.1109/TVCG.2014.2339831 http://doi.org/10.1109/TVCG.2014.2339831 . .

HM Wang , , , JF OoBrien , , , R Ramamoorthi . . Data-driven elastic models for cloth: modeling and measurement . . ACM Trans Graph , , 2011 . . 30 ( ( 4 ): ): Article 71 DOI: 10.1145/2010324.1964966 http://doi.org/10.1145/2010324.1964966 . .

WW Xu , , , N Umentani , , , QW Chao , , , 等 . . Sensitivityoptimized rigging for example-based real-time clothing synthesis . . ACM Trans Graph , , 2014 . . 33 ( ( 4 ): ): Article 107 DOI: 10.1145/2601097.2601136 http://doi.org/10.1145/2601097.2601136 . .

C Yuksel , , , JM Kaldor , , , DL James , , , 等 . . Stitch meshes for modeling knitted clothing with yarn-level detail . . ACM Trans Graph , , 2012 . . 31 ( ( 4 ): ): Article 37 DOI: 10.1145/2185520.2185533 http://doi.org/10.1145/2185520.2185533 . .

JH Zhang , , , G Baciu , , , DJ Zheng , , , 等 . . IDSS: a novel representation for woven fabrics . . IEEE Trans Vis Comput Graph , , 2013 . . 19 ( ( 3 ): ): 420 - - 432 . . DOI: 10.1109/TVCG.2012.66 http://doi.org/10.1109/TVCG.2012.66 . .

M Zhang , , , ML Chai , , , HZ Wu , , , 等 . . A data-driven approach to four-view image-based hair modeling . . ACM Trans Graph , , 2017 . . 36 ( ( 4 ): ): Article 156 DOI: 10.1145/3072959.3073627 http://doi.org/10.1145/3072959.3073627 . .

S Zhao , , , W Jakob , , , S Marschner , , , 等 . . Structure-aware synthesis for predictive woven fabric appearance . . ACM Trans Graph , , 2012 . . 31 ( ( 4 ): ): Article 75 DOI: 10.1145/2185520.2185571 http://doi.org/10.1145/2185520.2185571 . .

S Zhao , , , W Jakob , , , S Marschner , , , 等 . . Building volumetric appearance models of fabric using micro CT imaging . . ACM Commun , , 2014 . . 57 ( ( 11 ): ): 98 - - 105 . . DOI: 10.1145/2670517 http://doi.org/10.1145/2670517 . .

S Zhao , , , FJ Luan , , , K Bala . . Fitting procedural yarn models for realistic cloth rendering . . ACM Trans Graph , , 2016 . . 35 ( ( 4 ): ): Article 51 DOI: 10.1145/2897824.2925932 http://doi.org/10.1145/2897824.2925932 . .

ZL Zhou , , , Z Wu , , , P Tan . . Multi-view photometric stereo with spatially varying isotropic materials . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2013 . . p.1482 - - 1489 . . DOI: 10.1109/CVPR.2013.195 http://doi.org/10.1109/CVPR.2013.195 . .

H Zhu , , , YB Liu , , , JT Fan , , , 等 . . Video-based outdoor human reconstruction . . IEEE Trans Circ Syst Video Technol , , 2017 . . 27 ( ( 4 ): ): 760 - - 770 . . DOI: 10.1109/TCSVT.2016.2596118 http://doi.org/10.1109/TCSVT.2016.2596118 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据