|
JAIST Repository >
School of Knowledge Science >
Articles >
Journal Articles >
Please use this identifier to cite or link to this item:
http://hdl.handle.net/10119/19346
|
| Title: | Drawing Guidance for Freehand Sketching with Interactive Diffusion Model |
| Authors: | Chen, Chuang
Xie, Xiaoxuan
Zhang, Yongming
Zhang, Tianyu
Xie, Haoran |
| Keywords: | Drawing guidance
diffusion model
freehand sketch |
| Issue Date: | 2024-09-02 |
| Publisher: | 情報処理学会 |
| Magazine name: | 研究報告コンピュータグラフィックスとビジュアル情報学（CG） |
| Volume: | 2024-CG-195 |
| Number: | 2 |
| Start page: | 1 |
| End page: | 6 |
| Abstract: | Drawing is a universal form of human expression that transcends language barriers. However, the common users may have difficulty to convey their ideas independently due to the necessity of consistent practice and professional guidance. In this work, we proposed our system for freehand sketching. The proposed system adopts an interactive diffusion model, StreamDiffusion for providing real-time user guidance to assist users within the drawing process. We use a diffusion model to generate RGB images based on hand-drawn sketches and prompts, then convert RGB images into sketches using informative drawings line detector to assist users with creative expression in the drawing practice. Our method can generate images in real time that accurately align with the user’s intent and provide shadow guidance in the background. This process aids users in their drawing practice by allowing them to create sketches based on prompts and their own coarse drawings. A user study evaluates our method’s effectiveness and gathers feedback on interface design. |
| Rights: | 社団法人情報処理学会, Chuang Chen, Xiaoxuan Xie, Yongming Zhang, Tianyu Zhang, Haoran Xie, 情報処理学会研究報告. コンピュータグラフィックスとビジュアル情報学（CG）, 2024-CG-195 (2), 2024, pp.1-6. ここに掲載した著作物の利用に関する注意: 本著作物の著作権は（社）情報処理学会に帰属します。本著作物は著作権者である情報処理学会の許可のもとに掲載するものです。ご利用に当たっては「著作権法」ならびに「情報処理学会倫理綱領」に従うことをお願いいたします。 Notice for the use of this material: The copyright of this material is retained by the Information Processing Society of Japan (IPSJ). This material is published on this web site with the agreement of the author (s) and the IPSJ. Please be complied with Copyright Law of Japan and the Code of Ethics of the IPSJ if any users wish to reproduce, make derivative work, distribute or make available to the public any part or whole thereof. All Rights Reserved, Copyright (C) Information Processing Society of Japan. |
| URI: | http://hdl.handle.net/10119/19346 |
| Material Type: | publisher |
| Appears in Collections: | a10-1. 雑誌掲載論文 (Journal Articles)
|
Files in This Item:
| File |
Description |
Size | Format |
|---|
| H-XIE-K-6.pdf | | 467Kb | Adobe PDF | View/Open |
|
All items in DSpace are protected by copyright, with all rights reserved.
|
