uu.seUppsala University Publications
Change search
Link to record
Permanent link

Direct link
BETA
Publications (10 of 35) Show all publications
Takeuchi, K., Hayashi, M. & Hirayama, M. J. (2019). Development of VR museum and a comparison with the screen-based virtual musuem. In: Kemao, Q Hayase, K Lau, PY Lie, WN Lee, YL Srisuk, S Yu, L (Ed.), INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019: . Paper presented at International Workshop on Advanced Image Technology (IWAIT), JAN 06-09, 2019, Singapore, SINGAPORE. SPIE-INT SOC OPTICAL ENGINEERING, Article ID 110491B.
Open this publication in new window or tab >>Development of VR museum and a comparison with the screen-based virtual musuem
2019 (English)In: INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019 / [ed] Kemao, Q Hayase, K Lau, PY Lie, WN Lee, YL Srisuk, S Yu, L, SPIE-INT SOC OPTICAL ENGINEERING , 2019, article id 110491BConference paper, Published paper (Refereed)
Abstract [en]

We have been researching and developing virtual museums that can enable a user to appreciate artworks with much reality and less stress as if one is experiencing in actual museums. For this time, as a method to further increase the reality of the virtual museum, we developed a virtual museum using Head Mounted Display. We used Oculus Rift and Unity Game Engine to develop this VR museum. We also performed a comparison of the developed VR museum and the screen-based virtual museum in order to maximize the user experience of the virtual museum. Four aspects of "Freedom of operation". "Immersion", "Comfort of play", and "Picture quality" are examined to clarify which type of virtual museum would be suitable for any specific user's needs.

Place, publisher, year, edition, pages
SPIE-INT SOC OPTICAL ENGINEERING, 2019
Series
Proceedings of SPIE, ISSN 0277-786X, E-ISSN 1996-756X ; 11049
Keywords
Virtual Museum, VR, HMD, Oculus
National Category
Computer Systems
Identifiers
urn:nbn:se:uu:diva-383056 (URN)10.1117/12.2521304 (DOI)000464743900046 ()978-1-5106-2774-1 (ISBN)
Conference
International Workshop on Advanced Image Technology (IWAIT), JAN 06-09, 2019, Singapore, SINGAPORE
Available from: 2019-05-08 Created: 2019-05-08 Last updated: 2019-05-08Bibliographically approved
Asada, A., Hayashi, M. & Hirayama, M. J. (2019). TV production tool to make art programmes based on a simple scenario. In: Kemao, Q Hayase, K Lau, PY Lie, WN Lee, YL Srisuk, S Yu, L (Ed.), INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019: . Paper presented at International Workshop on Advanced Image Technology (IWAIT), JAN 06-09, 2019, Singapore, SINGAPORE. SPIE-INT SOC OPTICAL ENGINEERING, Article ID 1104921.
Open this publication in new window or tab >>TV production tool to make art programmes based on a simple scenario
2019 (English)In: INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019 / [ed] Kemao, Q Hayase, K Lau, PY Lie, WN Lee, YL Srisuk, S Yu, L, SPIE-INT SOC OPTICAL ENGINEERING , 2019, article id 1104921Conference paper, Published paper (Refereed)
Abstract [en]

We have been studying and developing the real-time Computer Graphics (CG) based virtual museum where a user can walk through to appreciate artworks digitized in high-resolution. Our virtual museum also has a function to automatically create TV program-like CG animations using 3D CG models in the virtual space as it is so that the user can learn about individual works by watching the art shows. The CG animation is produced with TVML (TV program Making Language) engine implemented on the virtual museum. However, the current problem is that it requires a lot of work for a developer to write the complicated TVML scripts manually Therefore, this time we have developed a special tool to help the developer to prepare the TVML scripts easily. With this tool, the developer can produce the TVML-based art program simply by writing out a simple scenario on an ordinary text editor. In order to design this tool, TV art programs actually broadcasted are analyzed to determine the syntax of the simple scenario. Based on the analysis, we have developed the tool with TVML engine working on the Unity game Engine. We have also used this tool to imitate the broadcasted TV program to validate its usability.

Place, publisher, year, edition, pages
SPIE-INT SOC OPTICAL ENGINEERING, 2019
Series
Proceedings of SPIE, ISSN 0277-786X, E-ISSN 1996-756X ; 11049
Keywords
CG animation, video production tool, TVML, Virtual museum
National Category
Computer Systems Software Engineering
Identifiers
urn:nbn:se:uu:diva-383055 (URN)10.1117/12.2521298 (DOI)000464743900072 ()978-1-5106-2774-1 (ISBN)
Conference
International Workshop on Advanced Image Technology (IWAIT), JAN 06-09, 2019, Singapore, SINGAPORE
Available from: 2019-05-08 Created: 2019-05-08 Last updated: 2019-05-08Bibliographically approved
Hayashi, M., Bachelder, S., Tsuruta, N., Teraoka, T., Sasaki, K., Usami, W., . . . Kondo, K. (2018). Automatic Generation of a TV Programme from Blog Entries. In: Adjunct Proceedings of ACM TVX2018: . Paper presented at ACM TVX2018, Seoul, June 26-28, 2018..
Open this publication in new window or tab >>Automatic Generation of a TV Programme from Blog Entries
Show others...
2018 (English)In: Adjunct Proceedings of ACM TVX2018, 2018Conference paper, Poster (with or without abstract) (Refereed)
Abstract [en]

TVML (TV program Making Language) is a technology capable of obtaining TV (television)-programme-like Computer Graphics (CG) animation by writing text script. We have originally developed TVML and have been studying generative contents with the aid of TVML. This time, we have created an application that automatically converts blog posts into CG animations with TV news show format. The process is: 1) to fetch HTML of the blog posts and perform Web scraping and natural language processing to obtain summarized speech texts, 2) to automatically give a show format obtained from the analysis of professional TV programme to get TVML script, 3) to apply the CG character and artworks etc. that fit the blog content to obtain the final CG animation. In the demo session, we will explain the method and will demonstrate the working application on a PC connected to the Internet showing CG animations actually created on site.

Keywords
Computer graphics; animation; Internet blog; television programme
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:uu:diva-361989 (URN)
Conference
ACM TVX2018, Seoul, June 26-28, 2018.
Available from: 2018-09-28 Created: 2018-09-28 Last updated: 2018-10-01Bibliographically approved
Hayashi, M., Bachelder, S. & Nakajima, M. (2018). Automatic Generation of CG Animation from the Internet Forum "2 Channeru". Journal of the Institute of Image Information and Television Engineers, 72(10), 189-196
Open this publication in new window or tab >>Automatic Generation of CG Animation from the Internet Forum "2 Channeru"
2018 (Japanese)In: Journal of the Institute of Image Information and Television Engineers, ISSN 1342-6907, Vol. 72, no 10, p. 189-196Article in journal (Refereed) Published
Abstract [ja]

Web サイトをはじめとする様々な情報をテレビ番組的なCG アニメーションに自動変換する研究開発を進めている.今回,その試みの一つとして,「2ちゃんねる掲示板」からコンピュータ・グラフィックス(CG) アニメーションを自動生成するアプリケーションを開発した.基本的な方法は,実際のテレビ番組映像を分析し,そこで使われている制作ノウハウを抽出して,これをルール化および数値化し,ソフトウェアに実装することで,テレビ番組を真似たCG アニメーションを得るというものである.今回,実際に放送された1 時間分の討論番組映像のカメラスイッチングを解析しアルゴリズム化した.本論文では,このプロセスの詳細を説明し,この方法により作成した実際のアプリケーションについて述べる.また,得られたCG アニメーションについて評価実験を行い,本手法の有効性と今後の課題を明らかにしたので,これについて述べる.

Place, publisher, year, edition, pages
Tokyo, Japan: , 2018
Keywords
Automatic content generation, CG animation, Internet forum, Media conversion
National Category
Computer Sciences Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:uu:diva-368979 (URN)10.3169/itej.72.J189 (DOI)
Available from: 2018-12-10 Created: 2018-12-10 Last updated: 2018-12-11Bibliographically approved
Hayashi, M. (2018). Generating Play with Computer. In: : . Paper presented at The 12th International Symposium of Research Institute of Korean Dance.
Open this publication in new window or tab >>Generating Play with Computer
2018 (English)Conference paper, Published paper (Other academic)
Abstract [en]

I have been conducting research on the method of generating contents by computer. This time, the automatic generation of rap music video from a script and the slap-stick effect generation by the destruction of neurons in the neural network, are described in detail from the recent attempts. The former is in the direction of completion and the latter is in the direction of destroying it. This paper describes both concepts of creation and destruction, and the construction of complex systems which are equally important in art, and tries to give a guideline of art generation by computer.

Keywords
Computer-generated content; CG; neural network; automatic content generation; art and technology
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:uu:diva-368985 (URN)
Conference
The 12th International Symposium of Research Institute of Korean Dance
Available from: 2018-12-10 Created: 2018-12-10 Last updated: 2019-03-07Bibliographically approved
Hayashi, M. (2018). Neurodrug: Slapstick Effects by Destroying Neurons in a Neural Network. In: 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE): . Paper presented at IEEE GCCE2018 (2018 IEEE 7th Global Conference on Consumer Electronics), October 9-12, 2018, Nara, Japan (pp. 588-589). IEEE
Open this publication in new window or tab >>Neurodrug: Slapstick Effects by Destroying Neurons in a Neural Network
2018 (English)In: 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), IEEE, 2018, p. 588-589Conference paper, Published paper (Refereed)
Abstract [en]

We propose a method to possibly generate slapstick effects by deliberately cutting out, tampering and re-connecting neurons in the neural network which has been trained in a proper way. We have developed two applications of a drumbeat generator and a CG character animation as the experiments to try out the idea. The results look interesting and show a certain potential for entertainment and also a viable way of interactive art.

Place, publisher, year, edition, pages
IEEE, 2018
Series
IEEE Global Conference on Consumer Electronics, ISSN 2378-8143
Keywords
Neural network, deep learning, CG animation, drumbeat, slapstick
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:uu:diva-368984 (URN)10.1109/GCCE.2018.8574811 (DOI)000459859500204 ()978-1-5386-6309-7 (ISBN)
Conference
IEEE GCCE2018 (2018 IEEE 7th Global Conference on Consumer Electronics), October 9-12, 2018, Nara, Japan
Available from: 2018-12-10 Created: 2018-12-10 Last updated: 2019-03-18Bibliographically approved
Tsuruta, N., Teraoka, T., Kondo, K. & Hayashi, M. (2018). TV Show Template for Text Generated TV. In: 2018 International Workshop on Advanced Image Technology (IWAIT): . Paper presented at International Workshop on Advanced Image Technology (IWAIT), JAN 07-09, 2018, Chiang Mai, THAILAND. IEEE
Open this publication in new window or tab >>TV Show Template for Text Generated TV
2018 (English)In: 2018 International Workshop on Advanced Image Technology (IWAIT), IEEE , 2018Conference paper, Published paper (Refereed)
Abstract [en]

The technique which converts text-based document into a TV show like computer graphics animation has been developed. However, writing a scripting language requires a variety of knowledge on TV shows such as speech timing, camera angle, lighting and so on. In this paper, we propose TV show template that contains animation settings imitating a particular type of TV show and semi-automatic animation generation using it.

Place, publisher, year, edition, pages
IEEE, 2018
Series
Proceedings of International Workshop on Advanced Image Technology, ISSN 2306-2274
Keywords
animation, text visualization, media conversion, scripting language
National Category
Computer Systems
Identifiers
urn:nbn:se:uu:diva-365886 (URN)10.1109/IWAIT.2018.8369756 (DOI)000434996800136 ()978-1-5386-2615-3 (ISBN)
Conference
International Workshop on Advanced Image Technology (IWAIT), JAN 07-09, 2018, Chiang Mai, THAILAND
Available from: 2018-11-20 Created: 2018-11-20 Last updated: 2018-11-20Bibliographically approved
Hayashi, M., Bachelder, S., Tsuruta, N., Sasaki, K. & Kondo, K. (2018). Wordpress-based Blog System with a Capability of Showing Entries by TV-program-like CG Animations. In: : . Paper presented at ADADA2018 (The 16th International Conference of Asia Digital Art and Design), 22-24 November 2018 in National Cheng Kung University, Taiwan.
Open this publication in new window or tab >>Wordpress-based Blog System with a Capability of Showing Entries by TV-program-like CG Animations
Show others...
2018 (English)Conference paper, Poster (with or without abstract) (Other academic)
Abstract [en]

We have developed a blog system with Wordpress which has a capability of automatically converting its blog entries into CG animations. By embedding necessary functions in Wordpress' s theme, a user can select this theme and construct a blog where readers can watch CG animation instead of reading the blog entry. The CG animation is created by TVML (TV program Making Language) technology which enables to make a TV-program-like animation with CG characters with synthesized voices, image data display, sound data playback, superimposing and so on. Not only to contribute to the Wordpress community, in particular, expected as an auxiliary function of the blog service, but also this could work as a production tool for creating various types of CG animations rather than blogging assistance.

Keywords
Blog, CG animation, TV production tool
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:uu:diva-368981 (URN)
Conference
ADADA2018 (The 16th International Conference of Asia Digital Art and Design), 22-24 November 2018 in National Cheng Kung University, Taiwan
Available from: 2018-12-10 Created: 2018-12-10 Last updated: 2018-12-10Bibliographically approved
Hayashi, M., Bachelder, S., Nakajima, M. & Shishikui, Y. (2017). Rap Music Video Generator: Write a Script to Make Your Rap Music Video with Synthesized Voice and CG Animation. In: : . Paper presented at 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE, 24-27 Oct. 2017..
Open this publication in new window or tab >>Rap Music Video Generator: Write a Script to Make Your Rap Music Video with Synthesized Voice and CG Animation
2017 (English)Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

We have made an application to make rap music video with CG animation by writing out a simple script. Aquestalk and TVML (TV program Making Language) are used for synthesized voice and real-time CG generation, respectively. A user can enjoy making rap music video easily by writing speech texts and character movements along with the music beat in the script.

Keywords
CG animation, Voice synthesis, Music, TVML, Aquestalk
National Category
Computer Sciences
Research subject
Computing Science
Identifiers
urn:nbn:se:uu:diva-336338 (URN)10.1109/GCCE.2017.8229189 (DOI)000426994600004 ()978-1-5090-4046-9 (ISBN)978-1-5090-4045-2 (ISBN)
Conference
2017 IEEE 6th Global Conference on Consumer Electronics (GCCE, 24-27 Oct. 2017.
Available from: 2017-12-13 Created: 2017-12-13 Last updated: 2018-06-29Bibliographically approved
Hayashi, M., Shishikui, Y., Bachelder, S. & Nakajima, M. (2017). ラップスクリプト: テキストを書いて音声合成とCGアニメのラップが作れる. In: : . Paper presented at Art & Science Forum.
Open this publication in new window or tab >>ラップスクリプト: テキストを書いて音声合成とCGアニメのラップが作れる
2017 (Japanese)Conference paper, Poster (with or without abstract) (Other (popular science, discussion, etc.))
Abstract [en]

We have made an application to make rap music with CG animation by writing out a simple script. Aquestalk and TVML are used for synthesized voice and real-time CG generation, respectively. A user can enjoy making rap music video easily by writing speech texts and character movements along with music beat in the script.

Keywords
CG animation,Voice synthesis,Music, TVML,Aquestalk
National Category
Computer Sciences
Identifiers
urn:nbn:se:uu:diva-336334 (URN)
Conference
Art & Science Forum
Note

English title: Rap making script : you can make your own rap with synthesized voice and CG animation by writing a script

Available from: 2017-12-13 Created: 2017-12-13 Last updated: 2018-01-13Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-5153-9036

Search in DiVA

Show all publications