科技藝術書報討論

U!Scientist: Designing for People-Powered Research in Museums – SIGCHI 2021, Best Paper

→ U!Scientist Web

→ Full-text Paper

→ Class Presentation

Authors –Mmachi God’sglory Obiorah et al.

Key words – Citizen science, museums, interactive tabletop displays

Abstract – Scientists have long sought to engage public audiences in research through citizen science projects. This project engages public audiences in contributing to real research as part of their visit to a museum. We present the design and evaluation of U!Scientist, an interactive multi-person tabletop exhibit based on the online Zooniverse project, Galaxy Zoo. We installed U!Scientist in a planetarium and collected video, computer logs, naturalistic observations, and surveys with visitors. Our findings demonstrate the potential of exhibits to engage new audiences in collaborative scientific discussions as part of people-powered research.

Tracking the Loving Gaze – Leonardo 2021, Artists’Article

→ Leonardo journal [MIT press]

→ Journal

→ Class Presentation

Authors – Theopisti Stylianou-Lambert & Omiros Panayides (Cyprus University of Technology, CY)

Key words – Personal photography, Eye tracker, Loving gaze

Abstract – Tracking the Loving Gaze is a futile attempt to follow, map and capture the way cherished personal photographs are viewed. The authors asked 30 survey subjects to use an eye tracker while looking at a preselected photograph that held a special meaning for them. The raw visual data from this process—heat maps, focus maps and scan paths—became the foundation of a body of work that includes darkroom prints, short videos and a limited-edition artist book. Apart from exploring the invisible viewing processes of personal photography, this article introduces the concepts of the detached and the invested viewer as well as the corresponding concepts of the cold and the loving gaze.

20211214_Dual LearningMM ’21 MultiMedia: October 20–24, 2021, Virtual Event, China

Topic: Dual Learning Music Composition and Dance Choreography [Paper][ppt][pdf]

Author: Shuang Wu et al.

Abstract:
Music and dance have always co-existed as pillars of human activities, contributing immensely to the cultural, social, and entertainment functions in virtually all societies. Notwithstanding the gradual systematization of music and dance into two independent disciplines, their intimate connection is undeniable and one artform often appears incomplete without the other. Recent research works have studied generative models for dance sequences conditioned on music. The dual task of composing music for given dances, however, has been largely overlooked.

In this paper, we propose a novel extension, where we jointly model both tasks in a dual learning approach. To leverage the duality of the two modalities, we introduce an optimal transport objective to align feature embeddings, as well as a cycle consistency loss to foster overall consistency. Experimental results demonstrate that our dual learning framework improves individual task performance, delivering generated music compositions and dance choreographs that are realistic and faithful to the conditioned inputs.

MM ’20: the 28th ACM International Conference on Multimedia

Topic: Anisotropic Stroke Control for Multiple Artists Style Transfer ppt

Author: XuanHong Chen et al.

Abstract:

Though significant progress has been made in artistic style transfer, semantic information is usually difficult to be preserved in a fine-grained locally consistent manner by most existing methods, especially when multiple artists styles are required to transfer within one single model. To circumvent this issue, we propose a Stroke Control Multi-Artist Style Transfer framework. On the one hand, we design an Anisotropic Stroke Module (ASM) which realizes the dynamic adjustment of style-stroke between the non-trivial and the trivial regions. ASM endows the network with the ability of adaptive semantic-consistency among various styles. On the other hand, we present an novel Multi-Scale Projection Discriminator to realize the texture-level conditional generation. In contrast to the single-scale conditional discriminator, our discriminator is able to capture multi-scale texture clue to effectively distinguish a wide range of artistic styles. Extensive experimental results well demonstrate the feasibility and effectiveness of our approach. Our framework can transform a photograph into different artistic style oil painting via only ONE single model. Furthermore, the results are with distinctive artistic style and retain the anisotropic semantic information.

Link:  https://dl.acm.org/doi/abs/10.1145/3394171.3413770

主題：《基於視覺之意識遞延科技藝術創作論述》
Vision-based Consciousness Transmit and Extend Techno Art Creation

作者：黃浩旻

摘要：
In the context start with the observation of the relationship between humans and technology. Can consciousness be carried by technology to receive and control information in the real world? To clarify this issue, need to research in the fields of knowledge, such as philosophy, psychology, biology, futurology, etc. This context as the main theme to create, and analyze the experience process to clarify, analyze the meaning and logic of the results of the work.

關鍵字：Consciousness, Human Augmentation, Interactive Art, Installation Art, Virtual Reality.

報告：LINK

主題：《返轉抑制：時間空間的光學具象 》
作者：洪梓倪

摘要：
本論⽂創作因主要創作之空間、聲⾳裝置作品媒材與重點概念有互相交錯牽引 關係遂將性質劃分不以年代劃分，以「空間」、「速度」、「⼈」為基軸排列，對 應「裝置」、「錄像」與「表演」，關鍵概念上互為有機網狀連結。以最近期創作 之作品《 返轉抑制 Reversal Inhibition 》作為主要出發，先調查搜集時間概念與其演 進⽅式，⽽後帶⼊展演形式衍⽣相關實作技術、理論或範例，進⽽交叉帶⼊⾃⾝之 動機與對科技之想像，進⽽相互辯證探討。

空間作品《 返轉抑制 Reversal Inhibition 》、《秩序 The Order 》與表演裝置 《Prism 聲⾳裝置》為筆者主要創作主軸遂以較多幅度探討，其核⼼媒材與概念為 「光線光學(ray optics)」之「成像(imaging)」與「折射(refraction)」在空間中所造成 的反饋作⽤(feedback)；前期之錄像類創作《 Hey Kiddo, sooner or later you will grow up. 》與《 ⼈間排泄 Excretion 》、《 台北無間 Taipei Nowhere 》概念核⼼則圍繞現 實空間中之「速度」在透過鏡框式影像限制後加以敘事之⽇常隨筆與概念實驗；表 演作品《 未來的凌遲 An afterlife torture 》則主要分析⾝體如何在場及作為展演之⾝ 體為何，並藉機回應第⼆章創作動機中所提到科技與⼈之間的種種假設。

作品皆有⼀個共同探討之議題——不論是城市中、空間中、⼈意識中「在某個 特定時間造成之點、線、⾯」及其中所造成的⼀切「速度」之於空間。遂將《 返轉 抑制：時間空間的光學具象 Reversal Inhibition : Optical Materialization of Time and Space 》定為此⼤綱論述之探討主題。

關鍵字： 時間、速度、折射(refraction)、光線光學 (ray optics)、環境節奏、Beats Per Minutes(BPM)、虹、⾊散、類⽐、點線⾯、聽覺、反饋作⽤(feedback)。

PPT：LINK

主題：《流變空間：虛實空間中的身體感知》

作者：許巽翔

摘要：

在科技媒體迅速發展蓬勃的今日，那條原本在最原始的真實空間與虛擬空間之間還能被劃分清楚的分界線，也因為爆炸性成長發展的科技技術而互相覆蓋並逐漸糊。現代人的身體感知在這樣實虛不斷加速交織的過程中也開始更加嚮往於虛擬空間中那些於現實生活中無法體驗的特殊經驗。逐漸數位化的感受經驗似乎成為了我們未來的唯一指向，而在真實與虛擬
之間的拉扯也成為了今日我們都必須面對的議題。
本文的章節將依序整理我從進入研究所之後對於人與實虛空間之相關議題的創作進行脈絡整理。從《Ultra Line》系列作為出發，以放置巨大尺度的光線比例尺於戶外空間進而探討在真實世界中人與人造建築和自然環境之間的尺度關係。到《闔眼之前》，藉由空間裝置的搭建再現並重新詮釋因科技指數型蓬勃發展的環境之下，人在實體空間中與電子載具平面所形成的虛擬沈浸空間的交互關係。到最後的《流變空間》則是將前兩件作品探討的面相做結合，試著透過媒材的介入使原本單純的現實幾何空間因隨機亂數切割的剖線而將其有機化並產生實虛難辨的空間邊界，進而在黑暗中創造出實虛組合的空間量體，使人對於空間的感受藉由奇觀式的視覺體驗重新回歸於最本能的身體感知。希望能夠藉由這些作品的特性進而去探討在數位時代中虛實空間與人之間的關係。

關鍵字：空間尺度、虛實空間、身體感知、光、雷射、空間裝置

PPT：https://docs.google.com/presentation/d/1h2IIf6s9kf7Sa1LDWtdkVdOSdBlNpKve/edit?usp=sharing&ouid=111916077752186800808&rtpof=true&sd=true

《「小而輕」展覽之創造——擴增實境作為博物館新體驗媒介》

→ 論文

→ 簡報

作者 – 馮歆宇

關鍵字 – 擴增實境，博物館體驗，迭代設計

主旨 – 傳統博物館在創造數位體驗上需要注意什麼？本論文從探討AR技術運用著手，作出回應。作者認為展覽數位化不應僅著重軟硬體數量，而應綜合技術應用、體驗沈浸、文化創新等多面向。她歸納出一些策略，並以自己參與企劃的舊展覽為原型，提出新的「更小、更輕」的具體方案，進一步說明如何應對AR展覽中物件敘事、結合場域等方面的問題。

Topic: Medium . Permeation  ppt

Author: YuanFu Yang, Iuan Kai Fang

Abstract:

Impressionism expressed the scientific meaning of “light” in artistic creation. The light color reflected by the luminous flux through the medium in the air became the concept of impressionists’ creation.

After collecting the web imagination of global citizens about COVID19, we trained the generative model and let the computer randomly synthesize it. We adjusted various parameters during the training process making the results such as Dou Jia, Monet, Renoir , their style paintings.

Through this work the diffusion path of COVID19 spreading the molecular of the virus through the air, just like the scattering phenomenon formed by light through the particles in the air. Color is exclusive to the humans’ world, and COVID19 is also born with humans.

Link:

https://techart-ars.tw/2021/?page_id=293

https://github.com/Yfyangd/Ars-Electronica-2021

Topic：Bricolage

Report：LINK

Artist：Guy Ben-Ary (AU), Nathan Thompson (AU), Sebastian Diecke (DE)

Keywords：Bio/Live Art, Stem cell technology, Bio Engineering, Biological Alchemy, Living kinetic sculptures, Surrogate performer

Abstract：In Bricolage we create autonomous, animated, living, biological entities that have the ability to self-assemble and are hosted in a suspended vessel (Incubator) custom made of clay, metal, and glass. These automatons are made from three main materials: blood, heart, and silk. They are made from bio-engineered human heart muscle cells that grow on bodies made of silk. The muscle cells beat in real time manipulating the automatons’ movement.

Site：http://guybenary.com/work/bricolage/

Topic: Sound for Fungi. Homage to Indeterminacy (LINK) Report [PPT][ PDF]

Author:Theresa Schubert (LINK)

Keyword: Bio-Sound, Fungi Growth Sound

https://calls.ars.electronica.art/prix/winners/5588/

Abstract: Sound for Fungi. Homage to Indeterminacy is a generative video that simulates hyphae’s growth and via a hand tracking sensor allows people to interact with these. Thus, a visitor can take on the role of a sound frequency modulating the hyphae growth in real-time and move through the network. The multiplicity of fungi becomes tangible through being able to change perspective in a 3D environment and fluidly shift from a macro view to a cellular level opening up fragile topologies made of nodes, connections and their environment.

Topic: The Transparency of Randomness (ARS Electronica 2020)

Author: Mathias Gartner (AT), Vera Tolazzi (AT)

Abstract: The Transparency of Randomness ist eine interaktive Rauminstallation, die Einblick in die Welt des Zufalls gibt. In einem transparenten Würfelsystem werden kontinuierlich Zufallszahlen generiert, die als Basis für Echtzeitberechnungen sowie Visualisierungen dienen. Dieser Prozess wird durch die Verwendung verschiedenster Naturmaterialen und deren Komplexität beeinflusst.

ppt：https://docs.google.com/presentation/d/1ixteCk0cvKRVOVrjfog5Xn_G-Kkk59dei_LVOa5d97w/edit?usp=sharing

link: https://ars.electronica.art/keplersgardens/de/the-transparency-of-randomness/

PPT: https://docs.google.com/presentation/d/19_JjsnxkNY1IJBLsiwkXm0ZuW54kfc6l/edit?usp=sharing&ouid=103926017209371204990&rtpof=true&sd=true

Paper: Knitted RESi: A Highly Flexible, Force-Sensitive Knitted Textile Based on Resistive Yarns [SIGGRAPH ’20] [UIST ’18]

Video:

Topic: ZoomTouch:Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition

Report: Link

Report: Link

Topic: SlideFusion: Surrogacy Wheelchair with Implicit Eyegaze Modality Sharing

Author: Ryoichi Ando et al.

Reference: SlideFusion | ACM SIGGRAPH 2020 Emerging Technologies

Abstract:

For mobility-impaired people, the wheelchair is considered as a main navigation and accessibility device. However, due to the inherited design of the chair, the user is restricted to utilize his hand all the time during navigation resulting in a dual impairment. Our proposed system, SlideFusion, expands on previous work of collaborative and assistive technologies for accessibility scenarios. SlideFusion is focused on the remote collaboration of the mobility impaired person, that an operator can remotely access an avatar embedded into the wheelchair. To reduce the physical and cognitive overload on the wheelchair user, we propose the use of eye gaze modality sharing with the remote operator. The eye gaze modality enables implicit interactions that do not require the user to point or verbally say, thus leveraging indirect communication. By using this, not only accessibility can be provided to wheelchair users and their caregivers, but also hearing impairments and pronunciation disorders are applicable.