科技藝術書報討論

Topic: Reverse Pass-through VR (ACM SIGGRAPH – Emerging Technology)

PPT: 2021.10.19 ACM SIGGRAPH – Emerging Technology

Author: Nathan MatsudaFacebook Reality Labs

Abstract: We introduce reverse pass-through VR, wherein a three-dimensional view of the wearer’s eyes is presented to multiple outside viewers in a perspective-correct manner, with a prototype headset containing a world-facing light field display. This approach, in conjunction with existing video (forward) pass-through technology, enables more seamless interactions between people with and without headsets in social or professional contexts. Reverse pass-through VR ties together research in social telepresence and copresence, autostereoscopic displays, and facial capture to enable natural eye contact and other important non-verbal cues in a wider range of interaction scenarios.

Keywords: reverse pass-through, light field displays, virtual reality

Link:

https://s2021.siggraph.org/presentation/?id=gensub_158&sess=sess203
https://dl.acm.org/doi/fullHtml/10.1145/3450550.3465338#BibPLXBIB0003

Topic: Demonstrating Touch&Fold= A Foldable Haptic Actuator for Rendering Touch in Mixed Reality [Paper][PDF][PPT]
Author: Shan-Yuan Teng
Abstract: We propose a nail-mounted foldable haptic device that provides tactile feedback to mixed reality (MR) environments by pressing against the user’s fingerpad when a user touches a virtual object. What is novel in our device is that it quickly tucks away when the user interacts with real-world objects. Its design allows it to fold back on top of the user’s nail when not in use, keeping the user’s fingerpad free to, for instance, manipulate handheld tools and other objects while in MR. To achieve this, we engineered a wireless and self-contained haptic device, which measures 24×24×41 mm and weighs 9.5 g. Furthermore, our foldable end-effector also features a linear resonant actuator, allowing it to render not only touch contacts (i.e., pressure) but also textures (i.e., vibrations). We demonstrate how our device renders contacts with MR surfaces, buttons, low- and high-frequency textures.

Demonstrating MagnetIO: Passive Yet Interactive Soft Haptic Patches Anywhere – ACM SIGGRAPH 2021, Emerging Technologies

→ SIGGRAPGH 2021 Presentation

→ Full-text paper

→ Class Presentation

Authors – Alex Mazursky, Shan-Yuan Teng, Romain Nith, and Pedro Lopes (all from University of Chicago, US)

Key words – Human computer interaction, Passive actuator, Ubiquitous haptics

Interest Areas – Gaming & Interactive(AR), Research & Education

Abstract – MagnetIO is a new type of haptic actuator comprised of two parts: one battery-powered voice coil worn on the user’s fingernail and any number of interactive soft patches that can be attached to any surface (everyday objects, user’s body, appliances, etc.).When the user’s finger wearing the voice-coil contacts any of the interactive patches it detects its magnetic signature via magnetometer and vibrates the patch, adding haptic feedback to otherwise input-only interactions. To allow these passive patches to vibrate, we make them from silicone with regions doped with polarized neodymium powder, resulting in soft and stretchable magnets. This stretchable form-factor allows them to be wrapped to the user’s body or everyday objects of various shapes.

Topic: One Shot 3D Photography  ppt

Author: Johannes Kopf, et al.

Abstract: 3D photography is a new medium that allows viewers to more fully experience a captured moment. In this work, we refer to a 3D photo as one that displays parallax induced by moving the viewpoint (as opposed to a stereo pair with a fixed viewpoint). 3D photos are static in time, like traditional photos, but are displayed with interactive parallax on mobile or desktop screens, as well as on Virtual Reality devices, where viewing it also includes stereo. We present an end-to-end system for creating and viewing 3D photos, and the algorithmic and design choices therein. Our 3D photos are captured in a single shot and processed directly on a mobile device. The method starts by estimating depth from the 2D input image using a new monocular depth estimation network that is optimized for mobile devices. It performs competitively to the state-of-the-art, but has lower latency and peak memory consumption and uses an order of magnitude fewer parameters. The resulting depth is lifted to a layered depth image, and new geometry is synthesized in parallax regions. We synthesize color texture and structures in the parallax regions as well, using an inpainting network, also optimized for mobile devices, on the LDI directly. Finally, we convert the result into a mesh-based representation that can be efficiently transmitted and rendered even on low-end devices and over poor network connections. Altogether, the processing takes just a few seconds on a mobile device, and the result can be instantly viewed and shared. We perform extensive quantitative evaluation to validate our system and compare its new components against the current state-of-the-art.

Link:

https://arxiv.org/abs/2008.12298

https://s2020.siggraph.org/smile-photos-converted-into-3d-from-any-mobile-device/

PPT: https://docs.google.com/presentation/d/1uIvP17YXnXmpCcPJlOLc8kY13bqLfj0o/edit?usp=sharing&ouid=103926017209371204990&rtpof=true&sd=true

ARTWORK:

Mind – Shinseungback Kimyonghun ( ARS ELECTRONICA 2020)

2020 Interactive art+

Title:

“Google Maps Hacks” by Simon Weckert 

Report:

Links

Abstract:

由於 Google Maps推估路段上的車流狀況，其中一種方式就是透過計算同一路段下，同時間有多少隻手機使用該程式。

藝術家於一台小拖車中放置了 99 支有著個別SIM卡的二手智慧型手機並開啟Google Maps，

並拉動這一台小拖車於街上行走，就在約一小時的時間後於 Google Maps 上造成了 「虛擬塞車」的情形。

而塞車會導致Google Maps參照其路況，進而改變導航路徑，影響其他行經此路的用路人。

Keywords：權力、虛擬、真實

Report: Link

Topic: Exploring the structure of a real-time, arbitrary neural artistic stylization network

Author: Golnaz Ghiasi et al.

Reference: https://arxiv.org/abs/1705.06830

Abstract:

In this paper, we present a method which combines the flexibility of the neural algorithm of artistic style with the speed of fast style transfer networks to allow real-time stylization using any content/style image pair. We build upon recent work leveraging conditional instance normalization for multi-style transfer networks by learning to predict the conditional instance normalization parameters directly from a style image. The model is successfully trained on a corpus of roughly 80,000 paintings and is able to generalize to paintings previously unobserved. We demonstrate that the learned embedding space is smooth and contains a rich structure and organizes semantic information associated with paintings in an entirely unsupervised manner.

Compression Cradle by Lucy McRae – Ars Electronica 2020, Interactive+, Honorary Mentions

→ Class Presentation

→Lucy McRae Website

Key words – Touch, empathy, human condition

Theme/issue – “A Crisis of touch”

Summary – Compression Cradle is a machine that affectionately squeezes the body with a sequence of aerated volumes that hold you tight – in an attempt to prepare the self for a future that assumes a lack of human touch. It is an ongoing research project investigating the human losses and gains of touch. The project’s aim is to gather data at future exhibitions to form the premise for a new work and symposium that discuss research and new points of view on the future of touch, empathy, and the human condition. With a set of deeply ingrained beliefs and ethics, all of Lucy McRae’s projects, including the Compression Cradle, are committed to a single objective: the preservation of humanity.

2021.06.15 周巧其報告
Title:科技藝術的天才與窺探

PPT:
https://drive.google.com/file/d/12yCI5q_DdzSuAUrKttELqwyiW3sGaMCY/view?usp=sharing

Artwork:
Ars Electronica 2019
“Seer”-Takayuki Todo (JP)
Ars Electronica PRIX2021
“PL’AI”-Špela Petrič (SI)
Ars Electronica PRIX2021
“Cloud Studies”-Forensic Architecture (INT)

2021.05.18 周巧其報告
Title:科技藝術的當代借鏡

PPT:
https://drive.google.com/file/d/1ruNDkx_r0nKJfS4WXedBtrLqVvedEaMr/view?usp=sharing

Artwork:
Ars Electronica PRIX2020 Goldene Nica
“Be Water by Hong Kongers”
Ars Electronica PRIX2020
“Shadow Stalker”-Lynn Hershman Leeson
Ars Electronica 2019
“Biosignal_Cybernation”-Chiao-Chi Chou, You-Yang Hu

2021.04.20 周巧其報告
Title:科技藝術的信仰關鍵詞

PPT:
https://drive.google.com/file/d/1S4sV3ZdH2_bv_PLF753nnRitMPW5j0-f/view?usp=sharing

Artwork:
Ars Electronica1999 “Genesis”-Eduardo Kac
Ars Electronica PRIX2019 “REVERENT: MIRACLES ON DEMAND”-Adam Brown
Ars Electronica PRIX2020 “Appropriate Response”-
Mario Klingemann

Enhanced Family Tree: Evolving Research and Expression Overview
SIGGRAPH 2020 Art Papers – ACM SIGGRAPH

Enhanced Family Tree reimagines the possibilities of family trees with an evolving series of exhibits. The authors’ works combine genealogical data, visualization, 3D technologies and interactivity to explore and display ancient genealogical relationships. Their new approach may reveal questionable relationships in genealogical records. Moreover, the authors’ use of an organic metaphor of a “tree” can be further extended to increase public understanding and engagement. The audience’s questions arising from this project show increased curiosity and nuanced questioning about their own family origins and development.

https://direct.mit.edu/leon/article/53/4/367/96918/Enhanced-Family-Tree-Evolving-Research-and

科技藝術第三次簡報_NTHU Tom Lee

Artist : Paolo Cirio

Title : Capture / PPT

Exhibition :

1. Panorama 22exhibition at Le Fresnoy, 2020, Tourcoing – France
   2. Cybernetics of the Poor, exhibition at Kunsthalle Wien, 2020, Vienna – Austria
   3. Artissima Unplugged, solo show at GAM Musuem, 2020, Turin – Italy
   4. Plan B, exhibition at NOME Gallery, 2020, Berlin – Germany

Award : Prix ARS Electronica 2021 / Honorary Mentions

Category : AI & Life Art

Abstract :

藝術家Paolo Cirio 在法國抗議期間拍攝的照片中收集了 1,000 張警察的公開圖像，並使用人臉識別軟體對其進行了處理。

Paolo Cirio 創建了一個在線平台，其中包含一個 4,000 張警察面孔的數據庫，用物聯網技術網羅大量資訊，並依姓名獲取他們的身份證明。此外，Cirio 將警務人員的頭像輸出為街頭藝術海報，並將它們張貼在整個巴黎市區，以便在公共場所曝光。這個作品通過質疑權力的不對稱性，批判人臉識別和人工智慧的潛在用途和誤用。

此類技術缺乏隱私權法規，藝術家透過行動反對敦促使用它的政府當局。這一挑釁引發了法國內政部長和警察工會的反應，儘管法國公民和國際媒體都在慶賀這件藝術品，但他們還是對藝術品進行了壓制。

最初，Paolo Cirio 發起了一項運動，旨在倡議歐洲禁止人臉識別技術的濫用。2021 年的 A Ban on Facial Recognition in EU 活動中，Paolo Cirio 向歐洲各機構發送了一個包裹，其中包含一份法律投訴和他的研究以及擁有超過 50,000 個聲援者署名的請願書。

『歐盟執行委員會』最終通過承認有必要在法律上限制人工智慧的使用來回應Paolo Cirio 的請願訴求。

Topic: How to Draw the Coronavirus

Link:  PPT  &  Article

Theme: Covid-19, Art and Technology

Author: Rebekah Frumkin

Creators Mentioned: CDC illustrators Alissa Eckert and Dan Higgins, iSO-FORM’s Nick Klein and Jamie Vitzthum, Melanie Connolly, Jane Whitney, Jonathan Corum, David Goodsell.

Abstract: The disease that has put the entire world on pause is easily communicable, capable of stowing silently away in certain hosts and killing others, and, to the human eye, entirely invisible. In media parlance it’s become our “invisible enemy”: a nightmarish, oneiric force that can’t be seen, heard, or touched. But with the use of modeling software, scientists and illustrators have begun to visualize coronavirus, turning it into something that can be seen, understood, and, hopefully, eventually vanquished by science. Many of us imagine the virus as a sphere radiating red spikes—but why? Certain elements of these visualizations are based on the way coronavirus appears under a microscope, and others are choices that were made, an exercise of artistic license.