D.A.I.R. Digital Artist In Residence

The Fondazione Giorgio Cini, within the framework of the ARCHiVe Centre, announces 2 residential scholarships for 1 month each covering the cost of accommodation, aimed at artists with proven experience, of any artistic language and expressive tool, of any age and nationality.

deadline

Application deadline is postponed until 15 July, 2024 (applications must be uploaded by 11:59 pm CET).

The 2 scholarships are addressed, within the multidisciplinary context of the Fondazione Giorgio Cini on the Island of San Giorgio Maggiore, to Italian and foreign artists interested in spending a period of 1 month at the ARCHiVe digitisation laboratory for a direct confrontation with the potential of new technologies for the digitisation of cultural heritage, with the tools of AI applied to digital humanities and mainly in the reuse of data already in the archives of Fondazione Giorgio Cini in a creative and design key. The aim of the project is to enable dialogue between artists and computer scientists, developers, and archivists, in general between art and science, to narrow disciplinary distances, to create contamination between languages and to produce new works starting from the reuse of the digital heritage of the Fondazione Giorgio Cini.

Candidates are not required to have digital skills but will be able to take advantage of the support of ARCHiVe staff.

The goal of the residency period is the writing of a project, not the execution of the work. The Fondazione Giorgio Cini will be able to support the production of the digital artwork by agreeing on its realization with the artist who will be eventually selected.

Discover ARCHiVe projects, and available technologies.
We use various frameworks and models for computer vision, including:
– Detectron2 for object detection;
– Segment Anything for image segmentation (MobileSAM);
– Vertex AI, from Google.

Access to the digital archives of the Fondazione Giorgio Cini.
Information about ARCHiVe Online Academy.

Candidates must propose a research project preferably dedicated to the use of data from completed or ongoing digitisation campaigns or focused on the themes addressed in the ARCHiVe Online Academy training programme.

The two scholarships dedicated to the D.A.I.R. Digital Artist in Residence project guarantee access to the digitisation laboratory and the possibility of using, in collaboration with the operators of the Fondazione Giorgio Cini, all the technological equipment and computer apparatus of the ARCHiVe Centre.

In addition, selected artists will have access to:

  • Libraries and Photographic Library of the Fondazione Giorgio Cini, specialised in art history, history of Venice, literature, music, dance, theatre, rare books, comparative civilisations, and spirituality. The libraries are equipped with Wi-Fi connection.
  • Cultural initiatives (seminars, conferences, concerts, exhibitions) organised by the Fondazione Giorgio Cini, which will give residents the opportunity to place their digital research in a broader cultural perspective.

The Residence, located in the park of the Island, can accommodate up to 90 scholars simultaneously in single and double accommodations. The Residence is equipped with reception services, surveillance, cleaning, and self-service laundry. To promote social life and the circulation of ideas, common spaces are open to all guests: living room, music room, fitness area, terrace.

Recording Banksy’s Migrant Child and monitoring Venice Lagoon

Gabriel Scarpa recording the Migrant Child from a boat © Factum Foundation
A test of the facsimile © Factum Foundation

2019 – 2022

ARCHiVe decided to record The Migrant Child in high-resolution to demonstrate the urgent need to preserve and document cultural heritage before it is lost or damaged. 

équipe

  • Carlos Alonso | Factum Arte
  • Silvia Álvarez | Factum Arte
  • Nicolas Béliard | Factum Foundation
  • Florencio Martínez Tortosa | Factum Arte
  • Pedro Miró | Factum Foundation
  • Rafa Rachewsky | Factum Arte
  • Pedro Vicente Salafranca Hernández | Factum Arte
  • Gabriel Scarpa | Factum Foundation
  • Oak Taylor Smith | Factum Foundation

project

ARCHiVe is devoted to preserving Venice’s culture; its contemporary life as well as its historic past.

During the 2019 Venice Biennale, the pink flare of Banksy’s The Migrant Child first appeared just above the waterline on a palace facing the Canal of Dorsoduro in Venice. In the same year, amid flooding and rumours that the mural was scheduled for removal, ARCHiVe decided to record The Migrant Child in high-resolution to demonstrate the urgent need to preserve and document cultural heritage before it is lost or damaged. 

From 2022 this year the Factum team finalized the processing of the data and rematerialised the painting and a section of the wall around it.

The high-resolution photogrammetry was recorded by Gabriel Scarpa, operating from a distance in a boat in the canal, which was a significant challenge. However, the results have encouraged a study into the condition of the wall and will enable a detailed condition monitoring of the work. The work to monitor the condition of the impact of the water on the fabric of the city is a core part of ARCHiVe’s mission. The Divirod sensors, installed on the island, are monitoring the level of the water, the wind direction, the wave frequency and the wave intensity 24/7 using ambient signals from passing satellites.

viewer

Technologies

Photogrammetry

Photogrammetry is a 3D recording technique that uses 2D images to create a digital 3D model of an object or surface. It involves taking hundreds of overlapping photographs and processing them using sp[...]

The Mask of Time

2021 – 2022

Artificial Intelligence, 3D creation and modelling, sound design and fashion, interwoven with the Fondazione Giorgio Cini heritage of collections and archives have given rise to a highly original work of art: The Mask of Time. This audiovisual work by Mattia Casalegno and Martux_m raises awareness of the need to enhance the Teatro Verde.

Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time
Video still from The Mask of Time

èquipe

the project

Commissioned by Vittorio Cini and inaugurated in 1954, the open-air amphitheatre designed by architect Luigi Vietti (1903-1998) has often been an important cultural venue in Venice and has hosted excellent productions of the performing arts. In 2021 the theatre was the subject of a major restoration project that, thanks to a partnership with Cartier,  brought its architecture back to life and made the most of all the qualities of the building materials, the surrounding greenery, the fascinating spaces and the stunning landscape views.

To enhance this beautiful theatre and relaunch its leading creative role, Fondazione Giorgio Cini invited Mattia Casalegno, one of Italy’s most successful digital artists based in New York, to create a work that would showcase the beauty of the theatre starting from the photogrammetric acquisition carried out with drones by Factum Foundation, an institutional partner of ARCHiVe. Curatorship is by Ennio Bianco.

In The Mask of Time, the architecture and history of the Teatro Verde have been brought back to life in a world inhabited by hyper-realistic avatars, made through the creative use of pioneering 3D animation and text processing software, combined with sound designed by Maurizio Martuscello aka Martux_m. The avatars will become actors performing the theatre’s great historical productions. Photorealistic digital human beings are immersed in real sets as well as dreamlike environments in a post-human sci-fi world, somewhere between fiction and representation, in which Nature and Art breathe and flourish. The narrative unfolds through intense imagery in four acts on the subject of the Teatro Verde: History, Performances, Present and Future. It thus explores themes such as teatri di verzura (garden theatres), the golden age of the amphitheatre, and its dialogue with Nature, both dominated and dominating and now a creative force cooperating in the theatre’s new lease of life.

© Fondazione Giorgio Cini
© Fondazione Giorgio Cini
© Fondazione Giorgio Cini
© Fondazione Giorgio Cini
© Massimo Pistore for Fondazione Giorgio Cini

objectives

Mattia Casalegno’s work starts from the idea of theatre as a place of fiction and representation. Situated at the intersection between Nature and Culture, it explores the relationships and tensions that unite the natural environment, the human world, and technologies.

The project starts from the notion that people interact with the world through multiple sensory streams: we see objects, hear sounds, read words, feel textures, taste flavours, combine information, and form associations between the senses. Similarly, real-world data is made up of various signals occurring simultaneously, such as video frames and audio tracks, web images, captions, and voice tracks. Casalegno adopts this common logic in the creation of the multimodal work The Mask of Time.

In The Mask of Time, thanks to a combination of in-depth archival research on material held by the Fondazione Giorgio Cini’s Institute of Theatre and Opera and the innovative application of Artificial Intelligence with the visual power of new kinds of software, the architecture and the history of the Teatro Verde have been brought back to life in a world inhabited by hyper-realistic avatars. Fundamental is also the creative use of pioneering 3D animation and text processing software, combined with sound designed by Martux_m and the costume designs of the 3D garments by Amin Farah. All of these competencies are perfectly blended into a single artistic meta-language.

documents + technologies

1.

The Institute of Theatre and Opera provided over 10000 images of stage designs and performances held at the Teatro Verde, including photos of costumes from the plays on the Greek myth of Pasiphaë and the Minotaur to the Goldonian Commedia dell’Arte.

2.

Factum Foundation provided a complete survey of the Teatro Verde by making expert use of drones for the photogrammetry as part of the 3D digitisation project of the Island of San Giorgio.

3.

Mattia Casalegno was thus able to move some high-definition realistic human-digital actors within the space of the virtual Teatro Verde, created using the Unreal Engine MetaHuman Creator and the Reallusion Character Creator.

4.

MetaHuman Creator is a software enabling the designer to create photorealistic digital human beings. The character is refined by sculpting tools and control guides to achieve infinite variations in facial and body features.

5.

Character Creator 3 allows the designer to easily create and customise realistic subjects for use in the Unreal Engine and Unity platforms, combining 3D character generation, animation, rendering and interactive design in a single system. It thus allows 3D scanning technology, produced by Scanlab Photogrammetry and adopted from Hollywood game productions, to be applied to a stationary person to create a fully clothed speaking character moving freely in space.

6.

These digital human actors, or hyper-real avatars, can thus move or be fixed in digital tableaux vivants within a virtual theatrical spatiality, made possible by Unity Technologies Unity software.

future developments

In the future it will be possible to draw on all the materials used for this video, for example, to recreate paths inside the Teatro Verde enabling audiences to converse with characters generated in augmented reality, or to offer an interactive virtual tour experience of the Teatro Verde in a metaverse.