Using augmented reality to reunite pet owners with their deceased dogs

J-STORIES - For many people, pets provide comfort and relief from the stresses of daily life. But the loss of a much-loved animal companion can cause enormous emotional distress, and even lead to physical illness. Hoping to relieve even just a little of that pain, a Tokyo company has developed an augmented-reality system that digitally brings pet dogs back to life.

The service was launched this January by Sasuke Tokyo. First, a pet dog is scanned using a proprietary 360-degree photo system to acquire the data for a 3D virtual model. This model can then be used to re-create the appearance and movements of the pet for viewing via smartphone or special headset.

The photo data can also be used to create 3D-printed figures of pets. Source: Sasuke Tokyo

Using a smartphone, AR (augmented reality) technology can make it seem as if the deceased dog is present and moving in the owner’s actual home. The system only shows a dog for around 40 seconds, but it re-creates a series of movements from the dog lying down asleep to getting up and approaching the viewer. It can also reproduce the dog’s typical actions and bark. Wearing a special headset creates an even more realistic experience and sense of closeness to the dog.

The process from photographing a dog to producing a 3D-printed figure.     Source: Sasuke Tokyo — The process from photographing a dog to producing a 3D-printed figure. Source: Sasuke Tokyo

Interaction with much-loved pets has the power to make owners forget everyday tiredness and stress. According to a 2023 survey of 50,000 people by the Japan Pet Food Association, the most common reason why people keep dogs is because they want “healing and comfort” in their daily lives.

A dog being scanned by the 360-degree photo system.     Source: Sasuke Tokyo — A dog being scanned by the 360-degree photo system. Source: Sasuke Tokyo

For this reason, when a pet dies the grief can be enormous. According to a 2023 survey by Ipet Insurance Co. Ltd., 60% of people whose pets died said they experienced grief. Furthermore, around 60% of those who had lost pets said they had regrets about the way they had treated their pets. Around half, meanwhile, said they had vague feelings that they could have been done or that they wished they had valued their time together with their pet more (multiple answers were allowed.)

The 360-degree photos are used to create moving images of deceased pets.      Source: Sasuke Tokyo — The 360-degree photos are used to create moving images of deceased pets. Source: Sasuke Tokyo

The system was inspired by the experiences of Sasuke Tokyo CEO Yoshie Ueyama in caring for her own dog, who is 19. As her dog became older, she found herself making more and more urgent visits to the vet and becoming aware of dogs of the same age dying. She decided that she wanted to preserve memories of her dog in the form of 3D data while it was still healthy.

Artists skilled in 3D imaging adjust the scan data to create an AR dog.     Source: Sasuke Tokyo — Artists skilled in 3D imaging adjust the scan data to create an AR dog. Source: Sasuke Tokyo

Using the system, owners can not only remember lost pets, but even create “new” memories; for example, by combining the 3D data with favorite scenery or places, they can visit places they weren’t able to go with their pets in real life. It may also be of value to owners who want to create a more vivid record of their dog’s early years and journey to adulthood. According to Sasuke Tokyo, developments in generative AI may make it possible to develop similar services for other animals such as cats and birds, that are less likely to stay still while being photographed in the studio.

A conceptual image showing that AR technology can make it seem as if a deceased dog is actually in the owner’s home.    Source: Sasuke Tokyo — A conceptual image showing that AR technology can make it seem as if a deceased dog is actually in the owner’s home. Source: Sasuke Tokyo

Ueyama says that, even if it is impossible to fully heal the pain of losing a pet, such avatars created using 3D data feel more real than figurines or stuffed animals, helping people remember their pets and heal. Her company is currently developing a metaverse where owners can take their deceased pets for walks and let them play with other pets. She hopes that communication and sharing of feelings among owners in the virtual space might help alleviate their grief.

A conceptual image showing a metaverse space where owners can interact via avatars of their deceased pets.    Source: Sasuke Tokyo — A conceptual image showing a metaverse space where owners can interact via avatars of their deceased pets. Source: Sasuke Tokyo

Currently, the system costs 270,000 yen (excluding tax) for the smartphone version and 370,000 yen (excluding tax) for the headset version. Yet despite the relatively high price, the company quickly started to receive inquiries.

Wearing a special VR headset creates an even more realistic experience as shown in this conceptual image.     Source: Sasuke Tokyo — Wearing a special VR headset creates an even more realistic experience as shown in this conceptual image. Source: Sasuke Tokyo

“At the moment, in terms of price, the service is still limited to those who have enough money and are suffering deep grief,” says Ueyama. “If the number of users increases, and if we can reduce the time required for production through further technological development, we would like to expand its use as a slightly cheaper service that can reach more people.”

“One day I will have to face the loss of my own much-loved dog. As a pet owner, and also as an engineer with many years of experience in digital technology, I would like to solve the remaining problems one by one, and make reducing the pain suffered by those who lose pets my long-term lifework.”

Pet & 3D,” a sculpting service using 3D photo scanning to create "a pet figurine that is one of its kind in the world and uniquely my own. From: Sasuke Tokyo Youtube channel

Translation by Tony McNicol