Music video
Squarepusher – Terminal Slam
2020
00:05:33
Terminal Slam Music Video is a Diminished Reality / Mixed Reality music video in which all advertisements in the city are erased or replaced with Squarepusher-related ads. Daito Manabe created this MV, imagining that in the near future, as shown in this music video, AR/MR glasses will make it possible to freely rewrite cityscapes.
Using machine learning technology, we performed:
- Object Detection (identifying the positions of objects in an image)
- Semantic Segmentation (labeling each pixel in an image and categorizing image regions according to their meaning)
- Image Inpaint (image restoration)
Most advertising billboards in the city change periodically, so with current technology it was difficult for machines to recognize them accurately; therefore, the billboard position data was created manually.
In addition, mask information was generated from the analysis data and positional data, and post-processing was performed, such as applying glitch effects only to areas where people or advertisements exist, and applying optical camouflage effects.
Furthermore, because the process of extracting advertisement regions could not be accomplished using existing machine learning technologies alone, manual operations were also carried out for elements that could not be realized with the technology available at present. We anticipate that in the near future, all of this will be done automatically.
