Suppose a pedestrian is using our technology to control a shop screen. Someone else walks by and also wants to control the screen. What can happen?

First, even if only one person can control the screen at a time, that is a big improvement over the current situation, where a screen plays some video and no pedestrian can control it.

But our technology lets the retailer set a multiuser parameter: the maximum number of simultaneous users that can control the screen. This would depend on how large the screen is, as measured in pixels horizontally and vertically. So above, when the second person comes by and takes a photo of the barcode on the screen, then the screen can split into left and right parts, or upper and lower parts. The first user gets control of one part and the new user gets the other part.

This is different from when you might have been watching a film where the screen splits into a left and right part. There, both parts are part of the same narrative. And you, the watcher, cannot control either. In our situation, each person can control her part independently of the other users.

Another unique aspect is that the users controlling each half, plus any other users who are just watching the screen, can get audio through their cellphones specific to that half.

This split screen and the accompanying audios also generalises to more than 2 split screens, up to the maximum number of split screens allowed by the retailer. This is shown in the figure below, which is taken from our patent pending, Mobile device audio from an external video display using a barcode. It shows the screen split into 4 parts. Three of these parts have barcodes that let nearby pedestrians get audio feeds specific to each part.