Screen–smart device interaction

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

Screen-Smart Device Interaction (SSI) [1] is fairly new technology developed as a sub-branch of Digital Signage.

It differs from the Second screen configuration. The latter typically has the first screen being a big screen and the second screen being the smaller screen of a cellphone. Where the small screen cannot affect or control the big screen. The small screen is often used to provide supplementary data on the content of the big screen. In contrast, SSI is distinguished by the small screen being able to change the flow of information or content on the big screen.

The big screen shows an identifier of its computer network address. Often, the network is the Internet. The identifier might be in a barcode that is part of the image on the big screen. The mobile device scans the barcode, decodes it and queries a server. The server controls the big screen. When the server gets the query, it extracts the identifier of the big screen. The server can alter the mobile device screen and the big screen in a feedback loop.

The user of the mobile device can pick buttons in its web page to change the big screen. The mobile device functions as a remote control. The advantage is the decoupling of specific hardware requirements for the pair of the mobile device and the big screen. If the mobile device is a cellphone, it only needs a camera and wireless Internet access.

If the big screen shows a browser, then there are paired web pages. One for the small screen, one for the big screen. Microsoft calls this the "Companion Web". In general, the pages in the pair are different. The page for the big screen is essentially a digital poster. It does not need any buttons or selectable links. It can have large graphics. The large screen can be assumed to be on a wired connection, giving it large bandwidth. The small screen page is optimised for low bandwidth across a wireless connection.

SSI is gradually becoming a standard for Digital Signage Implementation, seeking to expand the traditional capabilities of this technology, adopting the modern Internet and 'Connected Devices' concepts. It is related to augmented reality and the Internet of Things.

Interactive Digital Signage might be a growth engine for traditional digital signage. Interactive capabilities are gaining increasing attention by retailers, clinics, hotels/restaurants/bars, and other venues that provide service to a 'captive audience'.

Muzzley is a trend in present technology that lets a user in any connected network access the Digital Signage screen using the smartphone. In this scenario, the smartphone keeps adapting its interface according to the experience that the user is having. Muzzley integrates with all the major digital signage manufacturers as well as traditional applications made in standard developing languages as javascript, java, node.js, flash / Action Script and others.

In general, Screen-Smart device Interaction is a set of mobile, networking, signal processing, software and hardware technologies that allows users with mobile devices (typically cellphones) to connect (using QR, URL or any other novel method) to a public screen and interact, control or acquire its content for emerging applications like effective outdoor advertising, event information distributions, out-of-home gaming, etc.[2] These technologies lets users in any venue use smart mobile devices to answer a poll/survey/quiz, win coupons and even participate in a game.

This Image is a schematic description of SSI implementation:


[3] [4] [5] [6] [7] [8] [9] [10] [11]

[12] [13] [14] [15] [16] [17] [18] [19] [20] [21] [22] [23] [24] [25] [26]


  1. ^ "When Smart Devices Interact With Pervasive Screens: A Survey", P.C. Ng, K.E. Eun, J. She, M. Baldauf, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) Volume 13, Issue 4, August 2017. [1]
  2. ^ "Convergence of Interactive Displays with Smart Mobile Devices for Effective Advertising: A survey", J. She, J. Crowcroft, H. Fu, F. Li, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) TOMCCAP Volume 10, Issue 2, February 2014. [2]
  3. ^ NoviSign - "Digital Signage Gaming"
  4. ^ Cayin - "Control digital signage"
  5. ^ Comqi - "Passport links mobile phones to an in-venue digital screen"
  6. ^ Crowdpurr - "Why should digital signage ... remain static when they can incorporate their audience in real-time?" [3]
  7. ^ Enteractv - "prospects use their cellphone to control a display screen inside the window" [4]
  8. ^ Kik - "turn your phone into a remote control for any screen with a browser" [5]
  9. ^ Locbit - "turn internet connected devices into a mouse and allow you to turn any surface into a digital canvas" [6]
  10. ^ Microsoft - "lays out vision to link big and small screens" and "companion web" [7]
  11. ^ Muzzley - "Control a wide range of devices with customizable interfaces using only your phone" [8]
  12. ^ Noisestreet - "turns any screen into a 2-way interactive experience"
  13. ^ Novisign - "This four-in-a-row game is presented on a digital signage big screen" [9]
  14. ^ Scala - "QR code demo"
  15. ^ - Cyber-physical Dragging Technologies"-
  16. ^ CyPhy Media - "Collect Media With A Drag demos"
  17. ^ Dimedis - "use the QR-Codes on the screen to directly control contents on the display" [10]
  18. ^ - "Short video on Digital Signage Gaming"
  19. ^ Game Concourse - communicating and interacting with a display screen using a remote device [11]
  20. ^ Heeddooh -scan the QR code with their smartphones, and that will lead them to a website that acts as a remote control [12]
  21. ^ Media Signage - scans the QR code, his mobile device will... control your designated digital Signage screen [13]
  22. ^ Movilok - link temporarily the mobile phone with this interactive showcase [14]
  23. ^ Qr-screen - Interactive Narrowcasting with QR-codes
  24. ^ Red Crystal - an interactive ‘session’ between your smart device and the screen on which you want to interact [15]
  25. ^ Smoothboard Air -
  26. ^ Green Valley Media - scans the QR code, his mobile device will open an HTML page that will ... control your designated digital Signage [16]