How well can you understand an image without seeing it? Palpiction Demo provides a glimpse into how a touch-based image exploration system might look -- where image elements and objects are spoken out when touched.---Here's how it works:- Users are presented a series of "blinded" images which they can touch to explore. As image elements are discovered, Palpiction Demo reads out the object's identity through text-to-speech.- Users can access a list of all undiscovered objects on-demand by double tapping off the image.- Users are tested on their understanding of the image through a choice between real human descriptions, and are rewarded with leaderboard points based on the accuracy of responses.---This application is fully compatible with TalkBack accessibility. Install and activate TalkBack to see more. While in TalkBack mode, the "swipe" action is performed with two fingers (see in-app FAQ).Palpiction Demo takes advantage of the Microsoft COCO dataset (which provides image captions and object segmentations). The COCO dataset follows the Creative Commons Attribution 4.0 License.
Palpiction Demo
