Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)
Date

July 30, 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.587
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Chair 98.3
Furniture 98.3
Human 95.2
Person 95.2
Person 93.7
Face 92.5
Text 68.5
Photo 68.4
Photography 68.4
Piano 68.4
Leisure Activities 68.4
Musical Instrument 68.4
Table 67.5
Portrait 66
Sitting 65.6
Phone 64
Mobile Phone 64
Cell Phone 64
Electronics 64
Wood 63.4
Art 61.1
Drawing 58.7

Clarifai
created on 2018-03-23

people 99.5
furniture 98.7
one 98.3
no person 97.6
room 96.9
adult 96.8
seat 96.6
two 96.3
indoors 93.8
chair 92.9
wear 92.1
man 89.9
music 88.8
recreation 88.6
group 88.3
vehicle 88
home 85.8
piano 83.5
woman 83.2
leader 82.3

Imagga
created on 2018-03-23

chair 100
seat 79.9
support 51.8
device 38.9
barrow 24.8
handcart 24.7
wheeled vehicle 18.8
grand piano 18.3
business 17
piano 16.2
computer 13.6
outdoors 13.4
empty 12.9
keyboard instrument 12.6
percussion instrument 12.5
furniture 12.4
stringed instrument 12.3
office 12
people 11.7
wood 11.7
vehicle 11.3
work 11
bench 11
city 10.8
man 10.7
sitting 10.3
black 10.2
sky 10.2
laptop 10.1
relax 10.1
water 10
technology 9.6
outside 9.4
musical instrument 9.2
room 9.2
outdoor 9.2
modern 9.1
container 9
working 8.8
wooden 8.8
armchair 8.5
male 8.5
relaxation 8.4
summer 8.4
old 8.4
person 8.3
box 8.1
sun 8
metal 8
interior 8
nobody 7.8
travel 7.7
telephone 7.6
building 7.5
vacation 7.4
scenery 7.2
holiday 7.2

Google
created on 2018-03-23

black 95.8
photograph 94.9
black and white 93.1
photography 82.7
monochrome photography 82.2
furniture 76.6
technology 75
monochrome 73.5
still life photography 62.5
table 57.8
darkness 53.8

Microsoft
created on 2018-03-23

floor 92
indoor 89

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 55%
Confused 45.1%
Surprised 45%
Happy 45%
Angry 45.1%
Disgusted 45%
Sad 45.1%
Calm 54.6%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Surprised 45.2%
Confused 45.2%
Disgusted 45.1%
Calm 53.4%
Angry 45.2%
Sad 45.9%
Happy 45.1%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 45
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.2%
Piano 68.4%
Mobile Phone 64%

Captions

Microsoft

a person sitting on a table 47.8%
a person sitting at a table 47.7%
a person sitting at a table in a room 47.6%