Human Generated Data

Title

Untitled (woman being questioned at customs counter, Miami International Airport)
Date

1951, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12224
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman being questioned at customs counter, Miami International Airport)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1951, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.3
Human 99.3
Person 99
Person 97.7
Person 96.8
Tie 93.4
Accessories 93.4
Accessory 93.4
Sitting 86.2
Clinic 64.1
Couch 56.6
Furniture 56.6
LCD Screen 56.3
Electronics 56.3
Screen 56.3
Display 56.3
Monitor 56.3
Musical Instrument 55.6
Musician 55.6

Clarifai
created on 2019-11-16

people 99.8
group 97.8
group together 97.2
adult 96.8
man 96
woman 93.2
several 92
administration 91.6
leader 90.8
actor 88.9
four 87.9
five 86.7
furniture 86.6
wear 85.9
monochrome 85.9
elderly 85.7
movie 85.1
two 84.8
sit 84.7
many 84

Imagga
created on 2019-11-16

man 47
person 45.6
male 36.1
patient 31.1
people 30.1
home 24.7
senior 23.4
adult 22.1
sitting 21.5
nurse 21.3
indoors 21.1
men 18.9
case 17.5
office 17
sick person 16.8
business 15.2
happy 15
smiling 14.5
casual 14.4
businessman 14.1
mature 13.9
computer 13.8
clothing 13.2
laptop 13
portrait 12.9
teacher 12.9
work 12.7
room 12.7
40s 12.6
30s 12.5
elderly 12.4
couple 12.2
professional 11.7
retired 11.6
retirement 11.5
working 11.5
medical 11.5
camera 11.1
white 11
lifestyle 10.8
grandfather 10.7
job 10.6
mid adult 10.6
table 10.5
talking 10.4
horizontal 10
old 9.7
half length 9.7
middle aged 9.7
hospital 9.6
together 9.6
looking 9.6
clothes 9.4
inside 9.2
occupation 9.2
hand 9.1
color 8.9
two people 8.7
colleagues 8.7
happiness 8.6
face 8.5
lab coat 8.5
chair 8.5
doctor 8.5
book 8.3
health 8.3
worker 8.2
to 8
disk jockey 7.9
women 7.9
70s 7.9
day 7.8
smile 7.8
education 7.8
discussion 7.8
older 7.8
husband 7.6
illness 7.6
meeting 7.5
monitor 7.5
glasses 7.4
20s 7.3
cheerful 7.3
indoor 7.3
family 7.1

Google
created on 2019-11-16

Photograph 96.9
Snapshot 85.1
Black-and-white 68.3
Photography 67.8
Room 65.7
Vintage clothing 59
Classic 56.7
Television set 56.5
Family 54.8
Gentleman 54.5
Sitting 54.1

Microsoft
created on 2019-11-16

person 96.5
clothing 93.6
text 93.4
man 78.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-59
Gender Male, 85%
Happy 2.6%
Disgusted 0.8%
Fear 0.7%
Calm 77.9%
Angry 4.7%
Confused 0.8%
Sad 11.8%
Surprised 0.6%

AWS Rekognition

Age 23-35
Gender Male, 54.4%
Disgusted 45%
Confused 45.1%
Sad 46.4%
Calm 53%
Angry 45.4%
Fear 45.1%
Surprised 45.1%
Happy 45%

AWS Rekognition

Age 34-50
Gender Female, 84.3%
Calm 93.7%
Surprised 1.9%
Disgusted 0.3%
Happy 0.2%
Angry 0.9%
Confused 0.4%
Sad 2.4%
Fear 0.3%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 93.4%

Captions

Microsoft

a group of people sitting in front of a window 79.4%
a group of people sitting and standing in front of a window 79.3%
a group of people standing in front of a window 79.2%

Text analysis

Amazon

S
KoDk

Google

48
48