Human Generated Data

Title

Untitled (man with cane and tophat in front of staircase)

Date

1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15132

Human Generated Data

Title

Untitled (man with cane and tophat in front of staircase)

People

Artist: Jack Gould, American

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.1
Human 99.1
Clothing 99
Apparel 99
Helmet 93.2
Handrail 87.2
Banister 87.2
Face 84.1
Beard 75.6
Shorts 73.4
Overcoat 67.4
Coat 67.4
Hat 64.8
Door 61.9
Art 57.2
Corridor 57.1
Floor 57
Staircase 51.5

Imagga
created on 2022-03-05

adult 25.1
people 24.5
person 23.6
groom 23.3
male 21.3
man 20.2
businessman 18.5
business 18.2
indoors 17.6
indoor 15.5
corporate 14.6
clothing 14.5
day 14.1
room 13.8
men 13.7
professional 12.9
office 12.7
women 12.7
full length 12.6
musical instrument 12.5
smiling 12.3
sitting 12
happy 11.9
portrait 11.6
light 11.4
worker 11.4
adults 11.4
statue 11.1
inside 11
happiness 11
chair 10.8
window 10.8
interior 10.6
color 10.6
desk 10.5
accordion 10.4
historic 10.1
keyboard instrument 9.9
executive 9.6
standing 9.6
businesspeople 9.5
smile 9.3
communication 9.2
building 9.2
20s 9.2
modern 9.1
businesswoman 9.1
column 9.1
old 9.1
bride 9
history 8.9
marble 8.9
lady 8.9
architecture 8.9
group 8.9
home 8.8
couple 8.7
corporation 8.7
face 8.5
casual 8.5
side 8.4
black 8.4
church 8.3
fashion 8.3
cheerful 8.1
religion 8.1
family 8
looking 8
posing 8
art 7.9
work 7.9
colleagues 7.8
daytime 7.7
attractive 7.7
two 7.6
historical 7.5
house 7.5
clothes 7.5
monument 7.5
computer 7.3
job 7.1
working 7.1
travel 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

man 97.5
black and white 97.1
text 94
street 86.2
stairs 85.9
monochrome 85.6
person 81.7
clothing 73.6
footwear 67

Face analysis

Amazon

Google

AWS Rekognition

Age 56-64
Gender Male, 99.9%
Calm 49.1%
Fear 23.4%
Sad 18.4%
Surprised 3.3%
Confused 2.1%
Angry 2.1%
Disgusted 1%
Happy 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Helmet 93.2%
Staircase 51.5%

Captions

Microsoft

a man standing in a room 88.3%
a man wearing a suit and tie 87.5%
a man wearing a suit and tie standing in a room 87.4%