Human Generated Data

Title

Untitled (woman standing with two elderly people in rocking chairs)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14786

Human Generated Data

Title

Untitled (woman standing with two elderly people in rocking chairs)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Furniture 98.6
Human 97.7
Person 97.7
Person 97.1
Person 90.4
People 81
Face 76.2
Baby 70.1
Indoors 68.8
Room 68.8
Portrait 63.7
Photography 63.7
Photo 63.7
Text 63.6
Living Room 59.3
Female 58.7
Chair 57.6
Clothing 56.8
Apparel 56.8
Girl 56.5
Person 46

Imagga
created on 2022-01-29

newspaper 51.3
product 41.8
creation 30.2
glass 27.6
table 26.3
drink 23.4
restaurant 21.1
shop 20.9
interior 19.4
wedding 19.3
setting 19.3
home 19.1
people 19
dinner 18
plate 17.8
room 17.6
party 17.2
service 16.7
food 16
wine 15.8
man 15.4
decoration 14.5
celebration 14.3
dining 14.3
indoors 14
person 13.6
fork 13.4
medical 13.2
worker 13.2
banquet 13
mercantile establishment 12.9
male 12.9
luxury 12.9
reception 12.7
waiter 12.4
cup 12.1
cutlery 11.7
chair 11.1
catering 10.8
dine 10.8
napkin 10.7
barbershop 10.7
work 10.7
happy 10.6
kitchen 10.6
meal 10.6
laboratory 10.6
working 10.6
knife 10.6
medicine 10.6
formal 10.5
lunch 10.3
elegant 10.3
glasses 10.2
event 10.2
two 10.2
smiling 10.1
house 10
serve 9.7
decor 9.7
breakfast 9.7
flowers 9.6
hotel 9.5
fine 9.5
bouquet 9.4
place 9.3
employee 9.3
coffee 9.3
eat 9.2
adult 9.2
alcohol 8.9
silverware 8.8
place of business 8.6
research 8.6
smile 8.5
beverage 8.4
dish 8.1
tablecloth 7.8
china 7.8
black 7.8
professional 7.8
chemistry 7.7
test 7.7
flower 7.7
clothing 7.7
arrangement 7.7
health 7.6
set 7.6
tea 7.6
biology 7.6
dining-room attendant 7.6
elegance 7.6
fashion 7.5
doctor 7.5
equipment 7.5
life 7.4
technology 7.4
hospital 7.4
care 7.4
clinic 7.3
business 7.3
container 7.2
holiday 7.2
science 7.1
modern 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 97.4
drawing 81.7
table 79.5
black and white 55.6
sketch 54.2
old 42

Face analysis

Amazon

Google

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 99.8%
Sad 0.2%
Disgusted 0%
Confused 0%
Surprised 0%
Fear 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 53-61
Gender Male, 70.8%
Calm 92.7%
Happy 6.7%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%

Captions

Microsoft

a group of people in a room 81%
a group of people standing in a room 76.7%
a group of people standing on top of a refrigerator 27.7%