Human Generated Data

Title

Untitled (women wearing hats serving and drinking tea)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14922

Human Generated Data

Title

Untitled (women wearing hats serving and drinking tea)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.5
Human 99.5
Person 99.4
Tie 99.1
Accessories 99.1
Accessory 99.1
Person 95.7
Person 95.1
Person 90.5
Meal 87.9
Food 87.9
Person 87.6
Sunglasses 85.8
Dish 78.6
Apparel 78.2
Clothing 78.2
Hat 78.2
Person 73.9
Person 73.9
Person 67.3
Icing 67.1
Cake 67.1
Cream 67.1
Dessert 67.1
Creme 67.1
Furniture 66.2
People 65.5
Face 64.2
Pottery 64
Poster 61.9
Advertisement 61.9
Table 61.7
Collage 60.2
Photo 58.4
Photography 58.4
Art 57.9
Room 57.2
Indoors 57.2
Chef 56.7
Text 55
Hat 53.3
Person 48.8

Imagga
created on 2022-01-29

lab coat 84
coat 74.6
people 32.3
garment 32.3
person 31.2
professional 30.7
medical 30
man 28.2
doctor 25.4
nurse 23.7
medicine 22
clinic 21.7
clothing 21.4
work 21.2
laboratory 20.2
male 19.9
hospital 19.6
patient 19.5
adult 19.3
working 18.6
worker 18.2
lab 17.5
team 17
scientist 15.7
health 15.3
office 14.5
research 13.3
biology 13.3
men 12.9
occupation 12.8
chemistry 12.6
test 12.5
science 12.4
profession 12.4
happy 11.9
technology 11.9
room 11.8
portrait 11.6
equipment 11.6
interior 11.5
table 11.5
smile 11.4
student 10.9
pharmacist 10.7
care 10.7
scientific 10.7
chemical 10.6
indoors 10.5
smiling 10.1
assistant 9.7
instrument 9.5
two 9.3
wedding 9.2
hand 9.1
attractive 9.1
holding 9.1
chemist 8.9
to 8.8
businessman 8.8
looking 8.8
desk 8.8
optical 8.7
brunette 8.7
bride 8.6
illness 8.6
business 8.5
black 8.4
teamwork 8.3
groom 8.3
dress 8.1
cheerful 8.1
uniform 8
glass 8
home 8
specialist 7.9
women 7.9
microscope 7.9
biotechnology 7.8
standing 7.8
surgery 7.8
experiment 7.8
discovery 7.8
development 7.6
talking 7.6
shop 7.5
study 7.5
decoration 7.4
service 7.4
indoor 7.3
computer 7.2
surgeon 7.1
face 7.1
job 7.1
modern 7

Google
created on 2022-01-29

Hat 89.5
Cooking 78
Service 69.2
Art 68
Illustration 64.6
History 64.6
Monochrome photography 64
Stock photography 63.4
Monochrome 62.4
Vintage clothing 60.3
Room 58.3
Cook 58
Machine 56.9
Picture frame 54.6
Uniform 54.2
Apron 50.3

Microsoft
created on 2022-01-29

text 97.2
person 96.9
drawing 90
clothing 84.6
sketch 83.8
black and white 76.3
human face 68.9
clothes 18.8

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.4%
Happy 90.5%
Confused 3.3%
Calm 1.8%
Disgusted 1.2%
Sad 1.1%
Surprised 1.1%
Angry 0.8%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 92.5%
Calm 74.8%
Happy 17.5%
Surprised 2.2%
Angry 1.9%
Sad 1.6%
Confused 1%
Disgusted 0.5%
Fear 0.5%

AWS Rekognition

Age 25-35
Gender Male, 94%
Sad 60.9%
Calm 24.4%
Happy 3.8%
Surprised 3.6%
Angry 3.1%
Confused 2.4%
Disgusted 1.2%
Fear 0.5%

AWS Rekognition

Age 27-37
Gender Male, 82.9%
Calm 85.2%
Sad 6.4%
Confused 4.6%
Happy 1.3%
Surprised 1%
Angry 0.8%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Confused 80.7%
Calm 5.9%
Sad 4.1%
Angry 3.8%
Surprised 2.1%
Fear 1.3%
Happy 1.2%
Disgusted 1%

AWS Rekognition

Age 28-38
Gender Male, 97.1%
Sad 48.2%
Confused 35.4%
Surprised 6.3%
Fear 3.4%
Angry 2.6%
Calm 2%
Happy 1.2%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.5%
Tie 99.1%
Sunglasses 85.8%
Hat 78.2%

Captions

Microsoft

a group of people posing for a photo 73.2%
a group of people posing for the camera 73.1%
a group of people posing for a picture 73%