Human Generated Data

Title

Untitled (Winston Churchill and others wearing graduation gowns marching in procession)

Date

1952

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14536

Human Generated Data

Title

Untitled (Winston Churchill and others wearing graduation gowns marching in procession)

People

Artist: Jack Gould, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99
Human 99
Tie 98.9
Accessories 98.9
Accessory 98.9
Person 98.7
Person 98
Person 97.4
Person 95.6
Person 94.6
Person 92.9
Person 88.3
Person 84.6
Person 77.8
Apparel 75.4
Clothing 75.4
People 69.8
Crowd 68.1
Clinic 67
Doctor 63.5
Face 55.5

Imagga
created on 2022-01-29

nurse 45.2
coat 42.6
lab coat 39.1
medical 37.9
doctor 34.7
people 33.4
professional 28.5
man 27.5
person 27.5
medicine 24.6
health 24.3
adult 24.3
male 24.1
laboratory 24.1
hospital 22.6
lab 22.3
work 22
men 21.5
clinic 21.1
worker 20.5
chemistry 20.3
research 20
negative 19.7
scientist 19.6
human 19.5
biology 19
team 17.9
chemical 17.5
business 17
student 16.7
scientific 16.5
science 16
businessman 15.9
care 15.6
assistant 15.5
test 15.4
portrait 14.9
film 14.8
patient 14.4
instrument 14.2
clothing 14.1
happy 13.8
development 13.3
working 13.2
garment 13.2
chemist 12.8
optical 12.6
suit 12.6
equipment 12.3
smile 12.1
technology 11.9
smiling 11.6
job 11.5
exam 11.5
photographic paper 11.5
specialist 11.4
education 11.2
office 11.2
looking 11.2
women 11.1
researcher 10.8
microscope 10.8
technician 10.7
face 10.6
profession 10.5
corporate 10.3
day 10.2
happiness 10.2
occupation 10.1
biotechnology 9.8
attractive 9.8
colleagues 9.7
indoors 9.7
bright 9.3
modern 9.1
lady 8.9
color 8.9
biochemistry 8.9
group 8.9
stethoscope 8.9
microbiology 8.9
uniform 8.8
analysis 8.8
serious 8.6
illness 8.6
study 8.4
blur 8.4
mask 8.2
look 7.9
experiment 7.8
consultant 7.8
expertise 7.8
pretty 7.7
blurred 7.7
photographic equipment 7.6
casual 7.6
clothes 7.5
teamwork 7.4
businesswoman 7.3
success 7.2

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 98.4
person 87.8
clothing 87.6
man 79.5
sketch 67.2
group 61.7
wedding dress 58.7
wedding 54.6
posing 46.4
dressed 28.9
clothes 15

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 75%
Sad 97%
Calm 1%
Disgusted 0.4%
Confused 0.4%
Happy 0.3%
Surprised 0.3%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 51-59
Gender Male, 98.4%
Calm 99.2%
Sad 0.3%
Surprised 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Female, 98.3%
Happy 45%
Calm 29.2%
Sad 10.3%
Surprised 7%
Confused 3.6%
Angry 1.9%
Fear 1.7%
Disgusted 1.2%

AWS Rekognition

Age 31-41
Gender Male, 92.8%
Confused 57.5%
Sad 36.7%
Calm 3.1%
Disgusted 0.7%
Happy 0.7%
Angry 0.5%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 39-47
Gender Female, 89%
Calm 66.3%
Happy 11.3%
Sad 10.3%
Confused 8.2%
Surprised 1.4%
Disgusted 1.3%
Angry 0.8%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Female, 58%
Calm 63.8%
Sad 34%
Confused 0.9%
Surprised 0.3%
Angry 0.3%
Disgusted 0.3%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 18-24
Gender Female, 90.7%
Calm 60.3%
Sad 10%
Angry 7.4%
Fear 6.7%
Surprised 5.4%
Happy 5.2%
Confused 3.4%
Disgusted 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 98.9%

Captions

Microsoft

a group of people posing for a photo 91%
a group of people posing for the camera 90.9%
a group of people posing for a picture 90.8%

Text analysis

Amazon

MJI7
MJI7 YT37AS
YT37AS

Google

YT37A
MJI7 YT37A
MJI7