Human Generated Data

Title

Untitled (VE Day: crowd of women praying in church)

Date

1945

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15350

Human Generated Data

Title

Untitled (VE Day: crowd of women praying in church)

People

Artist: Jack Gould, American

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.3
Human 99.3
Person 99.1
Person 98.6
Person 98.5
Person 96.6
Person 95.6
Person 94.3
Person 89.6
Building 87.5
Factory 82.2
Person 82.1
Furniture 74.6
Person 74.5
Person 72.6
Clinic 65.9
People 63.1
Person 56
Person 55.7

Imagga
created on 2022-03-05

nurse 40.1
room 29.3
table 28.5
interior 25.6
person 23.9
people 22.9
man 22.2
adult 20.3
indoors 20.2
home 19.9
restaurant 19.1
male 17.7
decor 15.9
work 15.7
shop 15.5
modern 14.7
elegant 14.6
decoration 14.5
hospital 14
service 13.9
dinner 13.8
patient 13.7
luxury 13.7
office 13.2
glass 12.9
business 12.7
house 12.5
iron lung 12.4
formal 12.4
furniture 12
happy 11.9
indoor 11.9
lifestyle 11.6
setting 11.6
professional 11.6
medical 11.5
businessman 11.5
meeting 11.3
men 11.2
worker 11.1
glasses 11.1
women 11.1
wedding 11
casual 11
portrait 11
mercantile establishment 10.9
team 10.7
banquet 10.5
dining 10.5
talking 10.5
couple 10.4
computer 10.4
desk 10.4
party 10.3
chair 10.1
barbershop 10
meal 10
drink 10
respirator 9.9
holding 9.9
silverware 9.8
napkin 9.8
clinic 9.5
happiness 9.4
doctor 9.4
salon 9.4
plate 9.3
counter 9.3
place 9.3
food 9.2
20s 9.2
businesswoman 9.1
reception 8.8
catering 8.8
lunch 8.8
smiling 8.7
kitchen 8.7
fork 8.6
businesspeople 8.5
design 8.4
laptop 8.2
cheerful 8.1
wineglass 8
breathing device 8
celebration 8
job 8
working 8
day 7.8
smile 7.8
clothing 7.7
sitting 7.7
attractive 7.7
knife 7.7
wine 7.6
two 7.6
bed 7.6
elegance 7.6
hall 7.6
horizontal 7.5
manager 7.4
style 7.4
coffee 7.4
event 7.4
place of business 7.2
face 7.1
love 7.1
medicine 7
together 7

Microsoft
created on 2022-03-05

sink 90.7
person 88.6
furniture 76.4
text 73.4
home appliance 69
countertop 60.6
table 58.8
cabinetry 55.3
house 54
kitchen appliance 50.7
room 41
bathroom 9.1

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 99.6%
Calm 94.8%
Surprised 1.9%
Confused 1.6%
Sad 1.1%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 45-51
Gender Male, 75.3%
Sad 99.1%
Calm 0.5%
Angry 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Fear 0%
Surprised 0%

AWS Rekognition

Age 31-41
Gender Male, 71.9%
Calm 91.5%
Sad 8.1%
Confused 0.2%
Angry 0.1%
Disgusted 0%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Female, 52.6%
Calm 98.8%
Sad 0.8%
Surprised 0.2%
Angry 0.1%
Confused 0%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 37-45
Gender Female, 94.1%
Calm 91.3%
Sad 7.8%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Female, 85.1%
Happy 95.9%
Calm 3.3%
Surprised 0.2%
Fear 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 54-64
Gender Male, 97.4%
Calm 80.6%
Confused 7.6%
Sad 5.1%
Surprised 2.7%
Disgusted 1.7%
Fear 1.1%
Happy 0.8%
Angry 0.4%

AWS Rekognition

Age 45-51
Gender Male, 96.7%
Calm 99.9%
Surprised 0%
Sad 0%
Disgusted 0%
Happy 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 86.7%
Calm 81.5%
Surprised 4.6%
Fear 3.6%
Disgusted 3.2%
Sad 2.6%
Happy 1.8%
Angry 1.6%
Confused 1.1%

AWS Rekognition

Age 23-31
Gender Female, 62.1%
Calm 65.8%
Disgusted 15.4%
Surprised 10.2%
Happy 5.6%
Confused 1.8%
Angry 0.7%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 95.8%
Sad 37.2%
Happy 25.7%
Calm 22.2%
Disgusted 4.1%
Angry 3.6%
Surprised 3.2%
Confused 2.2%
Fear 1.7%

AWS Rekognition

Age 2-8
Gender Male, 71.8%
Calm 87.6%
Happy 3.2%
Angry 2.6%
Fear 2.4%
Sad 2.2%
Confused 0.8%
Disgusted 0.7%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people performing on a counter 91.5%
a group of people in a room 91.4%
a group of people posing for a photo in front of a window 87.4%

Text analysis

Amazon

a
MJI7
MJI7 YT3RAS
YT3RAS

Google

MJIR
MJIR YT3RA2
YT3RA2