Human Generated Data

Title

Untitled (man giving speech to crowd of people at mock political convention)

Date

c. 1955

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15216

Human Generated Data

Title

Untitled (man giving speech to crowd of people at mock political convention)

People

Artist: Jack Gould, American

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 97.7
Human 97.7
Room 97.3
Indoors 97.3
Poster 97.2
Advertisement 97.2
Person 97.1
Dressing Room 89.8
Apparel 84.7
Clothing 84.7
Interior Design 84
Text 73
People 69.1
Shop 63.6
Person 60.7
Living Room 60.7
Collage 57.8
Furniture 55.6
Bedroom 55.4

Imagga
created on 2022-03-05

newspaper 43
product 33
creation 25.6
room 19.8
people 17.8
salon 16.8
interior 16.8
home 16.7
shop 15.4
man 14.8
house 14.2
work 13.5
professional 13.4
adult 12
person 11.7
building 10.9
decoration 10.6
mercantile establishment 10.5
old 10.4
architecture 10.1
table 9.9
modern 9.8
business 9.7
medical 9.7
indoors 9.7
window 9.6
furniture 9.4
male 9.2
city 9.1
technology 8.9
style 8.9
barbershop 8.7
wall 8.5
wedding 8.3
historic 8.2
indoor 8.2
film 8.1
chair 8
office 8
flowers 7.8
ancient 7.8
negative 7.7
worker 7.7
restaurant 7.6
happy 7.5
inside 7.4
design 7.3
lady 7.3
blackboard 7.2
holiday 7.2
family 7.1
love 7.1
job 7.1
decor 7.1
working 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 96.1
indoor 94.1
person 93.8
drawing 91.3
window 81.6
sketch 75.9
store 57
shop 8.8

Face analysis

Amazon

AWS Rekognition

Age 24-34
Gender Female, 91%
Happy 84.6%
Calm 5.4%
Fear 3.3%
Sad 2.9%
Angry 2.2%
Confused 0.6%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 48-54
Gender Female, 68.1%
Calm 70.6%
Happy 26.2%
Confused 0.9%
Sad 0.8%
Fear 0.6%
Surprised 0.3%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 27-37
Gender Female, 96%
Happy 98.1%
Calm 0.8%
Fear 0.5%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 29-39
Gender Male, 88.4%
Fear 79.9%
Happy 6.6%
Calm 5.1%
Sad 3.4%
Surprised 2.1%
Confused 1.2%
Disgusted 1%
Angry 0.7%

AWS Rekognition

Age 24-34
Gender Female, 68.9%
Calm 90.9%
Happy 7.2%
Disgusted 0.9%
Surprised 0.4%
Fear 0.3%
Sad 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 36-44
Gender Female, 58.7%
Happy 66.8%
Sad 11.9%
Calm 6.1%
Angry 5%
Confused 4.2%
Disgusted 2.4%
Surprised 1.8%
Fear 1.7%

AWS Rekognition

Age 31-41
Gender Male, 67.1%
Calm 97.4%
Confused 0.7%
Happy 0.5%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 87.6%
Calm 75.6%
Happy 16.3%
Fear 6.7%
Sad 0.7%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 36-44
Gender Male, 99.6%
Surprised 25%
Fear 17.1%
Disgusted 16.1%
Happy 13.4%
Calm 12%
Angry 11.2%
Sad 4.2%
Confused 1.1%

AWS Rekognition

Age 33-41
Gender Male, 98.2%
Calm 97.7%
Disgusted 1.3%
Fear 0.4%
Happy 0.2%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 39-47
Gender Male, 54.1%
Calm 44.1%
Disgusted 37.3%
Fear 8.8%
Happy 5.7%
Sad 1.6%
Angry 1.1%
Confused 0.7%
Surprised 0.6%

AWS Rekognition

Age 23-33
Gender Female, 72.2%
Calm 74.2%
Happy 13.1%
Sad 4.2%
Fear 4%
Surprised 1.7%
Confused 1.1%
Angry 0.9%
Disgusted 0.8%

AWS Rekognition

Age 16-22
Gender Male, 84.8%
Calm 46.4%
Disgusted 17.4%
Happy 14.9%
Confused 7.1%
Sad 6.2%
Surprised 3.1%
Angry 3.1%
Fear 1.7%

AWS Rekognition

Age 25-35
Gender Female, 85.3%
Happy 57.8%
Fear 31.1%
Sad 4.1%
Calm 2.3%
Angry 2.2%
Disgusted 0.8%
Surprised 0.8%
Confused 0.7%

AWS Rekognition

Age 25-35
Gender Female, 60.1%
Calm 87.8%
Fear 6.2%
Sad 3.3%
Happy 0.9%
Disgusted 0.7%
Surprised 0.5%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 43-51
Gender Male, 99%
Sad 28.3%
Calm 24%
Disgusted 18%
Fear 15.6%
Happy 5.7%
Angry 4.2%
Surprised 2.4%
Confused 1.9%

AWS Rekognition

Age 28-38
Gender Female, 53.6%
Happy 83.7%
Fear 8.7%
Angry 2.5%
Sad 1.5%
Calm 1.3%
Disgusted 1.3%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 24-34
Gender Male, 97.4%
Calm 91.3%
Sad 7.5%
Happy 0.5%
Confused 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 78.1%
Calm 87.1%
Sad 3.7%
Happy 3.1%
Surprised 2.7%
Fear 2%
Disgusted 0.6%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Sad 71.1%
Calm 24.3%
Fear 1.8%
Angry 1.5%
Disgusted 0.5%
Happy 0.5%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Male, 95.6%
Calm 63.9%
Fear 12%
Sad 8.7%
Happy 7.2%
Angry 3.6%
Confused 2.7%
Disgusted 1.2%
Surprised 0.8%

AWS Rekognition

Age 27-37
Gender Male, 96.1%
Disgusted 71.7%
Calm 8.6%
Sad 7.4%
Happy 7%
Angry 2%
Confused 1.9%
Fear 0.7%
Surprised 0.7%

AWS Rekognition

Age 22-30
Gender Male, 89.5%
Calm 62%
Angry 11.7%
Confused 9%
Sad 6.6%
Happy 3.8%
Disgusted 3.2%
Surprised 2.4%
Fear 1.4%

AWS Rekognition

Age 16-24
Gender Male, 84.6%
Happy 48%
Calm 17%
Surprised 9.3%
Sad 9.3%
Fear 8.2%
Angry 5%
Disgusted 2.1%
Confused 1%

AWS Rekognition

Age 30-40
Gender Male, 86.3%
Fear 58.2%
Happy 16.9%
Surprised 8.4%
Calm 8%
Disgusted 3.1%
Sad 2.5%
Angry 1.6%
Confused 1.3%

AWS Rekognition

Age 30-40
Gender Male, 99.4%
Calm 89.6%
Angry 5%
Sad 2.8%
Confused 1.2%
Disgusted 0.4%
Surprised 0.4%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 31-41
Gender Male, 92%
Calm 99.9%
Surprised 0%
Disgusted 0%
Happy 0%
Angry 0%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 97.9%
Calm 97%
Sad 1.9%
Happy 0.4%
Angry 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 29-39
Gender Male, 98.6%
Happy 49.5%
Sad 18.2%
Calm 16.7%
Fear 8.5%
Angry 2.7%
Disgusted 2.4%
Surprised 1.3%
Confused 0.7%

AWS Rekognition

Age 20-28
Gender Male, 93.1%
Calm 72.3%
Sad 12.3%
Happy 8.4%
Angry 3.6%
Fear 1.1%
Confused 0.9%
Disgusted 0.7%
Surprised 0.6%

AWS Rekognition

Age 23-31
Gender Male, 97%
Happy 54.9%
Sad 30%
Angry 3.7%
Calm 3.5%
Fear 3.4%
Disgusted 1.8%
Confused 1.4%
Surprised 1.3%

AWS Rekognition

Age 18-24
Gender Male, 97.1%
Calm 68.6%
Happy 9.5%
Sad 8.3%
Disgusted 4.8%
Angry 3.4%
Confused 2.5%
Surprised 1.9%
Fear 1%

AWS Rekognition

Age 24-34
Gender Female, 92.1%
Happy 87%
Sad 6.2%
Angry 3%
Calm 2%
Fear 0.6%
Disgusted 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 25-35
Gender Female, 53.7%
Calm 39.9%
Happy 37.9%
Fear 7.3%
Sad 5.8%
Disgusted 4.4%
Confused 2.1%
Angry 1.5%
Surprised 1%

AWS Rekognition

Age 25-35
Gender Male, 91.6%
Happy 84.5%
Calm 11.8%
Fear 1%
Sad 0.9%
Angry 0.8%
Disgusted 0.5%
Surprised 0.4%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Male, 93%
Calm 89.9%
Confused 2.5%
Disgusted 2.4%
Sad 1.6%
Happy 1.4%
Angry 1.2%
Fear 0.6%
Surprised 0.4%

AWS Rekognition

Age 26-36
Gender Male, 98.8%
Happy 69%
Calm 14.6%
Disgusted 5%
Sad 5%
Surprised 2.7%
Angry 1.7%
Confused 1.1%
Fear 0.8%

AWS Rekognition

Age 22-30
Gender Female, 54.3%
Calm 99.8%
Angry 0.1%
Sad 0%
Surprised 0%
Disgusted 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 79.4%
Calm 54.1%
Happy 21.5%
Angry 6.3%
Sad 4.8%
Surprised 4%
Disgusted 3.9%
Confused 2.9%
Fear 2.4%

AWS Rekognition

Age 28-38
Gender Male, 99.2%
Calm 52.3%
Happy 27.5%
Sad 7.7%
Fear 6.6%
Disgusted 2.1%
Confused 1.5%
Surprised 1.2%
Angry 1.1%

AWS Rekognition

Age 27-37
Gender Female, 85.9%
Happy 86.6%
Calm 7.8%
Sad 1.9%
Fear 1.6%
Disgusted 0.8%
Confused 0.5%
Angry 0.4%
Surprised 0.4%

AWS Rekognition

Age 34-42
Gender Male, 97.6%
Calm 90.3%
Sad 2.5%
Happy 1.8%
Surprised 1.5%
Confused 1.4%
Disgusted 1.1%
Angry 0.9%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 84.4%
Happy 7.7%
Sad 3.3%
Disgusted 1.5%
Fear 1.4%
Angry 1.1%
Confused 0.3%
Surprised 0.3%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 83.9%
Sad 8.6%
Happy 3.5%
Angry 2.4%
Confused 0.9%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 28-38
Gender Male, 94.4%
Happy 47.4%
Calm 32.6%
Sad 10.6%
Angry 3.9%
Disgusted 3.1%
Fear 1.1%
Surprised 0.9%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.2%
Calm 99.4%
Happy 0.2%
Sad 0.2%
Angry 0.1%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 59.3%
Sad 12.4%
Happy 11.7%
Fear 7.6%
Disgusted 3.7%
Surprised 2%
Angry 1.7%
Confused 1.6%

AWS Rekognition

Age 29-39
Gender Female, 86.9%
Disgusted 39.8%
Calm 28.6%
Happy 21.5%
Confused 3%
Sad 2.9%
Fear 1.7%
Surprised 1.4%
Angry 1.2%

AWS Rekognition

Age 18-26
Gender Male, 97.3%
Fear 49.1%
Sad 18.4%
Calm 12%
Happy 11.6%
Angry 4.9%
Surprised 1.9%
Disgusted 1.7%
Confused 0.4%

AWS Rekognition

Age 20-28
Gender Male, 73.5%
Calm 78%
Happy 11.6%
Sad 5.1%
Disgusted 1.2%
Angry 1.2%
Fear 1.2%
Confused 0.9%
Surprised 0.7%

AWS Rekognition

Age 20-28
Gender Male, 97.8%
Calm 31.8%
Fear 23.7%
Sad 21.9%
Happy 11.7%
Disgusted 4.6%
Angry 3.1%
Surprised 1.7%
Confused 1.4%

AWS Rekognition

Age 22-30
Gender Male, 94.9%
Sad 51.3%
Calm 27.8%
Angry 12%
Happy 4.5%
Disgusted 1.6%
Fear 1.1%
Confused 1.1%
Surprised 0.7%

AWS Rekognition

Age 21-29
Gender Male, 98.5%
Calm 65.8%
Sad 24.8%
Happy 2.9%
Angry 2.1%
Fear 1.7%
Confused 1.1%
Surprised 0.8%
Disgusted 0.7%

AWS Rekognition

Age 16-22
Gender Female, 90.7%
Calm 47.8%
Happy 26.9%
Disgusted 10.8%
Sad 4.9%
Angry 4.3%
Fear 2.8%
Confused 1.3%
Surprised 1.2%

AWS Rekognition

Age 18-26
Gender Male, 76.8%
Calm 82.5%
Sad 10.6%
Happy 2.5%
Disgusted 1.8%
Confused 1%
Angry 0.7%
Fear 0.5%
Surprised 0.3%

AWS Rekognition

Age 27-37
Gender Female, 84.4%
Calm 53.2%
Happy 18%
Disgusted 14%
Sad 8.4%
Angry 2.3%
Fear 2.3%
Surprised 1%
Confused 0.9%

AWS Rekognition

Age 23-33
Gender Male, 98.9%
Calm 91.1%
Happy 4.1%
Sad 1.2%
Confused 1.1%
Angry 0.8%
Surprised 0.8%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 89.1%
Calm 67.7%
Happy 22%
Sad 4.3%
Angry 2.6%
Fear 1.5%
Disgusted 0.9%
Confused 0.8%
Surprised 0.4%

AWS Rekognition

Age 25-35
Gender Male, 60.4%
Happy 52.1%
Sad 23.5%
Calm 7.1%
Disgusted 5.5%
Angry 5.1%
Fear 4.3%
Surprised 1.5%
Confused 1%

AWS Rekognition

Age 19-27
Gender Female, 70.9%
Calm 60.2%
Happy 28.3%
Angry 3.5%
Sad 3%
Disgusted 1.7%
Fear 1.6%
Confused 1%
Surprised 0.6%

AWS Rekognition

Age 19-27
Gender Female, 86.1%
Calm 46.2%
Happy 26.8%
Sad 10.7%
Fear 6.9%
Surprised 3.4%
Angry 2.7%
Disgusted 2.2%
Confused 1%

AWS Rekognition

Age 25-35
Gender Male, 61.5%
Sad 51.1%
Calm 21.6%
Happy 13.7%
Fear 6%
Disgusted 2.9%
Angry 2.9%
Confused 1.1%
Surprised 0.7%

AWS Rekognition

Age 24-34
Gender Female, 90.5%
Calm 92.9%
Sad 2.8%
Fear 1.9%
Angry 0.9%
Happy 0.6%
Disgusted 0.4%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Female, 63.1%
Happy 49.7%
Calm 45.2%
Sad 2.1%
Fear 1%
Surprised 0.7%
Angry 0.5%
Disgusted 0.5%
Confused 0.2%

Feature analysis

Amazon

Person 97.7%
Poster 97.2%

Captions

Microsoft

a group of people standing in front of a store window 60%
a group of people standing in front of a store 59.9%
a man standing in front of a store window 59.5%

Text analysis

Amazon

Need
VANDERBILT
We Need
We
KODAK
KOD
NATIVE
NESSEE
TS NATIVE
SON
TS
KODAK SAFETY FILM
Y
SAFETY
ES
ES KEFAUVER
FILM
KEFAUVER
AdlAi
Badly

Google

We lWeed Adlal- Daly NESTIVE KEFAUVER VANDERBILT FILM KODAK SA E ETY E!!M O D
KEFAUVER
O
Daly
KODAK
ETY
E!!M
D
lWeed
VANDERBILT
Adlal-
FILM
E
We
NESTIVE
SA