Human Generated Data

Title

Untitled (men smiling at Lion's Club meeting)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15627

Human Generated Data

Title

Untitled (men smiling at Lion's Club meeting)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Poster 99.7
Advertisement 99.7
Human 98.6
Person 98.6
Person 97.9
Person 96.9
Interior Design 96.6
Indoors 96.6
Person 96.2
Clothing 92.7
Apparel 92.7
Person 90
Face 84
Person 80
Person 78.7
Room 74.3
Sunglasses 70
Accessory 70
Accessories 70
Collage 66.5
Electronics 63.4
Furniture 63.4
Female 63.1
People 61.1

Imagga
created on 2022-02-05

man 30.9
blackboard 28.6
people 27.9
home 24.7
adult 24.3
male 24.2
person 22.9
portrait 20.7
indoors 20.2
room 17
attractive 15.4
smiling 15.2
hospital 15.2
business 14.6
women 14.2
interior 14.1
lifestyle 13.7
work 13.4
happy 13.1
couple 13.1
child 12.9
sitting 12.9
men 12.9
house 12.5
window 12.4
smile 12.1
indoor 11.9
professional 11.7
businessman 11.5
office 11.4
face 11.4
looking 11.2
cute 10.8
bedroom 10.7
light 10.7
working 10.6
modern 10.5
meeting 10.4
love 10.3
two 10.2
inside 10.1
businesswoman 10
case 9.9
pretty 9.8
together 9.6
newspaper 9.6
film 9.6
corporate 9.4
happiness 9.4
laptop 9.1
holding 9.1
fashion 9
patient 9
one 9
group 8.9
standing 8.7
relaxation 8.4
furniture 8.3
dress 8.1
cheerful 8.1
team 8.1
computer 8
healthy 7.6
doctor 7.5
negative 7.5
mature 7.4
executive 7.4
occupation 7.3
sexy 7.2
black 7.2
hair 7.1
family 7.1
worker 7.1
kid 7.1
to 7.1
job 7.1
medicine 7

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

person 91.1
posing 89.6
text 83.9
clothing 81.6
human face 78.3
white goods 76
wedding dress 75.1
group 73.5
bride 55.7
woman 52
smile 50.1

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 100%
Happy 86.3%
Calm 8.3%
Sad 3.3%
Confused 0.7%
Disgusted 0.4%
Angry 0.4%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 37-45
Gender Male, 93.1%
Calm 74.9%
Happy 10.8%
Surprised 6.1%
Sad 2.9%
Angry 1.8%
Confused 1.5%
Disgusted 1.2%
Fear 0.9%

AWS Rekognition

Age 47-53
Gender Male, 98.7%
Surprised 36.7%
Happy 34%
Angry 12.1%
Sad 7.2%
Fear 5.3%
Disgusted 2.2%
Confused 1.9%
Calm 0.8%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Happy 57.5%
Sad 13.8%
Surprised 10.4%
Confused 7.9%
Disgusted 6.1%
Angry 2%
Fear 1.7%
Calm 0.6%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Sad 83.9%
Happy 11.8%
Calm 1%
Disgusted 0.9%
Fear 0.8%
Confused 0.8%
Angry 0.4%
Surprised 0.4%

AWS Rekognition

Age 26-36
Gender Male, 98.1%
Fear 90.7%
Sad 7.3%
Confused 0.8%
Surprised 0.5%
Happy 0.3%
Disgusted 0.2%
Calm 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.7%
Person 98.6%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 92.2%
a group of people in front of a mirror posing for the camera 92.1%
a group of people posing for a photo in front of a mirror 92%