Human Generated Data

Title

Untitled (four women wearing funny floral hats)

Date

1949

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15033

Human Generated Data

Title

Untitled (four women wearing funny floral hats)

People

Artist: Jack Gould, American

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.9
Clothing 99.9
Dress 99.5
Person 98.5
Human 98.5
Person 98.4
Person 98.2
Female 98.2
Hat 97.3
Person 95.8
Face 92.6
Woman 90.6
Girl 78.9
Costume 75.6
Coat 73.7
Overcoat 73.7
Suit 73.7
Accessory 71.7
Glasses 71.7
Accessories 71.7
Portrait 71.1
Photo 71.1
Photography 71.1
Furniture 68.9
People 68.1
Indoors 65.4
Kid 64.1
Child 64.1
Robe 62.1
Fashion 62.1
Gown 62.1
Evening Dress 62.1
Advertisement 59.4
Poster 59.4
Shorts 58.8
Sailor Suit 56.9
Hair 55.1

Imagga
created on 2022-03-05

negative 46.2
film 39.2
photographic paper 28.1
people 24
person 22.1
photographic equipment 18.7
man 18.1
fashion 15.8
adult 15.5
portrait 14.9
sexy 14.4
happy 13.8
home 13.5
male 13.5
women 13.4
men 12.9
smile 12.8
dress 12.6
medical 12.3
shop 12
pretty 11.9
cute 11.5
black 11.4
attractive 11.2
style 11.1
love 11
clothing 11
happiness 11
lifestyle 10.8
team 10.7
bride 10.7
lady 10.5
indoors 10.5
groom 10.5
toyshop 10.4
standing 10.4
equipment 10.4
wedding 10.1
holiday 10
room 10
gorgeous 10
face 9.9
posing 9.8
human 9.7
fun 9.7
medicine 9.7
window 9.3
hat 9.1
health 9
science 8.9
interior 8.8
working 8.8
hair 8.7
play 8.6
child 8.5
professional 8.5
two 8.5
modern 8.4
vintage 8.3
technology 8.2
worker 8.1
work 8
celebration 8
smiling 7.9
veil 7.8
couple 7.8
life 7.8
party 7.7
married 7.7
elegance 7.5
head 7.5
doctor 7.5
sport 7.4
retro 7.4
occupation 7.3
mercantile establishment 7.3
decoration 7.3
active 7.2
family 7.1
kid 7.1
day 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

dress 95.9
wall 95.1
clothing 91.9
text 90.8
person 87.5
wedding dress 85.5
woman 85.3
bride 73.6
dance 67.5
black and white 59.9

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 91%
Calm 88.9%
Sad 8.8%
Happy 0.6%
Surprised 0.5%
Angry 0.4%
Confused 0.3%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Male, 99.3%
Happy 70.8%
Surprised 13%
Sad 5.5%
Fear 3.8%
Calm 3.5%
Confused 1.3%
Angry 1.2%
Disgusted 1%

AWS Rekognition

Age 52-60
Gender Male, 74.8%
Calm 98.5%
Surprised 0.8%
Confused 0.2%
Sad 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 93.9%
Happy 60.6%
Surprised 25.4%
Calm 8.4%
Disgusted 2.7%
Angry 1.5%
Sad 0.8%
Fear 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Hat 97.3%

Captions

Microsoft

a group of people posing for a photo 81.7%
a group of people posing for the camera 81.6%
a group of people posing for a picture 81.5%

Text analysis

Amazon

AN
A
IN
Little
I'M
A Lonely Little
IN AN ORIAN Patch
Petunia
ORIAN
Lonely
Patch

Google

LONely
IN
A
I'M A LONely Littie PetunIA IN AN OnaN Pat
I'M
Littie
PetunIA
AN
OnaN
Pat