Human Generated Data

Title

Untitled (bride and groom in receiving line, groom talking to young boy)
Date

c. 1955
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10328

Human Generated Data

Title

Untitled (bride and groom in receiving line, groom talking to young boy)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.8
Clothing 99.8
Person 98.8
Human 98.8
Person 98.7
Person 97.4
Person 97.2
Person 95.6
Person 95.4
Person 90.2
Tie 89.3
Accessories 89.3
Accessory 89.3
Gown 88.6
Fashion 88.6
Robe 86.7
Coat 81.3
Overcoat 81.3
Female 81.1
Hat 80.1
Suit 77.2
Woman 71.2
Wedding 71.1
People 70.5
Wedding Gown 67.6
Baby 64.8
Newborn 64.8
Sleeve 63.1
Shirt 61.4
Furniture 60.5
Couch 60.5
Tuxedo 58.3
Bride 56.7
Finger 55.6
Person 50.8

Imagga
created on 2022-01-23

kin 48.3
people 33.5
nurse 29.6
couple 28.7
adult 26.7
male 26.6
man 23.5
love 22.9
happiness 21.1
dress 20.8
person 20.4
child 20.3
mother 19.7
happy 19.4
portrait 19.4
bride 18.3
home 18.3
family 17.8
smiling 17.4
men 16.3
clothing 16.2
women 15.8
wedding 15.6
parent 15.3
fashion 15.1
husband 14.4
two 14.4
wife 14.2
attractive 14
sibling 13.7
face 13.5
elegance 13.4
indoors 13.2
room 12.8
cheerful 12.2
sexy 12
groom 12
smile 11.4
pretty 11.2
celebration 11.2
brunette 10.5
style 10.4
lifestyle 10.1
father 9.9
fun 9.7
baby 9.6
black 9.6
boy 9.6
bouquet 9.5
marriage 9.5
color 9.5
clothes 9.4
dad 9
group 8.9
neonate 8.7
hair 8.7
married 8.6
cute 8.6
adults 8.5
females 8.5
senior 8.4
relationship 8.4
modern 8.4
human 8.2
patient 8.2
gorgeous 8.2
romantic 8
interior 8
gown 7.9
day 7.8
model 7.8
affectionate 7.7
health 7.6
casual 7.6
studio 7.6
traditional 7.5
vintage 7.4
camera 7.4
business 7.3
world 7.2
office 7.2
looking 7.2
medical 7.1
businessman 7.1
daughter 7
hospital 7
together 7

Google
created on 2022-01-23

Photograph 94.1
Hat 89.3
Headgear 80.9
Snapshot 74.3
Event 73.4
Vintage clothing 72.2
Monochrome photography 68.5
Toddler 68
Monochrome 67.9
Classic 67.1
Stock photography 64
Sun hat 63.8
Family taking photos together 58.1
Formal wear 57.5
Family reunion 56.8
Suit 56.8
Photo caption 56.4
Room 55.6
Font 54.2
Ceremony 53.9

Microsoft
created on 2022-01-23

person 99.6
clothing 97.2
human face 97.1
text 93.1
baby 93
smile 83.7
toddler 80
woman 74.4
group 66.1
man 63.7
old 59.8
posing 41.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Female, 69.6%
Calm 66.5%
Confused 20.5%
Surprised 6.1%
Happy 3.4%
Sad 1.2%
Disgusted 1.2%
Angry 0.7%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 56.9%
Happy 16.6%
Surprised 10.4%
Sad 4.9%
Angry 4.5%
Confused 4.4%
Disgusted 1.6%
Fear 0.7%

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Happy 99.9%
Surprised 0%
Angry 0%
Fear 0%
Confused 0%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 0-3
Gender Male, 64.6%
Calm 49.3%
Happy 32.1%
Sad 15.6%
Fear 0.9%
Angry 0.6%
Confused 0.6%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 35-43
Gender Male, 57.5%
Happy 99.8%
Surprised 0.1%
Disgusted 0%
Fear 0%
Angry 0%
Sad 0%
Calm 0%
Confused 0%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 89.3%
Hat 80.1%
Suit 77.2%

Captions

Microsoft

Kurt Hamrin et al. posing for a photo 95.5%
Kurt Hamrin et al. posing for the camera 95.4%
Kurt Hamrin et al. posing for a picture 95.3%

Text analysis

Amazon

13
I