Human Generated Data

Title

Untitled (group family portrait of four men and five women)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2222

Human Generated Data

Title

Untitled (group family portrait of four men and five women)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Apparel 99.5
Clothing 99.5
Person 99.1
Human 99.1
Person 99
Person 98.8
Person 98.7
Person 98.4
Person 98.3
Person 98.1
Person 97.9
Person 97.9
Face 86.1
Robe 77.1
Fashion 77.1
People 72.6
Sleeve 72.4
Gown 71.4
Evening Dress 71.4
Female 67.9
Coat 67.9
Suit 67.9
Overcoat 67.9
Portrait 66.3
Photo 66.3
Photography 66.3
Accessory 62.5
Tie 62.5
Accessories 62.5
Wedding 57.7
Indoors 56
Plant 55.7
Blossom 55.7
Flower 55.7
Long Sleeve 55.5

Imagga
created on 2021-12-14

groom 100
bride 46.2
wedding 39.5
people 31.8
dress 30.7
couple 28.7
marriage 24.7
adult 24.5
love 24.5
happiness 24.3
flowers 22.6
married 22
ceremony 21.3
bouquet 21
person 19.9
two 19.5
celebration 19.1
wife 19
man 17.5
women 16.6
male 16.3
veil 15.7
men 15.5
engagement 15.4
happy 15
day 14.9
attractive 14.7
gown 14.6
husband 14.5
romance 14.3
bridal 13.6
portrait 13.6
fashion 13.6
negative 13
event 12.9
wed 12.8
clothing 12.7
suit 12.6
romantic 12.5
pretty 11.9
family 11.6
cheerful 11.4
human 11.2
relationship 11.2
worker 11.1
business 10.9
elegance 10.9
kiss 10.7
glass 10.7
outdoors 10.4
film 10.4
life 10.1
face 9.9
lady 9.7
roses 9.7
indoors 9.7
laboratory 9.6
together 9.6
perfume 9.5
holding 9.1
matrimony 8.9
sexy 8.8
medical 8.8
bartender 8.7
lab 8.7
professional 8.7
smiling 8.7
holiday 8.6
waiter 8.6
research 8.6
smile 8.5
biology 8.5
flower 8.5
rose 8.4
group 8.1
photographic paper 8
businessman 7.9
wedded 7.9
brunette 7.8
black 7.8
party 7.7
chemistry 7.7
coat 7.7
drink 7.5
toiletry 7.4
church 7.4
tradition 7.4
decoration 7.4
20s 7.3
blond 7.2
cute 7.2
posing 7.1
medicine 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

clothing 93.5
person 87.2
window 84.6
text 77.6
woman 73.3
smile 70.4
dress 50.4
posing 36.4

Face analysis

Amazon

Google

AWS Rekognition

Age 40-58
Gender Male, 78%
Calm 97.6%
Surprised 0.6%
Happy 0.6%
Sad 0.5%
Fear 0.3%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 47-65
Gender Male, 94.6%
Calm 96.1%
Happy 1.2%
Sad 1.2%
Surprised 0.6%
Angry 0.3%
Fear 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 51-69
Gender Male, 97.3%
Calm 95%
Confused 1.8%
Sad 1.5%
Surprised 0.9%
Angry 0.3%
Fear 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 52-70
Gender Male, 98.6%
Calm 87.1%
Surprised 6.2%
Angry 3.1%
Happy 1.2%
Disgusted 0.8%
Sad 0.7%
Confused 0.6%
Fear 0.2%

AWS Rekognition

Age 45-63
Gender Male, 58.5%
Calm 87.8%
Sad 8.8%
Confused 0.8%
Fear 0.7%
Angry 0.6%
Surprised 0.6%
Happy 0.5%
Disgusted 0.1%

AWS Rekognition

Age 51-69
Gender Male, 95.5%
Calm 80.2%
Angry 5.4%
Surprised 4.9%
Sad 3.8%
Fear 2%
Confused 1.4%
Disgusted 1.2%
Happy 1%

AWS Rekognition

Age 51-69
Gender Male, 98.1%
Calm 93.6%
Sad 2.5%
Surprised 1.5%
Fear 0.7%
Angry 0.6%
Happy 0.6%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 30-46
Gender Female, 65.5%
Calm 77.5%
Surprised 10.8%
Fear 3.5%
Happy 3.3%
Sad 2.6%
Angry 0.9%
Confused 0.8%
Disgusted 0.5%

AWS Rekognition

Age 50-68
Gender Male, 70.1%
Calm 93.8%
Sad 2.3%
Happy 2%
Surprised 0.6%
Fear 0.5%
Angry 0.3%
Confused 0.3%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 67.9%
Tie 62.5%

Captions

Microsoft

a group of people posing for a photo 77.9%
a group of people posing for a photo in front of a window 71.6%
a group of men standing next to a window 60.2%