Human Generated Data

Title

Untitled (Remirez family portrait)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2330

Human Generated Data

Title

Untitled (Remirez family portrait)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Clothing 99.9
Apparel 99.9
Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 99.3
Person 99.3
Person 99.2
Person 98.9
Person 98.7
Person 97.8
Person 97.8
Person 97
Coat 86.2
People 83.8
Bonnet 77.1
Hat 77.1
Face 71.1
Tie 71
Accessory 71
Accessories 71
Portrait 62.9
Photography 62.9
Photo 62.9
Suit 60
Overcoat 60
Kid 59.5
Child 59.5
Female 59.4
Girl 59.4
Dress 56.4

Imagga
created on 2022-01-30

groom 44.3
people 40.7
couple 40
nurse 39.1
man 34.9
lab coat 29.9
person 28.9
happy 28.8
male 26.9
bride 26.2
adult 25.3
coat 25.1
wedding 24.8
senior 24.4
happiness 24.3
love 22.9
specialist 22.7
married 22
together 21.9
kin 21.8
smiling 20.2
men 18.9
elderly 18.2
women 18.2
husband 18.1
marriage 18
wife 18
portrait 17.5
two 16.9
dress 16.3
bouquet 16
human 15.7
clothing 15.4
team 15.2
medical 15
mature 14.9
suit 14.4
group 13.7
romantic 13.4
family 13.3
old 13.2
indoors 13.2
flowers 13
day 12.5
romance 12.5
smile 12.1
looking 12
celebration 12
health 11.8
shower cap 11.6
businessman 11.5
garment 11.4
doctor 11.3
camera 11.1
patient 11.1
cap 11
gown 10.9
business 10.9
holding 10.7
older 10.7
ceremony 10.7
hospital 10.6
cheerful 10.6
retirement 10.6
attractive 10.5
negative 10.3
sitting 10.3
professional 9.9
worker 9.8
working 9.7
friends 9.4
casual 9.3
face 9.2
new 8.9
veil 8.8
kiss 8.8
retired 8.7
standing 8.7
clinic 8.6
relationship 8.4
friendship 8.4
hand 8.4
teamwork 8.3
outdoors 8.2
film 8.1
lady 8.1
surgeon 8.1
handsome 8
home 8
lifestyle 7.9
medicine 7.9
look 7.9
half length 7.8
affection 7.7
pretty 7.7
30s 7.7
illness 7.6
enjoying 7.6
pair 7.5
horizontal 7.5
occupation 7.3
businesswoman 7.3
holiday 7.2
hair 7.1
to 7.1
headdress 7

Google
created on 2022-01-30

Photograph 94.2
Shirt 94
Smile 91.3
Black 89.6
Sleeve 85.4
Style 84
T-shirt 83.4
Black-and-white 82.6
Headgear 81.6
Font 80.9
Art 80.1
Snapshot 74.3
Monochrome 74
Event 73.9
Hat 73.1
Team 72.9
Monochrome photography 72.3
Fun 67.9
Vintage clothing 67.4
Room 67.4

Microsoft
created on 2022-01-30

person 98.3
text 95.6
posing 82.7
smile 81.9

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Male, 76.3%
Happy 64.8%
Calm 17.9%
Sad 5.1%
Confused 3.7%
Disgusted 3.3%
Surprised 3%
Angry 1.5%
Fear 0.9%

AWS Rekognition

Age 38-46
Gender Male, 98.5%
Calm 42.4%
Happy 30.3%
Surprised 8.5%
Disgusted 7.6%
Confused 5.9%
Sad 3.7%
Angry 1.1%
Fear 0.4%

AWS Rekognition

Age 23-33
Gender Male, 94.1%
Happy 59.3%
Surprised 14.7%
Sad 8.4%
Calm 7.5%
Disgusted 5.9%
Confused 1.8%
Fear 1.2%
Angry 1.1%

AWS Rekognition

Age 28-38
Gender Male, 100%
Sad 38.8%
Calm 26.7%
Surprised 11.4%
Confused 8.7%
Disgusted 5.2%
Angry 4.8%
Fear 3%
Happy 1.3%

AWS Rekognition

Age 22-30
Gender Female, 73.6%
Calm 87%
Happy 8.5%
Sad 1.4%
Confused 1%
Disgusted 0.9%
Surprised 0.7%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 28-38
Gender Male, 86%
Happy 92.2%
Sad 3.4%
Confused 1.7%
Surprised 0.7%
Calm 0.7%
Disgusted 0.5%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 23-33
Gender Male, 92.5%
Happy 61%
Sad 22.4%
Fear 3.5%
Disgusted 3%
Calm 2.8%
Surprised 2.5%
Confused 2.4%
Angry 2.4%

AWS Rekognition

Age 27-37
Gender Male, 94.9%
Happy 26%
Calm 22.3%
Disgusted 16.7%
Sad 16.6%
Fear 6.3%
Surprised 4.9%
Angry 4%
Confused 3.2%

AWS Rekognition

Age 22-30
Gender Male, 96.9%
Happy 70.2%
Calm 13.1%
Surprised 12.3%
Confused 1.6%
Disgusted 1%
Fear 0.9%
Sad 0.7%
Angry 0.4%

AWS Rekognition

Age 28-38
Gender Male, 94.3%
Happy 61.4%
Sad 15.2%
Surprised 8.7%
Calm 6.4%
Disgusted 5.4%
Confused 1.4%
Angry 1.1%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 85.6%
Confused 4.6%
Sad 4.1%
Angry 2.9%
Surprised 1.2%
Disgusted 1.1%
Happy 0.4%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 71%

Captions

Microsoft

a group of people posing for a photo 95.9%
a group of people posing for the camera 95.8%
a group of people posing for a picture 95.7%

Text analysis

Amazon

c1x8-1
NAUOX

Google

ペー
Kペー
K