Human Generated Data

Title

Untitled (family portrait with five generations)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2274

Human Generated Data

Title

Untitled (family portrait with five generations)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Clothing 99.4
Apparel 99.4
Person 97.5
Human 97.5
Tie 97.3
Accessories 97.3
Accessory 97.3
Person 97.2
Person 96.1
Person 94.7
Overcoat 92.4
Suit 92.4
Coat 92.4
Tie 92.4
Person 89.8
Chair 85.2
Furniture 85.2
Suit 77.5
People 73.9
Tie 62.8
Photography 61.4
Photo 61.4
Portrait 60.6
Face 60.6
Icing 58
Food 58
Creme 58
Cream 58
Dessert 58
Cake 58
Evening Dress 58
Gown 58
Robe 58
Fashion 58

Imagga
created on 2022-01-30

groom 58.1
man 45.7
male 41.1
person 37.2
nurse 36.3
people 33.5
senior 31.9
adult 30.9
couple 29.6
happy 28.8
elderly 25.8
professional 25.5
hospital 24.6
doctor 24.4
mature 24.2
medical 23.8
patient 21.7
businessman 21.2
business 20.6
smiling 20.3
men 19.8
care 19.7
team 18.8
health 18.8
portrait 18.1
happiness 18
indoors 17.6
office 16.9
job 16.8
home 16.8
worker 16.6
stethoscope 16.2
looking 16
smile 15.7
suit 15.6
women 15
occupation 14.7
old 14.6
group 14.5
love 14.2
working 14.1
medicine 14.1
together 14
grandma 13.9
two 13.6
30s 13.5
specialist 13.5
kin 13.4
handsome 13.4
husband 13.4
standing 13
corporate 12.9
lab coat 12.9
businesswoman 12.7
colleagues 12.6
attractive 12.6
work 12.6
clinic 12.5
illness 12.4
talking 12.4
lifestyle 12.3
teamwork 12.1
sitting 12
bride 12
coat 11.6
businesspeople 11.4
wife 11.4
meeting 11.3
camera 11.1
wedding 11
40s 10.7
family 10.7
clothing 10.6
cheerful 10.6
retirement 10.6
bow tie 10.5
profession 10.5
practitioner 10.5
marriage 10.4
executive 10.3
dress 9.9
grandfather 9.8
human 9.7
examination 9.7
older 9.7
uniform 9.7
bouquet 9.6
married 9.6
day 9.4
help 9.3
joy 9.2
20s 9.2
hand 9.1
discussion 8.8
middle aged 8.8
partner 8.7
sick 8.7
flowers 8.7
necktie 8.7
partnership 8.6
exam 8.6
casual 8.5
manager 8.4
successful 8.2
aged 8.1
lady 8.1
romantic 8
building 7.9
look 7.9
70s 7.9
doctors 7.9
discussing 7.9
forties 7.8
physician 7.8
half length 7.8
consultant 7.8
thirties 7.8
retired 7.8
check 7.7
mid adult 7.7
waiter 7.5
friendly 7.3
indoor 7.3
new 7.3
confident 7.3
garment 7.2
romance 7.1

Google
created on 2022-01-30

Coat 90.3
Suit 85.4
Gesture 85.3
Hat 83.6
Snapshot 74.3
Formal wear 73.8
Event 73.5
Vintage clothing 73.2
Monochrome photography 72
Monochrome 70
Classic 67.9
Stock photography 65.6
History 62.7
Jewellery 62.4
Presbyter 56.8
Glass 55.4
Smile 55.1
Necklace 55.1
Bishop 54.5
Curtain 54.4

Microsoft
created on 2022-01-30

person 99.5
wall 98.9
man 97.2
smile 96
posing 95.9
clothing 92.5
standing 88.5
white 78.9
suit 77.9
wedding 75.5
black 73.9
dress 68.5
old 68.2
ceremony 66.7
human face 54.3
clothes 19.3

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Female, 94.9%
Happy 59.7%
Confused 20.4%
Fear 5.3%
Sad 3.7%
Calm 3.1%
Disgusted 3%
Surprised 3%
Angry 1.8%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 61.9%
Surprised 14.9%
Disgusted 8.6%
Happy 5.4%
Confused 4.2%
Sad 3.7%
Fear 0.7%
Angry 0.7%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Happy 94.3%
Surprised 2%
Sad 1.4%
Calm 0.5%
Disgusted 0.5%
Confused 0.4%
Fear 0.4%
Angry 0.4%

AWS Rekognition

Age 28-38
Gender Male, 52.9%
Calm 58.4%
Sad 34.7%
Happy 2.2%
Confused 1.6%
Surprised 1.2%
Disgusted 0.8%
Angry 0.5%
Fear 0.5%

AWS Rekognition

Age 54-62
Gender Male, 99.8%
Sad 96.4%
Happy 1.4%
Confused 0.5%
Calm 0.4%
Fear 0.4%
Disgusted 0.4%
Surprised 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Tie 97.3%
Suit 92.4%

Captions

Microsoft

a group of people posing for a photo 97.6%
a group of people posing for the camera 97.5%
a group of people posing for a picture 97.4%

Text analysis

Google

EIA--ETT
KODVR
W
VE
KODVR VE EIA--ETT W