Human Generated Data

Title

Untitled (studio portrait of four African American women)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6944

Human Generated Data

Title

Untitled (studio portrait of four African American women)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.6
People 96
Family 91.2
Text 80.1
Senior Citizen 55.2

Imagga
created on 2022-01-23

kin 100
man 44.4
couple 41.8
senior 41.3
male 41.2
happy 37
elderly 34.5
smiling 34
people 33.5
husband 27.8
mature 27
men 25.8
together 25.4
grandfather 25.4
home 24.7
adult 24
wife 23.7
indoors 22.9
grandma 22.5
group 21
person 20.5
portrait 19.4
retired 18.4
30s 18.3
married 18.2
love 18.2
family 17.8
middle aged 17.5
sitting 17.2
father 16.4
old 16
medical 15.9
professional 15.3
doctor 15
businessman 15
smile 15
mother 14.7
businesswoman 14.6
team 14.3
day 14.1
business 14
40s 13.6
women 13.5
lifestyle 13
camera 12.9
60s 12.7
half length 12.7
adults 12.3
parent 12.3
standing 12.2
patient 12.1
office 12.1
inside 12
nurse 11.9
70s 11.8
handsome 11.6
affection 11.6
retirement 11.5
dad 11.5
job 11.5
marriage 11.4
businesspeople 11.4
cheerful 11.4
teamwork 11.1
health 11.1
happiness 11
horizontal 10.9
discussing 10.8
forties 10.8
casual clothing 10.8
care 10.7
colleagues 10.7
talking 10.5
enjoying 10.4
meeting 10.4
friendship 10.3
sixties 9.8
romantic 9.8
businessmen 9.8
thirties 9.7
affectionate 9.7
looking camera 9.6
looking 9.6
illness 9.5
hospital 9.5
occupation 9.2
aged 9.1
color 8.9
working 8.8
grandmother 8.8
medicine 8.8
older 8.7
daytime 8.7
clinic 8.6
corporate 8.6
casual 8.5
worker 8.1
romance 8
explaining 7.9
stethoscope 7.9
days 7.8
50s 7.8
surgery 7.8
consultant 7.8
ill 7.8
two people 7.8
aging 7.7
four 7.7
exam 7.7
staff 7.7
females 7.6
friends 7.5
relaxed 7.5
relationship 7.5
fun 7.5
emotion 7.4
lab coat 7.3
suit 7.2
attractive 7

Google
created on 2022-01-23

Clothing 98.7
Photograph 94.2
Facial expression 93.3
Handwriting 90
Black 89.6
Curtain 83.8
Social group 82.3
Font 73.9
Event 72
Vintage clothing 67.3
History 63
Room 63
Team 60.5
Hat 58.7
Signature 57.1
Necklace 54.9
Jewellery 54.1
Photo caption 53.9
Art 52.4
Family 52.2

Microsoft
created on 2022-01-23

person 99.4
human face 98.7
smile 97.1
posing 93.6
clothing 93.4
group 91.6
man 85.9
text 82.1
standing 82
people 79.4
old 76.1
handwriting 59.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-58
Gender Female, 53.9%
Calm 99.1%
Angry 0.4%
Confused 0.1%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 49-57
Gender Female, 100%
Calm 89.8%
Fear 2.6%
Happy 2.1%
Angry 1.5%
Sad 1.4%
Disgusted 1.4%
Surprised 0.9%
Confused 0.4%

AWS Rekognition

Age 49-57
Gender Female, 99.9%
Calm 98.8%
Sad 0.4%
Fear 0.3%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 54-64
Gender Female, 100%
Calm 99%
Angry 0.3%
Disgusted 0.2%
Sad 0.2%
Confused 0.1%
Fear 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 70-80
Gender Female, 97.7%
Calm 55.9%
Sad 36.2%
Fear 2.3%
Confused 1.4%
Disgusted 1.4%
Angry 1.4%
Surprised 0.8%
Happy 0.6%

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 52
Gender Female

Microsoft Cognitive Services

Age 49
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 98.7%
a group of people posing for the camera 98.6%
a group of people posing for a picture 98.5%

Text analysis

Amazon

6
has
6 L mid
fix has
fix
L
mid

Google

mild
mild