Human Generated Data

Title

Untitled (studio portrait of grandfather and young girl, both looking right, girl standing)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6941

Human Generated Data

Title

Untitled (studio portrait of grandfather and young girl, both looking right, girl standing)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.3
Human 98.3
Person 98.3
Apparel 98.1
Overcoat 98.1
Coat 98.1
Suit 98.1
Clothing 98.1
Home Decor 81.6
Finger 72.8
Fashion 60
Sleeve 56.9

Imagga
created on 2022-01-23

child 39.8
family 38.3
people 35.2
male 30.7
happy 29.5
mother 27.9
man 27.6
sibling 27.4
bow tie 26.7
home 25.5
portrait 25.3
happiness 25.1
person 25
love 24.5
adult 22.7
parent 20.4
smiling 20.3
lifestyle 20.2
necktie 20.1
boy 20
clothing 19.6
childhood 17.9
cheerful 17.9
kid 17.7
indoors 17.6
father 17.5
couple 17.4
kin 17
children 16.4
two 16.1
face 15.6
casual 15.3
smile 15
together 14.9
attractive 14.7
fun 14.2
senior 14.1
mature 14
old 13.9
daughter 13.9
men 13.7
husband 13.5
cute 12.9
son 12.6
dad 12.5
standing 12.2
group 12.1
women 11.9
playing 11.9
color 11.7
elderly 11.5
brother 11.4
wife 11.4
innocent 11
girls 10.9
grandfather 10.9
holding 10.7
handsome 10.7
garment 10.6
human 10.5
office 10.4
baby 10.3
adorable 10.2
indoor 10
studio 9.9
care 9.9
business 9.7
looking 9.6
brunette 9.6
togetherness 9.4
relationship 9.4
youth 9.4
20s 9.2
blond 9.1
businesswoman 9.1
dress 9
health 9
one 9
jacket 8.9
interior 8.9
businessman 8.8
boys 8.7
married 8.6
loving 8.6
kids 8.5
joy 8.4
leisure 8.3
aged 8.2
little 8
vertical 7.9
good mood 7.8
grandmother 7.8
eye contact 7.8
two people 7.8
sitting 7.7
mid adult 7.7
years 7.7
pretty 7.7
partnership 7.7
four 7.7
boss 7.7
age 7.6
adults 7.6
playful 7.6
healthy 7.6
fashion 7.5
room 7.5
camera 7.4
teen 7.4
lady 7.3
life 7.2
team 7.2
world 7.1
suit 7.1

Google
created on 2022-01-23

Clothing 98.7
Sleeve 87
Gesture 85.3
Dress 84
Suit 83.3
Art 81.5
Blazer 78
Vintage clothing 76.4
Tie 73.8
Formal wear 73.4
Toddler 71.3
Classic 69.2
Monochrome 68.1
Pattern 67.7
Event 65.7
Child 65.4
Stock photography 62.6
Monochrome photography 61.6
Sitting 60.4
Portrait 58.8

Microsoft
created on 2022-01-23

person 100
human face 98.2
clothing 97.2
indoor 88.6
standing 83.4
suit 67.5
portrait 66.9
text 64
smile 55.3
boy 55

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 66-76
Gender Male, 97.6%
Calm 99.7%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%
Surprised 0%
Fear 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 6-14
Gender Female, 99.4%
Calm 94.5%
Fear 3.7%
Confused 0.5%
Sad 0.4%
Angry 0.2%
Disgusted 0.2%
Happy 0.2%
Surprised 0.2%

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Suit 98.1%

Captions

Microsoft

a person wearing a suit and tie 95%
a man standing next to a woman 81.9%
a woman standing next to a man in a suit and tie 81.8%