Human Generated Data

Title

Untitled (man in military dress, with woman and small girl, seated, half-length)
Date

c. 1940
People

Artist: Michael Disfarmer, American 1884 - 1959
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Susan and Neal Yanofsky, 2007.286

Human Generated Data

Title

Untitled (man in military dress, with woman and small girl, seated, half-length)

People

Artist: Michael Disfarmer, American 1884 - 1959

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.7
Human 99.7
Person 99.5
Person 99
Face 97.7
People 94.7
Female 94.1
Teen 90
Clothing 85.8
Apparel 85.8
Family 85.2
Woman 83.4
Girl 77.4
Photo 74.8
Portrait 74.8
Photography 74.8
Child 74.8
Kid 74.8
Blonde 72.2
Baby 67.4
Man 62.4
Suit 60.4
Coat 60.4
Overcoat 60.4
Glasses 60.2
Accessories 60.2
Accessory 60.2
Smile 59.9

Imagga
created on 2022-03-05

kin 42.3
people 37.4
happy 37
man 37
male 33.8
mother 33.5
parent 33.4
sibling 32.5
couple 29.6
smiling 28.9
home 28.7
family 27.6
together 25.4
child 24.9
adult 24.7
happiness 23.5
senior 23.4
mature 22.3
portrait 22
person 21.7
father 21.4
love 20.5
smile 20
indoors 19.3
husband 19.3
daughter 18.6
men 18
dad 17.8
elderly 17.2
computer 16.8
grandfather 16.4
cheerful 16.3
wife 16.1
clothing 15.9
togetherness 15.1
laptop 14.6
office 14.5
lifestyle 14.5
face 14.2
boy 13.9
casual 13.6
30s 13.5
women 13.4
looking 12.8
sitting 12
camera 12
nurse 11.9
old 11.8
world 11.8
attractive 11.2
work 11
grandma 11
girls 10.9
business 10.9
thirties 10.7
group 10.5
two 10.2
suit 10.1
aged 10
hand 9.9
60s 9.8
middle aged 9.7
working 9.7
two people 9.7
businessman 9.7
retired 9.7
married 9.6
horizontal 9.2
holding 9.1
human 9
fun 9
military uniform 8.9
kid 8.9
healthy 8.8
half length 8.8
older 8.7
room 8.7
table 8.7
retirement 8.6
tie 8.5
females 8.5
health 8.3
care 8.2
70s 7.9
day 7.8
professional 7.8
black 7.8
uniform 7.8
color 7.8
aging 7.7
son 7.6
age 7.6
enjoying 7.6
desk 7.6
baby 7.5
student 7.4
technology 7.4
school 7.4
bow tie 7.4
joyful 7.4
necktie 7.2
cute 7.2
childhood 7.2
hair 7.1
handsome 7.1
job 7.1
medical 7.1

Google
created on 2022-03-05

Clothing 98.7
Toddler 78.5
Art 77.5
Picture frame 76.7
Snapshot 74.3
Vintage clothing 70.6
Event 68
Monochrome photography 67.3
Stock photography 66.6
Room 66.6
Monochrome 66.2
Classic 64.1
Child 61.2
Baby 58
Portrait 56.2
Family 55.8
Hat 55.5
Rectangle 53.6
History 53.2
Portrait photography 52.6

Microsoft
created on 2022-03-05

person 99.9
text 99.8
human face 99.1
baby 97.7
clothing 97.6
wall 96.1
old 94.8
smile 94.2
toddler 91.9
window 82.5
posing 79.8
black 77.7
standing 77
boy 62.6
white 60.8
man 53.8
picture frame 11.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 99.5%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Fear 0%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 35-43
Gender Female, 99.7%
Calm 86.5%
Angry 7%
Happy 2%
Disgusted 1.9%
Confused 1.1%
Sad 1%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 0-4
Gender Female, 99.8%
Sad 49.4%
Angry 24.5%
Calm 17.3%
Confused 2.7%
Fear 2.3%
Disgusted 1.7%
Happy 1.3%
Surprised 0.8%

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a vintage photo of Ernst Thalmann and woman posing for a picture 91.5%
a vintage photo of Ernst Thalmann et al. posing for a picture 91.4%
a vintage photo of Ernst Thalmann et al. posing for the camera 91.3%