Human Generated Data

Title

Untitled (couple embracing and looking at camera)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.46

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple embracing and looking at camera)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Person 98.7
Human 98.7
Military 97.5
Military Uniform 96.3
Person 93.2
Face 90.6
Officer 90.4
Armored 79.1
Army 79.1
Soldier 75.1
Overcoat 72.9
Suit 72.9
Apparel 72.9
Clothing 72.9
Coat 72.9
People 66.3
Female 56
Mouth 55.1
Lip 55.1

Clarifai
created on 2019-03-25

people 100
two 99.5
adult 99.2
portrait 99
man 98.8
facial expression 98.3
actress 97.2
affection 96.8
wear 95.4
interaction 94.3
actor 93.6
woman 93.6
music 91.7
group 90.9
retro 89.4
offspring 88
administration 88
movie 87.3
three 87
embrace 85.7

Imagga
created on 2019-03-25

couple 46.2
male 44
man 41
love 37.9
people 37.4
happy 35.1
family 34.7
parent 31
father 30.5
adult 29.8
mother 29.5
portrait 29.1
happiness 29
together 28.1
person 26.6
smiling 26.1
dad 26.1
kin 25.5
smile 25
husband 24.3
child 21.5
lifestyle 21
married 20.2
wife 19.9
relationship 18.8
two 18.7
casual 17.8
looking 16.8
attractive 16.8
sitting 16.3
home 16
groom 15.8
hug 15.5
senior 15
face 14.9
daughter 14.6
men 14.6
son 14.4
handsome 14.3
joy 14.2
boy 13.9
cheerful 13.8
expression 13.7
boyfriend 13.5
guy 13.5
adolescent 13.3
togetherness 13.2
fun 12.7
women 12.7
girlfriend 12.5
loving 12.4
lady 12.2
mature 12.1
youth 11.9
embracing 11.7
affectionate 11.6
romance 11.6
cute 11.5
juvenile 11.3
group 11.3
pretty 11.2
suit 11.1
embrace 10.7
romantic 10.7
indoors 10.6
laugh 10.6
elderly 10.5
laughing 10.4
hair 10.3
grandfather 10.1
old 9.8
hugging 9.8
kid 9.8
brother 9.8
outdoors 9.7
affection 9.7
friends 9.4
blond 9.3
hand 9.1
holding 9.1
clothing 9
businessman 8.8
couples 8.8
two people 8.8
retired 8.7
serious 8.6
marriage 8.6
females 8.5
business 8.5
camera 8.3
fashion 8.3
human 8.3
playing 8.2
teenager 8.2
black 7.9
parents 7.8
bonding 7.8
tenderness 7.8
military uniform 7.7
generation 7.7
enjoying 7.6
adults 7.6
pair 7.6
leisure 7.5
three 7.5
close 7.4
grandma 7.4
teen 7.4
confident 7.3
aged 7.2
office 7.2
dress 7.2

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.3
posing 79.5
old 41.9
black and white 5.8
wedding 3.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 95.1%
Disgusted 0.2%
Calm 0%
Sad 0.1%
Confused 0.2%
Happy 99.1%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 26-43
Gender Female, 89.4%
Calm 36.1%
Happy 25.3%
Sad 4.9%
Angry 3.3%
Disgusted 12%
Confused 12.6%
Surprised 5.7%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Suit 72.9%

Captions

Microsoft

a man and woman posing for a photo 91.7%
a man and a woman posing for a photo 91.6%
a couple of people posing for a photo 91.5%