Human Generated Data

Title

Portrait of Anneliese Hager and K.O. Götz

Date

1943

People

Artist: Edmund Kesting, German 1892 - 1970

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of the German Friends of the Busch-Reisinger Museum, 2019.111

Copyright

© Edmund Kesting Estate/Artists Rights Society (ARS), New York/VG Bild-Kunst, Bonn

Human Generated Data

Title

Portrait of Anneliese Hager and K.O. Götz

People

Artist: Edmund Kesting, German 1892 - 1970

Date

1943

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2020-02-12

Person 98
Human 98
Person 97.9
Person 94.1
Tie 93.8
Accessories 93.8
Accessory 93.8
Overcoat 81.1
Clothing 81.1
Suit 81.1
Coat 81.1
Apparel 81.1
Finger 80.3
Crowd 72.9
Suit 71.4
People 63

Clarifai
created on 2020-02-12

people 100
group 99.7
portrait 99.4
three 99.1
two 99.1
adult 98.7
administration 98
four 97.6
leader 96.9
man 96.6
music 95.7
several 95.4
wear 95.4
group together 94.4
facial expression 92.8
five 92
woman 89.9
microphone 89.1
retro 88.1
actor 88

Imagga
created on 2020-02-12

man 49.8
male 45.8
businessman 34.4
people 34
executive 31.5
happy 30.7
business 30.4
couple 29.6
smiling 29
office 28.2
suit 28.2
person 28.1
corporate 26.7
men 26.6
senior 26.3
together 24.5
adult 23.4
professional 23.4
meeting 22.6
group 21.8
mature 21.4
smile 21.4
portrait 21.4
family 21.4
businesswoman 19.1
businessmen 18.5
baron 17.9
handsome 17.8
team 17
success 16.9
director 16.9
love 16.6
grandfather 16.3
elderly 16.3
businesspeople 16.1
attractive 16.1
husband 15.5
confident 15.5
teamwork 14.8
standing 14.8
cheerful 14.6
sitting 14.6
secretary 14.6
tie 14.2
work 14.1
successful 13.7
colleagues 13.6
happiness 13.3
grandma 13.3
job 13.3
old 13.2
lifestyle 13
two 12.7
partner 12.6
30s 12.5
partnership 12.5
married 12.5
necktie 12.4
entrepreneur 12.4
father 12.3
kin 12.3
working 11.5
mother 11.4
wife 11.4
groom 11.3
manager 11.2
home 11.2
bow tie 10.7
face 10.7
indoors 10.5
marriage 10.5
boy 10.4
child 9.9
older 9.7
looking 9.6
workplace 9.5
table 9.5
women 9.5
relationship 9.4
holding 9.1
aged 9.1
worker 9
grandmother 8.8
partners 8.8
parent 8.7
corporation 8.7
dad 8.6
expression 8.5
adults 8.5
son 8.5
communication 8.4
hand 8.4
fun 8.2
friendly 8.2
lady 8.1
romantic 8
businesswomen 7.9
planner 7.8
busy 7.7
diversity 7.7
leadership 7.7
casual 7.6
career 7.6
desk 7.6
brother 7.6
shirt 7.5
celebration 7.2
building 7.1
daughter 7.1
pretty 7

Google
created on 2020-02-12

Photograph 95.9
People 94.5
Gentleman 86.9
Snapshot 83.6
Vintage clothing 82.7
Retro style 75.5
Family 65.8
Photography 62.4
Portrait 56.7
Black-and-white 56.4
Monochrome 54.4
Suit 53.3
Art 50.2

Microsoft
created on 2020-02-12

human face 99.5
person 99.1
clothing 93.8
man 86.2
suit 82.6
portrait 77.3
smile 64.3
people 63
text 62.2
posing 46.3
necktie 21.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Female, 95.1%
Confused 0%
Fear 0%
Surprised 0.1%
Angry 0%
Disgusted 0%
Happy 0%
Sad 0%
Calm 99.7%

AWS Rekognition

Age 27-43
Gender Male, 97.6%
Angry 0.6%
Disgusted 0.1%
Happy 0%
Calm 98%
Sad 0.5%
Confused 0.7%
Surprised 0.2%
Fear 0%

AWS Rekognition

Age 23-35
Gender Male, 98.6%
Fear 0.3%
Calm 62.9%
Angry 0.4%
Sad 36.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Confused 0.2%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Tie 93.8%
Suit 81.1%

Captions

Microsoft

a group of people posing for a photo 95.1%
a group of people posing for the camera 95%
a group of people posing for a picture 94.9%