Human Generated Data

Title

Essing Family (Hermann Essing, 35, Rover Scout Leader / Bruna Essing, 32, Rover Scout Leader / Frank Essing, 6, Cub Scout / Tanja Essing, 4, Brownie)
Date

1974 (printed 1998)
People

Artist: Timm Rautert, German born 1941
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Purchased through the generosity of Günther Engler, Werner and Jutta Pottbrock, Lothar and Christiane Pues, and the Antonia Paepcke DuBrul Fund, 2012.7.25
Copyright

© Timm Rautert

Human Generated Data

Title

Essing Family (Hermann Essing, 35, Rover Scout Leader / Bruna Essing, 32, Rover Scout Leader / Frank Essing, 6, Cub Scout / Tanja Essing, 4, Brownie)

People

Artist: Timm Rautert, German born 1941

Date

1974 (printed 1998)

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Purchased through the generosity of Günther Engler, Werner and Jutta Pottbrock, Lothar and Christiane Pues, and the Antonia Paepcke DuBrul Fund, 2012.7.25

Copyright

© Timm Rautert

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Footwear 99.7
Apparel 99.7
Shoe 99.7
Clothing 99.7
Shoe 99.7
Family 99.5
People 99.5
Human 99.5
Person 99.2
Person 99
Person 98.9
Person 98.8
Shoe 90.3
Pants 82.9
Shoe 75.9
Denim 64.3
Jeans 64.3

Clarifai
created on 2018-03-16

child 99.4
people 99.2
wear 98.8
portrait 97.3
man 97
woman 96.2
two 95.2
son 94.2
uniform 93.8
three 91.8
family 90.8
adult 90.4
boy 90.3
fashion 89.4
group 89.3
facial expression 88.9
togetherness 88.9
pants 88.2
four 87.9
healthcare 86.1

Imagga
created on 2018-03-16

astronaut 100
people 33.4
man 31.6
happy 29.4
male 26.4
portrait 25.2
person 25.1
smile 24.9
smiling 23.9
adult 22.8
group 19.3
medical 18.5
uniform 18
doctor 17.8
nurse 17.3
hospital 16.7
team 16.1
standing 15.6
child 15.6
medicine 15
lifestyle 14.4
friends 14.1
couple 13.9
casual 13.5
stethoscope 13.5
professional 12.9
men 12.9
care 12.3
fun 12
women 11.9
happiness 11.7
boy 11.3
outdoors 11.2
health 11.1
kid 10.6
job 10.6
cheerful 10.6
together 10.5
senior 10.3
mature 10.2
youth 10.2
face 9.9
guy 9.8
family 9.8
black 9.6
work 9.4
outside 9.4
friendship 9.4
student 9.3
teamwork 9.3
20s 9.2
teenager 9.1
school 9.1
worker 8.9
clothing 8.6
culture 8.5
shirt 8.5
pretty 8.4
joy 8.3
occupation 8.2
human 8.2
park 8.2
confident 8.2
handsome 8
son 7.9
hair 7.9
backpack 7.8
attractive 7.7
diversity 7.7
coat 7.7
laugh 7.7
staff 7.6
laughing 7.6
clothes 7.5
teen 7.3
active 7.3
children 7.3
color 7.2
dress 7.2
activity 7.2
costume 7.1
love 7.1
to 7.1
sport 7.1

Google
created on 2018-03-16

human behavior 81.1
outerwear 73.4
family 66.4

Microsoft
created on 2018-03-16

person 99.4
group 74.5
posing 68.2
people 57.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.6%
Calm 24.3%
Sad 13%
Confused 10.2%
Disgusted 6.2%
Happy 29.4%
Surprised 6.8%
Angry 10.1%

AWS Rekognition

Age 26-43
Gender Female, 99.8%
Confused 12.6%
Angry 5.9%
Surprised 3.6%
Calm 18%
Happy 26.7%
Disgusted 25.1%
Sad 8.3%

AWS Rekognition

Age 9-14
Gender Female, 99.2%
Surprised 0.3%
Happy 0.5%
Disgusted 0.4%
Calm 95.4%
Confused 0.3%
Angry 2.1%
Sad 1.1%

AWS Rekognition

Age 4-9
Gender Female, 99.4%
Calm 94.5%
Sad 2.4%
Confused 0.2%
Disgusted 0.8%
Happy 0.6%
Surprised 0.8%
Angry 0.8%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.7%
Person 99.2%

Categories

Imagga

people portraits 96.7%
events parties 3.2%
paintings art 0.1%