Human Generated Data

Title

The Felsenfeld/Gold Families, Philadelphia
Date

2007
People

Artist: Thomas Struth, German born 1954
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Friends Anniversary Collection, Gift of the artist, 2011.23

Human Generated Data

Title

The Felsenfeld/Gold Families, Philadelphia

People

Artist: Thomas Struth, German born 1954

Date

2007

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Apparel 99.7
Clothing 99.7
Shoe 99.7
Footwear 99.7
Human 99.4
Person 99.4
Person 99.4
Person 99.4
Person 99.2
Person 98.6
Person 97.3
Person 95.6
Person 93.5
Person 91
Shoe 83.1
Couch 82.4
Furniture 82.4
Person 80.5
Shoe 75.7
Sitting 70.7
People 68.3
Diagram 66.7
Shoe 62.7
Shoe 61.9
Plot 57.1
Map 56.1

Clarifai
created on 2018-03-23

woman 98.8
people 98.8
group 98.4
adult 98
man 96.9
room 93.5
family 91.3
business 90.2
child 88.7
wear 86.6
recreation 86.3
girl 85.7
meeting 84.5
group together 83.9
lifestyle 81.8
class 80.4
education 79.4
portrait 77.8
indoors 77
boy 76.3

Imagga
created on 2018-03-23

kin 42
child 37.7
people 34
man 30.9
person 30
happy 28.2
male 27.8
group 27.4
school 23.9
teacher 23.6
education 23.4
classroom 22.6
student 22.1
smile 21.4
smiling 21
world 19.4
adult 19.4
women 19
men 18.9
family 18.7
boy 18.2
businessman 17.6
buddy 17.6
happiness 16.4
business 15.8
trainer 15.6
team 15.2
professional 14.8
class 14.5
kid 14.2
blackboard 13.8
children 13.7
mother 13.6
map 13.5
childhood 13.4
color 13.3
cheerful 13
room 12.7
portrait 12.3
lifestyle 12.3
friends 12.2
couple 12.2
casual 11.9
holding 11.5
together 11.4
fun 11.2
father 11.2
sitting 11.2
teamwork 11.1
board 10.8
lesson 10.7
success 10.5
standing 10.4
looking 10.4
study 10.3
suit 9.9
youth 9.4
life 9.2
teen 9.2
joy 9.2
indoor 9.1
businesswoman 9.1
home 8.8
students 8.8
studying 8.6
drawing 8.6
daughter 8.6
desk 8.5
learning 8.4
black 8.4
communication 8.4
human 8.2
teenager 8.2
little 7.9
indoors 7.9
love 7.9
work 7.8
elementary 7.8
pupil 7.8
corporate 7.7
diversity 7.7
expression 7.7
reading 7.6
hand 7.6
college 7.6
sit 7.6
friendship 7.5
friendly 7.3
girls 7.3
handsome 7.1
job 7.1
son 7

Google
created on 2018-03-23

blue 96.8
social group 94.8
fun 69.3
girl 52.6

Microsoft
created on 2018-03-23

person 99.7
scene 93.8
room 92
gallery 88.7
people 75.9
group 71
posing 68.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Female, 50.1%
Happy 48.3%
Sad 45.6%
Disgusted 45.5%
Calm 49.8%
Angry 45.4%
Surprised 45.1%
Confused 45.2%

AWS Rekognition

Age 45-66
Gender Male, 54.4%
Happy 45.9%
Surprised 45.2%
Calm 50.1%
Confused 46.1%
Sad 46.3%
Angry 46%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Female, 55%
Surprised 45.4%
Confused 45.3%
Sad 45.2%
Calm 45.2%
Angry 45.3%
Happy 53.5%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 55%
Sad 45%
Surprised 45.1%
Angry 45.1%
Happy 54.3%
Calm 45%
Confused 45%
Disgusted 45.4%

AWS Rekognition

Age 45-65
Gender Male, 54.9%
Happy 45.6%
Disgusted 45.1%
Confused 45.5%
Sad 45.4%
Angry 45.3%
Surprised 45.2%
Calm 52.9%

AWS Rekognition

Age 35-52
Gender Male, 55%
Confused 45%
Calm 54.8%
Disgusted 45%
Angry 45%
Happy 45%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 9-14
Gender Female, 54.9%
Sad 46.2%
Calm 49.6%
Angry 45.4%
Confused 45.4%
Disgusted 45.1%
Happy 47.7%
Surprised 45.7%

AWS Rekognition

Age 38-57
Gender Female, 54.9%
Happy 54.9%
Disgusted 45%
Calm 45%
Sad 45.1%
Angry 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 10-15
Gender Female, 54.9%
Confused 45%
Calm 45.4%
Disgusted 45%
Angry 45.1%
Happy 51.3%
Sad 48%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Surprised 45.2%
Confused 45.5%
Sad 47.8%
Calm 50.6%
Angry 45.6%
Happy 45.1%
Disgusted 45.1%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 42
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.7%
Person 99.4%
Couch 82.4%

Captions

Microsoft

a group of people sitting posing for the camera 91.9%
a group of people posing for a photo 90.8%
a group of people posing for the camera 90.7%

Text analysis

Amazon

THE
THE WORLD
WORLD

Google

WORLD
THE
THE WORLD