Human Generated Data

Title

Demonstrations at an “all-white” swimming pool in Cairo, Illinois

Date

1962, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.22

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Demonstrations at an “all-white” swimming pool in Cairo, Illinois

People

Artist: Danny Lyon, American born 1942

Date

1962, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.7
Human 99.7
Person 99.6
Hair 99.4
Person 99.2
Person 99.1
Person 99.1
Sunglasses 96.9
Accessories 96.9
Accessory 96.9
People 86.9
Person 85.2
Apparel 76.3
Clothing 76.3
Hat 76.3
Crowd 75.9
Car 66.6
Vehicle 66.6
Transportation 66.6
Automobile 66.6
Family 55.8
Hat 52.1

Clarifai
created on 2018-02-10

people 99.8
group 99.6
child 98.7
adult 98.4
three 97.6
four 97.2
facial expression 97
man 96.8
woman 96.3
offspring 96
group together 96
sibling 95.6
five 95.3
several 95.1
son 93.9
wear 93.8
two 93.2
family 90.1
interaction 89.2
portrait 87.1

Imagga
created on 2018-02-10

man 46.3
male 38.1
couple 36.6
people 32.9
together 30.6
happy 29.4
smiling 27.5
person 25.3
senior 25.3
home 23.1
adult 22.9
attractive 22.4
indoors 21.1
family 20.4
mature 20.4
sitting 19.7
lifestyle 19.5
love 18.9
father 17.3
men 17.2
smile 17.1
child 16.2
enjoying 16.1
handsome 16
talking 15.2
mother 15
happiness 14.9
husband 14.8
parent 14.7
dad 14.7
wife 14.2
cheerful 13
business 12.7
two 12.7
discussion 12.6
30s 12.5
grandfather 12.5
elderly 12.4
loving 12.4
meeting 12.2
sibling 12.2
old 11.8
retired 11.6
togetherness 11.3
looking 11.2
women 11.1
student 10.9
team 10.7
working 10.6
businessman 10.6
friends 10.3
color 10
businesswoman 10
discussing 9.8
their 9.8
thirties 9.7
colleagues 9.7
group 9.7
married 9.6
hair 9.5
dinner 9.4
friendship 9.4
20s 9.2
leisure 9.1
holding 9.1
portrait 9.1
meal 9
kitchen 8.9
work 8.9
grandmother 8.8
day 8.6
drinking 8.6
twenties 8.6
businesspeople 8.5
adults 8.5
food 8.5
casual 8.5
relaxed 8.4
active 8.4
drink 8.3
wine 8.3
fun 8.2
outdoors 8.2
playing 8.2
relaxing 8.2
kin 7.8
education 7.8
middle aged 7.8
affection 7.7
pretty 7.7
retirement 7.7
grandma 7.6
sit 7.6
relationship 7.5
clothing 7.5
teen 7.3
office 7.3
successful 7.3

Google
created on 2018-02-10

people 97.7
photograph 96.1
white 96.1
black 95.7
person 94.5
child 93.2
social group 92.4
black and white 88.9
photography 84.1
male 83.3
snapshot 81.8
standing 79.2
monochrome photography 77.3
boy 76.6
girl 76.5
family 73.8
fun 73.5
human 73
monochrome 68.4
smile 67.4

Microsoft
created on 2018-02-10

person 99.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 87.3%
Happy 0.9%
Surprised 2.4%
Angry 2.5%
Calm 59.1%
Disgusted 2.2%
Sad 25.7%
Confused 7.2%

AWS Rekognition

Age 35-52
Gender Female, 59%
Happy 2.4%
Sad 2.2%
Calm 88.7%
Confused 1.2%
Disgusted 1.7%
Angry 1.5%
Surprised 2.2%

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Calm 65.8%
Surprised 1.3%
Disgusted 7.8%
Angry 6%
Sad 9.8%
Confused 7.3%
Happy 2%

AWS Rekognition

Age 15-25
Gender Male, 87.3%
Happy 0.4%
Surprised 1%
Angry 3.3%
Confused 5.4%
Disgusted 0.6%
Calm 83.9%
Sad 5.4%

AWS Rekognition

Age 26-43
Gender Male, 92.7%
Surprised 0.8%
Disgusted 1.4%
Confused 1%
Angry 1%
Sad 6.4%
Happy 2.1%
Calm 87.3%

AWS Rekognition

Age 6-13
Gender Female, 59.4%
Surprised 2.1%
Disgusted 1.8%
Happy 1.2%
Sad 44.3%
Calm 45.4%
Angry 3.1%
Confused 2.1%

AWS Rekognition

Age 26-43
Gender Male, 94.6%
Angry 14%
Happy 9.3%
Disgusted 5.4%
Confused 9%
Sad 19%
Calm 39.1%
Surprised 4.2%

AWS Rekognition

Age 26-43
Gender Female, 58.8%
Happy 0.9%
Calm 4.4%
Confused 3.7%
Angry 10%
Sad 76.9%
Disgusted 2%
Surprised 2.2%

AWS Rekognition

Age 29-45
Gender Female, 67.4%
Disgusted 3.1%
Happy 5.1%
Calm 27.2%
Sad 51.5%
Angry 7.1%
Surprised 2.8%
Confused 3.2%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Sunglasses 96.9%
Hat 76.3%
Car 66.6%

Captions

Microsoft

a group of people around each other 90.2%
a group of people posing for the camera 90.1%
a group of young men sitting next to a window 51.4%