Human Generated Data

Title

Madrid

Date

1984

People

Artist: Mary Ellen Mark, American 1940-2015

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.376

Copyright

© Mary Ellen Mark

Human Generated Data

Title

Madrid

People

Artist: Mary Ellen Mark, American 1940-2015

Date

1984

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.6
Person 99.6
Person 99.3
Person 97.2
Person 95.4
Glass 91
Pub 90.8
Bar Counter 90.5
Person 90.2
Person 89
Beverage 88.1
Drink 88.1
Alcohol 86.3
Sitting 74
Tie 68.7
Accessories 68.7
Accessory 68.7
Dating 67
Wine Glass 66.3
Wine 66.3
Apparel 62.2
Clothing 62.2
Liquor 62.2
Overcoat 60.3
Coat 60.3
Suit 60.3
Person 52.5

Clarifai
created on 2018-03-23

people 99.9
two 98.3
adult 98
group 97.4
man 97.2
group together 96.8
three 96.5
woman 95.7
portrait 94.4
four 93.3
music 92.9
actor 89.1
actress 88.4
several 88.4
wear 87.9
movie 85.2
administration 85.1
monochrome 84.6
vehicle 84
military 83.9

Imagga
created on 2018-03-23

bartender 34.2
portrait 33.6
black 33.2
male 31.9
adult 31.7
man 31.6
person 31.3
people 27.3
face 26.3
sexy 22.5
attractive 21.7
couple 19.2
fashion 18.8
style 18.5
model 17.9
studio 17.5
looking 16.8
pretty 16.8
human 16.5
dark 15
guy 14.8
happy 14.4
love 14.2
men 13.7
hat 13.4
handsome 13.4
smiling 13
sensuality 12.7
together 12.3
smile 12.1
party 12
music 11.8
elegance 11.7
musician 11.7
barroom 11.6
holding 11.5
elegant 11.1
hair 11.1
sensual 10.9
make 10.9
brunette 10.5
expression 10.2
lifestyle 10.1
performer 9.9
device 9.9
retro 9.8
cheerful 9.7
suit 9.5
women 9.5
entertainment 9.2
makeup 9.1
clothing 9
jacket 8.9
body 8.8
look 8.8
vintage 8.7
cute 8.6
serious 8.6
casual 8.5
glasses 8.3
joyful 8.3
musical instrument 8.1
lovely 8
posing 8
singer 7.9
modern 7.7
guitar 7.6
hand 7.6
professional 7.6
hot 7.5
cosmetics 7.5
fun 7.5
one 7.5
girls 7.3

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.6
posing 39.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 98.9%
Confused 12.6%
Surprised 2.4%
Angry 48.9%
Sad 8.5%
Happy 0.4%
Calm 25.2%
Disgusted 2%

AWS Rekognition

Age 20-38
Gender Female, 98.7%
Happy 6.4%
Calm 79.8%
Surprised 5%
Angry 1.7%
Confused 3.2%
Disgusted 1.8%
Sad 2.1%

AWS Rekognition

Age 20-38
Gender Male, 94.5%
Calm 73.7%
Angry 1.8%
Disgusted 0.4%
Sad 22.2%
Surprised 0.5%
Happy 0.2%
Confused 1.3%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Angry 45.4%
Calm 49.1%
Happy 45.1%
Disgusted 45.1%
Surprised 45.2%
Sad 49.9%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 59.4%
Disgusted 2.6%
Confused 5.5%
Calm 69.7%
Surprised 4.2%
Angry 6.6%
Sad 5.5%
Happy 6%

AWS Rekognition

Age 20-38
Gender Male, 78.5%
Surprised 7.8%
Angry 15%
Sad 8.3%
Calm 49.2%
Disgusted 4.5%
Confused 5.1%
Happy 10%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Happy 45.3%
Angry 46.5%
Disgusted 45.8%
Calm 48.7%
Sad 47.4%
Surprised 45.7%
Confused 45.7%

AWS Rekognition

Age 23-38
Gender Male, 53.7%
Happy 45.4%
Confused 45.2%
Calm 47.8%
Sad 51.2%
Angry 45.3%
Disgusted 45.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 68.7%

Captions

Microsoft

a group of people posing for a photo 92.7%
a group of people posing for the camera 92.6%
a group of people sitting posing for the camera 91.4%

Text analysis

Amazon

SOD