Human Generated Data

Title

Street Scene, Azerbaijan

Date

1979

People

Artist: Gilles Peress, French born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.399

Copyright

© Gilles Peress/Magnum Photos

Human Generated Data

Title

Street Scene, Azerbaijan

People

Artist: Gilles Peress, French born 1946

Date

1979

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Clothing 99.8
Apparel 99.8
Person 99.2
Human 99.2
Person 98.7
Person 97.1
Person 96.7
Person 96.5
Automobile 94.5
Car 94.5
Vehicle 94.5
Transportation 94.5
Car 91
Car 90.5
Person 88.3
Coat 85.8
Overcoat 85.8
Face 78.1
Fashion 71.9
Cloak 70.6
Suit 66.3

Clarifai
created on 2018-02-09

people 99.8
adult 98.5
group 96.9
one 96.1
man 95.1
woman 94.8
street 94.7
monochrome 92.9
group together 92.5
two 92
wear 91.7
music 91.2
vehicle 87.5
many 87.3
administration 86
leader 86
portrait 85.2
outfit 84.8
war 79.9
transportation system 77.7

Imagga
created on 2018-02-09

man 32.9
groom 31.9
people 27.3
male 27
black 25.4
adult 25.3
person 25
dark 18.4
fashion 17.3
couple 16.5
portrait 14.9
business 14
dress 13.5
attractive 13.3
silhouette 13.2
face 12.8
suit 12.7
love 12.6
sexy 12
human 12
style 11.9
city 11.6
men 11.2
brass 10.9
glass 10.1
window 9.9
romantic 9.8
pretty 9.8
businessman 9.7
girlfriend 9.6
professional 9.6
hair 9.5
women 9.5
elegant 9.4
device 9.2
one 9
romance 8.9
cornet 8.7
urban 8.7
lifestyle 8.7
guy 8.7
model 8.6
expression 8.5
two 8.5
room 8.3
holding 8.2
music 8.2
group 8.1
handsome 8
world 7.9
clothing 7.9
darkness 7.8
happiness 7.8
standing 7.8
building 7.8
eyes 7.7
corporate 7.7
boyfriend 7.7
mystery 7.7
musician 7.5
clothes 7.5
leisure 7.5
alone 7.3
stylish 7.2
looking 7.2
shadow 7.2
smile 7.1
posing 7.1
night 7.1
job 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

outdoor 95.8
person 94.9
black 73.1
white 63.7
crowd 0.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Confused 45.6%
Surprised 45.7%
Disgusted 50.9%
Happy 45.1%
Sad 45.2%
Calm 45.8%
Angry 46.6%

AWS Rekognition

Age 27-44
Gender Male, 96.4%
Happy 1.1%
Angry 4.8%
Disgusted 2.8%
Calm 11.8%
Sad 75.4%
Surprised 1.9%
Confused 2.3%

AWS Rekognition

Age 48-68
Gender Male, 83.6%
Angry 8.7%
Disgusted 1%
Calm 54.3%
Happy 1.7%
Sad 15.8%
Surprised 13.3%
Confused 5.1%

AWS Rekognition

Age 26-43
Gender Male, 51.2%
Angry 46.1%
Calm 45.8%
Happy 46.5%
Disgusted 45.5%
Surprised 45.3%
Sad 50.7%
Confused 45.2%

AWS Rekognition

Age 35-53
Gender Male, 50.3%
Surprised 49.5%
Angry 50.4%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Calm 49.5%
Sad 49.6%

AWS Rekognition

Age 27-44
Gender Female, 50.3%
Happy 49.6%
Confused 49.5%
Angry 49.8%
Surprised 49.5%
Disgusted 49.5%
Calm 49.6%
Sad 49.9%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 76
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Car 94.5%

Captions

Microsoft

a black and white photo of a person 88.6%
a group of people that are standing in the street 88.5%
a group of people walking down the street 88.4%