Human Generated Data

Title

Indianapolis

Date

1955-1956

People

Artist: Robert Frank, American 1924 - 2019

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.753

Copyright

© Robert Frank Estate

Human Generated Data

Title

Indianapolis

People

Artist: Robert Frank, American 1924 - 2019

Date

1955-1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.4
Person 99.4
Person 99.1
Person 99
Person 98.9
Person 97.9
Person 96.9
Apparel 94.5
Clothing 94.5
Machine 90.8
Person 89.9
Person 86.7
Coat 84.9
Jacket 84.9
Person 81.6
Motor 81
Dj 79.7
Vehicle 68.9
Transportation 68.9
Engine 62.6

Imagga
created on 2022-01-08

man 30.3
person 29.2
male 29
people 27.9
black 20.8
photographer 18.7
night 18.6
party 17.2
adult 16.9
men 15.4
disco 15.4
business 14
music 13.6
club 13.2
human 12.7
dark 12.5
silhouette 12.4
dance 11.8
nightclub 11.7
dancing 11.6
office 11.4
fashion 11.3
portrait 11
disk jockey 10.8
light 10.7
equipment 10.5
dress 9.9
businessman 9.7
broadcaster 9.7
group 9.7
sexy 9.6
couple 9.6
women 9.5
hand 9.1
attractive 9.1
one 8.9
working 8.8
nightlife 8.8
happy 8.8
youth 8.5
city 8.3
computer 8.3
danger 8.2
style 8.2
art 8
lifestyle 7.9
love 7.9
work 7.8
car 7.6
clothes 7.5
fun 7.5
entertainment 7.4
mask 7.3
lady 7.3
success 7.2
smiling 7.2
looking 7.2
body 7.2
electronic equipment 7.2
face 7.1
professional 7.1
job 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 99.7
text 99.2
clothing 98.5
man 93.5
standing 87.4
people 76.3
group 74
posing 73.1
human face 66.1
music 54
concert 50.5
crowd 2.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Male, 100%
Sad 94%
Calm 2.8%
Disgusted 0.8%
Angry 0.7%
Confused 0.6%
Happy 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 73.2%
Sad 21.8%
Angry 1.9%
Surprised 1.4%
Fear 0.9%
Disgusted 0.4%
Happy 0.3%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Female, 91.2%
Sad 82.9%
Confused 15.3%
Fear 0.7%
Calm 0.4%
Surprised 0.3%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Calm 98.6%
Sad 0.8%
Fear 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Confused 0%
Surprised 0%

AWS Rekognition

Age 25-35
Gender Female, 83.8%
Calm 95%
Angry 1.6%
Sad 1.1%
Surprised 1%
Confused 0.5%
Happy 0.4%
Disgusted 0.4%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 94.6%
Happy 2.2%
Sad 1.8%
Disgusted 0.4%
Angry 0.3%
Fear 0.3%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 18-24
Gender Male, 78.4%
Fear 79.8%
Sad 7.8%
Calm 3.5%
Angry 3.2%
Disgusted 2.3%
Surprised 2.1%
Happy 0.8%
Confused 0.6%

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 98.3%
a group of people posing for a photo in front of a crowd 98.2%
a group of people posing for a photo 98.1%