Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

Date

August 1938, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3357

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3357

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Baseball Cap 100
Cap 100
Face 99.2
Head 99.2
Photography 99.2
Portrait 99.2
Person 99
Adult 99
Male 99
Man 99
Sun Hat 98.7
Person 98.6
Person 98.3
Person 98.3
Adult 98.3
Male 98.3
Man 98.3
Person 97
Adult 97
Male 97
Man 97
Person 97
Adult 97
Female 97
Woman 97
Person 94
Adult 94
Male 94
Man 94
Person 92.7
Person 89.1
Adult 89.1
Male 89.1
Man 89.1
Hat 88.7
Hat 81.7
Hat 75.6
Person 68.5
Adult 68.5
Adult 68.5
Female 68.5
Female 68.5
Woman 68.5
Bride 68.5
Wedding 68.5
Bonnet 57.8
Lady 56.5
Hat 55.6
People 55.2
Dress 55.1

Clarifai
created on 2018-05-10

people 99.8
group 99.5
adult 98.6
group together 97.9
man 97.7
woman 97.1
several 94.7
four 94.6
wear 93.8
three 91.5
many 90.5
vehicle 90.2
child 88.8
five 88.7
lid 86.9
administration 86.8
boy 86
seat 83.6
facial expression 82.5
transportation system 82.4

Imagga
created on 2023-10-06

hat 95.3
cowboy hat 65.4
headdress 41.3
man 37
clothing 34.8
person 29.8
male 28.9
people 27.9
happy 26.3
senior 25.3
portrait 24.6
couple 21.8
adult 20.1
cowboy 19.6
smile 19.2
smiling 18.1
face 17.8
outdoors 17.2
love 15.8
elderly 15.3
together 14.9
consumer goods 14.8
covering 14.8
two 14.4
shirt 14
mature 13.9
old 13.9
western 13.6
husband 13.4
lifestyle 13
guy 13
child 12.9
hand 12.9
men 12.9
expression 12.8
looking 12.8
hair 12.7
loving 12.4
fashion 12.1
boy 11.3
attractive 11.2
happiness 11
nurse 10.7
handsome 10.7
mother 10.6
married 10.5
standing 10.4
style 10.4
relationship 10.3
women 10.3
casual 10.2
hold 10.2
model 10.1
father 9.8
fun 9.7
affection 9.7
look 9.6
wife 9.5
enjoy 9.4
leisure 9.1
holding 9.1
black 9
family 8.9
parent 8.9
kid 8.9
home 8.8
hug 8.7
affectionate 8.7
straw 8.7
retirement 8.6
sitting 8.6
gesture 8.6
pair 8.5
pretty 8.4
dad 8.3
indoor 8.2
children 8.2
vacation 8.2
romance 8
farm 8
travel 7.7
boyfriend 7.7
summer 7.7
horse 7.6
human 7.5
one 7.5
emotion 7.4
farmer 7.3
friendly 7.3
blond 7.2
romantic 7.1
posing 7.1
interior 7.1
work 7.1
day 7.1
indoors 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.7
people 66.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-53
Gender Female, 98.9%
Sad 87.5%
Calm 28.6%
Confused 14.9%
Angry 10.3%
Surprised 6.8%
Fear 6.3%
Disgusted 2.9%
Happy 0.8%

AWS Rekognition

Age 19-27
Gender Male, 99.1%
Confused 45.3%
Calm 40.4%
Sad 11.1%
Surprised 6.4%
Fear 6.1%
Disgusted 0.6%
Angry 0.4%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 87.3%
Surprised 6.9%
Fear 6.1%
Sad 4.6%
Angry 2%
Confused 1.7%
Disgusted 1.3%
Happy 0.4%

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Adult 99%
Male 99%
Man 99%
Female 97%
Woman 97%
Hat 88.7%
Bride 68.5%

Categories