Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.94

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (relief station, Urbana, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Apparel 100
Clothing 100
Person 99.7
Human 99.7
Hat 99.7
Person 98.9
Person 98.9
Person 98.7
Person 97.4
Person 97.4
Person 97
Person 96.4
Hat 89.1
Sailor Suit 85
Sleeve 82.6
Cap 77
Sun Hat 69.5
Baseball Cap 68.1
Face 63.9
People 63.3
Person 62

Imagga
created on 2021-12-15

hat 43.4
man 37.6
person 33.7
male 33.2
people 32.9
happy 27.6
senior 26.2
portrait 24.6
adult 23.4
couple 21.8
face 20.6
clothing 20.3
old 18.8
together 18.4
elderly 18.2
cowboy 17.7
mature 17.7
smiling 17.4
cowboy hat 17.3
love 16.6
smile 15.7
two 15.2
home 15.1
family 15.1
mother 15
happiness 14.9
child 14.6
expression 14.5
casual 14.4
looking 14.4
outdoors 14.2
men 13.7
hand 13.7
shirt 13.1
lifestyle 13
aged 12.7
loving 12.4
parent 12.3
guy 12.1
father 11.9
attractive 11.9
western 11.6
headdress 11.6
husband 11.6
handsome 11.6
boy 11.3
hair 11.1
women 11.1
interior 10.6
retirement 10.6
married 10.5
look 10.5
age 10.5
style 10.4
room 10.1
lady 9.7
affection 9.7
dad 9.5
grandfather 9.5
relationship 9.4
hold 9.2
car 9.2
children 9.1
pretty 9.1
fashion 9
black 9
cheerful 8.9
retired 8.7
affectionate 8.7
uniform 8.7
sitting 8.6
wife 8.5
pair 8.5
human 8.2
indoor 8.2
one 8.2
fall 8.1
indoors 7.9
cute 7.9
standing 7.8
model 7.8
older 7.8
hug 7.7
30s 7.7
wearing 7.6
adults 7.6
head 7.6
fun 7.5
leisure 7.5
holding 7.4
inside 7.4
20s 7.3
farmer 7.3
make 7.3
posing 7.1
kid 7.1

Google
created on 2021-12-15

Outerwear 95.1
Shirt 94
Coat 90.3
Cap 85.8
Black-and-white 85.4
Gesture 85.3
Hat 84.9
Style 84
Headgear 82.3
Adaptation 79.2
Art 77.1
Monochrome photography 75.8
Vintage clothing 73.7
Event 73.1
Monochrome 71.9
Room 66.8
Visual arts 66.5
History 64.1
Stock photography 63
Sun hat 62.2

Microsoft
created on 2021-12-15

person 99.7
human face 96.8
hat 95.8
clothing 94.6
fashion accessory 92.2
text 92.1
man 83.5
window 83.4
fedora 60.7
people 60.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 55.2%
Calm 97.3%
Happy 1.2%
Sad 0.9%
Fear 0.2%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-37
Gender Male, 53.5%
Confused 38.7%
Sad 25.8%
Calm 22.1%
Angry 6.7%
Fear 3.2%
Surprised 1.5%
Disgusted 1.1%
Happy 1%

AWS Rekognition

Age 48-66
Gender Male, 68.6%
Calm 68.5%
Sad 14.7%
Confused 5.3%
Happy 3.7%
Surprised 3%
Angry 2.2%
Fear 1.5%
Disgusted 1.1%

AWS Rekognition

Age 23-37
Gender Male, 70.6%
Calm 86.2%
Happy 5.6%
Sad 3.2%
Surprised 2.4%
Confused 1.1%
Angry 0.9%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 21-33
Gender Female, 95.5%
Sad 46.1%
Fear 19.7%
Calm 14.6%
Angry 9.9%
Surprised 2.7%
Disgusted 2.4%
Confused 2.4%
Happy 2.2%

AWS Rekognition

Age 47-65
Gender Female, 94.5%
Happy 67.5%
Calm 31.5%
Sad 0.7%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 50
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 99.7%

Captions

Microsoft

a group of people sitting in front of a window 83.6%
a group of people looking at an old photo of a person 83.5%
a group of people standing in front of a window 83.4%