Human Generated Data

Title

Untitled (Smithland, Kentucky)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3131
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Smithland, Kentucky)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3131

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Cap 99.9
Face 99.9
Head 99.9
Photography 99.9
Portrait 99.9
Person 99.6
Adult 99.6
Male 99.6
Man 99.6
Person 99.5
Adult 99.5
Female 99.5
Woman 99.5
Coat 99.4
Sun Hat 99.3
Hat 97.6
Person 93
Adult 93
Female 93
Woman 93
Bride 93
Wedding 93
Hat 59.8
Baseball Cap 57.1
Bonnet 56.1
Shirt 55.7
Jacket 55.5

Clarifai
created on 2018-05-10

people 99.9
adult 98.1
man 98.1
lid 98
two 97.3
woman 97
group 96.7
portrait 96.5
group together 96.3
wear 96
veil 95.6
four 94.8
three 94.2
uniform 94.2
outfit 91.1
child 89.3
actor 89
military 87.6
several 87.4
facial expression 86.7

Imagga
created on 2023-10-06

man 42.3
nurse 35.6
male 34.1
hat 30
people 28.4
person 26.4
couple 24.4
smiling 23.9
clothing 23
happy 22.5
adult 22.1
smile 20.7
love 20.5
portrait 20
coat 19.8
men 19.7
cowboy hat 19.5
lab coat 18.5
worker 18.4
senior 16.9
looking 16.8
work 16.5
headdress 16.3
women 15
face 14.9
attractive 14.7
occupation 14.7
professional 13.7
handsome 13.4
waiter 12.7
husband 12.5
happiness 12.5
holding 12.4
wife 12.3
black 12
diversity 11.5
hair 11.1
hand 10.6
medical 10.6
married 10.5
garment 10.4
doctor 10.3
business 10.3
sitting 10.3
two 10.2
lifestyle 10.1
family 9.8
old 9.7
job 9.7
health 9.7
employee 9.7
indoors 9.7
together 9.6
elderly 9.6
loving 9.5
patient 9.4
dining-room attendant 9.4
mature 9.3
bartender 9.2
pretty 9.1
team 9
hospital 8.8
working 8.8
uniform 8.7
serious 8.6
industry 8.5
togetherness 8.5
casual 8.5
relationship 8.4
fashion 8.3
teenager 8.2
equipment 8.2
cheerful 8.1
home 8
covering 7.9
groom 7.8
helmet 7.8
standing 7.8
two people 7.8
glasses 7.4
specialist 7.4
surgeon 7.3
20s 7.3
room 7.3
dress 7.2
child 7.2
romance 7.1
day 7.1
medicine 7

Google
created on 2018-05-10

photograph 96.2
white 95.9
black and white 91.3
monochrome photography 83.2
photography 82.9
snapshot 81.8
male 79.9
standing 76.6
monochrome 71
gentleman 65.3
vintage clothing 64.8
human behavior 54.6
fun 51.9

Microsoft
created on 2018-05-10

person 98.6
window 88.8
posing 77.8
white 65
old 59.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 79.7%
Angry 18.6%
Surprised 6.3%
Fear 6%
Sad 2.4%
Confused 0.4%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 23-31
Gender Female, 77.5%
Calm 94.3%
Surprised 6.3%
Fear 5.9%
Angry 5.4%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Adult 99.6%
Male 99.6%
Man 99.6%
Female 99.5%
Woman 99.5%
Hat 97.6%
Bride 93%

Categories

Imagga

people portraits 94.8%
paintings art 4.8%

Text analysis

Amazon

OR
GEM
mess