Human Generated Data

Title

Untitled (Tahiti)
Date

January 14, 1960-January 22, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5019

Human Generated Data

Title

Untitled (Tahiti)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 14, 1960-January 22, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5019

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Baseball Cap 100
Cap 100
Clothing 100
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Person 98.9
Adult 98.3
Male 98.3
Man 98.3
Person 98.3
People 96.9
Person 95.5
Baby 95.5
Face 95
Head 95
Photography 88.1
Crowd 87.9
Portrait 79.5
Hat 71.5
Formal Wear 68.2
Accessories 60.1
Glasses 60.1
Hat 56.6
Sailor Suit 56.4
Dress 56.3
Body Part 56.3
Finger 56.3
Hand 56.3
Coat 56.2
Shirt 56.2
Back 56
T-Shirt 55.7
Hardhat 55.1
Helmet 55.1
Architecture 55
Building 55
Hospital 55

Clarifai
created on 2018-05-10

people 99.8
group 99.5
group together 99.3
leader 97.9
adult 97.7
several 97.5
man 96.6
many 96
four 94.7
five 94.4
administration 94.4
woman 93.4
wear 91.3
vehicle 89.2
military 89
war 87.2
three 84.7
veil 84.5
child 83.4
facial expression 82.4

Imagga
created on 2023-10-05

man 48.4
senior 47.8
elderly 39.2
couple 38.3
grandfather 38.2
male 35
mature 34.4
happy 32.6
people 32.3
adult 29.2
old 27.8
person 25.8
smiling 24.6
together 24.5
love 24.4
family 22.2
retired 21.3
retirement 21.1
husband 20.2
portrait 20
smile 19.9
wife 19.9
happiness 19.6
lifestyle 18.1
outdoors 16.4
aged 16.3
married 15.3
looking 15.2
active 14.8
grandmother 14.7
sitting 14.6
men 14.6
casual 14.4
home 14.3
age 14.3
father 13.8
pensioner 13.6
marriage 13.3
60s 12.7
handsome 12.5
laughing 12.3
child 12.2
professional 12.1
face 12.1
70s 11.8
day 11.8
joy 11.7
older 11.6
indoors 11.4
enjoying 11.4
women 11.1
two 11
parent 10.8
leisure 10.8
dad 10.7
cheerful 10.6
aging 10.5
boy 10.4
health 10.4
relationship 10.3
glasses 10.2
kin 10
park 9.9
romantic 9.8
attractive 9.8
laugh 9.6
talking 9.5
friendship 9.4
activity 8.9
lady 8.9
businessman 8.8
medical 8.8
50s 8.8
patient 8.8
affection 8.7
loving 8.6
engineer 8.5
camera 8.3
relaxing 8.2
romance 8
business 7.9
gray hair 7.9
middle aged 7.8
affectionate 7.7
outside 7.7
togetherness 7.6
doctor 7.5
friends 7.5
grandma 7.5
enjoyment 7.5
fun 7.5
gray 7.2
sky 7

Google
created on 2018-05-10

people 96.5
photograph 96.4
black and white 93.4
man 91.8
monochrome photography 88
standing 84.9
photography 83.5
snapshot 81.8
male 80.6
senior citizen 74.7
interaction 72.6
monochrome 70.2
family 68.5
human 68.2
human behavior 61.2
conversation 61.2
stock photography 59.1
gentleman 53.8

Microsoft
created on 2018-05-10

person 99.4
old 43.8
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Female, 100%
Happy 91.2%
Surprised 6.6%
Calm 6.2%
Fear 6%
Sad 2.4%
Angry 0.4%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 20-28
Gender Male, 98.2%
Calm 32.6%
Happy 20.8%
Sad 20.7%
Fear 17%
Surprised 8%
Disgusted 3.9%
Angry 3.1%
Confused 1.7%

AWS Rekognition

Age 45-51
Gender Female, 92.1%
Calm 47.4%
Happy 25.7%
Surprised 19.7%
Fear 6.5%
Sad 3.9%
Disgusted 2.7%
Confused 1.6%
Angry 1.5%

Microsoft Cognitive Services

Age 53
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Baby 95.5%
Hat 71.5%
Glasses 60.1%

Categories

Imagga

people portraits 52.9%
paintings art 18.3%
nature landscape 15.5%
pets animals 9.3%
macro flowers 1.4%
food drinks 1%

Captions

Microsoft
created on 2018-05-10

an old photo of a man 89%
a group of people around each other 84.4%
old photo of a man 84.3%