Human Generated Data

Title

Untitled (unidentified man on left wearing turban crouching, right hand placed on head of shirtless man on right sitting with crossed legs holding object in right hand)

Date

1860-1899

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.20

Human Generated Data

Title

Untitled (unidentified man on left wearing turban crouching, right hand placed on head of shirtless man on right sitting with crossed legs holding object in right hand)

People

Artist: Unidentified Artist,

Date

1860-1899

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.20

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Clothing 100
Apparel 100
Person 99.6
Human 99.6
Person 99.4
Turban 97.5
Headband 97.5
Hat 97.5
Fire Hydrant 87.7
Hydrant 87.7
Furniture 69.7

Clarifai
created on 2023-10-28

people 99.8
portrait 99.7
art 97.9
documentary 97.8
adult 97.8
vintage 97.3
son 97
two 96.9
man 96.7
woman 96.4
child 95.2
wear 94.8
offspring 94.5
old 94.4
furniture 94.4
retro 93.9
family 93.5
sepia pigment 92.7
sepia 92.3
facial expression 90.1

Imagga
created on 2022-02-25

old 23.7
currency 20.6
ancient 19
vintage 19
money 18.7
cash 18.3
art 17.2
bill 17.1
bank 17
sculpture 16.9
paper 16.5
decoration 16.2
freight car 16
dollar 15.8
antique 15.6
statue 15.4
cemetery 15.2
banking 14.7
grunge 14.5
finance 14.4
business 14
culture 12.8
world 12.6
history 12.5
architecture 12.5
financial 12.5
people 12.3
man 12.1
car 12
dollars 11.6
stone 11.5
structure 11.5
exchange 11.5
savings 11.2
rich 11.2
historic 11
wheeled vehicle 10.9
closeup 10.8
wealth 10.8
religion 10.8
tourism 10.7
hundred 10.7
retro 10.6
building 10.5
one 10.4
graffito 10.4
portrait 10.4
historical 10.3
monument 10.3
aged 10
male 9.9
travel 9.9
close 9.7
newspaper 9.7
us 9.6
loan 9.6
person 9.5
famous 9.3
face 9.2
marble 9
memorial 8.9
barbershop 8.8
sepia 8.7
pay 8.6
capital 8.5
economy 8.3
texture 8.3
city 8.3
investment 8.2
landmark 8.1
body 8
product 8
design 7.9
franklin 7.9
bills 7.8
states 7.7
finances 7.7
payment 7.7
kin 7.7
god 7.7
united 7.6
old fashioned 7.6
head 7.6
commerce 7.5
vehicle 7
painter 7

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99.9
old 98.3
clothing 97.2
person 96.2
book 93.5
black 86
human face 80.9
white 77
posing 76
vintage 72.5
footwear 60.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 100%
Angry 58.6%
Calm 19.5%
Confused 12.2%
Sad 5.5%
Surprised 1.7%
Disgusted 0.9%
Fear 0.9%
Happy 0.7%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Happy 86%
Calm 12.5%
Confused 0.4%
Surprised 0.3%
Sad 0.3%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Fire Hydrant
Person 99.6%
Person 99.4%
Fire Hydrant 87.7%

Categories

Imagga

paintings art 99.2%