Human Generated Data

Title

Untitled (two men leaning on podium, standing, full-length, Greek/Roman-type garden setting)

Date

1882

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3866

Human Generated Data

Title

Untitled (two men leaning on podium, standing, full-length, Greek/Roman-type garden setting)

People

Artist: Unidentified Artist,

Date

1882

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3866

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Clothing 100
Apparel 100
Overcoat 99.6
Person 98.2
Human 98.2
Person 98
Trench Coat 85.5
Coat 77.5
Suit 60.9

Clarifai
created on 2021-04-03

people 99.6
lid 98.4
portrait 97.4
man 95.4
wear 94.5
street 94.4
art 93.6
two 92.7
veil 92.5
adult 90.5
woman 89.4
three 86.1
military 82.3
documentary 77.1
elderly 75.8
vintage 75.6
group 73.8
fedora 73.3
child 73.2
coat 73.2

Imagga
created on 2021-04-03

man 28.2
people 25.6
person 22.2
male 22
silhouette 21.5
prison 18.2
dark 16.7
cell 16.1
adult 15.1
correctional institution 14.6
sunset 14.4
black 13.2
portrait 12.9
old 12.5
suit 12.4
couple 12.2
penal institution 11
hat 10.6
kin 10.3
men 10.3
love 10.2
model 10.1
light 10
water 10
body 9.6
boy 9.6
walking 9.5
room 9.4
vintage 9.1
fashion 9
human 9
family 8.9
posing 8.9
interior 8.8
standing 8.7
lifestyle 8.7
grunge 8.5
beach 8.4
city 8.3
tourism 8.2
one 8.2
world 8.2
style 8.1
clothing 8.1
shadow 8.1
group 8.1
sun 8
cool 8
building 7.9
business 7.9
guy 7.7
walk 7.6
ocean 7.5
institution 7.3
lady 7.3
pose 7.2
dirty 7.2
looking 7.2
night 7.1
spectator 7.1
travel 7
sea 7
together 7

Google
created on 2021-04-03

Coat 89.9
Gesture 85.3
Collar 83.1
Picture frame 81.8
Hat 80
Frock coat 77.9
Sleeve 77.5
Suit 76.9
Art 76.6
Blazer 76.5
Tints and shades 75.8
Vintage clothing 71.6
Visual arts 68.4
Uniform 67.2
Formal wear 67.2
Duster 65.6
Overcoat 65.2
Rectangle 63.1
Stock photography 62.6
Military person 62.1

Microsoft
created on 2021-04-03

building 99.5
clothing 98
man 97.9
wall 96.6
suit 96.6
person 94.7
coat 93.1
standing 90.8
text 86.2
old 75.9
gentleman 68.2
hat 65
posing 44.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-56
Gender Male, 95.1%
Calm 61.4%
Sad 23.7%
Angry 5.6%
Fear 4.4%
Confused 3.7%
Surprised 0.8%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 20-32
Gender Male, 96.2%
Calm 99.2%
Sad 0.4%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 29-45
Gender Male, 52.8%
Calm 35%
Happy 19.2%
Surprised 13.2%
Angry 12.5%
Sad 9.2%
Fear 8%
Confused 2%
Disgusted 0.9%

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Coat 77.5%

Categories

Text analysis

Google

CLUE TWBA Draies
CLUE
TWBA
Draies