Human Generated Data

Title

Untitled (man seated on chair and standing female child)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.17

Human Generated Data

Title

Untitled (man seated on chair and standing female child)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.17

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.8
Apparel 99.8
Person 98.2
Human 98.2
Person 97.4
Tie 97.4
Accessory 97.4
Accessories 97.4
Coat 91.4
Overcoat 91.4
Face 83.8
Baby 83.1
Sitting 79.7
Jacket 73.8
People 71.6
Pants 69.4
Photography 66.2
Photo 66.2
Portrait 66.2
Hat 65
Suit 63.1

Clarifai
created on 2023-10-25

people 99.8
portrait 99
two 98.7
adult 96.7
group 96.6
man 96.5
child 96.1
offspring 95.4
retro 95.4
administration 95
family 94.8
son 94.4
three 94.3
wear 93.9
sepia 90.3
woman 88.6
nostalgia 88.3
leader 87.8
actor 84.4
sit 83

Imagga
created on 2022-01-08

bow tie 53.2
man 47.8
businessman 46.8
necktie 45.1
suit 43.9
male 41.3
business 38.9
person 38.7
people 31.8
office 30.6
executive 29.5
corporate 29.2
adult 29.2
groom 28.5
professional 28.2
handsome 27.7
portrait 27.2
tie 26.6
happy 23.2
garment 23.1
confident 20.9
success 20.9
successful 20.2
happiness 19.6
job 19.5
smile 19.3
businesswoman 19.1
men 18.9
meeting 18.9
manager 18.6
clothing 18.3
attractive 18.2
kin 18.2
work 18.1
company 17.7
couple 17.4
businesspeople 17.1
standing 16.5
team 16.1
career 16.1
family 16
smiling 15.9
group 15.3
building 15.1
cheerful 14.6
looking 14.4
lifestyle 13.7
colleagues 13.6
two 13.6
boss 13.4
modern 13.3
face 12.8
businessmen 12.7
love 12.6
working 12.4
shirt 12.1
mature 12.1
human 12
corporation 11.6
formal 11.5
workplace 11.4
adolescent 11.3
sitting 11.2
teamwork 11.1
indoor 11
worker 10.6
leadership 10.6
fashion 10.6
grandfather 10.5
serious 10.5
old 10.5
guy 10.4
expression 10.2
one 9.7
partnership 9.6
home 9.6
boy 9.6
senior 9.4
room 9.2
20s 9.2
father 9.1
juvenile 9
posing 8.9
interior 8.9
partner 8.7
confidence 8.6
mother 8.5
black 8.5
phone 8.3
occupation 8.3
alone 8.2
outdoors 8.2
style 8.2
dress 8.1
computer 8
jacket 7.9
businesswomen 7.9
color 7.8
parent 7.6
hand 7.6
adults 7.6
relationship 7.5
friendly 7.3
laptop 7.3
romance 7.1
indoors 7
together 7

Google
created on 2022-01-08

Photograph 94.3
Picture frame 87.7
Standing 86.4
Coat 85.3
Suit 81.6
Collar 80
Tie 78
Vintage clothing 75.5
Blazer 75.3
Snapshot 74.3
Classic 72.7
Formal wear 71.1
Event 69.4
Stock photography 66.1
Toddler 65.3
Sitting 64.3
Art 59.9
Pattern 57.8
Rectangle 57.7
Room 56.3

Microsoft
created on 2022-01-08

person 100
clothing 97.7
old 97.7
man 97.5
text 96.2
human face 95.5
black 88.1
white 79.2
photograph 74.8
posing 72.6
boy 70.1
smile 68.1
suit 61.6
baby 55.4
vintage 45

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Male, 100%
Confused 63.3%
Happy 21.5%
Calm 9.6%
Sad 2.4%
Fear 1%
Angry 1%
Surprised 0.6%
Disgusted 0.6%

AWS Rekognition

Age 2-8
Gender Female, 99.9%
Calm 99%
Sad 0.9%
Angry 0.1%
Confused 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Tie 97.4%
Suit 63.1%

Categories

Imagga

people portraits 80.6%
paintings art 18.7%