Human Generated Data

Title

Count Marchetti, Mrs. Robert Lowe Bacon, Mme Claudel, Mrs. Franklin Mott Gunther, Mrs. Warren D. Robbins
Date

c. 1932
People

Artist: Erich Salomon, German 1886 - 1944
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Yale F. Levin, MBA 2001, 2021.481

Human Generated Data

Title

Count Marchetti, Mrs. Robert Lowe Bacon, Mme Claudel, Mrs. Franklin Mott Gunther, Mrs. Warren D. Robbins

People

Artist: Erich Salomon, German 1886 - 1944

Date

c. 1932

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Yale F. Levin, MBA 2001, 2021.481

Machine Generated Data

Tags

Amazon
created on 2021-10-07

Person 99.7
Human 99.7
Person 99.4
Person 99.4
Person 99.2
Person 97.4
Person 96.7
People 96.1
Person 96
Family 92
Clothing 91.6
Coat 91.6
Overcoat 91.6
Apparel 91.6
Person 87.2
Person 76
Performer 74.7
Face 73.4
Tuxedo 64.5
Accessories 60.3
Sunglasses 60.3
Accessory 60.3
Musical Instrument 59.9
Horn 56.5
Brass Section 56.5
Suit 51.6

Clarifai
created on 2023-10-13

people 100
group 99.6
adult 99.5
portrait 98.2
group together 97.7
administration 97.5
man 97.3
wear 94.8
leader 94.8
woman 93.4
actor 92.5
music 92.5
several 91.9
facial expression 90.7
three 90.7
outfit 89.4
five 89.3
musician 88.9
retro 88.3
military 87.5

Imagga
created on 2021-10-07

mask 45.1
man 27.5
person 27.3
male 27
black 26.6
covering 24.7
disguise 24
people 20.1
adult 19.4
portrait 19.4
human 17.2
clothing 17.2
face 15.6
dark 15
attractive 13.3
sexy 12.8
fashion 12.8
attire 11.8
pose 11.8
spooky 11.7
model 11.7
horror 11.6
scary 11.6
death 11.6
costume 11.3
world 11
evil 10.7
posing 10.7
happy 10.6
hand 10.6
mystery 10.6
men 10.3
emotion 10.1
head 10.1
kin 10
couple 9.6
women 9.5
party 9.4
smiling 9.4
studio 9.1
danger 9.1
dress 9
fun 9
lady 8.9
style 8.9
body 8.8
together 8.8
fear 8.7
love 8.7
lifestyle 8.7
pretty 8.4
vintage 8.4
one 8.2
happiness 7.8
skull 7.8
theater 7.8
dead 7.8
eyes 7.7
attendant 7.7
art 7.4
entertainment 7.4
makeup 7.3
protection 7.3
group 7.2
color 7.2
performer 7.2
fantasy 7.2
suit 7.2
guy 7.2
smile 7.1

Google
created on 2021-10-07

Black 89.6
Smile 87.3
Coat 85.5
Suit 77.4
Monochrome photography 75.6
Art 74.2
Vintage clothing 74.2
Monochrome 73.4
Formal wear 72.2
Event 70.4
Classic 69.4
Hat 67.6
History 65.8
Room 65.4
Stock photography 62.3
Photo caption 58.3
Team 56.9
Eyewear 55.9
Photographic paper 55.8
Retro style 55.1

Microsoft
created on 2021-10-07

text 99.5
person 98.4
posing 97.6
smile 96.9
clothing 96.9
outdoor 91.6
man 90
suit 86.6
dress 85.3
woman 83.9
human face 83.2
old 81
wedding dress 73.1
people 70.9
group 70
bride 64.6
white 60.4
vintage 45.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Female, 94%
Calm 60.2%
Happy 28.2%
Fear 4.3%
Angry 2.1%
Surprised 1.8%
Sad 1.6%
Disgusted 1.4%
Confused 0.5%

AWS Rekognition

Age 23-37
Gender Female, 99.3%
Happy 82.8%
Calm 15.8%
Disgusted 0.3%
Angry 0.3%
Sad 0.2%
Surprised 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 26-42
Gender Female, 99.2%
Calm 76.4%
Sad 5.4%
Disgusted 5.1%
Fear 3.6%
Happy 3.4%
Angry 3.1%
Confused 1.7%
Surprised 1.4%

AWS Rekognition

Age 32-48
Gender Female, 68.9%
Calm 92.8%
Angry 4%
Happy 1%
Sad 0.9%
Disgusted 0.5%
Surprised 0.3%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 23-35
Gender Female, 91.4%
Calm 80.8%
Sad 19%
Happy 0.1%
Confused 0.1%
Fear 0%
Angry 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 32-48
Gender Male, 99.5%
Happy 96%
Calm 1.3%
Surprised 1.2%
Confused 0.8%
Fear 0.2%
Disgusted 0.2%
Sad 0.2%
Angry 0.2%

AWS Rekognition

Age 22-34
Gender Male, 98.7%
Calm 55%
Happy 31.3%
Sad 5.5%
Confused 3.3%
Angry 2.1%
Fear 1.2%
Surprised 1.1%
Disgusted 0.5%

AWS Rekognition

Age 41-59
Gender Female, 73.8%
Fear 52.2%
Sad 27.9%
Calm 6%
Angry 4.2%
Happy 4.1%
Surprised 2.5%
Disgusted 2.4%
Confused 0.7%

AWS Rekognition

Age 22-34
Gender Male, 94.6%
Calm 65.9%
Angry 18.3%
Sad 11.2%
Happy 3%
Fear 0.8%
Confused 0.4%
Disgusted 0.2%
Surprised 0.2%

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 52
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Sunglasses 60.3%
Suit 51.6%

Categories

Imagga

people portraits 99.5%